Image display control device, image display control method, and image display control program

Abstract

To transparentize a vehicle forming a dead angle and to display transfer information that the vehicle displays.SOLUTION: An image display control device (1) comprises: a data acquisition unit (12); a visual field image generation section (131); a dead angle range discrimination section (132); an information display determination section (133); an image generation section (130) for generating a superposed image in which dead angle information ahead of a second vehicle is superposed on a dead angle range of a visual field image by processing image data acquired by an image acquisition device (3); and a communication unit (11) capable of transmitting the superposed image to an image display device. The image generation section generates a superposed image in which dead angle information is indicated in the dead angle range in a case where it is determined that an information display unit does not display transfer information, and generates a superposed image in which transfer information displayed by the information display unit is indicated in the dead angle range in addition to the dead angle information in a case where it is determined that the information display unit displays the transfer information.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an image display control device, an image display control method, and an image display control program for generating an image of a field of view of a vehicle driver. [Background technology]

[0002] In recent years, image display control devices have been developed that display images generated by processing images acquired from sources other than the vehicle in order to display information that is difficult for the vehicle to directly acquire to the driver in an image display device equipped in the vehicle. For example, Patent Document 1 discloses a technology in which, when generating a field-of-view image from the driver's perspective and displaying it on an image display device, the vehicle in front is made transparent with respect to a blind spot area generated by the vehicle in front, and an image acquired from a source other than the vehicle being driven is processed to display the blind spot ahead of the vehicle in front. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-126478 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, when the vehicle ahead that forms the blind spot is made transparent, the information display devices of the vehicle, such as turn signals and backlights, are also made transparent. Therefore, even if the information display device displays information to be transmitted to other vehicles, the transmitted information is not displayed on the image display device, making it difficult for the driver to obtain the transmitted information displayed to other vehicles by the vehicle ahead.

[0005] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide an image display control device that can make a vehicle forming a blind spot transparent and display communication information displayed by that vehicle. [Means for solving the problem]

[0006] According to an aspect of the present invention, an image display control device causes an image display device mounted on a first vehicle to display an image of a blind spot formed by a second vehicle present in front of the first vehicle. The image display control device includes a data acquisition unit that acquires image data showing the surroundings of the first vehicle and the front of the second vehicle acquired by an image acquisition device, as well as position data of the image display device and the image acquisition device, a field of view image generation unit that processes the image data based on the position data to generate a field of view image of the area in front of the first vehicle as viewed from the first vehicle, a blind spot range determination unit that determines in the field of view image a blind spot range formed by the second vehicle, an information display determination unit that determines whether or not an information display unit provided in the second vehicle displays information transmitted to the outside in the field of view image, an image generation unit that processes the image data acquired by the image acquisition device to generate a superimposed image in which blind spot information in front of the second vehicle is superimposed in the blind spot range of the field of view image, and a communication unit that is capable of transmitting the superimposed image to the image display device. When the information display determination unit determines that the information display unit is not displaying transmitted information, the image generation unit generates a superimposed image in which information on the blind spot in front of the second vehicle is superimposed in the blind spot range of the field of view image. Regarding the entire area of ​​the second vehicle Blind spot information was provided Blind Spot Range An image is generated, and when the information display determination unit determines that the information display unit is displaying transmitted information, a blind spot range image generating unit that generates a blind spot range image in which blind spot information is displayed for an area other than the information display unit of the second vehicle, and an image superimposing unit that generates a superimposed image by superimposing the blind spot range image on the field of view image. . Effect of the Invention

[0007] According to the image display control device of the present invention, when vehicles that form blind spots in the field of view of the driver of the vehicle in which an image is displayed are made transparent to display the field of view ahead, information transmitted from the vehicle to the outside can be displayed. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram showing a traveling state of a vehicle in the first embodiment. [Diagram 2] FIG. 2 is another explanatory diagram showing a traveling state of the vehicle. [Diagram 3] FIG. 3 is a display example of the generated superimposed image. [Figure 4] FIG. 4 is a block diagram showing the configuration of the image display control system. [Diagram 5] FIG. 5 is a flowchart showing generation control of a superimposed image. [Figure 6] FIG. 6 is a diagram showing a traveling state of the second embodiment. [Figure 7] FIG. 7 is a display example of the generated superimposed image. [Figure 8] FIG. 8 is a block diagram showing the configuration of the image display control system. [Figure 9] FIG. 9 is a flowchart showing the generation control of the superimposed image. [Figure 10] FIG. 10 shows another display example of the generated superimposed image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] (First embodiment) 1 and 2 are explanatory diagrams showing a traveling state of a vehicle in this embodiment, in which Fig. 1 is a diagram seen from the side of the vehicle, and Fig. 2 is a diagram seen from above the vehicle.

[0011] The image display control system 100 includes an image display control device 1, which is a network-connected device, an image display device 2 mounted on a vehicle V1, and an image acquisition device 3 provided on the side of the road on which the vehicle V1 is traveling. As shown in the figure, a vehicle V2 is traveling in front of the vehicle V1. In the field of view of the driver of the vehicle V1, a blind spot is formed by the vehicle V2, and part of the field of view is blocked by the vehicle V2 and cannot be seen.

[0012] The image display device 2 is mounted on the vehicle V1 and includes a display unit that is visible from the driver's seat. The display unit is, for example, a transparent head-up display provided in front of the windshield, or VR goggles that can be worn by the driver. The image display device 2 transmits its own position information to the image display control device 1, and receives image data generated in the image display control device 1 to display an image corresponding to the image data on the display unit.

[0013] The image acquisition device 3 includes a camera installed on the shoulder of the lane in which the vehicle V1 is traveling, at a position higher than the vehicle height of the vehicle V1. The image acquisition device 3 can acquire an image of a blind spot D formed by a vehicle V2 existing within the field of view X, in addition to the field of view X from the driver's seat of the vehicle V1. The image acquisition device 3 transmits the acquired image and position information of the image acquisition device 3 to the image display control device 1. Note that a plurality of image acquisition devices 3 may be provided, and the image acquisition device 3 may be attached to a location other than the shoulder of the road, for example, to the roof of the vehicle V2 or another vehicle (not shown).

[0014] The image display control device 1 uses the position data and image data acquired from the image acquisition device 3 and the position data acquired from the image display device 2 to generate an image showing the field of view from the driver's seat of the vehicle V1, and transmits image data corresponding to the generated image to the image display device 2. Note that this image is an image of the field of view from the driver's seat of the vehicle V1, in which the vehicle V2 is made transparent, and an image showing information showing the blind spot blocked by the vehicle V2 (hereinafter referred to as blind spot information) is superimposed. Therefore, the image finally generated by the image display control device 1 is referred to as a superimposed image.

[0015] FIG. 3 is an example of a superimposed image generated by the image display control device 1. As shown in this figure, the superimposed image is an image of the field of view from the driver's seat of the vehicle V1 displayed on the image display device 2 mounted on the vehicle V1, in which the vehicle V2 is made transparent and its outline is displayed, and blind spot information of the area blocked by the vehicle V2 in the field of view from the driver's seat of the vehicle V1 is displayed. Note that the superimposed image only needs to show information related to driving, and does not need to show all the scenery. Such a superimposed image is displayed by the image display device 2 in the vehicle V1, separately from the forward field of view that the driver directly sees through, for example, the windshield. The driver can see the blind spot blocked by the vehicle V2 in front through the superimposed image. Note that the vehicle V2 may be configured so that the driver cannot directly see the front and can only see the image display device 2.

[0016] The image display control device 1 generates a forward view image showing the field of view from the driver's seat of the vehicle V1 from the image data acquired by the image acquisition device 3. The image display control device 1 determines the range in the forward view image in which the vehicle V2 is shown as a range in which a blind spot is formed (hereinafter referred to as a blind spot range). Then, the image display control device 1 generates an image showing blind spot information in the blind spot range (blind spot range image) from the acquired image data.

[0017] Furthermore, the image display control device 1 generates a contour image that displays the contour of the vehicle V2 shown in the blind spot range of the forward view image by making it transparent. Finally, the image display control device 1 generates a superimposed image by superimposing the blind spot range image and the contour image on the forward view image. As a result, as shown in the figure, a superimposed image is generated in which the driving lanes and the like present in the blind spot ahead of the vehicle V2 are displayed in the blind spot area.

[0018] Furthermore, the image display control device 1 extracts the information display unit S1 of the vehicle V2 from the forward view image. Here, the information display unit S1 is a device provided on the vehicle V2 that displays information visible from the outside and to be transmitted to the outside (hereinafter referred to as transmitted information), and displays the driving state according to the illumination state of, for example, a turn signal, a brake lamp, a back lamp, etc. The image display control device 1 extracts the information display unit S1 of the vehicle V2 from the forward view image and determines whether or not the transmitted information is displayed by the information display unit S1.

[0019] When the image display control device 1 determines that the information display unit S1 of the vehicle V2 is displaying transmitted information, it makes part of the vehicle V2 other than the information display unit S1 transparent and generates a blind spot range image showing blind spot information ahead of the vehicle V2. On the other hand, when the image display control device 1 determines that the information display unit S1 of the vehicle V2 is not displaying information, it makes the entire vehicle V2 in the blind spot transparent and generates a blind spot range image showing blind spot information.

[0020] In this way, when the information display unit S1 is not displaying transmitted information, the blind spot range image shows blind spot information ahead of the vehicle V2, and when the information display unit S1 is displaying transmitted information, the information display unit S1 is displayed in addition to the blind spot information. As a result, when the information display unit S1 is displaying transmitted information in the finally generated superimposed image, a part of the vehicle V2 other than the information display unit S1 is made transparent to show the blind spot information, so that the transmitted information by the information display unit S1 is displayed in addition to the blind spot information.

[0021] 4 is a block diagram of an image display control system 100. The image display control system 100 has an image display control device 1, an image display device 2, and an image acquisition device 3. The image display control device 1, the image display device 2, and the image acquisition device 3 each have a communication unit 11, 21, and 31, and are configured to be able to communicate with each other.

[0022] In addition to the communication unit 21, the image display device 2 includes a position information acquisition unit 22, a display unit 23, and a controller 24. When the position information acquisition unit 22 acquires the position information of the image display device 2, it transmits the acquired position information to the image display control device 1. The display unit 23 acquires image data generated in the image display control device 1 and displays a superimposed image indicated by the image data. The controller 24 controls the entire image display device 2.

[0023] In addition to the communication unit 31, the image acquisition device 3 includes a position information acquisition unit 32, a camera 33, and a controller 34. When the position information acquisition unit 32 acquires position information of the image display device 2, it transmits the acquired position information to the image display control device 1. When the camera 33 acquires an image of the periphery of the image acquisition device 3, it transmits the acquired image to the image display control device 1. The controller 34 controls the entire image acquisition device 3.

[0024] The image display control device 1 includes a data acquisition unit 12 and an image processing unit 13 in addition to a communication unit 11. The data acquisition unit 12 and the image processing unit 13 are each configured with one or more controllers, and the controller executes a predetermined program to generate a superimposed image.

[0025] The data acquisition unit 12 includes a position data acquisition unit 121 and an image data acquisition unit 122. The position data acquisition unit 121 acquires the position data of the image display device 2 acquired by the position information acquisition unit 22, and the position data of the image acquisition device 3 acquired by the position information acquisition unit 32. The position data acquisition unit 121 then obtains the positional relationship between the vehicle V1 on which the image display device 2 is mounted and the image acquisition device 3, for use in image processing, which will be described later. The image data acquisition unit 122 receives the image data acquired by the image acquisition device 3.

[0026] The image processing unit 13 includes a forward visual field image generating unit 131, a blind spot range discrimination unit 132, an information display determination unit 133, a blind spot range image generating unit 134, a contour image generating unit 135, and an image superimposing unit 136. The blind spot range image generating unit 134, the contour image generating unit 135, and the image superimposing unit 136 are collectively referred to as the image generating unit 130.

[0027] The forward view image generation unit 131 uses image data acquired by the image acquisition device 3 and the positional relationship between the image display device 2 and the image acquisition device 3 determined by the position data acquisition unit 121 to generate a forward view image showing the field of view from the driver's seat of the vehicle V1 in which the image display device 2 is installed.

[0028] The blind spot range determination unit 132 determines a blind spot range formed by an object (vehicle V2) existing in front of the vehicle V1 equipped with the image display device 2 in the forward view image generated by the forward view image generation unit 131. The blind spot range determination unit 132 may determine the blind spot range in the forward view image by supplementary use of image data acquired by the image acquisition device 3 and the positional relationship between the image display device 2 and the image acquisition device 3 obtained by the position data acquisition unit 121. The blind spot range is not limited to the area where the vehicle V2 is shown, and an area where multiple vehicles included in the forward view image are shown may be determined as the blind spot range.

[0029] The information display determination unit 133 extracts the information display unit S1 provided on the vehicle V2 from the blind spot range determined in the forward view image by the blind spot range determination unit 132, and determines whether the information display unit S1 is displaying communication information.

[0030] When it is determined that the information display unit S1 is not displaying the transmitted information, the blind spot range image generating unit 134 generates a blind spot range image showing blind spot information ahead of the vehicle V2 in the field of view from the driver's seat of the vehicle V1, using the image data acquired by the image acquisition device 3. In this way, the blind spot range image shows forward blind spot information for the entire area of ​​the vehicle V2. Note that in the blind spot range image, areas other than the blind spot range blocked by the vehicle V2 (the entire area of ​​the vehicle V2) are made transparent.

[0031] On the other hand, when it is determined that the information display unit S1 is displaying the transmitted information, the blind spot range image generating unit 134 generates a blind spot range image showing the blind spot information for a part of the vehicle V2 forming the blind spot range excluding the information display unit S1. In this way, the blind spot range image shows the blind spot information for a part of the vehicle V2 excluding the information display unit S1. In this case, in addition to the area other than the blind spot range, the blind spot range image shows the area showing the information display unit S1 within the blind spot range in a transparent manner. Therefore, as described later, the transmitted information by the information display unit S1 is shown in a superimposed image generated by superimposing the blind spot range image on the forward view image.

[0032] The contour image generating unit 135 generates a contour image by extracting the contour of the vehicle V2 that forms the blind spot range in the forward view image determined by the blind spot range determining unit 132.

[0033] The image superimposing unit 136 generates a superimposed image by superimposing the blind spot range image generated by the blind spot range image generating unit 134 and the contour image generated by the contour image generating unit 135 on the forward visual field image generated by the forward visual field image generating unit 131. Image data indicating the superimposed image thus generated is transmitted to the image display device 2, and the superimposed image is displayed on the display unit 23 of the image display device 2.

[0034] 5 is a flowchart showing generation control of a superimposed image by the image display control device 1. The following processing is performed by a controller constituting the image display control device 1 executing a program, but will be described as being executed by a plurality of functional blocks included in the data acquisition unit 12 and the image processing unit 13.

[0035] In step S101, the data acquisition unit 12 (position data acquisition unit 121, image data acquisition unit 122) acquires image data acquired by the image acquisition device 3, and position data of the image display device 2 and the image acquisition device 3 via the communication units 11, 21, and 31. Then, the position data acquisition unit 121 determines the positional relationship between the image display device 2 and the image acquisition device 3 for image processing, which will be described later.

[0036] In step S102, the forward visual field image generating unit 131 generates a forward visual field image showing the visual field of the driver of the vehicle A, using the image data obtained in step S101 and the positional relationship between the image display device 2 and the image acquisition device 3. When the forward visual field image generating unit 131 does not have enough image data, it uses image data obtained from another image acquisition device 3 (not shown) or prerecorded map data to supplement the missing image data and generate a forward visual field image. When a vehicle V2 is present in front of the vehicle V1, the vehicle V2 is shown in the forward visual field image, and the area in front of the vehicle V2 is a blind spot range.

[0037] In step S103, the blind spot range determination unit 132 determines whether or not there is a blind spot range formed by an object (vehicle V2) existing in front of the vehicle V1 in the forward view image generated by the forward view image generation unit 131.

[0038] If it is determined that no blind spot range exists in the forward visual field image, the process proceeds to step S109. In step S109, the image processing unit 13 transmits image data representing the forward visual field image generated in step S102 to the image display device 2, and the forward visual field image is displayed on the display unit 23 of the image display device 2. On the other hand, if it is determined that a blind spot range exists, the process proceeds to step S104.

[0039] In step S104, the information display determination unit 133 extracts the information display unit S1 provided in the vehicle V2 forming the blind spot determined to exist in step S103, and determines whether or not the information display unit S1 is displaying the transmitted information (the lamp is turned on). If the information display unit S1 is not displaying the transmitted information, the process proceeds to step S105, and if the information display unit S1 is displaying the transmitted information, the process proceeds to step S106.

[0040] In step S105, if the information display unit S1 is not displaying the transmitted information, the blind spot range image generation unit 134 uses the image data acquired by the image acquisition device 3 to generate a blind spot range image, which is an image from the field of view from the driver's seat of the vehicle V1 and shows blind spot information ahead of the vehicle V2 that forms the blind spot range.

[0041] On the other hand, in step S106, when the information display unit S1 is displaying the transmitted information, the blind spot range image generating unit 134 generates a blind spot range image showing blind spot information in a part of the blind spot range excluding the information display unit S1. In this way, the blind spot information is not shown in the area of ​​the information display unit S1 in the blind spot range image, and the blind spot information is shown in the area excluding the information display unit S1.

[0042] In step S107, the contour image generating unit 135 generates a contour image showing only the contour of the vehicle V2 forming the blind spot area by making the vehicle V2 transparent, using the image data acquired by the image acquiring device 3 and the positional relationship between the image display device 2 and the image acquiring device 3. In the contour image, the parts other than the contour are made transparent.

[0043] In step S108, the image superimposition unit 136 superimposes the blind spot range image generated in step S105 or S106 and the contour image generated in step S107 on the forward field of view image generated in step S102 to generate a superimposed image.

[0044] Then, in step S109, image data representing the superimposed image generated in step S108 is transmitted to the image display device 2. Then, on the display unit 23 of the image display device 2, a superimposed image corresponding to the image data is displayed.

[0045] In this way, in step S106, when the information display unit S1 of the vehicle V2 is displaying transmitted information, a blind spot range image is generated that shows blind spot information for the portion of the vehicle V2 other than the information display unit S1. Since the area of ​​the information display unit S1 in the blind spot range image is made transparent, the transmitted information by the information display unit S1 is displayed in the superimposed image.

[0046] Incidentally, since the processes of steps S105 to S108 are processes for generating a superimposed image that is a final image, they may be collectively indicated as a final image generating step S110.

[0047] In addition, the information display unit S1 is not limited to light-emitting devices such as turn signals, brake lights, and backlights, but may also be a rearview mirror that allows the driver of the vehicle V2 to check his or her actions, or a display device attached to the vehicle V2 that visually transmits information to the outside.

[0048] In step S108, the image superimposing unit 136 may generate a superimposed image without including a contour image by superimposing only the blind spot range image on the forward visual field image. Even in this case, the information transmitted by the information display unit S1 is displayed on the superimposed image, so that the driver of the vehicle V1 can obtain the information displayed by the information display unit S1 of the vehicle V2.

[0049] In addition, in this embodiment, the vehicle V2 forming the blind spot is traveling in the same lane as the vehicle V1, but this is not limited thereto. The vehicle V2 may be traveling in an adjacent lane to the vehicle V1. When the vehicle V2 traveling in the adjacent lane changes lanes to the same lane as the vehicle V1, the turn indicator is blinked. Even if the vehicle V2 is made transparent to display the blind spot information, the information transmitted by the turn indicator is displayed on the superimposed screen according to this embodiment, so that the driver of the vehicle V1 can know that the vehicle V2 is about to change lanes to the vehicle's own lane.

[0050] In this embodiment, in step S108, the image superimposing unit 136 generates a superimposed image by superimposing the blind spot range image and the contour image on the forward visual field image. When generating the superimposed image, the image superimposing unit 136 may perform image processing such as emphasizing the information display unit S1 displaying the transmitted information on the object (vehicle V2) forming the blind spot range. For example, when the information display unit S1 is a light-emitting device, a light ray image may be added that explicitly shows the light rays extending radially from the information display unit S1, which is a light source, in a display mode like a light ray. In this way, it becomes easier for the driver of the vehicle V1 to obtain the necessary information. Note that emphasizing the display of the transmitted information on the information display unit S1 in this manner may be performed in any step, not limited to step S108.

[0051] In the present embodiment, the image display control device 1 is connected to the image display device 2 via the communication units 11 and 21, but this is not limiting. The image display control device 1 may be mounted on the same vehicle V1 as the image display device 2. In addition, a plurality of image acquisition devices 3 may be provided, and may be attached to the roofs of not only the vehicles V1 and V2 but also other vehicles, or may be provided on the roadside.

[0052] In the generation control of the superimposed image in this embodiment, when the information display unit S1 is displaying the transmitted information, the image display control device 1 makes the information display unit S1 transparent in the blind spot range image, but this is not limited to this. Regardless of whether the information display unit S1 displays the transmitted information, a blind spot range image showing the blind spot information for the entire blind spot range may be generated, and the transmitted information by the information display unit S1 may be included in the contour image.

[0053] As another form of control for generating the superimposed image, when the information display unit S1 is displaying the transmitted information, an information display image showing the transmitted information of the information display unit S1 may be generated, and the superimposed image may be generated by superimposing the blind spot range image, the contour image, and the information display image on the forward visual field image. In such a case, the image generating unit 130 further includes a functional block for generating the information display image, and the final image generating step S110 includes a process for generating the information display image.

[0054] According to the first embodiment, the following effects can be obtained.

[0055] According to the first embodiment of the image display control device 1, the device includes a data acquisition unit 12 that acquires image data acquired by the image acquisition device 3 and position data of the image acquisition device 3, a forward view image generation unit 131 that generates a forward view image of the area in front of the first vehicle V1 as seen from the first vehicle V1, a blind spot range discrimination unit 132 that discriminates the blind spot range formed by the second vehicle V2 in the forward view image, an information display determination unit 133 that determines whether or not transmitted information is displayed by the information display unit S1 provided on the second vehicle V2 in the forward view image, and an image generation unit 130 that generates a superimposed image that is an image of the area in front of the first vehicle V1 as seen from the first vehicle V1, in which blind spot information of the area in front of the second vehicle V2 shown in the blind spot range is displayed.

[0056] When it is determined that the information display unit S1 is not displaying the transmitted information, the image generation unit 130 generates a superimposed image in the blind spot range in which blind spot information in front of the second vehicle V2 is displayed, and when it is determined that the information display unit S1 is displaying the transmitted information, the image generation unit 130 generates a superimposed image in the blind spot range in which not only the blind spot information but also the transmitted information from the information display unit S1 is displayed.

[0057] In this way, when the information display unit S1 of the second vehicle V2 is displaying transmission information, the transmission information displayed by the information display unit S1 is shown in the superimposed image, so that the driver of the vehicle V1 can more reliably recognize the transmission information displayed to the outside by the information display unit S1 of the vehicle V2.

[0058] According to the first embodiment of the image display control device 1, the image generation unit 130 includes a blind spot range image generation unit 134 that generates a blind spot range image which is an image of the field of view from the first vehicle V1 and shows blind spot information ahead of the second vehicle V2, and an image superimposition unit 136 that generates a superimposed image by superimposing the blind spot range image on the forward field of view image.

[0059] When the information display determination unit 133 determines that the information display unit S1 is not displaying transmitted information, the blind spot range image generation unit 134 generates a blind spot range image in which blind spot information is displayed for the entire region of the blind spot range of the forward visual field image. On the other hand, when the information display determination unit 133 determines that the information display unit S1 is displaying transmitted information, the blind spot range image generation unit 134 generates a blind spot range image in which blind spot information is displayed for a portion of the blind spot range of the forward visual field image other than the information display unit S1.

[0060] In this way, when the information display unit S1 of the second vehicle V2 is displaying the transmitted information, a blind spot range image is generated that shows the blind spot information for a part of the vehicle V2 other than the information display unit S1. As a result, the transmitted information displayed by the information display unit S1 shown in the forward view image is shown in a superimposed image that is generated by superimposing the blind spot range image on the forward view image, so that the driver of the vehicle V1 can more reliably recognize the transmitted information shown by the information display unit S1 of the vehicle V2.

[0061] According to the image display control device 1 of the first embodiment, the image generating unit 130 further includes a contour image generating unit 135 that performs image processing on the image data to generate a contour image showing the contour of the second vehicle V2 in the field of view from the first vehicle V1. The image superimposing unit 136 generates a superimposed image by superimposing the blind spot range image and the contour image on the forward field of view image. By displaying the contour image of the second vehicle V2 in the superimposed image in this manner, the driver of the vehicle V1 can grasp the presence of the vehicle V2 from the contour image while checking the blind spot information ahead of the vehicle V2, and therefore, the driver's discomfort when the transmitted information of the information display unit S1 is displayed in the superimposed image can be reduced.

[0062] According to the image display control device 1 of the first embodiment, the information display unit S1 of the second vehicle V2 is at least one of the turn indicators, brake lights, and backlights of the second vehicle V2 traveling in the same lane as the first vehicle V1. In such a configuration, the driver of the first vehicle V1 can obtain the transmission information required for driving indicated by the turn indicators, brake lights, and backlights that are the information display unit S1 of the second vehicle V2 ahead of the vehicle V1 while checking the blind spot of the second vehicle V2 ahead of the vehicle V2 in the same lane.

[0063] According to the image display control device 1 of the first embodiment, the information display unit S1 of the second vehicle V2 is a turn signal of the second vehicle V2 traveling ahead of the first vehicle V1 in the adjacent lane. In such a configuration, the driver of the first vehicle V1 can know that the second vehicle V2 will change lanes into the own lane by acquiring necessary information indicated by the turn signal, which is the information display unit S1 of the second vehicle V2, while checking the blind spot of the second vehicle V2 ahead of the adjacent lane.

[0064] According to the image display control device 1 of the first embodiment, the information display unit S1 of the second vehicle V2 is at least one of a light-emitting device, a rearview mirror, and a character display device. In such a configuration, the information display determination unit 133 performs image analysis of the forward visual field image to determine whether or not the information display unit S1, which is one of various display devices, displays transmission information. As a result, the transmission information displayed by the various display devices is included in the superimposed image, so that the driver of the vehicle V1 can obtain more transmission information.

[0065] According to the image display control device 1 of the first embodiment, the image superimposing unit 136 emphasizes and displays the information display unit S1 of the object (vehicle V2) forming the blind spot range when generating the superimposed image. For example, if the information display unit S1 is a brake lamp, the area of ​​the brake lamp is enlarged, and an image of light rays extending radially from a light source is added. This improves the visibility of the communication information displayed by the information display unit S1, and the driver of the vehicle V1 can more reliably view the communication information displayed by the information display unit S1 of the vehicle V2.

[0066] Second embodiment In the first embodiment, when the information display unit S1 shown on an object forming a blind spot area is displaying transmitted information (S104: Yes), a blind spot range image showing blind spot information in a portion of the vehicle V2 other than the information display unit S1 is generated (S106), but this is not limited to this. In the second embodiment, an example will be described in which a blind spot range image showing blind spot information in a portion of the vehicle V2 other than the information display unit S2 is generated when a risk object such as a pedestrian is present in the blind spot in front of the vehicle V2 and the information display unit of the vehicle V2 is displaying transmitted information.

[0067] FIG. 6 is an explanatory diagram showing a traveling state of a vehicle in the second embodiment, and corresponds to FIG.

[0068] As shown in this figure, a vehicle V2 is traveling ahead of a vehicle V1 equipped with an image display device 2, and ahead of the vehicle V2, another vehicle V3 is traveling. And ahead of the vehicle V3, a pedestrian W is about to cross the lane. In such a case, since the pedestrian W is a risk that may cause the vehicle V3 to stop, the vehicle V3 performs a stopping control and turns on the brake lights.

[0069] FIG. 7 is an example of a superimposed image generated by the image display control device 1, and corresponds to FIG.

[0070] As shown in this figure, the superimposed image shows the outlines of both vehicles V2 and V3, which are made transparent. The superimposed image is an image of the field of view from the driver's seat of vehicle V1, and shows blind spots ahead of vehicles V2 and V3 in the field of view from the driver's seat of vehicle V1.

[0071] Here, since there is a pedestrian W in front of the vehicle V3, the vehicle V3 is performing a stop control and the information display unit S2 (brake lamp) is displaying a transmission information indicating that the vehicle is under stop control. Therefore, a blind spot range image is generated that shows some blind spot information other than the information display unit S2 of the vehicle V3. As a result, the information display unit S2 displaying the transmission information is shown in the superimposed image.

[0072] Furthermore, according to this figure, the auxiliary information display area S3 indicates how many vehicles (in this embodiment, two vehicles) ahead of the vehicle V1 is the vehicle V3 equipped with the information display unit S2 displaying the transmission information. Such auxiliary information allows the driver of the vehicle V1 to know the distance to the vehicle V3 displaying the transmission information.

[0073] Fig. 8 is a block diagram of the image display control system 100. According to this diagram, compared with the configuration of the image display control system 100 of the first embodiment shown in Fig. 4, the image processing unit 13 further includes a stopping cause determination unit 201.

[0074] The stopping factor determination unit 201 determines the presence or absence of risk objects that may cause the vehicles V1, V2, and V3 to stop in front of them by analyzing the image data acquired by the image acquisition device 3. Risk objects are pedestrians, bicycles, objects fallen on the road, etc., that may impede the travel of the vehicles. Specifically, the stopping factor determination unit 201 determines the presence of a risk object (a stopping factor) when it detects a pedestrian or bicycle by moving object detection, or detects objects fallen on the road by analyzing the road surface condition.

[0075] Then, when the stopping factor determination unit 201 determines that there is a stopping factor (risk object) in front of vehicles V2 and V3 that are in front of vehicle V1 (in this embodiment, it is determined that there is a risk object in front of vehicle V3), the information display determination unit 133 further determines whether the information display unit S2 equipped on vehicle V3 is currently displaying transmitted information.

[0076] In response to such a determination result by the stopping factor determination unit 201, when it is determined that a stopping factor (risk object) exists in front of the vehicle V3 and the information display unit S2 of the vehicle V3 is displaying transmitted information, the blind spot range image generation unit 134 generates a blind spot range image showing blind spot information for a part of the blind spot range excluding the information display unit S2 of the vehicle V3. As a result, the transmitted information by the information display unit S2 of the vehicle V3 is displayed in the superimposed image.

[0077] Fig. 9 is a flowchart showing generation control of a superimposed image by the image display control device 1. According to this figure, compared with the flowchart showing generation control of a superimposed image in the first embodiment shown in Fig. 5, the process of step S211 is included between step S103 and step S104.

[0078] In step S211, the stopping factor determination unit 201 determines whether or not there is a risk object in front of the vehicles V2 and V3 that are present ahead of the vehicle V1, by analyzing the image data acquired by the image acquisition device 3. In detail, as described above, the stopping factor determination unit 201 determines that there is a stopping factor (risk object) when it detects a pedestrian or bicycle by moving object detection, or detects an object that has fallen on the road by analyzing the road surface condition.

[0079] Then, if it is determined that a stopping factor (risk object) exists ahead of the vehicles V2, V3, then the process of step S104 is performed. If it is determined that a stopping factor (risk object) does not exist ahead of the vehicles V2, V3, then the process of step S105 is performed. In this way, if it is determined that a stopping factor (risk object) exists ahead of the vehicle V3 and the information display unit S2 of the vehicle V3 is displaying the transmitted information, the superimposed image shows the transmitted information displayed by the information display unit S2 of the vehicle V3 ahead of which a stopping factor (risk object) exists.

[0080] In addition, in step S108, when generating the superimposed image, an auxiliary information display area S3 is additionally displayed, and the auxiliary information display area S3 indicates how many vehicles ahead of vehicle V1 vehicle V3 equipped with the information display unit S2 currently displaying information is (in this embodiment, two vehicles ahead).

[0081] According to the image display control device 1 of the second embodiment, the vehicle further includes a stopping factor determination unit 201 that determines whether or not there is a pedestrian W, which is a risky object that may cause the second vehicle V3 to stop, in front of the second vehicle V3. If the stopping factor determination unit 201 determines that there is a stopping factor (S211: Yes) and the information display determination unit 133 determines that the information display unit S2 is displaying transmitted information (S104: Yes), a blind spot area image showing blind spot information for a part of the blind spot range other than the information display unit S2 is generated (S106). On the other hand, if the stopping factor determination unit 201 determines that there is no stopping factor (S211: No), a blind spot area image showing blind spot information for the entire blind spot range is generated (S105).

[0082] Here, in the vehicle V3 where a stopping factor (risk object) exists ahead, the necessity of performing stopping control is high, so the braking time is likely to be long. Therefore, when the stopping factor determination unit 201 determines that a stopping factor exists (S211: Yes) and the information display determination unit 133 determines that the information display unit S2 is displaying the transmitted information (S104: Yes), a blind spot range image showing the blind spot ahead is generated for a part of the blind spot range other than the information display unit S2 of the vehicle V3 (S106). As a result, the superimposed image shows the transmitted information shown by the information display unit S2 of the vehicle V3, so that the driver of the vehicle V1 can obtain information on the stopping control of the vehicle V3 in advance. In this way, by displaying the transmitted information by the information display unit for a vehicle where a stopping factor exists ahead, the driver of the vehicle V1 can easily obtain information that affects the running of the vehicle.

[0083] According to the image display control device 1 of the second embodiment, the image superimposition unit 136 generates a superimposition image in the auxiliary information display area S3 that indicates how many vehicles ahead (two vehicles ahead in this embodiment) the vehicle V3 equipped with the information display unit S2 currently displaying information is from the vehicle V1. By doing so, as shown in Fig. 8, the auxiliary information display area S3 is displayed in the superimposition image, and the driver of the vehicle V1 can grasp the distance to the vehicle V3 currently displaying information.

[0084] (First Modification) In the second embodiment, the auxiliary information display area S3 indicates how many vehicles ahead of the vehicle V1 the vehicle V3 equipped with the information display unit S2 currently displaying information is (two vehicles ahead in this embodiment), but this is not limited to this. As shown in Fig. 10, an auxiliary information display area S4 provided separately from the superimposed image may display a view of the vehicles V1, V2, and V3 viewed from above, and the position of the vehicle V3 equipped with the information display unit S2 currently displaying information may be specified by the display area S5. In this manner, the driver of the vehicle V1 can also know the distance to the vehicle V3 currently displaying the transmission information.

[0085] Each process shown in this embodiment is executed based on a program for causing a computer to execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program for realizing the function of executing each process, and a recording medium for storing the program. For example, the program can be stored in the storage device of the information processing device by an update process for adding a new function to the information processing device. This makes it possible to cause the updated information processing device to execute each process shown in this embodiment.

[0086] Although the embodiments of the present invention have been described above, the configurations described in the above embodiments and the modifications merely show some of the application examples of the present invention and are not intended to limit the technical scope of the present invention. For example, the above embodiments and modifications can be implemented in combination in part or in whole. [Explanation of symbols]

[0087] 100 Image display control system, 1 Image display control device, 2 Image display device, 3 Image acquisition device, 11 Communication unit, 12 Data acquisition unit, 13 Image processing unit, 130 Image generation unit, 131 Forward field of view image generation unit, 132 Blind spot range discrimination unit, 133 Information display determination unit, 134 Blind spot range image generation unit, 135 Contour image generation unit, 136 Image superimposition unit, 201 Stopping factor determination unit, S1, S2 Information display unit, S3, S4 Auxiliary information display area, S5 Display area

Claims

1. An image display control device that displays an image of a blind spot formed by a second vehicle in front of a first vehicle on an image display device mounted on the first vehicle, a data acquisition unit that acquires image data showing the surroundings of the first vehicle and the front of the second vehicle acquired by an image acquisition device, and position data of the image display device and the image acquisition device; a field of view image generating unit that processes the image data based on the position data to generate a field of view image of a region ahead of the first vehicle as viewed from the first vehicle; a blind spot determination unit that determines a blind spot formed by the second vehicle in the field of view image; an information display determination unit that determines whether or not a transmission information to the outside is displayed by an information display unit included in the second vehicle in the field of view image; an image generating unit that processes the image data acquired by the image acquisition device to generate a superimposed image in which blind spot information ahead of the second vehicle is superimposed on the blind spot range of the field of view image; a communication unit capable of transmitting the superimposed image to the image display device, The image generating unit includes: When the information display determination unit determines that the information display unit is not displaying the transmission information, a blind spot range image is generated in which the blind spot information is displayed for the entire area of ​​the second vehicle in the blind spot range, a blind spot range image generating unit that generates the blind spot range image in which the blind spot information is displayed for an area other than the information display unit of the second vehicle in the blind spot range when the information display determination unit determines that the information display unit is displaying the transmitted information; and and an image superimposition unit that generates the superimposed image by superimposing the blind spot range image on the field of view image.

2. 2. The image display control device according to claim 1, A stop factor determination unit that determines whether or not there is a stop factor of the second vehicle indicated in the blind spot range in front of the second vehicle, The image generating unit includes: When the stop factor determination unit determines that the stop factor exists and the information display determination unit determines that the information display unit is displaying the transmission information, the blind spot range is displayed with the transmission information by the information display unit in addition to the blind spot information, When the stopping cause determination unit determines that the stopping cause does not exist, the image display control device generates the superimposed image indicating the blind spot information in the blind spot range.

3. The image display control device according to claim 1, a contour image generating unit that processes the image data to generate a contour image showing a contour of the second vehicle as seen from the first vehicle, The image generating unit generates the superimposed image including the contour image. Place.

4. An image display control device according to any one of claims 1 to 3, The information display unit is at least one of a turn signal, a brake lamp, and a backlight of the second vehicle traveling in the same lane as the first vehicle.

5. An image display control device according to any one of claims 1 to 3, The information display unit is a turn signal of the second vehicle traveling in an adjacent lane to the first vehicle.

6. An image display control device according to any one of claims 1 to 3, The information display unit is at least one of a light emitting device, a rearview mirror, and a character display device of the second vehicle.

7. An image display control device according to any one of claims 1 to 6, The image display control device, wherein the image generation unit, when generating the superimposed image, highlights the information display unit that is determined by the information display determination unit to be displaying the transmission information.

8. The image display control device according to claim 7, The image display control device, when generating the superimposed image, the image generation unit displays the transmission information in an emphasized manner by adding a light image extending radially from the information display unit to the information display unit that has been determined by the information display determination unit to be displaying the transmission information.

9. An image display control device according to any one of claims 1 to 8, The image display control device, when generating the superimposed image, further displays information indicating the positional relationship between the first vehicle equipped with the image display device and the second vehicle equipped with the information display unit that has been determined by the information display determination unit to be displaying the transmission information.

10. 1. An image display control method for displaying an image of a blind spot formed by a second vehicle in front of a first vehicle on an image display device mounted on the first vehicle, the method comprising: Acquiring image data showing the surroundings of the first vehicle and the front of the second vehicle, which are acquired by an image acquisition device, and position data of the image display device and the image acquisition device; generating a field of view image of a region ahead of the first vehicle as viewed from the first vehicle by processing the image data based on the position data; A blind spot range formed by the second vehicle is determined in the field of view image; determining whether or not a transmission information to the outside is displayed by an information display unit provided in the second vehicle in the field of view image; In a case where a superimposed image in which blind spot information ahead of the second vehicle is superimposed on the blind spot range of the field of view image is generated by processing the acquired image data, When it is determined that the information display unit is not displaying the transmission information, a blind spot range image is generated in which the blind spot information is displayed for the entire area of ​​the second vehicle in the blind spot range, When it is determined that the information display unit is displaying the transmitted information, the blind spot range image is generated in which the blind spot information is displayed for an area other than the information display unit of the second vehicle in the blind spot range, and The blind spot range image is superimposed on the field of view image to generate the superimposed image; The superimposed image is transmitted to the image display device.

11. a communication unit capable of communicating with an image display device mounted on a first vehicle and an image acquisition device that acquires image data showing the surroundings of the first vehicle and the front of a second vehicle that is present in front of the first vehicle; a data acquisition unit that acquires, via the communication unit, the image data acquired by the image acquisition device, and position data of the image display device and the image acquisition device; and a controller that causes the image display device to display an image of a blind spot formed by the second vehicle. The image display control program is for the controller: Acquiring the image data and the position data via the data acquisition unit; generating a field of view image of a region ahead of the first vehicle as viewed from the first vehicle by processing the image data based on the position data; A blind spot range formed by the second vehicle is determined in the field of view image; determining whether or not an information display unit of the second vehicle displays information to be transmitted to the outside in the field of view image; In a case where a superimposed image in which blind spot information ahead of the second vehicle is superimposed on the blind spot range of the field of view image is generated by processing the image data, When it is determined that the information display unit is not displaying the transmission information, a blind spot range image is generated in which the blind spot information is displayed for the entire area of ​​the second vehicle in the blind spot range, When it is determined that the information display unit is displaying the transmission information, a blind spot range image is generated in which the blind spot information is displayed for an area other than the information display unit of the second vehicle in the blind spot range, and The blind spot range image is superimposed on the field of view image to generate the superimposed image; an image display control program for causing the image display device to transmit the superimposed image;

Images