Display control device, display device, display system, vehicle, display control method and program

Abstract

To appropriately transmit information about a detected target when the target has been detected outside a field angle of an image displayed in a display area.SOLUTION: A display control device 35 includes: a positional information acquisition section 54 for acquiring, on the basis of a camera image of a camera 12 for capturing an image of a target 90 ahead of a vehicle 10, a position P2 of the target 90; a virtual origin setting section 56 for setting a virtual origin P1 inside a field angle 51A of a projection section 51 having a field angle narrower than a field angle 12A of the camera 12; a hypothetical line setting section 58 for setting a hypothetical line 66 connecting the virtual origin P1 and the position P2 acquired by the positional information acquisition section 54; and a mark generation section 62 for generating, on the basis of the hypothetical line 66, a mark 68 which is displayed in a superimposed manner in a third display area G3 provided in a cabin, and which urges caution toward the target 90.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a display control device, a display device, a display system, a vehicle, a display control method, and a program. [Background technology]

[0002] BACKGROUND ART Conventionally, display devices such as head-up displays that project an image onto the windshield or the like of a vehicle to superimpose a virtual image of an AR (Augmented Reality) image on the view in front of the vehicle have been known (see, for example, Patent Document 1).

[0003] Patent Document 1 discloses a technology in which, using relative position information of the notification target acquired by a detection information acquisition unit, a shape extending in a straight, thin strip from the main image unit toward the notification target outside the angle of view is drawn, thereby indicating the relative position of the notification target outside the angle of view to the driver in an easily understandable manner. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-037916 Summary of the Invention [Problem to be solved by the invention]

[0005] In a display device such as a head-up display, when a target is detected outside the angle of view, it is required to appropriately convey information about the detected target. In contrast, the technology described in Patent Document 1 simply draws a shape that extends in a straight, thin strip toward the target to be notified outside the angle of view, and there is room for improvement in terms of appropriately conveying information about the detected target when the target is detected outside the angle of view of the image displayed in the display area.

[0006] The present invention aims to appropriately transmit information about a detected target when the target is detected outside the angle of view of an image displayed in a display area. [Means for solving the problem]

[0007] The display control device according to claim 1 includes a position information acquisition unit that acquires position information of a target based on detection information from a target detection unit that detects targets around a vehicle, and a virtual origin setting unit that sets a virtual origin inside an angle of view of an output unit that has an angle of view narrower than an angle of view of the target detection unit. ,car A mark is displayed superimposed on a display area provided in the room, and a mark is displayed to call attention to the target. , between the virtual origin and the position of the position information a mark generating unit for generating a mark; a size detection unit that detects the size of the target, and the mark generation unit generates the mark based on the size of the target detected by the size detection unit.

[0008] According to the display control device of claim 1, a virtual origin is set inside the angle of view of the output unit. Between the location of the location information By superimposing a mark that calls attention to the target on the display area, even if the target detection unit detects a target outside the field of view of the output unit, a mark that calls attention to the target is superimposed on the display area. Therefore, when a target is detected outside the field of view of the output unit, information on the direction in which the detected target is located is superimposed on the display area. As a result, targets outside the field of view of the output unit can be properly communicated to the occupant. Here, the field of view of the output unit is the angular range in which an image can be displayed in the display area. Furthermore, according to the display control device of claim 1, by generating a mark based on the size of the target, for example, if the target is a large object such as a car, a large mark is generated. On the other hand, if the target is a small object such as a person, a small mark is generated. Therefore, the size of the mark can be set according to the size of the target. As a result, it is possible to transmit information about the size of targets outside the angle of view of the output unit.

[0009] A display control device according to claim 2 is the display control device according to claim 1, The apparatus further includes an imaginary line setting unit that sets an imaginary line connecting the virtual origin and the position of the position information acquired by the position information acquisition unit, and the mark generation unit generates the mark based on the imaginary line.

[0010] According to the display control device of claim 2, Since the mark is generated based on the imaginary line set by the imaginary line setting unit, the mark that calls attention to the target can be displayed in an appropriate position.

[0011] A display control device according to a third aspect of the present invention is the display control device according to the second aspect, wherein the mark generating unit generates a plurality of the marks on the imaginary line.

[0012] According to the display control device of claim 3, a plurality of marks are generated on an imaginary line, and thus the marks are superimposed and displayed toward the target. Therefore, the marks can be used to indicate the direction in which the target exists. As a result, information about the direction in which the target exists can be appropriately conveyed.

[0013] A display control device according to claim 4 is a display control device according to any one of claims 1 to 3, wherein the mark generation unit generates the marks closer to the virtual origin larger than the marks farther from the virtual origin.

[0014] According to the display control device of claim 4, marks closer to the virtual origin are generated larger than marks further away, so that the marks express a sense of depth (perspective), thereby making it possible to more appropriately convey information about the direction of the target.

[0015] A display control device according to claim 5 is a display control device according to any one of claims 1 to 4, wherein the virtual origin setting unit sets the virtual origin at a position offset from the eye point of the driver of the vehicle toward the front of the vehicle.

[0016] According to the display control device of claim 5, the virtual origin is set to a position offset from the driver's eye point toward the front of the vehicle, so the virtual origin is set based on the driver's eye point. Therefore, the imaginary line is set according to the driver's eye point. As a result, it is possible to superimpose and display a mark at an appropriate position in the display area according to the driver's eye point.

[0017] A display control device according to claim 6 is a display control device according to any one of claims 1 to 4, wherein the mark generation unit generates at least one mark at a position offset from the virtual origin toward the position of the position information acquired by the position information acquisition unit, within the angle of view of the output unit.

[0018] According to the display control device of claim 6, at least one mark is generated at a position offset from the virtual origin inside the angle of view of the output unit, so that when a target exists outside the angle of view of the output unit, at least one mark is superimposed and displayed in the display area. Therefore, when a target exists outside the angle of view of the output unit, information on the direction in which the target exists can be transmitted.

[0019] A display control device according to a seventh aspect of the present invention is the display control device according to any one of the first to sixth aspects, wherein the mark generation unit generates the mark on either the left or right side of the virtual origin.

[0020] According to the display control device of claim 7, when the target is outside the field of view of the output unit and on the right side of the vehicle, a mark is displayed on the right side of the virtual origin. When the target is outside the field of view of the output unit and on the left side of the vehicle, a mark is displayed on the left side of the virtual origin. Therefore, it becomes possible to see at a glance whether the target is on the left side of the vehicle or in the direction of the left side of the vehicle. As a result, the speed at which the occupant recognizes the direction of a target that is outside the field of view of the output unit can be improved.

[0021] A display control device according to claim 8 is a display control device according to any one of claims 1 to 7, wherein the mark generation unit generates the mark as a three-dimensional arrow pointing in the direction of the target.

[0022] According to the display control device of claim 8, by generating the mark as a three-dimensional arrow, the three-dimensional arrow is superimposed and displayed pointing towards the target, thereby making it possible to more appropriately convey information about the direction in which the target exists.

[0023] The display control device of claim 9 is a display control device according to any one of claims 1 to 8, which is provided with a size detection unit that detects the size of the target, and the mark generation unit generates the mark based on the size of the target detected by the size detection unit.

[0024] According to the display control device of claim 9, by generating a mark based on the size of the target, for example, if the target is a large object such as a car, a large mark is generated. On the other hand, if the target is a small object such as a person, a small mark is generated. Therefore, the size of the mark can be set according to the size of the target. As a result, it is possible to transmit information about the size of targets outside the angle of view of the output unit.

[0025] The display system according to claim 10 is to 9 and a target detection unit having a field of view wider than the field of view of the output unit and configured to detect the target in the vicinity of the vehicle.

[0026] According to the display system of claim 10, targets outside the angle of view of the output unit can be properly conveyed to the occupants.

[0027] A vehicle according to an eleventh aspect of the present invention includes the display system according to the tenth aspect of the present invention and a windshield that forms the display area.

[0028] According to the vehicle of claim 11, the mark is displayed in the display area of ​​the windshield, so the occupant can recognize the mark while keeping their eyes facing forward. Therefore, the occupant can recognize the mark while driving without taking their eyes off the road.

[0029] A display control method according to claim 12 includes acquiring position information of a target based on detection information from a target detection unit that detects a target around a vehicle, and setting a virtual origin inside an angle of view of an output unit that has an angle of view narrower than an angle of view of the target detection unit. ,car A mark is displayed superimposed on a display area provided in the room, and a mark is displayed to call attention to the target. , between the virtual origin and the position of the position information Generate The computer executes the process Display control method The size of the target is detected, and the mark is generated based on the detected size of the target.

[0030] According to the display control method of claim 12, targets outside the angle of view of the output unit can be properly conveyed to the occupant.

[0031] The program according to claim 13 acquires position information of a target based on detection information from a target detection unit that detects targets around a vehicle, and sets a virtual origin within an angle of view of an output unit that has an angle of view narrower than that of the target detection unit. ,car A mark is displayed superimposed on a display area provided in the room, and a mark is displayed to call attention to the target. , between the virtual origin and the position of the position information A program that causes a computer to execute the generation process a size of the target is detected, and the mark is generated based on the detected size of the target. .

[0032] According to the program of claim 13, it is possible to properly notify the occupant of a target that is outside the angle of view of the output unit. [Effects of the Invention]

[0033] According to the present invention, when a target is detected outside the angle of view of an image displayed in a display area, information about the detected target can be appropriately transmitted. [Brief explanation of the drawings]

[0034] [Figure 1]1 is a bird's-eye view showing a vehicle equipped with a display system according to a first embodiment, showing a case where a target is outside the angle of view of a projection unit. FIG. [Figure 2] 1 is a schematic diagram showing a vehicle equipped with a display system according to a first embodiment, viewed from the inside of the vehicle toward the front of the vehicle. [Figure 3] 1 is a block diagram showing a hardware configuration of a display system according to a first embodiment. [Figure 4] 1 is a block diagram showing a functional configuration of a display control device according to a first embodiment. [Figure 5] 1 is a bird's-eye view showing a vehicle equipped with a display system according to a first embodiment, showing a case where a target is located inside the angle of view of a projection unit. FIG. [Figure 6] FIG. 2 is a diagram showing a display example of a display area of ​​the display device according to the first embodiment, showing a case where a target is outside the angle of view of a projection unit. [Figure 7] FIG. 2 is a diagram showing a display example of a display area of ​​the display device according to the first embodiment, showing a case where a target is inside the angle of view of a projection unit. [Figure 8] 1 is a bird's-eye view showing a vehicle equipped with a display system according to a first embodiment, showing a case where a target is outside the angle of view of a projection unit. FIG. [Figure 9] FIG. 2 is a diagram showing a display example of a display area of ​​the display device according to the first embodiment, showing a case where a target is outside the angle of view of a projection unit. [Figure 10] FIG. 2 is a diagram showing an example of a display area of ​​the display device according to the first embodiment, showing a case where a bus as a target is outside the angle of view of the projection unit. [Figure 11] 4 is a flowchart showing the flow of display processing of the display control device according to the first embodiment. [Figure 12] FIG. 10 is a diagram showing a display example of a display device according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0035] [First embodiment] A display system according to a first embodiment will be described below with reference to the drawings. Note that the arrow FR in Fig. 1 indicates the front side of the vehicle, and the arrow RH indicates the right side of the vehicle. In addition, in the first embodiment, an example will be described in which the vehicle 10 is traveling at a speed V in the forward direction of the vehicle.

[0036] [Configuration of vehicles equipped with display systems] 1, a vehicle 10 is provided with a camera 12 as a target detection unit. The camera 12 is attached to the front bumper of the vehicle 10 and can capture images of the area ahead of the vehicle. The camera 12 is configured to have an angle of view 12A.

[0037] The target object 90 may be a pedestrian 92 (see FIG. 1) or a bus 94 (see FIG. 10). The target object 90 may also be a vehicle ahead of the vehicle, an oncoming vehicle in the oncoming lane, a parked vehicle, or any other obstacle.

[0038] As shown in FIG. 2, an instrument panel 18 and a windshield 22 are provided at the front side of the passenger compartment of the vehicle 10.

[0039] (Instrument Panel 18) The instrument panel 18 is provided to extend in the vehicle width direction. A steering wheel 20 is provided on the right side of the instrument panel 18. That is, in the first embodiment, as an example, the vehicle 10 is configured as a right-hand drive vehicle in which the steering wheel 20 is provided on the right side of the vehicle.

[0040] The instrument panel 18 is provided with a first display unit 28 as an output unit having a first display area G1 as a display area, and a second display unit 30 as an output unit having a second display area G2 as a display area.

[0041] The first display unit 28 is disposed on the right side of the instrument panel 18, on the front side of the steering wheel 20. The first display unit 28 is configured as, for example, a speedometer that displays the traveling speed, direction indicators, warnings, etc., as a meter display.

[0042] The second display unit 30 is disposed at the center in the vehicle width direction of the instrument panel 18. The second display unit 30 is configured as, for example, a center display on which an image output by a navigation system is displayed.

[0043] (Windshield 22) The windshield 22 is supported by front pillars 24. The front pillars 24 are located on the right and left sides of the vehicle at the front of the vehicle interior and extend substantially in the vertical direction of the vehicle. The upper end of the windshield 22 is covered by a headlining 25 attached to the roof panel.

[0044] The windshield 22 is provided with a third display unit 32 having a third display area G3 as a display area.

[0045] Then, based on information output from a display control device 35 installed inside the instrument panel 18, an image projected from a projection unit 51 serving as an output unit is projected onto the third display unit 32 of the windshield 22. This causes this image to be superimposed as a virtual image on a virtual image plane T (see FIG. 1) in front of the occupant (driver) H.

[0046] The display device 34, which includes the display control device 35, the projection unit 51, and the third display unit 32, constitutes a head-up display device. The third display unit 32, onto which an image projected from the projection unit 51 is projected, constitutes the projection surface of the head-up display device.

[0047] 1, the projection unit 51 has a field angle 51A that is narrower than the field angle 12A of the camera 12. The field angle 51A of the projection unit 51 is set with the eye point E of the occupant H as its origin. The distance D from the eye point E of the occupant H to the virtual image surface T can be set to, for example, 20 m. Note that the distance D from the eye point E of the occupant H to the virtual image surface T can be changed as appropriate depending on the vehicle in which the display device 34 is installed.

[0048] As shown in FIG. 3, the display device 34 and the camera 12 form a display system 16 .

[0049] [Display system hardware configuration] As shown in FIG. 3, the display system 16 is configured such that the camera image captured by the camera 12 is input to the display control device 35, and the processing information processed by the display control device 35 is output to the first display unit 28, the second display unit 30, and the projection unit 51.

[0050] The camera 12 captures an image of the area in front of the vehicle. The camera image of the area in front of the vehicle captured by the camera 12 is input to the display control device 35.

[0051] The display control device 35 is configured as an ECU (Electronic Control Unit) that performs various controls. The display control device 35 includes a CPU (Central Processing Unit) 36, a ROM (Read Only Memory) 38, a RAM (Random Access Memory) 40, a storage 42, a communication interface (communication I / F) 44, and an input / output interface (input / output I / F) 46. Each component is connected to each other via a bus 48 so as to be able to communicate with each other.

[0052] The CPU 36 is a central processing unit that executes various programs and controls each unit. That is, the CPU 36 reads programs from the ROM 38 or storage 42 and executes the programs using the RAM 40 as a work area. The CPU 36 also controls the above-mentioned components and performs various arithmetic processing in accordance with the programs recorded in the ROM 38 or storage 42.

[0053] The ROM 38 stores various programs and various data. The RAM 40 temporarily stores programs or data as a working area. The storage 42 is configured by an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and is a non-temporary recording medium that stores various programs including an operating system and various data. In the first embodiment, the ROM 38 or the storage 42 stores programs for performing display processing, which will be described later, and the like.

[0054] The input / output interface 46 is connected to the first display unit 28, the second display unit 30, the projection unit 51, and the camera 12.

[0055] [Functional configuration of display control device] The function of the display control device 35 of the first embodiment will be described.

[0056] As shown in FIG. 4, the display control device 35 functionally includes a position information acquisition unit 54, a virtual origin setting unit 56, an imaginary line setting unit 58, a size detection unit 60, and a mark generation unit 62.

[0057] (Location information acquisition unit) The position information acquisition unit 54 acquires position information of the target 90 based on a camera image of the camera 12 that captures the target 90 ahead of the vehicle 10.

[0058] 1, position information acquisition unit 54 acquires position P2 of pedestrian 92 based on a camera image captured by camera 12 of pedestrian 92 who is outside angle of view 51A of projection unit 51. Also, as shown in FIG. 5, position information acquisition unit 54 acquires position P2 of pedestrian 92 based on a camera image captured by camera 12 of pedestrian 92 who is inside angle of view 51A of projection unit 51.

[0059] (Virtual origin setting section) The virtual origin setting unit 56 sets the virtual origin P1 inside the angle of view 51A of the projection unit 51 which is narrower than the angle of view 12A of the camera 12.

[0060] Specifically, as shown in Figures 1 and 5, the virtual origin setting unit 56 sets a position offset by a distance D toward the front of the vehicle from the eye point E of the occupant H of the vehicle 10 as the virtual origin P1.

[0061] The virtual origin P1 can be defined as the intersection of a straight line K extending from the eye point E of an occupant H of the vehicle 10 to the front of the vehicle and the virtual image plane T.

[0062] (Assumed line setting section) The imaginary line setting unit 58 sets an imaginary line connecting the virtual origin P1 and the position P2 acquired by the position information acquisition unit 54. Specifically, as shown in Fig. 1 and Fig. 5, the imaginary line setting unit 58 sets an imaginary line 66 connecting the virtual origin P1 and the position P2 of the pedestrian 92.

[0063] The position P2 of the pedestrian 92 can be a point on a horizontal plane including the virtual origin P1. In other words, the virtual origin P1 and the position P2 of the pedestrian 92 can be at the same height.

[0064] (Size detection unit) The size detection unit 60 detects the size of the target 90. Specifically, the size detection unit 60 detects the size of the target 90 captured in the camera image based on the camera image captured by the camera 12. The size detection unit 60 can detect at least one piece of information regarding the width, height, and length of the target 90 captured in the camera image.

[0065] (Mark generation section) The mark generating unit 62 generates a mark 68 (see FIG. 1) that calls attention to the target 90 based on the assumed line 66. The mark 68 that calls attention to the target 90 is a mark that indicates the position of the target 90.

[0066] <When a pedestrian is outside the projection angle> Specifically, as shown in FIG. 1, when a pedestrian 92 is outside the angle of view 51A of the projection unit 51, the mark generation unit 62 generates a first mark 70 as a mark 68 at a position offset by a distance L1 from the virtual origin P1 toward the position P2 acquired by the position information acquisition unit 54, inside the angle of view 51A of the projection unit 51.

[0067] The mark generating unit 62 generates a second mark 74 as the mark 68 at a position offset by a distance L2 from the position P2 acquired by the position information acquiring unit 54 toward the virtual origin P1.

[0068] The mark generating unit 62 generates a third mark 72 as a mark 68 at a position offset by a distance L3 from the first mark 70 toward the position P2 acquired by the position information acquiring unit 54, and at a position offset by a distance L3 from the second mark 74 toward the virtual origin P1.

[0069] That is, the mark generating unit 62 generates a plurality of marks 68 on the imaginary line 66 at equal intervals.

[0070] As shown in Figure 3, image information of the mark 68 generated by the mark generation unit 62 is output to the projection unit 51, and the image projected from the projection unit 51 is projected onto the third display unit 32 on the windshield 22.

[0071] 6, when a pedestrian 92 is outside the angle of view 51A of the projection unit 51, the first mark 70 and the second mark 72 are displayed as superimposed virtual images in the third display area G3 of the third display unit 32. That is, the first mark 70 and the second mark 72 are displayed as superimposed virtual images in the foreground of the windshield 22. Note that in FIG. 6, the virtual origin P1, the imaginary line 66, and the third mark 74 are depicted by dashed lines for reference, but in reality, this information does not need to be displayed.

[0072] <When a pedestrian is within the projection angle> On the other hand, as shown in Figure 5, when a pedestrian 92 is present inside the angle of view 51A of the projection unit 51, the mark generation unit 62 generates a first mark 70 as a mark 68 at a position offset by a distance L1 from the virtual origin P1 toward the position P2 acquired by the position information acquisition unit 54, inside the angle of view 51A of the projection unit 51.

[0073] The mark generating unit 62 generates a second mark 74 as the mark 68 at a position offset by a distance L2 from the position P2 acquired by the position information acquiring unit 54 toward the virtual origin P1.

[0074] The mark generating unit 62 generates a third mark 72 as a mark 68 at a position offset by a distance L4 from the first mark 70 toward the position P2 acquired by the position information acquiring unit 54, and at a position offset by a distance L4 from the second mark 74 toward the virtual origin P1.

[0075] That is, the mark generating unit 62 generates a plurality of marks 68 at equal intervals on the imaginary line 66. Furthermore, the mark generating unit 62 changes the distance between the plurality of marks 68 in accordance with the distance to the target 90.

[0076] 7, when a pedestrian 92 is present inside the angle of view 51A of the projection unit 51, the first mark 70, the second mark 72, and the third mark 74 are displayed as superimposed virtual images in the third display area G3 of the third display unit 32. That is, the first mark 70, the second mark 72, and the third mark 74 are displayed as superimposed virtual images in the foreground of the windshield 22. Note that in FIG. 7, for reference, the virtual origin P1, the assumed line 66, and the position P2 acquired by the position information acquisition unit 54 are depicted by dashed lines, but in reality, this information does not need to be displayed.

[0077] (Further characteristic configuration) The mark generation unit 62 can generate the mark 68 on either the left or right side of the virtual origin P1. Specifically, as shown in Fig. 1, when a pedestrian 92 is located outside the left side of the vehicle within the angle of view 51A of the projection unit 51, the mark generation unit 62 generates the mark 68 on the left side of the virtual origin P1. In this case, as shown in Fig. 6, the first mark 70 and the second mark 72 are displayed superimposed on the left side of the virtual origin P1.

[0078] 8, when a pedestrian 92 is located outside the right side of the vehicle within the angle of view 51A of the projection unit 51, the mark generation unit 62 generates the mark 68 on the right side of the virtual origin P1. In this case, as shown in FIG. 9, parts of the first mark 70, the second mark 72, and the third mark 74 are displayed superimposed on the right side of the virtual origin P1.

[0079] The mark generation unit 62 generates marks 68 closer to the virtual origin P1 to be larger than marks 68 further from the virtual origin P1. Specifically, as shown in Figures 1 and 5, the mark generation unit 62 generates a first mark 70 closer to the virtual origin P1 to be larger than a second mark 72 further from the virtual origin P1. The mark generation unit 62 generates the second mark 72 closer to the virtual origin P1 to be larger than a third mark 74 further from the virtual origin P1.

[0080] In this case, as shown in FIGS. 6 and 7, the first mark 70 is displayed larger than the second mark 72 and superimposed thereon, and the second mark 72 is displayed larger than the third mark 74 and superimposed thereon.

[0081] The mark generating unit 62 can generate the mark 68 as a three-dimensional arrow pointing in the direction of the target 90 .

[0082] The mark generation unit 62 can generate a mark 68 based on the size of the target object 90 detected by the size detection unit 60. Specifically, as shown in Fig. 1 and Fig. 5, when the target object 90 is a pedestrian 92, the mark generation unit 62 can generate a mark 68 having a width corresponding to the width of the pedestrian 92. In this case, as shown in Fig. 6 and Fig. 7, the mark 68 having a width corresponding to the width of the pedestrian 92 is superimposed and displayed.

[0083] On the other hand, when the target object 90 is a bus 94, the mark generating unit 62 can generate a mark 68 having a width corresponding to the width of the bus 94. In this case, as shown in FIG. 10 , the mark 68 having a width corresponding to the width of the bus 94 is superimposed and displayed.

[0084] The mark generation unit 62 generates a mark that displays the speed V1 of the vehicle 10, and as shown in Figure 6, a mark 76 that displays the speed V1 of the vehicle 10 may be superimposed on the third display area G3 of the third display unit 32.

[0085] [Display process flow by display device] The flow of display processing by the display device 34 will be described with reference to the flowchart shown in FIG.

[0086] As shown in FIG. 11, when the display process starts, the position information acquisition unit 54 acquires the position P2 of the target 90 based on the image of the camera 12 (step S101).

[0087] Next, the size detection unit 60 detects the size of the target 90 captured in the camera image based on the camera image captured by the camera 12 (step S102).

[0088] Next, the virtual origin setting unit 56 sets a virtual origin P1 inside the angle of view 51A of the projection unit 51 (step S103).

[0089] Next, the imaginary line setting unit 58 sets an imaginary line connecting the virtual origin P1 and the position P2 acquired by the position information acquisition unit 54 (step S104).

[0090] Next, the mark generating unit 62 generates the mark 68 based on the imaginary line 66 (step S104).

[0091] Next, information about the mark 68 generated by the mark generation unit 62 is output to the projection unit 51, and the mark 68 is superimposed and displayed as a virtual image in the third display area G3 of the third display unit 32 (step S105), and the display process is terminated.

[0092] [Operation of the first embodiment] Next, the operation and effects of the first embodiment will be described.

[0093] The display control device 35 of the first embodiment includes a position information acquisition unit 54 that acquires a position P2 of a target 90 based on a camera image of a camera 12 that photographs the target 90 in front of the vehicle 10, a virtual origin setting unit 56 that sets a virtual origin P1 inside the angle of view 51A of the projection unit 51, which has an angle of view narrower than the angle of view 12A of the camera 12, an imaginary line setting unit 58 that sets an imaginary line 66 connecting the virtual origin P1 and the position P2 acquired by the position information acquisition unit 54, and a mark generation unit 62 that generates a mark 68 that is superimposed on a third display area G3 provided in the vehicle cabin based on the imaginary line 66 and that draws attention to the target 90 (see Figure 4).

[0094] By superimposing a mark 68 that calls attention to the target 90 based on an imaginary line 66 that connects a virtual origin P1 set inside the angle of view 51A of the projection unit 51 and a position P2 of the target 90, the mark 68 that calls attention to the target 90 is superimposed and displayed in the third display area G3 even when the camera 12 captures an image of the target 90 outside the angle of view 51A of the projection unit 51. Therefore, when the camera 12 captures an image of the target 90 outside the angle of view 51A of the projection unit 51, i.e., outside the angle of view of the image displayed in the third display area G3, information about the direction in which the captured target 90 exists can be superimposed and displayed in the third display area G3. As a result, the occupant H can be made aware of the target 90 that is outside the angle of view 51A of the projection unit 51.

[0095] In the display control device 35 of the first embodiment, the mark generating unit 62 generates a plurality of marks 68 at equal intervals on the imaginary line 66 (see FIGS. 1 and 5).

[0096] By generating a plurality of marks 68 at equal intervals on the imaginary line, the plurality of marks 68 are superimposed and displayed at equal intervals toward the target 90. Therefore, the marks 68 can be used to indicate the direction in which the target 90 exists. As a result, information about the direction in which the target 90 exists can be appropriately transmitted.

[0097] In the display control device 35 of the first embodiment, the mark generating unit 62 generates the first mark 70 located closer to the virtual origin P1 to be larger than the second mark 72 located farther from the virtual origin P1 (see FIGS. 1 and 5).

[0098] The first mark 70 located closer to the virtual origin P1 is generated larger than the second mark 72 located further away, so that the first mark 70 located closer to the virtual origin P1 is displayed larger than the second mark 72 located further away, as shown in Figures 6 and 7. This allows the mark 68 to express a sense of depth (perspective). As a result, information about the direction in which the target 90 exists can be more appropriately transmitted.

[0099] In the display control device 35 of the first embodiment, the virtual origin setting unit 56 sets a position offset from the eye point E of the occupant H of the vehicle 10 toward the front of the vehicle 10 as the virtual origin P1 (see Figures 1 and 5).

[0100] Since the virtual origin P1 is set to a position offset from the eye point E of the occupant H toward the front of the vehicle, the virtual origin P1 is set based on the eye point E of the occupant H. Therefore, the imaginary line 66 is set according to the eye point E of the occupant H. As a result, the mark 68 can be superimposed and displayed at an appropriate position in the third display area G3 according to the eye point E of the occupant H.

[0101] In the display control device 35 of the first embodiment, the mark generation unit 62 generates at least one mark 68 at a position offset from the virtual origin P1 toward the position P2 of the target 90 acquired by the position information acquisition unit 54, within the angle of view 51A of the projection unit 51 (see Figures 1 and 5).

[0102] At least one mark 68 is generated at a position offset from the virtual origin P1 inside the angle of view 51A of the projection unit 51, so that when a target 90 exists outside the angle of view 51A of the projection unit 51, the at least one mark 68 is superimposed and displayed in the third display region G3. Therefore, when a target 90 exists outside the angle of view 51A of the projection unit 51, information on the direction in which the target 90 exists can be transmitted.

[0103] In the display control device 35 of the first embodiment, the mark generating unit 62 generates the mark 68 on either the left or right side of the virtual origin P1 (see FIGS. 6 and 9).

[0104] As shown in FIG. 1, when the target 90 is outside the angle of view 51A of the projection unit 51 and on the left side of the vehicle, the mark 68 is displayed on the left side of the virtual origin P1 as shown in FIG. 6. When the target 90 is outside the angle of view 51A of the projection unit 51 and on the right side of the vehicle as shown in FIG. 8, the mark 68 is displayed on the right side of the virtual origin P1 as shown in FIG. 9. Therefore, it becomes possible to know at a glance whether the target 90 is on the left side of the vehicle or in the direction of the left side of the vehicle. As a result, the speed at which the occupant H recognizes the direction of the target 90 that is outside the angle of view 51A of the projection unit 51 can be improved.

[0105] In the display control device 35 of the first embodiment, the mark generating unit 62 generates the mark 68 as a three-dimensional arrow pointing in the direction of the target 90 (see FIGS. 6 to 10).

[0106] By generating the mark 68 as a three-dimensional arrow, a three-dimensional arrow is superimposed and displayed pointing toward the target 90. Therefore, information regarding the direction in which the target 90 exists can be more appropriately conveyed.

[0107] The display control device 35 of the first embodiment is equipped with a size detection unit 60 that detects the size of the target 90, and a mark generation unit 62 generates a mark 68 based on the size of the target 90 detected by the size detection unit 60 (see Figures 6 and 10).

[0108] By generating the mark 68 based on the size of the target 90, for example, if the target 90 is a wide object such as a bus 94 as shown in FIG. 10, the mark 68 is made to have a large width. On the other hand, if the target 90 is a narrow object such as a pedestrian 92 as shown in FIG. 6, the mark 68 is made to have a small width. Therefore, the size of the mark 68 can be set according to the size of the target 90. As a result, it is possible to appropriately transmit information about the size of the target 90 that is outside the angle of view 51A of the projection unit 51.

[0109] The display system 16 of the first embodiment includes a display device 34 and a camera 12 that has a field of view 12A wider than the field of view 51A of the projection unit 51 and captures an image of a target 90 ahead of the vehicle 10 (see FIG. 1).

[0110] Since the display system 16 includes the display device 34 and the camera 12 having the angle of view 12A wider than the angle of view 51A of the projection unit 51, even if the camera 12 captures an image of the target 90 outside the angle of view 51A of the projection unit 51, i.e., outside the angle of view of the image displayed in the third display area G3, information on the direction in which the captured target 90 is located can be superimposed and displayed in the third display area G3. As a result, the target 90 outside the angle of view 51A of the projection unit 51 can be properly communicated to the occupant H.

[0111] The vehicle 10 of the first embodiment has a third display area G3 on the windshield 22 (see FIG. 2).

[0112] Since the mark 68 is displayed in the third display area G3 of the windshield 22, the occupant H can recognize the mark 68 while directing his or her gaze forward. Therefore, the occupant H can recognize the mark 68 while driving without diverting his or her gaze from the front.

[0113] Second Embodiment The display system of the second embodiment differs from the display system of the first embodiment in that the display area in which the mark calling attention to the target is superimposed is different.

[0114] The configuration of the display system of the second embodiment will be described below. Note that the same terms or symbols will be used to describe parts that are the same as or equivalent to those described in the first embodiment.

[0115] In the second embodiment, as shown in FIG. 12, a mark 68 that calls attention to the target 90 is superimposed and displayed in the second display area G2 of the second display unit 30.

[0116] The upper side of the second display area G2 displays a camera image F captured by the camera 12, and the lower side of the second display area G2 displays the current position 10A of the vehicle 10 and the route (guided route) R to the destination on a map using the navigation system.

[0117] An image of the mark 68 generated by the mark generating unit 62 is output to the second display unit 30 serving as an output unit, and the mark 68 is displayed superimposed on the second display region G2.

[0118] Even with this configuration, it is possible to achieve the same effects as the display system of the first embodiment.

[0119] The display system of the present invention has been described above based on the above-mentioned embodiments. However, the specific configuration is not limited to these embodiments, and design changes are permitted as long as they do not deviate from the gist of the invention according to each claim in the scope of the claims.

[0120] In the above embodiment, an example has been shown in which the position information acquisition unit 54 acquires the position information of the target 90 based on a camera image captured by the camera 12 that captures the target 90 ahead of the vehicle 10. However, the position information acquisition unit may acquire the position information of the target based on a camera image captured by a camera that detects targets around the vehicle.

[0121] In the above embodiment, an example was shown in which the target detection unit was the camera 12. However, the target detection unit is not limited to this form, and can also be, for example, a radar, a LiDAR, a sonar, or the like.

[0122] In the above embodiment, an example has been described in which the imaginary line setting unit 58 sets the imaginary line 66 on a horizontal plane including the virtual origin P1, connecting the virtual origin P1 and the position P2 of the pedestrian 92. However, the imaginary line setting unit may set an imaginary line connecting the virtual origin P1 and the position P2 of the pedestrian 92 in three-dimensional space.

[0123] In the above embodiment, an example has been described in which the size detection unit 60 detects the size of the target 90 captured in a camera image based on the camera image captured by the camera 12. However, the size detection unit is not limited to this example, and can also detect the size of the target based on detection information from, for example, radar, LiDAR, sonar, or the like.

[0124] In the above embodiment, an example has been shown in which the mark generating unit 62 changes the distance between the multiple marks 68 depending on the distance to the target 90. However, the mark generating unit may keep the distance between the marks constant regardless of the distance to the target. Furthermore, the mark generating unit may change the color or size of the marks to be generated depending on the distance to the target. This makes it possible to transmit information about the distance to the target.

[0125] In the above embodiment, an example has been shown in which a mark calling attention to the target is superimposed and displayed when the target 90 is outside or inside the angle of view 51A of the projection unit 51. However, it is also possible to superimpose a mark calling attention to the target when the target is outside the angle of view of the projection unit, and to superimpose a mark calling attention to the target (a mark indicating the position of the target) when the target is inside the angle of view of the projection unit.

[0126] In the above embodiment, an example has been shown in which the mark generating unit 62 generates the mark 68 as a three-dimensional arrow pointing in the direction of the target 90. However, the mark generating unit may generate a two-dimensional arrow, or may generate a shape other than an arrow (for example, a sphere or a triangular prism).

[0127] In the above embodiment, an example has been shown in which the virtual origin P1 is the intersection of a straight line K extending from the eye point E of an occupant H of the vehicle 10 to the front of the vehicle and the virtual image surface T. However, the virtual origin is not limited to this example, and may be set within the angle of view of the output unit.

[0128] In the above embodiment, an example has been shown in which the mark generating unit 62 generates the mark 68 based on the width of the target 90 detected by the size detecting unit 60. However, the mark generating unit can also generate a mark based on the height or length of the target detected by the size detecting unit.

[0129] In the first embodiment, an example was shown in which an image of the mark 68 generated by the mark generation unit 62 was projected onto the third display unit 32 of the windshield 22. In the second embodiment, an example was shown in which an image of the mark 68 generated by the mark generation unit 62 was displayed on the second display unit 30. However, the image of the mark generated by the mark generation unit may also be displayed on the first display unit 28, or may be projected onto a combiner provided on the top surface of the instrument panel.

[0130] In the above embodiment, an example has been shown in which the display system of the present invention is applied to a vehicle 10 traveling ahead. However, the display system of the present invention can also be applied to a vehicle traveling around a curve, a vehicle traveling around a corner, or a stopped vehicle. [Explanation of symbols]

[0131] 10 vehicles 12 Camera (example of target detection unit) 12A Camera angle of view 16 Display System 22 Windshield 34 Display device 35 Display control device 51 Projection part 51A Projection angle 54 Location information acquisition unit 56 Virtual origin setting section 58 Assumed line setting section 60 Size detection unit 62 Mark Generation Unit 66 Assumed Line 68 marks 90 Target G3 3rd display area P1 Virtual origin P2 Target position

Claims

1. a position information acquisition unit that acquires position information of a target based on detection information from a target detection unit that detects a target around the vehicle; a virtual origin setting unit that sets a virtual origin inside an angle of view of an output unit that has an angle of view narrower than an angle of view of the target detection unit; a mark generating unit that generates a mark to be superimposed on a display area provided in the vehicle cabin and to call attention to the target between the virtual origin and a position of the position information; a size detection unit that detects the size of the target; Equipped with The mark generating unit generates the mark based on the size of the target detected by the size detecting unit. Display control device.

2. An imaginary line setting unit that sets an imaginary line connecting the virtual origin and the position of the position information acquired by the position information acquisition unit, The mark generating unit generates the mark based on the imaginary line. The display control device according to claim 1 .

3. The mark generating unit generates a plurality of the marks on the imaginary line. The display control device according to claim 2 .

4. The mark generating unit generates the mark closer to the virtual origin larger than the mark farther from the virtual origin. The display control device according to claim 1 .

5. The virtual origin setting unit sets a position offset from an eye point of a driver of the vehicle toward the front of the vehicle as the virtual origin. The display control device according to claim 1 .

6. The mark generating unit generates at least one of the marks at a position offset from the virtual origin toward the position of the position information acquired by the position information acquiring unit within an angle of view of the output unit. The display control device according to claim 1 .

7. The mark generating unit generates the mark on either the left or right side of the virtual origin. The display control device according to claim 1 .

8. The mark generating unit generates the mark as a three-dimensional arrow pointing in the direction of the target. The display control device according to claim 1 .

9. A display control device according to any one of claims 1 to 8; an output unit that outputs a field of view narrower than the field of view of the target detection unit; a display area in which the image output by the output unit is superimposed and displayed; A display device comprising:

10. The display device according to claim 9 ; a target detection unit having a field of view wider than the field of view of the output unit and configured to detect the target around the vehicle; A display system comprising:

11. A display system according to claim 10; a windshield that forms the display area; A vehicle equipped with:

12. acquiring position information of the target based on detection information from a target detection unit that detects targets around the vehicle; a virtual origin is set inside an angle of view of an output unit having an angle of view narrower than an angle of view of the target detection unit; A mark that is superimposed on a display area provided in the vehicle cabin and calls attention to the target is generated between the virtual origin and the position of the position information. A display control method in which processing is executed by a computer, Detecting the size of the target; A display control method for generating the mark based on the size of the detected target.

13. acquiring position information of the target based on detection information from a target detection unit that detects targets around the vehicle; a virtual origin is set inside an angle of view of an output unit having an angle of view narrower than an angle of view of the target detection unit; A mark that is superimposed on a display area provided in the vehicle cabin and calls attention to the target is generated between the virtual origin and the position of the position information. A program that causes a computer to execute a process, Detecting the size of the target; A program that generates the mark based on the size of the detected target.

Images