Information display method and information display device

Abstract

To enable a driver of one's own vehicle to recognize that an information image is displayed to the other vehicle without erroneous recognition even when the position of the other vehicle is outside the angle of view of a head-up display.SOLUTION: The information display device 1 receives and acquires visible light emitted from another vehicle by the camera 11 mounted on the host vehicle, generates an information image for displaying information transmitted by the acquired visible light, detects the position of the other vehicle that has emitted the visible light, and displays the information image in a shape indicating the other vehicle within the angle of view of the head-up display 15 when the detected position of the other vehicle is outside the angle of view of the head-up display 15.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information display method and an information display device. [Background technology]

[0002] Conventionally, a vehicle communication device that transmits messages between a vehicle and another vehicle using vehicle-to-vehicle communication is disclosed in Patent Document 1. The vehicle communication device disclosed in Patent Document 1 displays messages to other vehicles on a head-up display of the vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-12277 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional vehicle communication device, if the position of the other vehicle communicating with the vehicle-to-vehicle communication is outside the field of view of the head-up display, the message image cannot be displayed near the other vehicle, even if it is displayed, and therefore the driver does not know which vehicle the image is being displayed for, resulting in the problem of misidentifying the vehicle for which the image is being displayed.

[0005] An object of the present invention is to provide an information display method and device that allows the driver of a vehicle to recognize, without misunderstanding, which object an image is being displayed for, even if the object's position is outside the field of view of the head-up display. [Means for solving the problem]

[0006] An information display method and device according to one aspect of the present invention generates an information image that displays information transmitted by visible light emitted from an object, and when the position of the object that emitted the visible light is outside the field of view of the head-up display, displays the information image in a shape that points to the object within the field of view of the head-up display. [Effects of the Invention]

[0007] According to the present invention, even if the position of the object for which the information image is displayed is outside the field of view of the head-up display, the driver of the vehicle can recognize without mistake which object the information image is displayed for. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing the configuration of an information display device according to an embodiment. [Figure 2] FIG. 2 is a flowchart showing a processing procedure of information transmission processing by the information display device according to one embodiment. [Figure 3] FIG. 3 is a flowchart showing the processing procedure of the information display process performed by the information display device according to one embodiment. [Figure 4] FIG. 4 is a diagram showing an example of an information image displayed by an information display device according to an embodiment. [Figure 5] FIG. 5 is a diagram showing an example of an information image displayed by an information display device according to an embodiment. [Figure 6] FIG. 6 is a diagram for explaining the effect of an information image displayed by an information display device according to an embodiment. [Figure 7] FIG. 7 is a diagram for explaining the effect of an information image displayed by an information display device according to an embodiment. [Figure 8] FIG. 8 is a diagram for explaining the effect of an information image displayed by an information display device according to an embodiment. [Figure 9] FIG. 9 is a diagram showing an example of an information image displayed by an information display device according to a modified example. [Figure 10] FIG. 10 is a diagram showing an example of an information image displayed by an information display device according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an information display method and an information display device according to the present embodiment will be described with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and detailed description will be omitted.

[0010] [Configuration of information display device] The configuration of the information display device according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information display device according to this embodiment. As shown in Fig. 1, the information display device 1 includes a control unit 3, a storage unit 5, and a visible light communication unit 7. The information display device 1 is also connected to a camera 11, a vehicle sensor 13, a head-up display 15, and a turn signal 17 mounted on the vehicle.

[0011] The information display device 1 is mounted on the host vehicle and displays an information image of an object ahead of the host vehicle on the head-up display 15. In particular, in this embodiment, a case where the object is another vehicle is described, and visible light communication is performed between the host vehicle and the other vehicle, and an information image of the other vehicle is displayed on the head-up display 15.

[0012] The control unit 3 is a controller that displays an information image of an object ahead of the host vehicle on the head-up display 15. Specifically, the control unit 3 receives and acquires visible light emitted from another vehicle using the camera 11, generates an information image that displays the information transmitted by the acquired visible light, and detects the position of the other vehicle that emitted the visible light. If the detected position of the other vehicle is outside the angle of view of the head-up display 15, the control unit 3 displays the information image in a shape that indicates the other vehicle within the angle of view of the head-up display 15.

[0013] In addition, the control unit 3 executes processing for displaying an information image on the head-up display 15, and sets the display position of the information image so that the information image is displayed in a display area that is arranged to overlap the position of the vehicle's front window.

[0014] The storage unit 5 is a memory or database that stores information necessary for executing the information display process. Specifically, the storage unit 5 records data of the information image to be displayed, data of visible light received by the camera 11, captured images, etc.

[0015] Visible light communication unit 7 transmits and receives information such as messages and images to and from objects around the vehicle via visible light communication. Visible light communication is a method of transmitting and receiving digital data using blinking light. An LED (Light Emitting Diode) light source is modulated (blinked) at high speed, and the modulation pattern is transmitted as digital data (bit string). In this embodiment, visible light communication is performed between the vehicle and another vehicle, using the vehicle's turn signal 17, which is an LED lamp, as a transmitter and the camera 11 as a receiver. Visible light communication unit 7 interprets the modulation pattern of the visible light received by camera 11 to recognize the digital data, and outputs a message or image related to the recognized digital data.

[0016] The camera 11 is mounted on the vehicle and serves as an imaging unit that captures an image ahead of the vehicle, and also functions as a receiver that receives visible light emitted from other vehicles. In particular, the camera 11 receives visible light emitted from the turn signals of other vehicles. Therefore, the camera 11 is a high-speed camera that has a frame rate necessary for visible light communication. The image captured by the camera 11 is output to the information display device 1 and recorded in the storage unit 5.

[0017] The vehicle sensor 13 is mounted on the vehicle and detects objects around the vehicle, and measures the distance and direction to the detected objects. For example, the vehicle sensor 13 is a LiDAR, a stereo camera, an ultrasonic sensor, etc. The measured data is output to the information display device 1 and recorded in the memory unit 5.

[0018] The head-up display 15 is a display device that is mounted on the vehicle and displays the information image output from the information display device 1. The head-up display 15 includes a projection unit that projects an image, a screen that reflects the image, a Fresnel mirror, etc., and displays the information image in a display area that is provided so as to overlap the position of the front window of the vehicle. In particular, the head-up display 15 can display the information image superimposed on the scenery ahead of the vehicle by projecting the image reflected by the mirror as a virtual image on the front of the front window.

[0019] The turn signals 17 are light-emitting devices that are installed at the front and rear of the vehicle and can rapidly blink high-speed modulated LED lamps, and function as transmitters for visible light communication by emitting visible light. In addition to the turn signals 17, other lighting devices installed on the vehicle, such as stop lamps and headlights, may also be used as transmitters.

[0020] The information display device 1 is a computer configured with general-purpose electronic circuits including a microcomputer, a microprocessor, and a CPU, as well as peripheral devices such as memory, and is installed with a computer program for executing information display processing. Each function of the information display device 1 can be implemented by one or more processing circuits. The processing circuit may include, for example, a programmed processing device including electrical circuits, and may also include devices such as application-specific integrated circuits (ASICs) or conventional circuit components arranged to perform the functions described in the embodiments.

[0021] [Information transmission processing] Next, an information transmission process for transmitting information to the information display device 1 according to this embodiment via visible light communication will be described. FIG. 2 is a flowchart showing the processing procedure for the information transmission process. In this embodiment, a case will be described in which information such as a message or an image is transmitted from another vehicle to the subject vehicle via visible light communication. The other vehicle is equipped with an information display device 1A similar to the information display device 1 described above, and the information display device 1A includes a control unit 3A, a storage unit 5A, and a visible light communication unit 7A. The other vehicle also includes a camera 11A, a vehicle sensor 13A, a head-up display 15A, and a blinker 17A. In the following description, the other vehicle that transmits information will be referred to as a transmitting vehicle, and the subject vehicle that receives the information will be referred to as a receiving vehicle.

[0022] 2, in step S101, the control unit 3A of the information display device 1A mounted on the transmitting vehicle acquires data measured by the vehicle sensor 13A and determines whether or not a vehicle is present near the transmitting vehicle. If a vehicle is present near the transmitting vehicle, the process proceeds to step S103; if no vehicle is present, the information transmission process according to this embodiment ends.

[0023] In step S103, visible light communication unit 7A emits visible light to confirm whether the vehicle detected in step S101 is capable of performing visible light communication. Visible light communication unit 7A blinks the LED lamp of turn signal 17A to emit visible light to confirm whether visible light communication is possible.

[0024] In step S105, control unit 3A determines whether or not it has been able to receive visible light returned in response to the visible light emitted in step S103. If control unit 3A has not been able to receive visible light returned from the receiving vehicle with camera 11A, the process proceeds to step S107, and if it has been able to receive visible light returned from the receiving vehicle, the process proceeds to step S109.

[0025] In step S107, since the control unit 3A was unable to receive the return visible light, it displays a message on an in-vehicle display or the like informing the driver of the transmitting vehicle that the vehicle detected in step S101 does not have visible light communication capabilities.

[0026] In step S109, the control unit 3A detects the position of the receiving vehicle that emitted the return visible light. Specifically, the control unit 3A detects the relative position of the receiving vehicle with respect to the transmitting vehicle from the direction and distance of the receiving vehicle detected by the vehicle sensor 13A.

[0027] In step S111, control unit 3A captures an image of the receiving vehicle with camera 11A and detects the shape of the receiving vehicle and the position of the receiving vehicle's turn signal 17. Control unit 3A detects the shape of the receiving vehicle from the image captured by camera 11A, and detects the position of the turn signal 17 from the detected shape of the receiving vehicle.

[0028] In step S113, visible light communication unit 7A blinks the LED light source for the vehicle detected in step S101 and emits visible light from blinker 17A representing a message or image to be transmitted. For example, visible light representing a message or image for changing lanes or for giving way is emitted. Specifically, visible light communication unit 7A generates digital data representing the image or message, and blinks blinker 17A in accordance with the generated digital data, thereby emitting visible light representing the image or message.

[0029] In step S115, control unit 3A determines whether or not it has received visible light returned in response to the visible light emitted in step S113. If control unit 3A has received visible light returned from the receiving vehicle with camera 11A, the process proceeds to step S117, but if control unit 3A has not received visible light returned from the receiving vehicle, it ends the information transmission process according to this embodiment.

[0030] In step S117, the visible light communication unit 7A automatically emits visible light to notify that the reply visible light received in step S115 has been received, and then the information transmission process according to this embodiment ends.

[0031] [Information display processing] Next, the information display process by the information display device 1 according to this embodiment will be described. Fig. 3 is a flowchart showing the processing procedure of the information display process. The information display process shown in Fig. 3 starts when the power of the receiving vehicle is turned on.

[0032] 3, in step S201, the control unit 3 determines whether or not visible light emitted from the blinker 17A of the transmitting vehicle has been received by the camera 11. If the camera 11 has received visible light, the process proceeds to step S203, and if the camera 11 has not received visible light, the process proceeds to step S219.

[0033] In step S203, visible light communication unit 7 automatically emits visible light to notify the transmitting vehicle that emitted the visible light received in step S201 that visible light communication is possible. Visible light communication unit 7 generates digital data representing a message notifying the transmitting vehicle that visible light communication is possible, and emits visible light notifying the transmitting vehicle that visible light communication is possible by blinking turn signal 17 in accordance with the generated digital data. In this way, it is determined in advance whether communication by visible light is possible between the transmitting vehicle and the receiving vehicle.

[0034] In step S205, the control unit 3 acquires visible light emitted from the transmitting vehicle and received by the camera 11. The control unit 3 may acquire the received visible light from the camera 11, or may acquire the visible light from the storage unit 5 that records the visible light received by the camera 11.

[0035] In step S207, the control unit 3 generates an information image that displays the information transmitted by visible light acquired in step S205. For example, as shown in Fig. 4, if the information transmitted by visible light is that the transmitting vehicle 41 is moving to the right, an information image 45 that displays an arrow 43 pointing right as seen from the transmitting vehicle 41 is generated.

[0036] At this time, the control unit 3 displays the shape of the information image 45 in a shape that points to the transmitting vehicle 41. Specifically, the information image 45 is surrounded by an outer frame and displayed in the shape of a speech bubble that points to the transmitting vehicle 41. In addition, the information image 45 is set to a transparency that allows the background to be seen.

[0037] In step S209, the control unit 3 detects the position of the transmitting vehicle that emitted the visible light. Specifically, the control unit 3 detects the relative position of the transmitting vehicle with respect to the receiving vehicle from the direction and distance of the transmitting vehicle detected by the vehicle sensor 13.

[0038] In step S211, the control unit 3 captures an image of the transmitting vehicle using the camera 11 and detects the shape of the transmitting vehicle and the position of the blinker 17A of the transmitting vehicle. The control unit 3 detects the shape of the transmitting vehicle from the image captured by the camera 11, and detects the position of the blinker 17A from the detected shape of the transmitting vehicle.

[0039] In step S213, the control unit 3 displays the information image generated in step S207 on the head-up display 15 based on the relative position of the transmitting vehicle detected in step S209. For example, as shown in Fig. 5, when the position of the transmitting vehicle 41 is within the angle of view of the head-up display 15, the control unit 3 displays the information image 45 in the shape of a speech bubble pointing to the transmitting vehicle 41, and displays the speech bubble so that it points to the blinker 17A of the transmitting vehicle 41.

[0040] On the other hand, as shown in Figure 4, when the position of the transmitting vehicle 41 is outside the field of view of the head-up display 15, the control unit 3 displays the information image 45 in a shape that points to the transmitting vehicle 41 within the field of view of the head-up display 15.

[0041] 4, the transmitting vehicle 41 is located outside the display area 47 as seen by the driver of the receiving vehicle, and is therefore outside the angle of view of the head-up display 15. In this case, the control unit 3 displays the information image 45 inside the display area 47 of the head-up display 15. In other words, the control unit 3 displays the information image 45 within the angle of view of the head-up display 15.

[0042] Then, the control unit 3 displays the information image 45 in a shape that points to the transmitting vehicle 41. Furthermore, the information image 45 is surrounded by an outer frame and displayed in the shape of a speech bubble that points to the transmitting vehicle 41. In particular, the tip of the speech bubble of the information image 45 is displayed at a position closest to the transmitting vehicle 41 within the field of view of the head-up display 15. This allows the driver of the receiving vehicle to recognize without mistake that the information image 45 is being displayed on the transmitting vehicle 41, even if the position of the transmitting vehicle 41 is outside the field of view of the head-up display 15.

[0043] For example, as shown in Fig. 6, when the angle of view in the vertical direction of the display area 47 is 4°, the transmitting vehicle 41 is located outside the angle of view of the head-up display 15 and is located outside the display area 47 as seen by the driver of the receiving vehicle. In this case, if only the arrow 43 is displayed inside the display area 47, the driver will mistakenly believe that the arrow 43 is pointing to vehicle 51, not the transmitting vehicle 41. Furthermore, as shown in Fig. 7, if the angle of view is changed to 5°, the transmitting vehicle 41 will be included in the angle of view, and the arrow 43 can be displayed near the transmitting vehicle 41. This will prevent the arrow 43 from being mistakenly seen alone, but it will require the angle of view of the head-up display 15 to be widened.

[0044] In contrast, in this embodiment, as shown in Fig. 8, the information image 45 is displayed in a shape that points to the transmitting vehicle 41. Therefore, even if the information image 45 is displayed inside the display area 47 with a 4° angle of view without widening the angle of view, the driver can recognize without misunderstanding that the information image 45 is being displayed for the transmitting vehicle 41 outside the angle of view. That is, in this embodiment, even if the angle of view in the vertical direction is 4°, the driver's misunderstanding can be prevented, so there is no need to widen the angle of view to 5°, and the angle of view can be reduced by 1°.

[0045] When an object such as a pedestrian or a vehicle is moving around the receiving vehicle, the information image 45 is displayed so as not to overlap with the object moving around the receiving vehicle. The control unit 3 detects the position of the object moving around the receiving vehicle based on information from the vehicle sensor 13, and controls the display area 47 so that the position of the object does not overlap with the position of the information image 45. The information image 45 may be displayed not only on the head-up display 15 but also on an in-vehicle display.

[0046] In step S215, the control unit 3 determines whether the driver of the receiving vehicle has recognized the information transmitted by visible light from the transmitting vehicle 41. The receiving vehicle is equipped with a function for receiving input from the driver via voice recognition or buttons, and the control unit 3 determines, using an automatic determination function based on machine learning, whether the driver has recognized the information transmitted by visible light communication. If the driver has recognized the information transmitted by visible light communication, the process proceeds to step S217; if the driver has not recognized it, the process proceeds to step S219.

[0047] In step S217, visible light communication unit 7 emits visible light to notify that the driver of the receiving vehicle has recognized the information transmitted by visible light communication. Visible light communication unit 7 generates digital data representing a message notifying that the driver has recognized the transmitted information, and emits visible light to notify that the driver has recognized the transmitted information by flashing blinker 17 in accordance with the digital data.

[0048] In step S219, the control unit 3 determines whether the power supply of the receiving vehicle has been turned off, and if it has not been turned off, returns to step S201, and if it has been turned off, terminates the information display processing of this embodiment.

[0049] [Variations] In the above-described embodiment, a case where visible light communication is performed between the vehicle and another vehicle has been described. However, visible light communication can also be performed between the vehicle and other objects. For example, visible light communication can be performed between street lights and signs installed in a city. As shown in FIG. 9, by configuring a street light 81 with an LED lamp, visible light communication can be performed between the street light 81 and the vehicle. In the example shown in FIG. 9, a road sign is displayed in the information image 83. This allows street lights installed in a city to be used as information sources, eliminating the need to install road signs.

[0050] Furthermore, as shown in Fig. 10, by configuring a signboard 91 with LED lamps, visible light communication can be performed between the signboard 91 and vehicles. In the example shown in Fig. 10, information image 93 displays detailed information about the parking lot, indicating that the parking lot is "vacant." In addition, it is also possible to display the opening hours of the facility, waiting times for restaurants, and the like. In this way, detailed information about the facility can be provided to passing vehicles using a signboard installed at the facility.

[0051] [Effects of the embodiment] As described above in detail, when the position of another vehicle is outside the angle of view of the head-up display 15, the information display device 1 according to this embodiment displays an information image in a shape that points to the other vehicle within the angle of view of the head-up display 15. This allows the driver of the host vehicle to recognize, without misunderstanding, which vehicle the information image is being displayed for, even if the position of the other vehicle on which the information image is displayed is outside the angle of view of the head-up display 15. In addition, the angle of view of the head-up display 15 can be reduced.

[0052] Furthermore, in the information display device 1 according to this embodiment, the information image is surrounded by an outer frame and displayed in the shape of a speech bubble pointing to another vehicle. As a result, even if the position of the other vehicle on which the information image is displayed is outside the angle of view of the head-up display 15, the information image is displayed with an emphasis by the outer frame, and the other vehicle can be clearly pointed out.

[0053] Furthermore, in the information display device 1 according to this embodiment, the tip of the speech bubble is displayed at a position closest to the other vehicle within the angle of view of the head-up display 15. As a result, even if the position of the other vehicle on which the information image is displayed is outside the angle of view of the head-up display 15, the other vehicle can be clearly indicated by the tip of the speech bubble.

[0054] Furthermore, in the information display device 1 according to this embodiment, the information image is set to a transparency that allows the background to be seen, so that even if the information image is displayed on the windshield, the driver of the vehicle can see people and vehicles moving around the vehicle.

[0055] Furthermore, the information display device 1 according to this embodiment generates an information image using visible light emitted from the turn signals of other vehicles, and the speech bubble of the information image indicates the turn signals of other vehicles. This allows visible light communication to be performed using the turn signals located on the front, rear, left, and right of the vehicle, so visible light communication can be reliably performed regardless of the direction in which the vehicle is facing the other vehicle.

[0056] Furthermore, the information display device 1 according to this embodiment determines whether the driver of the vehicle has recognized the information transmitted by visible light, thereby making it possible to confirm that the driver of the vehicle has recognized the information transmitted by visible light communication.

[0057] Furthermore, the information display device 1 according to this embodiment determines in advance whether visible light communication is possible between the vehicle and other vehicles, thereby transmitting information only to vehicles capable of visible light communication, thereby enabling efficient visible light communication.

[0058] Furthermore, the information display device 1 according to this embodiment detects the shape of the other vehicle that has emitted visible light, thereby enabling the information image to be displayed in accordance with the shape of the other vehicle, allowing the driver of the vehicle to accurately recognize which vehicle the information image is being displayed for.

[0059] Furthermore, the information display device 1 according to this embodiment displays the information image so that it does not overlap with objects moving around the vehicle, so that the driver of the vehicle can see people and vehicles moving around the vehicle even when the information image is displayed on the front window.

[0060] Although the embodiments of the present invention have been described above, the descriptions and drawings that form part of this disclosure should not be understood to limit the present invention. Various alternative embodiments, examples, and operating techniques will become apparent to those skilled in the art from this disclosure. [Explanation of symbols]

[0061] 1, 1A Information display device 3, 3A control section 5, 5A storage section 7, 7A visible light communication section 11, 11A Camera 13, 13A Vehicle Sensor 15, 15A Head-up display 17, 17A turn signals 41 Transmitting vehicle 43 Arrow 45, 83, 93 infographics 47, 52 display area 51 vehicles 81 Streetlight 91 Signboard

Claims

1. An information display method using a controller that displays an information image on a head-up display for an object ahead of a vehicle, comprising: receiving and acquiring visible light emitted from the object with an imaging unit mounted on the vehicle; generating the information image that displays the information transmitted by the acquired visible light; detecting the position of the object that emitted the visible light; When the position of the detected object is outside the angle of view of the head-up display, the information image is displayed in a shape that points to the object within the angle of view of the head-up display. Information display method.

2. The information image is surrounded by an outer frame and displayed in the form of a speech bubble pointing to the object. The information display method according to claim 1 .

3. The tip of the speech bubble is displayed at a position closest to the object within the angle of view of the head-up display. The information display method according to claim 2 .

4. The information image is set to a transparency that allows the background to be seen. The information display method according to any one of claims 1 to 3.

5. When the object is another vehicle, the information image is generated by visible light emitted from a blinker of the other vehicle, and the speech bubble indicates the blinker of the other vehicle. The information display method according to claim 2 .

6. Determining whether the driver of the vehicle has recognized the information transmitted by the visible light The information display method according to claim 1 .

7. If the object is another vehicle, it is determined in advance whether or not communication by visible light is possible between the other vehicle and the subject vehicle. The information display method according to claim 1 .

8. Detecting the shape of the object that emitted the visible light The information display method according to claim 1 .

9. The information image is displayed so as not to overlap with objects moving around the vehicle. The information display method according to claim 1 .

10. An information display device including a controller that displays an information image on a head-up display for an object ahead of a vehicle, receiving and acquiring visible light emitted from the object with an imaging unit mounted on the vehicle; generating the information image that displays the information transmitted by the acquired visible light; detecting the position of the object that emitted the visible light; When the position of the detected object is outside the angle of view of the head-up display, the information image is displayed in a shape that points to the object within the angle of view of the head-up display. Information display device.

Images