Vehicle information display apparatus

Abstract

To provide a vehicle information display apparatus that enables a user to instinctively recognize an in-vehicle component on the own-vehicle that relates to information provision.SOLUTION: A vehicle information display apparatus 100 displays an image representing an environment surrounding an own-vehicle on a display 4 on the basis of information detected by an external camera 1 of the own-vehicle itself. The vehicle information display apparatus 100 includes an abnormality detection unit 11 for detecting an abnormality occurrence on an on-vehicle component of the own-vehicle, and an image display unit 13 for displaying an own-vehicle icon corresponding to the own-vehicle on the display 4. When an occurrence of abnormality has been detected, the image display unit 13 displays an abnormality indication representing the occurrence of the abnormality over the own-vehicle icon so as to correspond to a position of the component on which the abnormality has occurred in the own-vehicle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information display device for a vehicle. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known an information providing device that displays information on a meter display, such as what to do when a warning light is lit or flashing and the meaning of the warning light. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-088697 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-described conventional device, the meter display shows the corrective action, the meaning of the warning light, etc. in concrete sentences, etc. In the vehicle information display device, there is room for improvement in enabling the user to intuitively recognize the on-board components of the vehicle related to the provided information, which is information provided to the user, such as the occurrence of an abnormality. [Means for solving the problem]

[0005] One aspect of the present invention is an information display device for a vehicle that displays an image representing the surrounding environment of the vehicle on a display based on detection information from an external sensor of the vehicle, and is equipped with: a provided information acquisition unit that acquires provided information, which is information provided to a user of the vehicle about onboard components of the vehicle; and an image display unit that displays a vehicle icon corresponding to the vehicle on a display; and when provided information is acquired, the image display unit displays an information provided display representing the provided information superimposed on the vehicle icon so as to correspond to the position on the vehicle of the onboard component related to the provided information.

[0006] In an information display device for a vehicle according to one aspect of the present invention, an image representing the surrounding environment of the vehicle is displayed on the display together with a vehicle icon corresponding to the vehicle based on detection information from an external sensor of the vehicle. When provided information is acquired, an information display representing the provided information is superimposed on the vehicle icon so as to correspond to the position of the on-board component related to the provided information on the vehicle. This allows the user to intuitively recognize the on-board component of the vehicle related to the provided information, for example, when an abnormality in the on-board component is detected as the provided information, compared to when only the telltale warning light specified by law is turned on or when the meaning of the telltale warning light is displayed in specific text.

[0007] In one embodiment, the vehicle information display device includes a virtual space generation unit that generates a virtual space corresponding to the surrounding environment of the vehicle based on detection information from an external sensor. The image display unit displays an image of the virtual space as seen from a virtual viewpoint operated by a user of the vehicle on a display, and the vehicle icon may be a three-dimensional icon corresponding to the vehicle placed in the virtual space. In this case, the information display is displayed superimposed on the three-dimensional vehicle icon, allowing the user to more intuitively recognize the onboard components of the vehicle related to the provided information.

[0008] In one embodiment, when provision information about an on-board part other than the exterior of the vehicle is acquired, the image display unit may erase the exterior image of the vehicle icon and display an internal structure image corresponding to the internal structure of the vehicle on the display, and display the information provision display superimposed on the internal structure image. In this case, the user can easily recognize which on-board part in the internal structure of the vehicle the provision information has been generated for. [Effects of the Invention]

[0009] According to various aspects of the present invention, it is possible to allow a user to intuitively recognize an on-board part of the vehicle related to the provided information. [Brief explanation of the drawings]

[0010] [Figure 1]1 is a block diagram showing an information display device for a vehicle according to an embodiment; [Figure 2] FIG. 2 is a diagram illustrating a host vehicle icon and a virtual viewpoint. [Figure 3] 10A and 10B are diagrams illustrating examples of displaying an image corresponding to the surrounding environment and an icon of the vehicle; [Figure 4] 1A is a diagram showing a display example in which an abnormality display is superimposed on a host vehicle icon, and FIG. 1B is a diagram showing another display example in which an abnormality display is superimposed on a host vehicle icon. [Figure 5] 1A and 1B are diagrams illustrating an example of a situation in which the virtual part position of an on-vehicle part in which an abnormality has occurred is not included in the range displayed on the display, respectively. [Figure 6] 2 is a flowchart showing an example of processing by the ECU of FIG. 1; DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] FIG. 1 is a block diagram showing a vehicle information display device 100 according to an embodiment. The vehicle information display device 100 shown in FIG. 1 is mounted on a vehicle such as a passenger car or a freight vehicle (hereinafter referred to as the host vehicle) and is configured to support the user in recognizing the vehicle's surrounding environment. The vehicle information display device 100 displays an image representing the host vehicle's surrounding environment on a display based on detection information from external sensors of the host vehicle. As an example, the vehicle information display device 100 generates a virtual space that reflects the host vehicle's surrounding environment and displays an image of the virtual space as seen from a virtual viewpoint operated by the user on the display. The vehicle information display device 100 displays the host vehicle's surrounding environment on the display as a so-called 3D view.

[0013] The user may be the driver of the vehicle, a passenger of the vehicle, or the owner of the vehicle. The user may also be an operator who remotely supports the vehicle using a remote assistance system. In the remote assistance system, the operator can make decisions about the vehicle's driving (decisions about proceeding, turning right or left, stopping, etc.) or operate the vehicle through remote assistance equipment installed outside the vehicle and capable of communicating with the vehicle. The vehicle is not limited to vehicles that can be remotely supported by the remote assistance system. The vehicle may be a vehicle with an autonomous driving function or a vehicle without an autonomous driving function.

[0014] [Configuration of vehicle information display devices] As shown in FIG. 1 , the vehicle information display device 100 includes an ECU (Electronic Control Unit) 10. The ECU 10 is an electronic control unit that comprehensively manages the vehicle information display device 100. The ECU 10 includes a CPU (Central Processing Unit) and a storage unit. The storage unit is configured, for example, with a ROM (Read Only Memory), a RAM (Random Access Memory), and an EEPROM (Electrically Erasable Programmable Read-Only Memory). The ECU 10 realizes various functions by, for example, executing programs stored in the storage unit in the CPU. The ECU 10 may be configured with multiple electronic units. The ECU 10 is connected to an external camera 1 (external sensor), a radar sensor 2 (external sensor), a user operation reception unit 3, and a display 4.

[0015] The external camera 1 is an imaging device that captures images of the external situation of the vehicle. The external camera 1 includes, for example, a front camera that captures images in front of the vehicle, a back camera that captures images behind the vehicle, and side cameras that capture images on the left and right sides of the vehicle. The number of cameras in the external camera 1 is not particularly limited, and may be one. The external camera 1 transmits captured image information to the ECU 10.

[0016] The radar sensor 2 is a detection device that detects objects around the vehicle using radio waves (e.g., millimeter waves) or light. The radar sensor 2 can be configured to include a millimeter wave radar or a LIDAR (Light Detection and Ranging). The radar sensor 2 transmits object detection information relating to the detected objects to the ECU 10. The radar sensor 2 and the external camera 1 constitute an external sensor for detecting the environment around the vehicle. The object detection information of the radar sensor 2 or the captured image information of the external camera 1 corresponds to the detection information of the external sensor.

[0017] The user operation reception unit 3 is a device that receives operations of the virtual viewpoint by the user. The user operation reception unit 3 can be, for example, an input unit of an HMI (Human Machine Interface) provided in the vehicle. The input unit includes, for example, a touch panel display, buttons, levers, switches, etc. The user operation reception unit 3 may also be capable of receiving operations by voice recognition or gestures.

[0018] A mobile terminal or a computer input device connected to the vehicle may be used as the user operation reception unit 3. Alternatively, an operator terminal of the remote assistance system may be used as the user operation reception unit 3.

[0019] The display 4 is, for example, a center display mounted on the dashboard of the vehicle. The display 4 may be a display of a tablet computer that can be installed in the vehicle, or may be a HUD (Head Up Display). The display 4 is not limited to being mounted on the vehicle. The display 4 may be a display for an operator of a remote assistance system installed in a facility away from the vehicle. The display 4 may be a display of a mobile terminal carried by the user, or may be a display of the user's tablet computer or desktop computer.

[0020] Next, a description will be given of the functional configuration of the ECU 10. As shown in Fig. 1, the ECU 10 has an abnormality detection unit 11 (provided information acquisition unit), a virtual space generation unit 12, and an image display unit 13. Some of the functions of the ECU 10 described below may be executed by a server (e.g., a server of a remote assistance system) that can communicate with the vehicle, a mobile terminal, or a computer (e.g., a tablet computer or a desktop computer).

[0021] The abnormality detection unit 11 detects (acquires) the occurrence of an abnormality in an on-board component of the host vehicle as provided information about the on-board component of the host vehicle. The abnormality detection unit 11 detects at least the occurrence of an abnormality in an on-board component related to a tell-tale, which is a warning light specified by regulations, by a known method.

[0022] Telltales refer to warning and indicator lights installed or displayed on the vehicle's speedometer, dashboard, or instrument panel. Telltales are predefined icons that visually communicate the status of various systems in the vehicle to the user.

[0023] Examples of telltales include a yellow engine check icon indicating an abnormality in the engine system, a red oil jug icon (oil pressure warning light) indicating low engine oil pressure, a red battery icon (charging warning light) indicating a low battery charge state or poor power generation, a red thermometer icon (overheating) on ​​the surface of the water indicating overheating of the coolant, a yellow icon of a tire cross section and an exclamation mark (low tire pressure) indicating low tire pressure, a yellow icon of ``ABS'' surrounded by a circle (ABS warning light) indicating an abnormality in the vehicle's ABS system and driving control system, a yellow icon of ``!'' surrounded by a circle (brake warning light) indicating low brake fluid in the hydraulic brakes, a yellow or red icon indicating an abnormality in the airbag status (SRS airbag warning light, side airbag abnormality, etc.), a yellow light bulb icon indicating an abnormality in the lights, and a red icon of a plan view of the vehicle indicating an open door.

[0024] The virtual space generation unit 12 generates a virtual space corresponding to the surrounding environment of the host vehicle based on detection information from an external sensor. The virtual space generation unit 12 generates the virtual space based on, for example, image information captured by the external camera 1. The surrounding environment of the host vehicle includes, for example, the position of the white lines of the lane in which the host vehicle is traveling. The surrounding environment of the host vehicle may also include the conditions (positions, traveling direction, etc.) of other vehicles, such as a preceding vehicle or an adjacent vehicle traveling alongside the host vehicle.

[0025] The virtual space is generated as, for example, a 3D image obtained by combining multiple images. The method of combining the images is not particularly limited. For example, the virtual space generation unit 12 generates the virtual space as a 3D image by projecting each image onto a global coordinate system that serves as the reference for the virtual space and associating overlapping pixels with each other.

[0026] The virtual space generation unit 12 places a host vehicle icon corresponding to the host vehicle in the virtual space. The host vehicle icon is placed as a three-dimensional icon in the shape of a car. The host vehicle icon can be formed using polygons, voxels, or other CG processing. The virtual space generation unit 12 may generate a host vehicle icon that reflects the state of the host vehicle. The virtual space generation unit 12 may reflect the lighting status of the host vehicle's lights (the lighting status of headlights, turn signals, brake lights, etc.) in the lighting status of the host vehicle icon, and may reflect the steering angle of the host vehicle's tires in the tires of the host vehicle icon. The shape and size of the host vehicle icon are set in advance according to the vehicle model.

[0027] When the virtual space generation unit 12 recognizes another vehicle based on the image information captured by the external camera 1, it may place a three-dimensional other vehicle icon corresponding to the other vehicle in the virtual space. Similarly, the virtual space generation unit 12 may place a three-dimensional pedestrian icon in the virtual space. The virtual space generation unit 12 may recognize another vehicle, etc. based on object detection information from the radar sensor 2 instead of the image information captured by the external camera 1, or may recognize another vehicle, etc. using both the external camera 1 and the radar sensor 2.

[0028] The image display unit 13 displays a host vehicle icon corresponding to the host vehicle on the display 4. As an example, the image display unit 13 displays an image of the virtual space seen from a virtual viewpoint operated by the user of the host vehicle on the display 4. The host vehicle icon here is a three-dimensional icon corresponding to the host vehicle arranged in the virtual space.

[0029] FIG. 2 is a diagram for explaining the host vehicle icon and the virtual viewpoint. FIG. 2 shows the host vehicle icon 20 and the virtual viewpoint 50. The plane on which the host vehicle icon 20 is arranged corresponds to the horizontal plane of the global coordinate system. FIG. 2 also shows the line of sight D of the virtual viewpoint 50 and the depression angle α of the virtual viewpoint 50. For ease of understanding, FIG. 2 illustrates the virtual viewpoint 50 as a camera icon. The depression angle α is the angle between the line of sight D and the plane on which the host vehicle icon 20 is arranged in a vertical plane or the horizontal plane of the global coordinate system. It should be noted that it is not essential to display the virtual viewpoint 50 as an icon in the virtual space.

[0030] FIG. 3 is a diagram showing a display example of an image corresponding to the surrounding environment and the host vehicle icon. The image display unit 13 moves the virtual viewpoint 50 in accordance with a user operation input to the user operation receiving unit 3. The image display unit 13 changes the orientation and size of the image corresponding to the surrounding environment and the host vehicle icon displayed on the display 4 in accordance with the position of the virtual viewpoint 50. In FIG. 3, the host vehicle icon 20 is displayed on the display 4 at an angle viewed from behind. The example in FIG. 3 corresponds to the field of view when the host vehicle icon 20 is viewed from the virtual viewpoint 50 in the positional relationship shown in FIG. 2. The exterior image 21 is an image that constitutes the surface of the host vehicle icon 20. The exterior image 21 may be a portion of the polygons, voxels, etc. of the host vehicle icon 20 that corresponds to the exterior.

[0031] When an abnormality in an on-vehicle part is detected, the image display unit 13 displays an abnormality display (information display showing provided information) indicating the occurrence of the abnormality superimposed on the vehicle icon so as to correspond to the position of the on-vehicle part where the abnormality occurred in the vehicle. The position of the on-vehicle part where the abnormality occurred in the vehicle means where the actual position of the on-vehicle part where the abnormality occurred is located in the actual vehicle. The abnormality display indicating the occurrence of the abnormality is a display for showing information about the on-vehicle part where the abnormality occurred in the virtual space.

[0032] The abnormality display may include a marking placed at a position in virtual space corresponding to the position of the abnormal on-board part on the vehicle. The marking may be an area image occupying a certain area in virtual space. The area image may be an area whose border is a shape that occupies a certain area on the display 4, such as a circle, ellipse, or polygon. The border of the area image may be filled in, or the border may be transparent or semi-transparent. The marking may be a point or the like placed in virtual space. The marking may include a telltale icon. However, since the type of the abnormal on-board part corresponds to the virtual part position and this virtual part position can be visually identified, the display of the abnormality display makes it easier to intuitively recognize the type of the abnormal on-board part, etc., than displaying only a telltale icon that encompasses the meaning of abnormalities in multiple on-board parts.

[0033] The display color of the marking may be changed depending on the urgency of the abnormality caused by the vehicle component in which the abnormality occurred. The display color of the marking may be red for abnormalities with a certain level of urgency or higher, such as when there is a risk of further damage, such as engine overheating. The display color of the marking may be yellow for abnormalities with a lower level of urgency, such as an ABS system abnormality.

[0034] For example, when an abnormality is detected in an on-board component other than the exterior of the host vehicle, the image display unit 13 erases the exterior image 21 of the host vehicle icon 20, displays the internal structure image 22 on the display 4, and displays the abnormality display superimposed on the internal structure image 22. FIG. 4(a) is a diagram showing a display example in which an abnormality display 23 is superimposed on the host vehicle icon. In FIG. 4(a), the exterior image 21 (see FIG. 2) of the host vehicle icon 20 is erased, and the internal structure image 22 is displayed on the display 4. As shown in FIG. 4(a), when an abnormality is detected in an on-board component other than the exterior of the host vehicle, the abnormality display 23 is superimposed on the internal structure image 22. In the example of FIG. 4(a), the area of ​​the abnormality display 23 is schematically shown as an ellipse with a dashed line.

[0035] An onboard component other than the vehicle's exterior refers to an onboard component whose virtual component position may exist on the internal structure image 22. The virtual component position is the position of the onboard component related to the provided information on the vehicle. The virtual component position is the position of the onboard component on the vehicle icon 20 in virtual space, corresponding to the actual position of the onboard component on the vehicle. Examples of onboard components other than the vehicle's exterior include the engine, battery, ABS system and cruise control system, hydraulic brakes, and airbags. Abnormalities in onboard components other than the vehicle's exterior include engine system abnormalities, low engine oil pressure, low battery charge or poor power generation, overheating of coolant, low tire pressure, abnormalities in the vehicle's ABS system and cruise control system, insufficient brake fluid in the hydraulic brakes, and abnormal airbag conditions. In the example of FIG. 4(a), the abnormality indicator 23 indicates an engine system abnormality and low tire pressure.

[0036] The internal structure image 22 is a three-dimensional icon corresponding to the internal structure of the host vehicle, and is arranged in the virtual space so as to be covered by the exterior image 21 of the host vehicle icon 20. The internal structure image 22 may show various internal structures such as an engine, tires, a battery, an inverter, etc. For example, in response to a pinch-out operation by the user input to the touch panel of the display 4 serving as the user operation reception unit 3, the host vehicle icon 20 is enlarged and the virtual viewpoint 50 approaches the host vehicle icon 20, and when the host vehicle icon 20 enters a predetermined approach area, the image display unit 13 erases the exterior image 21 of the host vehicle icon 20 and displays the internal structure image 22 on the display 4.

[0037] For example, when erasing the exterior image 21 of the host vehicle icon 20 and displaying the internal structure image 22 on the display 4, the image display unit 13 may gradually erase the exterior image 21 of the host vehicle icon 20. When erasing the exterior image 21 of the host vehicle icon 20 and displaying the internal structure image 22 on the display 4, the image display unit 13 may increase the transparency of the tire portion of the internal structure image 22 when, for example, a drop in tire air pressure has not occurred as an abnormality compared to when a drop in tire air pressure has occurred as an abnormality. Similarly, the transparency of on-vehicle parts other than tires may be changed depending on the presence or absence of an abnormality.

[0038] The predetermined approach area is a threshold value of the position of the virtual viewpoint 50 in the virtual space for switching between erasing the exterior image 21 and displaying the internal structure image 22. The predetermined approach area may be, for example, an area within the surface of the host vehicle icon 20 in the virtual space. The predetermined approach area may be, for example, a hemispherical area that encompasses the host vehicle icon 20 in the virtual space. The predetermined approach area may be set in advance and stored in the ECU 10.

[0039] When an abnormality is detected in an on-board component of the exterior of the host vehicle, the image display unit 13 may display the exterior image 21 of the host vehicle icon 20 on the display 4, and may superimpose an abnormality display 24 on the exterior image 21 of the host vehicle icon 20. FIG. 4(b) is a diagram showing another display example in which an abnormality display is superimposed on the host vehicle icon. In FIG. 4(b), the exterior image 21 of the host vehicle icon 20 is displayed on the display 4. As shown in FIG. 4(b), when an abnormality is detected in an on-board component of the exterior of the host vehicle, the abnormality display 24 may be superimposed on the exterior image 21 of the host vehicle icon 20. In the example of FIG. 4(b), the area of ​​the abnormality display 24 is schematically shown as an ellipse with a dashed line.

[0040] An on-board part on the exterior of the host vehicle refers to an on-board part whose virtual part position may exist on the exterior image 21. Examples of on-board parts on the exterior of the host vehicle include tires, lights, doors, etc. Abnormalities in on-board parts other than the exterior of the host vehicle include low tire pressure, abnormal lights, and an open door. In the example of FIG. 4(b), an abnormality in the left brake light is displayed as the abnormality indicator 24. Note that the tire is an on-board part whose virtual part position may exist on the internal structure image 22, and is also an on-board part whose virtual part position may exist on the exterior image 21. Therefore, the tire may be treated as an on-board part other than the exterior of the host vehicle, or as an on-board part on the exterior of the host vehicle.

[0041] When an abnormality in an on-vehicle part is detected, the image display unit 13 may superimpose an abnormality indicator indicating the occurrence of the abnormality on the vehicle icon so as to correspond to the position of the on-vehicle part where the abnormality occurred on the vehicle, and may also display a button for displaying detailed information about the on-vehicle part where the abnormality occurred. For example, the image display unit 13 may display detailed information about the on-vehicle part where the abnormality occurred when the user touches the button.

[0042] When an abnormality is detected in an on-board component on the exterior of the vehicle, and the virtual component position of the on-board component where the abnormality has occurred (e.g., the left brake light) is not included in the range displayed on the display 4 (see FIG. 5(a)), the image display unit 13 may move the virtual viewpoint 50 so that the virtual component position is included in the range displayed on the display 4 (see FIG. 5(b)). This movement of the virtual viewpoint 50 may be performed when permitted in advance by a setting made by the user, or may be performed when the movement of the virtual viewpoint 50 is proposed to the user and the user's consent is obtained.

[0043] Next, an example of the processing of the ECU 10 of the vehicle information display device 100 will be described with reference to the drawings. Fig. 6 is a flowchart showing an example of the processing of the ECU in Fig. 1.

[0044] 6, in S11, the ECU 10 of the vehicle information display device 100 detects the occurrence of an abnormality in an on-board component of the host vehicle by the abnormality detection unit 11. The ECU 10 detects the occurrence of an abnormality in an on-board component related to a telltale, which is a warning light specified by regulations, by using, for example, a known method.

[0045] In S12, the ECU 10 determines whether an abnormality has occurred in an on-board component on the exterior of the vehicle using the image display unit 13. If the ECU 10 determines that the on-board component in which the abnormality has occurred is a predetermined on-board component whose virtual component position may exist on the exterior image 21 (S12: YES), the ECU 10 proceeds to S13. If the ECU 10 determines that the on-board component in which the abnormality has occurred is a predetermined on-board component whose virtual component position may exist on the internal structure image 22 (S12: NO), the ECU 10 proceeds to S14.

[0046] In S13, the ECU 10 causes the image display unit 13 to perform a screen display in which the abnormality display 24 is superimposed on the exterior image 21 of the host vehicle icon 20. The ECU 10 displays the exterior image 21 of the host vehicle icon 20 on the display 4, and displays the abnormality display 24 superimposed on the exterior image 21 of the host vehicle icon 20. Thereafter, the current processing ends.

[0047] In S14, the ECU 10 causes the image display unit 13 to perform a screen display in which the abnormality display 23 is superimposed on the internal structure image 22. The ECU 10 erases the exterior image 21 of the host vehicle icon 20, displays the internal structure image 22 on the display 4, and displays the abnormality display 23 superimposed on the internal structure image 22. The ECU 10 may erase the exterior image 21 of the host vehicle icon 20 in response to a pinch-out operation input by the user to the touch panel of the display 4. Thereafter, the current processing ends.

[0048] According to the vehicle information display device 100 described above, an image showing the surrounding environment of the host vehicle is displayed on the display 4 together with the host vehicle icon 20 corresponding to the host vehicle, based on information detected by an external sensor of the host vehicle. When an abnormality is detected, abnormality indicators 23, 24 indicating the occurrence of the abnormality are displayed superimposed on the host vehicle icon 20 so as to correspond to the position on the host vehicle of the on-vehicle part where the abnormality has occurred. This allows the user to intuitively recognize the on-vehicle part of the host vehicle related to the provided information, compared to, for example, lighting only the telltale warning light specified by regulations, or displaying the meaning of the telltale warning light in specific text.

[0049] Furthermore, by displaying abnormality indicators 23, 24 indicating the occurrence of an abnormality superimposed on the vehicle icon 20, the user can visually recognize the position of the virtual part on the vehicle icon 20. By visually recognizing the virtual part position of the vehicle part where an abnormality has occurred, the user can intuitively recognize the type of vehicle part where an abnormality has occurred, compared to, for example, when viewing only the telltale.

[0050] In the vehicle information display device 100, the image display unit 13 generates a virtual space corresponding to the surrounding environment of the host vehicle based on detection information from external sensors, and displays an image of the virtual space as seen from a virtual viewpoint 50 operated by the user of the host vehicle on the display 4. The host vehicle icon 20 is a three-dimensional icon corresponding to the host vehicle placed in the virtual space. As a result, abnormality indicators 23, 24 are displayed superimposed on the three-dimensional host vehicle icon 20, allowing the user to more intuitively recognize an on-board part of the host vehicle in which an abnormality has occurred.

[0051] In the vehicle information display device 100, when an abnormality is detected in an on-board component other than the exterior of the vehicle, the image display unit 13 erases the exterior image 21 of the vehicle icon 20, displays an internal structure image 22 corresponding to the internal structure of the vehicle on the display 4, and displays an abnormality display 23 superimposed on the internal structure image 22. This allows the user to easily recognize which on-board component in the internal structure of the vehicle has the abnormality.

[0052] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. The present invention can be embodied in various forms, including the above-described embodiments, with various modifications and improvements made based on the knowledge of those skilled in the art.

[0053] In the above embodiment, when an abnormality is detected in an on-board part other than the exterior of the host vehicle, the image display unit 13 erases the exterior image 21 of the host vehicle icon 20 and displays on the display 4 an internal structure image 22 corresponding to the internal structure of the host vehicle, and displays the abnormality display 23 superimposed on the internal structure image 22, but this function is not essential. The image display unit 13 may also display the abnormality display 23 superimposed on the exterior image 21 of the host vehicle icon 20, even when an abnormality is detected in an on-board part other than the exterior of the host vehicle.

[0054] In the above embodiment, the vehicle information display device 100 includes the virtual space generation unit 12 that generates a virtual space corresponding to the surrounding environment of the host vehicle based on detection information from an external sensor, but the virtual space generation unit 12 is not essential. The host vehicle icon may be a 2D image of the host vehicle displayed in a planar view on the display 4. Even in this case, when an abnormality is detected in an on-board component other than the exterior of the host vehicle, the image display unit 13 may erase the exterior image of the host vehicle icon in a planar view and display an internal structure image in a planar view corresponding to the internal structure of the host vehicle on the display 4, and display the abnormality indication superimposed on the internal structure image in a planar view.

[0055] In the above embodiment, the abnormality detection unit 11 that detects (acquires) the occurrence of an abnormality in an on-board component of the host vehicle is shown as an example of the provided information acquisition unit, but the present invention is not limited to this example. For example, the provided information about the on-board component of the host vehicle may be maintenance information for the on-board component that is acquired under predetermined conditions and provided to the user. Examples of maintenance information include a recommendation for an engine oil change conditional on the passage of time or mileage, and a recommendation for tire air refill conditional on the passage of time. Even when the provided information is maintenance information, as in the above embodiment, the user can visually recognize the virtual component position of the on-board component related to the provided information, thereby achieving the same advantageous effects as the above embodiment. [Explanation of symbols]

[0056] 1...External camera (external sensor), 2...Radar sensor (external sensor), 3...User operation reception unit, 4...Display, 10...ECU, 11...Abnormality detection unit (provided information acquisition unit), 12...Virtual space generation unit, 13...Image display unit, 20...Own vehicle icon, 21...Exterior image, 22...Internal structure image, 23, 24...Abnormality display, 50...Virtual viewpoint, 100...Vehicle information display device.

Claims

1. An information display device for a vehicle that displays an image representing a surrounding environment of a vehicle on a display based on detection information from an external sensor of the vehicle, a provision information acquisition unit that acquires provision information that is information about the on-board parts of the vehicle to be provided to a user of the vehicle; an image display unit that displays a host vehicle icon corresponding to the host vehicle on the display; When the provided information is acquired, the image display unit displays an information display representing the provided information superimposed on the vehicle icon so as to correspond to the position of the on-board part related to the provided information in the vehicle.

2. a virtual space generation unit that generates a virtual space corresponding to a surrounding environment of the host vehicle based on the detection information of the external sensor; the image display unit displays, on the display, an image of the virtual space seen from a virtual viewpoint operated by a user of the host vehicle; The vehicle information display device according to claim 1 , wherein the host vehicle icon is a three-dimensional icon that corresponds to the host vehicle and is arranged in the virtual space.

3. 3. The vehicle information display device according to claim 1, wherein when the provided information about the onboard parts other than the exterior of the vehicle is acquired, the image display unit erases the exterior image of the vehicle icon and displays an internal structure image corresponding to the internal structure of the vehicle on the display, and displays the information provided display superimposed on the internal structure image.

Images