Vehicle display device, display control method, and storage medium

Abstract

A vehicle display device, a display control method, and a storage medium that can efficiently display each item image. The vehicle display device includes a display control unit that causes a display unit to perform the following processing: the display unit visually recognizes an image overlapping with the scenery outside the vehicle; based on first information, causes a first display area to display a first item image; and based on second information, causes a second display area to display a second item image. When the display control unit simultaneously displays the first item image and the second item image on the display unit, it changes the display mode of the first item image based on the content of the second information.

Description

Technical Field

[0001] The present invention relates to a vehicle display device, a display control method, and a storage medium. Background Art

[0002] In recent years, vehicles equipped with a head-up display have been becoming popular. The head-up display displays entry images related to driving, entry images not related to driving, and the like. Various entry images to be displayed change appropriately according to the situation. Therefore, sometimes another entry image is inserted into the entry image being displayed.

[0003] As a related technique, there is disclosed a technique in which when an insertion process occurs in a second screen where an operation related to the insertion process is performed, if it is a user operation on the first screen, the operation input is waited for on the first screen, and if it is not the operation, the operation input is waited for on the second screen (for example, refer to Japanese Unexamined Patent Application Publication No. 2016-103171). Summary of the Invention

[0004] However, in the conventional technology, in the case of displaying a plurality of entry images, it is sometimes impossible to display each entry image efficiently.

[0005] The solution of the present invention has been completed in consideration of such a situation, and one of its purposes is to provide a vehicle display device, a display control method, and a storage medium capable of efficiently displaying each entry image.

[0006] In order to solve the above problems and achieve related purposes, the present invention adopts the following solutions.

[0007] (1): One aspect of the present invention relates to a vehicle display device, wherein the vehicle display device includes a display control unit that causes a display unit to perform the following processing, and the display unit visually recognizes an image overlapping with the scenery outside the vehicle: based on first information, causing a first display area to display a first entry image; and based on second information, causing a second display area to display a second entry image, and when the display control unit causes the first entry image and the second entry image to be simultaneously displayed on the display unit, changing the display mode of the first entry image based on the content of the second information.

[0008] (2): Based on the solution in the above (1), it may also be that the second entry image includes a prompting image that requests a user to input and a result display image that represents the result of the user input, and when the display control unit causes the prompting image to be displayed on the display unit, the first entry image is not displayed, and when the display control unit causes the result display image to be displayed on the display unit, the first entry image is displayed on the display unit.

[0009] (3): On the basis of the solution in (2) above, it may also be that the vehicle display device is provided with an input control unit that accepts input from the user, and the input control unit does not accept input from the user to the urging image within a specified time from the start of the urging image.

[0010] (4): On the basis of the solution in (2) or (3) above, it may also be that the vehicle display device is provided with an input control unit that accepts input from the user, the first item image includes a selection item image that the user can select, and regardless of whether the result display image has been displayed on the display unit, the input control unit continues to accept operations on the selection item image.

[0011] (5): On the basis of the solution in (4) above, it may also be that when the display control unit displays the result display image and the selection item image on the display unit, at least a part of the selection item image and the result display image is displayed overlappingly.

[0012] (6): On the basis of the solution in (5) above, it may also be that regardless of whether the display unit displays the part overlappingly, the input control unit accepts operations on the selection item image of the overlapping part, and when the selection item image accepted by the input control unit and the result display image are displayed overlappingly, the display control unit makes the selection item image and the result display image not display overlappingly.

[0013] (7): On the basis of any one of the solutions in (4) to (6) above, it may also be that when the display control unit accepts an operation on the selection item image when displaying the result display image on the display unit, the display of the result display image ends earlier than usual.

[0014] (8): On the basis of the solution in (5) above, it may also be that when the display unit displays the part overlappingly, the input control unit does not accept operations on the selection item image of the overlapping part.

[0015] (9): On the basis of any one of the solutions in (1) to (8) above, it may also be that when the display control unit displays a detection image indicating the situation of another vehicle approaching the vehicle on the display unit, the display mode of the second item image is changed.

[0016] (10): On the basis of the solution in (9) above, it may also be that the display control unit makes the second item image display in a reduced size.

[0017] (11): Based on any of the above solutions (1) to (10), it may also be that when the display control unit causes a detection image indicating a situation of another vehicle approaching the own vehicle to be displayed on the display unit, the first entry image is made non-displayed.

[0018] (12): Based on the solution of the above (11), it may also be that the display control unit makes the second entry image non-displayed.

[0019] (13): One solution of the present invention relates to a display control method which is a display control method performed using a computer mounted on a vehicle. In the display control method, the display unit performs the following processing: the display unit visually recognizes an image overlapping with the scenery outside the vehicle; based on first information, a first display area displays a first entry image; based on second information, a second display area displays a second entry image; and when the first entry image and the second entry image are simultaneously displayed on the display unit, based on the content of the second information, the display mode of the first entry image is changed.

[0020] (14): One solution of the present invention relates to a storage medium which stores a program. The program is used to cause a computer mounted on a vehicle to perform processing so that the display unit performs the following processing: the display unit visually recognizes an image overlapping with the scenery outside the vehicle; based on first information, a first display area displays a first entry image; based on second information, a second display area displays a second entry image; and when the first entry image and the second entry image are simultaneously displayed on the display unit, based on the content of the second information, the display mode of the first entry image is changed.

[0021] According to (1) to (14), each entry image can be displayed efficiently. Description of the Drawings

[0022] Figure 1 It is a diagram illustrating the structure inside the vehicle compartment of the vehicle M equipped with the display device 100 of the embodiment.

[0023] Figure 2 It is a diagram showing a structural example of the display device 100.

[0024] Figure 3 It is a diagram showing an example of the entry image and the display area displayed in the displayable area A1.

[0025] Figure 4 It is a diagram showing a display example of the first entry image.

[0026] Figure 5 It is a diagram showing a specific example of the list image 406.

[0027] Figure 6 It is a diagram showing a display example of the second item image.

[0028] Figure 7 It is a diagram showing a display example of the item image displayed in the displayable area A1.

[0029] Figure 8 It is a diagram showing a display example of the item image displayed in the displayable area A1.

[0030] Figure 9 It is a diagram showing a display example of the item image displayed in the displayable area A1.

[0031] Figure 10 It is a diagram showing a display example of the item image displayed in the displayable area A1.

[0032] Figure 11 It is a diagram showing a display example of the item image displayed in the displayable area A1.

[0033] Figure 12 It is a flowchart showing an example of the processing in the display of the list image 406 performed by the display control device 150.

[0034] Figure 13 It is a flowchart showing an example of the processing in the display of the list image 406 performed by the display control device 150.

[0035] Figure 14 It is a flowchart showing Modification Example 1 of the processing in the list display performed by the display control device 150.

[0036] Figure 15 It is a diagram showing a display example of the item image related to Modification Example 2. Detailed implementation mode

[0037] Hereinafter, embodiments of a vehicle display device, a display control method, and a storage medium according to the present invention will be described with reference to the accompanying drawings. The vehicle display device controls, for example, a display device (an example of a "display unit") mounted on a vehicle (hereinafter referred to as vehicle M) that overlays an image with a landscape for visual recognition. The display device can be referred to as a HUD (Head Up Display) device. As an example, the display device is a device that projects light including an image onto the front windshield of vehicle M to enable a viewer to visually recognize a virtual image. The viewer is, for example, a driver, but can also be a passenger other than the driver. The display device can also be implemented by a light-transmissive display device (such as a liquid crystal display, an organic EL (Electroluminescence)) mounted on the front windshield of vehicle M, or by projecting light onto a transparent member (such as a visor or a lens of glasses) of a device worn on a person's body. The display device can also be formed by mounting a light-transmissive display device on a device. In the following description, the display device is a device mounted on vehicle M that projects light including an image onto the front windshield.

[0038] [Overall Structure]

[0039] Figure 1 FIG. is an illustration of the structure inside the passenger compartment of vehicle M equipped with the display device 100 of the embodiment. In vehicle M, for example, a steering wheel 10 for controlling the steering of vehicle M, a front windshield (an example of a reflector) 20 that separates the outside from the inside of the passenger compartment, and an instrument panel 30 are provided. The front windshield 20 is a light-transmissive member. The display device 100 projects light including an image (light projection) onto a displayable area A1 provided on a part of the front windshield 20 in front of the driver's seat 40, for example, so that the driver sitting on the driver's seat 40 can visually recognize a virtual image VI. In the following description, the virtual image may sometimes be referred to as an "image".

[0040] The display device 100 enables, for example, an image (including information for supporting the driving of the driver and information related to a specified event) to be visually recognized by the driver as a virtual image IV. Among the information for supporting the driving of the driver, for example, information such as the speed of vehicle M, the driving force distribution ratio, the engine speed, the operating state of the driving support function, the gear position, the sign recognition result, and the intersection position can be included. The driving support function is, for example, a direction indication function, ACC (Adaptive Cruise Contr01), LKAS (Lane Keep Assist System), CMBS (Collision Mitigation Brake System), a traffic congestion assistance function, etc.

[0041] In vehicle M, in addition to the display device 100, a first display unit 50-1 and a second display unit 50-2 may also be provided. The first display unit 50-1 is, for example, a display device that is provided near the front of the driver's seat 40 in the instrument panel 30 and that can be visually recognized by the driver through the gap in the steering wheel 10 or through the steering wheel 10. The second display unit 50-2 is, for example, mounted on the central portion of the instrument panel 30. The second display unit 50-2 displays, for example, an image corresponding to navigation processing performed by a navigation device (not shown) mounted on the vehicle M, or an image of the other party in a video phone. The second display unit 50-2 may also display items such as a TV program, play a DVD, or display a downloaded movie.

[0042] An operation switch 130 is provided in the vehicle M. The operation switch 130 receives an instruction to switch between opening and closing the display performed by the display device 100 and an instruction to adjust the position of the virtual image VI. The operation switch 130 is, for example, mounted at a position where a driver sitting in the driver's seat 40 can operate it without significantly changing the body posture. The operation switch 130 may be provided, for example, in front of the first display unit 50-1, or may be provided on the hub portion of the steering wheel 10. The operation switch 130 may also be provided on the spoke connecting the steering wheel 10 and the instrument panel 30.

[0043] [Structure of Display Device 100]

[0044] Figure 2 is a diagram showing an example of the structure of the display device 100. As Figure 2 shown, the display device 100 includes a lens position sensor 170, a concave mirror angle sensor 172, an environment sensor 174, an optical system controller 176, a display controller 178, a lens actuator 180, a concave mirror actuator 182, and a light projection device 120.

[0045] The lens position sensor 170 detects the position of one or more lenses included in an optical mechanism that adjusts the distance from a specified position to the position where light forms a virtual image. The concave mirror angle sensor 172 detects the rotation angle of the concave mirror. The environment sensor 174 detects, for example, the temperature of the light projection device 120 and the optical mechanism. The environment sensor 174 may also detect the illuminance around the vehicle M, detect the speed and steering angle of the vehicle M, and detect objects (such as other vehicles, pedestrians, and other obstacles) present in the vicinity.

[0046] Based on the control signal output by the drive control unit 158, the optical system controller 176 drives the lens actuator 180 to adjust the virtual image visual recognition distance. Based on the control signal output by the drive control unit 158, the optical system controller 176 drives the concave mirror actuator 182 to adjust the rotation angle of the concave mirror.

[0047] The display controller 178 controls the content and display mode of the image output by the light projection device 120. The display mode of the image is, for example, brightness, display position, size, etc.

[0048] The lens actuator 180 obtains a drive signal from the optical system controller 176, and based on the obtained drive signal, drives a motor or the like to move the position of one or more lenses included in the optical mechanism. Thereby, the virtual image visual recognition distance is adjusted.

[0049] The concave mirror actuator 182 obtains a drive signal from the optical system controller 176, and based on the obtained drive signal, drives a motor or the like to rotate the concave mirror actuator 182, thereby adjusting the reflection angle of the concave mirror.

[0050] The vehicle control device 200 controls the vehicle M or obtains the detection results of various sensors mounted on the vehicle M. For example, the vehicle control device 200 executes a driving support function for supporting the driver of the vehicle M. When executing the driving support function, for example, the vehicle M controls one or both of the steering control and the speed control without relying on the driver's operation of the driving operation members (such as the steering wheel 10, the accelerator pedal, and the brake pedal). For example, when the vehicle control device 200 executes ACC as a driving support function, based on the information input via an object recognition device (not shown) mounted on the vehicle M, it performs acceleration / deceleration control (speed control) based on the inter-vehicle distance from the preceding vehicle so that the vehicle M travels while maintaining a constant inter-vehicle distance from the preceding vehicle. When the vehicle control device 200 executes LKAS as a driving support function, it performs steering control so that the vehicle M travels while maintaining the current driving lane (lane keeping). When the vehicle control device 200 executes CMBS as a driving support function, when the inter-vehicle distance from the preceding vehicle is less than a specified distance, it performs deceleration control or stop control of the vehicle M. The vehicle control device 200 outputs, for example, the state of the driving support function to the display control device 150. Before executing LKAS and CMBS, the vehicle control device 200 outputs information (warning information) for warning the driver to the display control device 150. The warning information is, for example, a lane departure alarm, a preceding vehicle approach alarm, etc.

[0051] The display control device 150 includes, for example, a display control unit 152, an input control unit 154, a drive control unit 158, and a storage unit 160. Each of these components is implemented, for example, by a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components can be implemented by hardware (including circuitry such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit)), or can be implemented through the cooperation of software and hardware. The program can be pre-stored in a storage device (not shown) such as the HDD or flash memory of the display control device 150, or can be stored in a removable storage medium such as a DVD or CD-ROM, and loaded into the HDD or flash memory of the display control device 150 by attaching the storage medium to a drive device.

[0052] The storage unit 160 is implemented by a storage device such as RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), or flash memory, for example.

[0053] [Control of Display for HUD Device]

[0054] Next, the control of the display for the HUD device (display device 100) will be described. First, the display control unit 152 and the input control unit 154 will be described. Figures 3 to 6 The display control unit 152 and the input control unit 154 will be described. Figure 3 FIG. is an example of an item image and a display area displayed in the displayable area A1. The display control unit 152 causes the first display area 300 of the displayable area A1 of the HUD (Head-Up Display) device to display the first item image based on the first information. The first information is, for example, information related to driving, information related to the selection of a call object, radio channel, etc. The first item image is an image related to driving displayed based on information related to driving, or an image related to selection displayed based on information related to selection.

[0055] The display control unit 152 causes the second display area 302 of the displayable area A1 of the HUD device to display a second entry image based on the second information. The second information includes information that requests the user to input and information that represents the result of the user's input. The second entry image is, for example, an image that requests the user to input such as whether to respond to an incoming call, or an image that represents the result of the user's input such as the radio channel selected by the user. In the present embodiment, the "user" is the driver. However, the "user" may also include passengers other than the driver.

[0056] The display control unit 152 is capable of causing the second display area 302 to display a first entry image. On the other hand, the display control unit 152 does not cause the first display area 300 to display a second entry image. The second entry image is displayed by cutting in front of the first entry image. The display control device 150 can communicate and connect with a mobile phone and a smart phone through short-range wireless communication, obtain information indicating an incoming call when there is an incoming call, and obtain phone book information when making a call.

[0057] In Figure 3 the shown displayable area A1, the first display area 300 is the area below the second display area 302 in the figure, but is not limited thereto, and may also be the area above the second display area 302 in the figure. The first display area 300 and the second display area 302 are divided vertically in the figure, but are not limited thereto, and may also be divided horizontally in the figure. In Figure 3 , the first display area 300 is set as a display area larger than the second display area 302, and is capable of simultaneously displaying a plurality of first entry images, and even when a plurality of first entry images are simultaneously displayed, good visual recognition can be ensured. The first display area may also be smaller than the second display area 302, or may be the same size as the second display area 302.

[0058] [Display Example of Entry Image]

[0059] Hereinafter, Figures 4 to 6 is used to explain the display examples of the first entry image and the second entry image. Figure 4 is a diagram showing a display example of the first entry image. As Figure 4 shown, the first entry image includes an advanced driver assistance system image 400, a navigation image 402, a speed image 404, and a list image 406.

[0060] The advanced driving assistance system image 400 is an image for display, warning, and driving support according to the surrounding conditions. The navigation image 402 is an image representing the route guidance from the current position to the destination. The speed image 404 is an image representing the speed limit of the road during driving. The list image 406 is an example of a selection item image and is an image representing the selection items that the user can select. Specifically, the list image 406 is an image for the user to accept one selection item from multiple selection items. Each image as the first entry image displayed in the first display area 300 can be switched by the user's operation.

[0061] Figure 5 It is a diagram showing a specific example of the list image 406. In Figure 5 it, the types 500 of selection items include phone book, radio channel, music, destination, etc. When the phone book is selected from the type 500, the list image 406a of the phone book is displayed in the first display area 300. For example, when the destination is selected from the type 500, the list image 406b of the destination is displayed in the first display area 300.

[0062] Both the list image 406a of the phone book and the list image 406b of the destination are displayed in 4 lines. When a scrolling operation for displaying the 5th line and subsequent lines (not shown) is received, the 5th line and subsequent lines can be displayed. When, for example, "FM" is selected from the type 500, although not shown, a list of 4 lines of FM radio channels is displayed in the first display area 300.

[0063] In Figure 5 it, in the first display area 300, the speed image 404 is displayed on the right side of the list image 406a of the phone book and the list image 406b of the destination. In this way, multiple first entry images can be displayed in the first display area 300.

[0064] Figure 6 It is a diagram showing a display example of the second entry image. As Figure 6 shown, the second entry image is classified into a prompting image 600 and a result display image 610. The prompting image 600 is an image that requests the user to make an input. As a specific example, the prompting image 600 includes a voice input image 602 and an incoming call image 604.

[0065] The voice input image 602 is an image representing that voice input is being received. During the display of the voice input image 602, the voice emitted by the user can be recognized for various setting changes, various registrations, etc. The voice input image 602 becomes non-displayed when various setting changes and various registrations are completed. That is, the end condition of the voice input image 602 is that various setting changes and various registrations are completed.

[0066] The incoming call image 604 is an image representing an incoming call on a mobile phone or a smartphone. When the incoming call image 604 is displayed, a call can be made or the call can be rejected according to a specified operation received by the operation switch 130. After receiving a call start or a call rejection, the incoming call image 604 becomes non-displayed. That is, the end condition of the incoming call image 604 is to receive an operation of call start or call rejection. However, the incoming call image 604 can also be directly displayed until the call is completed when the call has started. The incoming call image 604 can also display only specific information such as the call time when the call has started. The incoming call image 604 can also change the display method for display when the call has started, that is, for example, display it as an icon image.

[0067] The result display image 610 is an image representing the result input by the user. As a specific example, the result display image 610 includes a volume image 612, a channel image 614, and a song name image 616. The volume image 612 is an image representing the changed volume when the user changes the volume. The channel image 614 is an image representing the changed channel when the user changes the radio channel. The song name image 616 is an image representing the changed song name when the user changes the song. The input made by the user includes voice input and operation input. The result display image 610 becomes non-displayed after a specified notification time (for example, 5 seconds).

[0068] When the display control unit 152 displays the first entry image and the second entry image on the HUD device at the same time, it changes the display method of the first entry image based on the content of the second information. Specifically, the display control unit 152 reduces the display area of the first entry image or makes it non-displayed based on the content of the second information.

[0069] Making the first entry image non-displayed means that as long as the user cannot visually recognize the display of the first entry image. Specifically, making the first entry image non-displayed means making the second entry image overlap with the first entry image so that the first entry image cannot be visually recognized, or not displaying the first entry image originally.

[0070] [Display example of the entry image displayed in the displayable area A1]

[0071] Here, use Figures 7 to 11 to illustrate the display example of the entry image displayed in the displayable area A1. Figures 7 to 11 It is a diagram showing the display example of the entry image displayed in the displayable area A1.

[0072] As Figure 7As shown in (A), a navigation image 402 and a speed image 404 are displayed in a first display area 300 of a displayable area A1. An advanced driver assistance system image 400 is displayed in a second display area 302. In Figure 7 a call is assumed to occur in the screen shown in (A). In this case, it transfers to Figure 7 the screen shown in (B) of

[0073] As Figure 7 shown in (B), in the second display area 302 of the displayable area A1, a call image 604 is overlapped and displayed on top of the advanced driver assistance system image 400. The call image 604 becomes non-displayed after receiving a call start or a call rejection. Thus, the user can grasp the occurrence of a call while looking ahead.

[0074] [Regarding the display or non-display of the first item image]

[0075] Here, a display control unit 152 causes the first item image to be displayed or non-displayed according to the content of the second information. Specifically, the display control unit 152 causes the first item image to be non-displayed or causes the first item image to be displayed according to whether the second item image is a prompt image 600 or a result display image 610.

[0076] First, the case of causing the first item image to be non-displayed will be described. The display control unit 152 causes the first item image to be non-displayed when causing the prompt image 600 to be displayed. Regarding this, Figure 8 will be specifically described using Figure 8 As shown in (A), in a first display area 300 of a displayable area A1, for example, a list image 406 and a speed image 404 are displayed. In a second display area 302, an advanced driver assistance system image 400 is displayed. In Figure 8 a call is assumed to occur in the screen shown in (A). In this case, it transfers to Figure 8 the screen shown in (B) of

[0077] As Figure 8 shown in (B), in the second display area 302 of the displayable area A1, a call image 604 is overlapped and displayed on top of the image of the advanced driver assistance system image 400. The list image 406 in the first display area 300 is eliminated. In this way, the display control unit 152 eliminates the list image 406 with a low possibility of being selected by the user when a call occurs. Therefore, the content notified to the user can be made clear.

[0078] As Figure 8As shown in (B) thereof, the display control unit 152 causes the speed image 404 to continue to be displayed in the first display area 300. That is, when the first entry image other than the list image 406 is displayed in the first display area 300 and the urging image 600 (call incoming image 604) is displayed in the second display area 302, the display control unit 152 does not eliminate the first entry image. Thus, even when the urging image 600 (call incoming image 604) is displayed, the user can confirm the speed. However, when the urging image 600 is displayed in the second display area 302, the first entry image other than the list image 406 may also be eliminated.

[0079] The input control unit 154 accepts an input from the user for the urging image 600 (call incoming image 604 in the drawing). The input control unit 154 accepts the input using, for example, the operation switch 130. The input control unit 154 may also accept the input from the user through voice input.

[0080] [Regarding the start of an unexpected call by the user]

[0081] Here, it is assumed that a call comes in while the user is selecting a selection item from the Figure 8 list image 406 in (A). More specifically, it is assumed that when an operation to select one selection item is to be performed from the Figure 8 list image 406 shown in (A), Figure 8 the call incoming image 604 in (B) is displayed and the operation switch 130 receives a prescribed operation. In this case, the call may unexpectedly start.

[0082] For this reason, the input control unit 154 does not accept an input from the user for the urging image 600 during the period from when the urging image 600 starts to a prescribed waiting time elapses. The waiting time is, for example, 0.1 to 0.5 seconds and can be set to any time. Thus, even when a call comes in while the user is selecting a selection item from the list image 406, an unexpected start of the call can be suppressed.

[0083] When a call comes in while the user has not selected a selection item from the list image 406, the possibility of an unexpected start of the call by the user is low. Therefore, in this case, the input control unit 154 may accept an input from the user for the urging image 600 without waiting for a prescribed waiting time to elapse.

[0084] [Regarding the case where the first entry image is displayed]

[0085] Next, the case where the first entry image is displayed will be described. The display control unit 152 causes the first entry image to be displayed when causing the result display image 610 to be displayed. Regarding this, Figure 9For specific illustration. Figure 9 (A) of Figure 8 is the same screen as (A) of Figure 9 Assume that during the display of the screen shown in (A) of Figure 9 the radio channel is changed. In this case, it transfers to the screen shown in (B) of

[0086] As Figure 9 shown in (B) of

[0087] As Figure 9 shown in (B) of

[0088] [Regarding the selection operation on the list image 406]

[0089] Here, the input control unit 154 accepts the operation (selection operation) of the user on the list image 406 in the list image 406. The input control unit 154 continues to accept the selection operation on the list image 406 regardless of whether the result display image 610 is displayed. Regarding this, use Figure 10 for specific illustration.

[0090] As Figure 10 shown in (A) of

[0091] [Display Regarding Overlap of List Image 406 and Result Display Image 610]

[0092] Here, when the display control unit 152 causes the result display image 610 and the list image 406 to be displayed on the HUD device, the list image 406 and at least a part of the result display image 610 are displayed overlappingly. For a specific description of this, as shown in Figure 10 (A) of, it is shown that the image of the uppermost selection item (hereinafter referred to as "specific selection item 1002".) among the plurality of selection items shown in the list image 406 is overlapped and displayed by the channel image 614, whereby the visual recognition of a part is reduced and displayed. On the other hand, regarding the result display image 610, it is possible to clearly notify the user.

[0093] The input control unit 154 accepts a selection operation on the list image 406 regardless of whether the image of the list image 406 and the result display image 610 are partially overlapped. Therefore, as shown in Figure 10 (B) of, the user sometimes selects the specific selection item 1002. That is, according to the operation of the user, the cursor 1000 sometimes indicates the specific selection item 1002. In this case, the user cannot visually recognize a part of the specific selection item 1002 and it is difficult to grasp the specific selection item 1002.

[0094] For this reason, as shown in Figure 10 (C) of, when the display control unit 152 receives a selection operation of the specific selection item 1002, the specific selection item 1002 is displayed in a manner that does not overlap with the result display image 610. In the illustration, a case where the selection item is moved down by one segment is shown. After moving the specific selection item 1002 to a position where it does not overlap with the result display image 610, a determination operation for determining the specific selection item 1002 can be accepted.

[0095] [Control Regarding Display Period of Result Display Image 610]

[0096] When the display control unit 152 displays the result display image 610 and the input control unit 154 receives an operation on the list image 406, the display of the result display image 610 ends earlier than usual. For example, usually, the display period of the result display image 610 is 5 seconds. On the other hand, when a selection operation on the list image 406 is received, the display period of the result display image 610 is, for example, 3 seconds. Here, the period for detecting whether there is a selection operation on the needle list image 406 is, for example, the period from several seconds before the start of the display of the result display image 610 to the end of the display of the result display image 610. That is, even when the timing of receiving the selection operation is before the display of the result display image 610, the display control unit 152 sometimes ends the display of the result display image 610 earlier than usual.

[0097] [Display control when another vehicle approaches]

[0098] The display control unit 152 can display a vehicle detection image indicating that another vehicle approaching the vehicle M has been detected. The other vehicle is a vehicle that may cause a head-on collision accident with the vehicle M at an intersection with poor predictability. A camera is provided at the corner of the front part of the vehicle M, and the detection result of this camera can be used to detect other vehicles. The display control unit 152 uses the detection result of the other vehicle obtained from the vehicle control device 200 to display the vehicle detection image. Use Figure 11 The display example of the vehicle detection image in (A) is described.

[0099] As Figure 11 shown in (A) of, a vehicle detection image 1100 is displayed in the displayable area A1. The vehicle detection image 1100 includes a vehicle detection image 1100a indicating that a vehicle is approaching from the right side, and a vehicle detection image 1100b indicating that a vehicle is approaching from the left side. It is assumed that Figure 11 a call comes in on the screen shown in (A) of. In this case, the display control unit 152 changes the display mode of the second entry image. That is, when the vehicle detection image 1100 and the second entry image are simultaneously displayed on the HUD device, the display control unit 152 changes the display mode of the second entry image.

[0100] For example, the display control unit 152 displays the second entry image in a reduced size. Specifically, for example, as Figure 11 shown in (B) of, the display control unit 152 causes the second display area 302 of the displayable area A1 to display a call icon image 1110 indicating a call. In this way, when the vehicle detection image 1100 is displayed, the display mode of the second entry image is changed, so that when another vehicle approaches, the driver can focus on driving. In Figure 11In (B), an example in which the second item image is set as the incoming call image 604 of the urging image 600 is described, but the same is true when the second item image is the result display image 610. That is, the result display image 610 is also displayed by an icon image when it is displayed simultaneously with the vehicle detection image 1100.

[0101] exist Figure 11 In the screen shown in (B) of FIG. 1 , after the operation switch 130 receives a predetermined operation as an operation to cancel the reduction of the incoming call icon image 1110, as shown in FIG. Figure 11 As shown in (C), the incoming call image 604 is displayed in a normal display mode. Figure 11 In the state of the incoming call icon image 1110 of (B), it is possible to select to start the call or reject the call. Figure 11 Only when the incoming call icon 604 of (C) is displayed can the user select to start the call or reject the call.

[0102] [Processing of Displaying List Image 406 by Display Control Device 150]

[0103] Figure 12 and Figure 13 FIG. 4 is a flowchart showing an example of processing performed by the display control device 150 in displaying the list image 406. Figure 12 , the display control unit 152 determines whether to start displaying the list image 406 on the HUD device (step S1201). The display control unit 152 waits until the display of the list image 406 starts, and when the display of the list image 406 starts, the display control unit 152 determines whether to start displaying the second item image on the HUD device (step S1202).

[0104] When the display of the second entry image begins, the display control unit 152 determines whether the second entry image is the urging image 600 (step S1203). If the second entry image is the urging image 600, the display control unit 152 deletes the list image 406 (step S1204). Then, the display control unit 152 determines whether the vehicle detection image 1100 is being displayed (step S1205). If the vehicle detection image 1100 is not being displayed, the display control unit 152 displays the urging image 600 in a normal display mode (step S1206), and proceeds to step S1208.

[0105] On the other hand, in step S1205, when the vehicle detection image 1100 is being displayed, the urging image 600 is displayed in reduced size (step S1207). Then, the input control unit 154 determines whether a predetermined waiting time has elapsed (step S1208).

[0106] The input control unit 154 stands by until a predetermined waiting time has elapsed, and when the predetermined waiting time has elapsed, it is controlled to be able to accept the input of the reminder image 600 (step S1209). When the reminder image 600 is displayed in a reduced size and an operation to cancel the reduction is received in step S1209, the reminder image 600 is displayed in the normal display mode.

[0107] Next, the input control unit 154 determines whether the end condition of the reminder image 600 is satisfied (step S1210). The end condition of the reminder image 600 refers to the situation where various settings are changed or various registrations are completed in the voice input image 602, or the situation where a call start or call rejection is received in the incoming call image 604.

[0108] When the end condition of the reminder image 600 is not satisfied, the input control unit 154 returns to step S1209. On the other hand, when the end condition of the reminder image 600 is satisfied, the display control unit 152 ends the reminder image 600 (step S1211) and returns to step S1202.

[0109] In step S1202, when the display of the second item image does not start, the display control unit 152 proceeds to Figure 13 step S1301. In step S1203, when the second item image is not the reminder image 600, that is, when the second item image is the result display image 610, the display control unit 152 displays the result display image 610 overlapping the list image 406 (step S1212).

[0110] Then, the input control unit 154 displays the cursor 1000 (see Figure 10 ), and is controlled to be able to accept the selection of the selection item shown in the list image 406 (step S1301). Next, the input control unit 154 determines whether the selection of the selection item is received (step S1302). When the selection of the selection item is not received, the input control unit 154 proceeds to step S1306. When the selection of the selection item is received, the display control unit 152 shortens the display period of the set result display image 610 (step S1303).

[0111] Then, the display control unit 152 determines whether the selection item indicated by the cursor 1000 is the selection item overlapping the result display image 610 ( Figure 10(Step S1304 for a specific selection item 1002). When the selection item indicated by the cursor 1000 is not the specific selection item 1002, the display control unit 152 proceeds to step S1306. When the selection item indicated by the cursor 1000 is the specific selection item 1002, the display control unit 152 moves the display position of the specific selection item 1002 to a position that does not overlap with the result display image 610 (refer to Figure 10 (C) of

[0112] to display the selection item (step S1305).

[0113] Then, the display control unit 152 determines whether the display period of the result display image 610 has elapsed (step S1306). When the display period of the result display image 610 has not elapsed, the display control unit 152 returns to step S1302. In the transfer process when returning to step S1302, if the shortening setting of the display period in step S1303 has been completed in the previous process, the display control unit 152 can skip the process of step S1303.

[0114] When the display of the list image 406 has not ended, the display control unit 152 returns to step S1202. When the display of the list image 406 has ended, the input control unit 154 ends a series of processes.

[0115] The display control device 150 of the embodiment described above changes the display mode of the first entry image based on the content of the second information when the first entry image and the second entry image are simultaneously displayed on the HUD device. Therefore, the HUD device can display the first entry image while giving priority to displaying the second entry image. Therefore, the entry images can be efficiently displayed, and thus the display area of the HUD device can be effectively utilized.

[0116] When the display control device 150 of the embodiment causes the HUD device to display the urging image 600, it makes the first entry image non-displayed. Thereby, the user can be made to focus only on the urging image 600. When the display control device 150 causes the HUD device to display the result display image 610, it makes the first entry image displayed. Thereby, the result display image 610 and the first entry image can be displayed simultaneously, and thus the content shown by these entry images can be notified to the user.

[0117] The display control device 150 of the embodiment does not accept an input from the user to the urging image 600 within a specified time from the start of the urging image 600. Thereby, even when the urging image 600 is being displayed while the user is performing a specified operation on the operation switch 130, an unexpected input by the user can be avoided.

[0118] The display control device 150 of the embodiment continues to accept an operation on a selection item of the list image 406 regardless of whether the result display image 610 has been displayed on the HUD device. Thereby, even when the result display image 610 is being displayed, the selection item can be selected, and thus convenience can be improved.

[0119] When the display control device 150 of the embodiment causes the result display image 610 and the list image 406 to be displayed on the HUD device, it causes at least a part of the image of the list image 406 and the result display image 610 to be displayed overlappingly. Thereby, even when the result display image 610 is being displayed, the user can confirm the selection item of the list image 406. Therefore, the display area of the HUD device can be effectively utilized.

[0120] The display control device 150 of the embodiment accepts an operation on the list image 406 regardless of whether a part of the list image 406 is being displayed overlappingly with the result display image 610. Thereby, even when the result display image 610 is being displayed overlappingly with the list image 406, the user can select the selection item. Moreover, when the selected selection item is a selection item image (specific selection item 1002 (refer to Figure 10 )) that is being displayed overlappingly with the result display image 610, the display control device 150 causes the specific selection item 1002 to be displayed non-overlappingly with the result display image 610. Thereby, regarding the selection item that is being displayed overlappingly with the result display image 610, it can also be made clear when the cursor 1000 indicates it. Therefore, misselection of the selection item can be suppressed.

[0121] When the display control device 150 of the embodiment receives an operation on the list image 406 when causing the HUD device to display the result display image 610, the display of the result display image 610 ends earlier than usual. Thereby, the display period of the result display image 610 can be shortened, and thus the user can quickly start selecting a selected item.

[0122] When the display control device 150 of the embodiment causes the vehicle detection image 1100 (see Figure 11 ) indicating the case where another vehicle approaching the vehicle M is detected to be displayed on the HUD device, the display mode of the second entry image (the urging image 600 and the result display image 610) is changed. Thereby, when another vehicle approaches, it is possible to less easily pay attention to the second entry image. Therefore, it is possible to concentrate on driving.

[0123] When the display control device 150 of the embodiment causes the vehicle detection image 1100 to be displayed, the second entry image is displayed in a reduced size. Thereby, it is possible to pay attention to the displayed vehicle detection image 1100, and thus it is possible to more concentrate on driving.

[0124] [Modification Example 1]

[0125] Next, Modification Example 1 of the embodiment will be described. In the above-described embodiment, the case where a selection operation is accepted regardless of whether a part of the list image 406 overlaps with the result display image 610 has been described (see Figure 10 (B) of Figure 13 and step S1304 of

[0126] In Modification Example 1, the case where the selection of a selection item (specific selection item 1002) of the overlapping part is not accepted when a part of the list image 406 overlaps with the result display image 610 will be described. Figure 10 In Modification Example 1, the input control unit 154 controls so that the cursor 1000 does not indicate

[0127] [Processing in List Display of Modification Example 1]

[0128] Figure 14 is a flowchart showing a modification example 1 of the processing in the list display performed by the display control device 150. The processing in the list display of Modification Example 1 is different from the processing in the list display of the embodiment in Figure 13 the processing shown. In Figure 14In the description of, for the same content as Figure 13 the same reference numerals are assigned and the description is omitted.

[0129] In Figure 14 step S1401, the input control unit 154 controls so as not to accept a selection item (specific selection item 1002) that overlaps with the result display image 610 in the list image 406 (step S1401). Then, the input control unit 154 controls to display the cursor 1000 (refer to Figure 10 ) so as to accept the selection of selection items other than the specific selection item 1002 (step S1402), and proceeds to step S1302. In Modification 1, since the cursor 1000 does not indicate the specific selection item 1002, the processes of step S1304 and step S1305 shown in Figure 13 can be omitted.

[0130] According to Modification 1, when a part of the list image 406 is displayed overlapping the result display image 610, the selection of the selection item in the overlapping part is not accepted. In this way, a selection item with low visual recognition is not selected, thereby suppressing the misselection of the selection item. The process of accepting the selection of the specific selection item 1002 is not performed, and the process of moving the display position of the specific selection item 1002 is not performed, so that the load related to the display control can be suppressed.

[0131] In Modification 1, when a part of the list image 406 is displayed overlapping the result display image 610, only the selection item (specific selection item 1002) in the part overlapping the result display image 610 is not selected. However, it is not limited to this. When a part of the list image 406 is displayed overlapping the result display image 610, the selection operation of all the selection items shown in the list image 406 may not be accepted. Specifically, the input control unit 154 may also control so that in Figure 10 the list image 406 shown in (A) of, the selection operation (operation of the cursor 1000) is not accepted for all the selection items. In this way, the misselection of the selection item can also be suppressed, and the load related to the display control can be suppressed.

[0132] [Modification 2]

[0133] Next, Modification 2 of the embodiment will be described. In the above-described embodiment, the case where the first entry image is also displayed even when the vehicle detection image 1100 is displayed has been described (refer to Figure 11 ). In Modification 2, the case where the first entry image is not displayed when the vehicle detection image 1100 is displayed will be described.

[0134] Figure 15This is a diagram showing a display example of the item image of Modification Example 2. As shown in Figure 15 (A) of Figure 15 , in the first display area 300 of the displayable area A1, a navigation image 402 and a speed image 404 are displayed. In the second display area 302, an advanced driving support system image 400 is displayed. In the Figure 15 screen shown in (A) of Figure 15 , it is assumed that another vehicle approaching the vehicle M is detected. In this case, the screen shown in Figure 15 (B) of Figure 15 is transferred to.

[0135] As shown in Figure 15 (B) of Figure 15 , a vehicle detection image 1100 is displayed in the displayable area A1. When the vehicle detection image 1100 is displayed, the advanced driving support system image 400, the navigation image 402, and the speed image 404, which are the first item images, become non-displayed.

[0136] In Figure 15 the screen shown in (B) of Figure 15 , it is assumed that an incoming call has occurred. In this case, the display control unit 152 changes the display mode of the second item image to display the second item image. For example, as shown in Figure 15 (C) of Figure 15 , the display control unit 152 displays an incoming call icon image 1110 in which the incoming call image 604 is reduced. Alternatively, in the Figure 15 screen shown in (C) of Figure 15 , when a predetermined operation is performed using the operation switch 130, the incoming call image 604 in the normal display mode may be displayed instead of the incoming call icon image 1110.

[0137] According to Modification Example 2, when the vehicle detection image 1100 is displayed, the first item image is eliminated. Thus, when another vehicle approaches, it is possible to avoid paying attention to the first item image. Therefore, when another vehicle approaches, it is possible to focus on driving.

[0138] In Modification Example 2, as shown in Figure 15 (B) of Figure 15 , regardless of the type of the first item image, when the vehicle detection image 1100 is displayed, the first item image is made non-displayed. However, it is not limited to this, and the display or non-display may be performed according to the type of the first item image. Specifically, for example, when the first item image is a first item image related to driving, the first item image may be displayed as it is. On the other hand, when the first item image is a first item image not related to driving (for example, a list image 406), the first item image may be made non-displayed. In this way, it is also possible to focus on driving when another vehicle approaches.

[0139] [Modification Example 3]

[0140] Next, a third modification example of the embodiment will be described. In the above-described second modification example, the case where the second item image (incoming call icon image 1110) can be displayed even when the vehicle detection image 1100 is displayed has been described (refer to Figure 15 (C)). In the third modification example, the case where the second item image (incoming call icon image 1110) is also set to non-display when the vehicle detection image 1100 is displayed will be described.

[0141] In the third modification example, for example, it is assumed that an incoming call occurs during the display of the screen shown in Figure 15 (B). In this case, the display control unit 152 maintains Figure 15 the screen shown in (B), that is, does not display the incoming call image 604 and the incoming call icon image 1110. In this case, it is also possible to make a notification of the incoming call based on sound and for the user to operate the operation switch 130 to enable answering. In this case, it is also possible to reject the incoming call and notify the other party of the driving situation where a call cannot be made.

[0142] In the third modification example, even when an incoming call occurs when another vehicle approaches, the second item image (incoming call) is not displayed. According to the third modification example, when another vehicle approaches, it is possible to focus more on driving.

[0143] The specific embodiments of the present invention have been described above using the embodiments, but the present invention is in no way limited to such embodiments, and various modifications and substitutions can be made without departing from the gist of the present invention.

Claims

1. A display device for a vehicle, wherein, The vehicle display device includes a display control unit and an input control unit that receives inputs from a user. The display control unit causes the display unit to perform the following processing, and the display unit visually identifies an image overlapping with the scenery outside the vehicle: Based on the first information, cause a first display area to display a first entry image; and Based on the second information, cause a second display area to display a second entry image. When the display control unit causes the first entry image and the second entry image to be displayed on the display unit at the same time, it changes the display mode of the first entry image based on the content of the second information. The second entry image includes a prompting image that requests the user to input and a result display image that represents the result of the user's input. When the display control unit causes the prompting image to be displayed on the display unit, it causes the first entry image not to be displayed. When the display control unit causes the result display image to be displayed on the display unit, it causes the first entry image to be displayed on the display unit. The first entry image includes a selection item image that the user can select. Regardless of whether the result display image has been displayed on the display unit, the input control unit continues to accept operations on the selection item image.

2. The display device for a vehicle according to claim 1, wherein, The input control unit does not accept the user's input on the prompting image within a specified time from the start of the prompting image.

3. The display device for a vehicle according to claim 1, wherein, When the display control unit causes the result display image and the selection item image to be displayed on the display unit, it causes at least a part of the selection item image and the result display image to be displayed overlappingly.

4. The display device for a vehicle according to claim 3, wherein, Regardless of whether the part is displayed overlappingly on the display unit, the input control unit accepts operations on the selection item image. When the selection item image accepted by the input control unit is displayed overlappingly with the result display image, the display control unit causes the selection item image and the result display image not to be displayed overlappingly.

5. The display device for a vehicle according to claim 1, wherein, When the display control unit receives an operation on the selection item image when causing the display unit to display the result display image, it causes the display of the result display image to end earlier than normal.

6. The display device for a vehicle according to claim 3, wherein, When the part is displayed overlappingly on the display unit, the input control unit does not accept operations on the selection item image of the overlapping part.

7. The display device for a vehicle according to claim 1, wherein, When the display control unit causes a detection image indicating a situation where another vehicle approaching the own vehicle is detected to be displayed on the display unit, it changes the display mode of the second entry image.

8. The display device for a vehicle according to claim 7, wherein, The display control unit causes the second entry image to be displayed in a reduced size.

9. The display device for a vehicle according to any one of claims 1 to 8, wherein, When the display control unit causes a detection image indicating a situation where another vehicle approaching the own vehicle is detected to be displayed on the display unit, it causes the first entry image not to be displayed.

10. The display device for a vehicle according to claim 9, wherein, The display control unit causes the second entry image not to be displayed.

11. A display control method, which is a display control method performed using a computer mounted on a vehicle, wherein, The display control method causes the display unit to perform the following processing, and the display unit visually identifies an image overlapping with the scenery outside the vehicle: Based on the first information, cause a first display area to display a first entry image; Based on the second information, cause a second display area to display a second entry image; And When the first item image and the second item image are simultaneously displayed on the display unit, the display mode of the first item image is changed based on the content of the second information. When a prompting image that requires the user to input is displayed as the second item image on the display unit, the first item image is made non-displayed. When a result display image indicating the result of the user input is displayed as the second item image on the display unit, the first item image is displayed on the display unit. Regardless of whether the result display image has been displayed on the display unit, operations on the selectable item images included in the first item image are continuously accepted.

12. A storage medium stores a program, wherein, The program causes a computer mounted on a vehicle to perform processing so that the display unit performs the following processing: the display unit visually identifies an image overlapping with the scenery outside the vehicle. Based on the first information, a first display area displays a first item image. Based on the second information, a second display area displays a second item image. And When the first item image and the second item image are simultaneously displayed on the display unit, the display mode of the first item image is changed based on the content of the second information. When a prompting image that requires the user to input is displayed as the second item image on the display unit, the first item image is made non-displayed. When a result display image indicating the result of the user input is displayed as the second item image on the display unit, the first item image is displayed on the display unit. Regardless of whether the result display image has been displayed on the display unit, operations on the selectable item images included in the first item image are continuously accepted.

Images