Display control device, vehicle display device, display control method and program

Abstract

To provide a display control device, etc. that are able to make a driver aware of content that is high in a degree of importance.SOLUTION: A display control device according to a first aspect includes: acquisition units (a first acquisition unit 21 and a second acquisition unit 22) that acquire vehicle information on a periphery of a vehicle 2 and on the vehicle 2 and occupant information on occupants including a driver 19 driving the vehicle 2; a calculation method update unit 12a that, based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2, updates a method for calculating a degree of importance of content displayed by a display unit 11 mounted in the vehicle 2.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present disclosure relates to a display control device, a vehicle display device, a display control method, and a program that display content in a driver's field of vision while driving. [Background technology]

[0002] The vehicle display projection device of Patent Document 1 is equipped with a display position adjustment unit that changes and rearranges the display positions of the multiple display contents according to assigned priorities, at least when the obstacle detection unit detects a new obstacle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-155960 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned Patent Document 1 does not provide any measures for reflecting the user's awareness in the setting of the importance of the content. For this reason, there is a demand to reflect the user's awareness in the content displayed on the display unit and display the content with high importance so that the driver can recognize it.

[0005] In view of the above, an object of the present disclosure is to provide a display control device, a vehicle display device, a display control method, and a program that can enable a driver to recognize content of high importance. [Means for solving the problem]

[0006] A display control device according to one aspect of the present disclosure includes an acquisition unit that acquires vehicle information regarding the vehicle's surroundings and the vehicle, and occupant information regarding occupants including a driver who drives the vehicle, and a calculation method update unit that updates a method for calculating the importance of content displayed by a display unit mounted on the vehicle based on the vehicle information of the vehicle and the occupant information of the vehicle.

[0007] A display device for a vehicle according to an aspect of the present disclosure includes a control device and a display unit mounted on the vehicle.

[0008] In addition, a display control method according to one aspect of the present disclosure includes an acquisition unit acquiring vehicle information regarding the vehicle's surroundings and the vehicle, and occupant information regarding occupants including a driver who drives the vehicle, and a calculation method update unit updating a method for calculating the importance of content displayed by a display unit mounted on the vehicle based on the vehicle information of the vehicle and the occupant information of the vehicle.

[0009] Moreover, a program according to an aspect of the present disclosure is a program that enables a computer to execute the display control method. Effect of the Invention

[0010] The display control device and the like disclosed herein can make the driver aware of content of high importance. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing an in-vehicle system when the vehicle is viewed from the side. [Diagram 2] FIG. 2 is a front view showing an example of a driver's forward visibility while driving. [Diagram 3] FIG. 3 is a diagram showing obstacles and content that appear in the driver's field of vision. [Figure 4] FIG. 4 is a diagram showing the relationship between obstacles, the driver's gaze point, and each area. [Diagram 5]FIG. 5 is a front view showing the relationship between the detected obstacles and the driver's gaze point and each area. [Figure 6] FIG. 6 is a diagram showing an object reflected in the driver's field of vision ahead and content that is highlighted for the object. [Figure 7] FIG. 7 is a flowchart showing an example of a main operation of the in-vehicle system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each of the embodiments described below shows a specific example of the present disclosure. Therefore, the numerical values, shapes, materials, components, arrangement and connection of the components, steps, order of steps, and the like shown in the following embodiments are merely examples and are not intended to limit the present disclosure.

[0013] Each figure is a schematic diagram and is not necessarily precisely illustrated. Therefore, for example, the scales and the like do not necessarily match in each figure. Furthermore, in each figure, the same reference numerals are given to substantially the same configurations, and duplicated explanations are omitted or simplified.

[0014] (Embodiment) <Configuration and Function> First, a display control device, a vehicle display device, a display control method, and a program according to the present embodiment will be described with reference to FIG.

[0015] FIG. 1 is a block diagram showing an in-vehicle system when a vehicle 2 is viewed from the side.

[0016] The in-vehicle system shown in FIG. 1 includes a display unit 11, an overlay drawing control unit (AR-ECU) 12, a navigation device 13, an advanced driver assistance system (ADAS) 15, a first acquisition unit 21, a second acquisition unit 22, and a voice recognition device 23.

[0017] The display unit 11 is, for example, a head-up display, a liquid crystal display device, an organic EL display, a display, etc. In the present embodiment, the case where the display unit 11 is a head-up display is illustrated.

[0018] In this case, the display unit 11 can project an image (content) displayed on a two-dimensional screen such as a liquid crystal display onto a display medium 3 such as a windshield or combiner of the vehicle 2 using illumination light such as a backlight. The optical image (content) projected by the display unit 11 is reflected by the display medium 3 and enters the eye position EP of the driver 19. The image displayed on the two-dimensional screen, that is, the optical image projected by the display unit 11, is recognized by the driver 19 as content, which will be described later. In this way, the display unit 11 can display content in the field of vision of the driver of the vehicle 2.

[0019] Therefore, the driver 19 can visually recognize the light image projected by the display unit 11 onto the display medium 3 as a virtual image 17 that is formed as if it were located in a position forward of the display medium 3. In addition, the driver 19 can visually recognize a real image of the scenery outside the vehicle, such as the road surface, through the display medium 3, and can simultaneously visually recognize this real image and the virtual image 17 projected by the display unit 11 in a superimposed state. The virtual image 17 is also recognized by the driver 19 as content, which will be described later. The real image is an example of an object seen through the display medium 3. The object is an object present around the vehicle 2 or an obstacle to the vehicle 2, and includes, for example, obstacles such as pedestrians, other vehicles, and road installations, as well as roads, parking lots, stores, and public facilities.

[0020] The display unit 11 can also provide a driving route showing guidance for driving the vehicle 2. The display unit 11 projects the driving route as content onto the display medium 3, allowing the driver 19 to recognize the driving route.

[0021] The superimposed drawing control unit 12 is an electronic control unit having a function of generating various contents for the display unit 11 to project on the display medium 3 and drawing the generated contents on the display medium 3. The display unit 11 displays the contents on the display medium 3 simply to emphasize the object, or displays the contents on the display medium 3 to emphasize the obstacle in particular. The superimposed drawing control unit 12 of this embodiment also has a function for realizing an augmented reality (AR). That is, the superimposed drawing control unit 12 controls the display position, size, etc., so that the driver 19 can view the contents projected by the display unit 11 as a virtual image 17 as if they existed in a three-dimensional real space. That is, the superimposed drawing control unit 12 sequentially determines the position and size of each content in accordance with the change between the position of the driver's 19's eyes EP and each coordinate position of the scenery of the three-dimensional real space that the driver 19 can actually view at that position.

[0022] The navigation device 13 can provide detailed map information, information indicating surrounding road conditions from the position of the vehicle 2, and a driving route indicating guidance for driving the vehicle 2. Specifically, the navigation device 13 can measure the position of the vehicle 2 using a Global Positioning System (GPS) receiver, and obtain necessary information using an Intelligent Transport System (ITS). The Intelligent Transport System can provide necessary information to the vehicle 2, a terminal device owned by the driver, etc., in order to solve various problems in road traffic such as accidents, congestion, and environmental measures.

[0023] The navigation device 13 is capable of receiving an input from the driver 19. Therefore, the navigation device 13 may be an example of the second acquisition unit 22.

[0024] The advanced driving assistance device 15 has a function of photographing the area in front of the vehicle 2, a function of recognizing objects in front of the vehicle 2, and a function of recognizing the position of objects in front of the vehicle 2 and the condition of the road surface, etc., using the first acquisition unit 21.

[0025] The first acquisition unit 21 is, for example, a sensor using a millimeter wave radar and an infrared laser, an in-vehicle camera, etc. The first acquisition unit 21 can, for example, photograph the front of the vehicle 2, scan a predetermined range in front of the vehicle 2 in the traveling direction, detect various objects, detect the position, shape, size and speed of objects arranged along the road on which the vehicle is traveling, and detect the position of each travel lane on the road, road signs, etc.

[0026] By detecting these, the first acquisition unit 21 can acquire vehicle information related to the surroundings of the vehicle 2 and the vehicle 2. The vehicle information includes information indicating the presence of an object, the position of the object, the shape of the object, the size of the object, the speed of the object, the position of the driving lane, road signs, etc. The first acquisition unit 21 is an example of an acquisition unit.

[0027] Furthermore, the first acquisition unit 21 can detect various obstacles that may affect the driving of the vehicle 2, such as pedestrians around the vehicle 2, based on the captured video, and detect the positions and distances of objects such as various other vehicles other than the vehicle 2. For this reason, the vehicle information may further include information indicating the distance between the vehicle 2 and the object.

[0028] The first acquisition unit 21 may be a communication interface capable of communicating with an external server. In this case, the first acquisition unit 21 can acquire the vehicle information from the external server or the like.

[0029] The first acquisition unit 21 may further acquire information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2.

[0030] For example, the first acquisition unit 21 may acquire information indicating the position of the vehicle 2 from a GPS receiver included in the navigation device 13. The first acquisition unit 21 may also acquire information indicating the current time from a clock unit mounted on the vehicle 2. The first acquisition unit 21 may also acquire information indicating the traveling direction from various sensors mounted on the vehicle 2. The vehicle information may further include information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2.

[0031] The first acquisition unit 21 outputs the acquired vehicle information to the calculation method update unit 12 a of the superimposed drawing control unit 12 .

[0032] The second acquisition unit 22 is disposed on an instrument panel near the steering wheel 18. The second acquisition unit 22 may be, for example, a camera sensor or the like. The second acquisition unit 22 can, for example, capture an image of the driver 19 driving the vehicle 2 to detect the position of the driver 19, the position of the head of the driver 19, the position of the eyes of the driver 19, the line of sight of the driver 19, and the like, capture an image of the interior of the vehicle 2 to detect passengers other than the driver 19, and detect the positions of the passengers. The second acquisition unit 22 is an example of an acquisition unit.

[0033] For example, the gaze position of the driver 19 can be detected by using the second acquisition unit 22 arranged in the passenger compartment of the vehicle 2 to detect the face position, eye position, eye direction, and the like of the driver 19.

[0034] By detecting these, the second acquisition unit 22 can acquire them as occupant information related to the occupants of the vehicle 2. The occupants of the vehicle 2 include the driver 19 and passengers other than the driver 19. The occupants include, for example, a passenger in the front passenger seat and a passenger in the rear seat.

[0035] Also, for example, the second acquisition unit may be the navigation device 13, and the second acquisition unit 22 may be an input interface mounted on the superimposed drawing control unit 12, or the like.

[0036] When the second acquisition unit is the navigation device 13, the driver 19 can input occupant information to the navigation device 13. The navigation device 13 can accept input of occupant information including, for example, the interests (concerns) of the driver 19, matters to which the driver 19 wants to pay attention, and a display request from the driver 19 for highlighting and displaying objects by content. The navigation device 13 can acquire the occupant information input by the driver 19.

[0037] In addition, when the second acquisition unit 22 is an input interface mounted on the overlay drawing control unit 12, the driver 19 inputs occupant information into the navigation device 13, and the second acquisition unit 22 can acquire the occupant information input by the driver 19 from the navigation device 13.

[0038] The occupant information includes information indicating the position of the driver 19, the position of the driver's 19's head, the position of the driver's 19's eyes, the driver's 19 line of sight, passengers other than the driver 19, the positions of the passengers, objects in which the driver 19 has expressed an interest (concern), matters to which the driver 19 wishes to pay attention, and display requests from the driver 19 to highlight and display objects using content.

[0039] It is also acceptable for the vehicle 2 to be equipped with at least one of the second acquisition unit 22 as a camera sensor, the second acquisition unit 22 as the navigation device 13, and the second acquisition unit 22 as an input interface.

[0040] The second acquisition unit 22 outputs the acquired occupant information to the calculation method update unit 12a of the superimposition drawing control unit 12.

[0041] The superimposed drawing control unit 12 has a calculation method update unit 12a. The calculation method update unit 12a acquires vehicle information from the first acquisition unit 21, and acquires occupant information from the second acquisition unit 22. The calculation method update unit 12a can update a method for calculating the importance of the content displayed by the display unit 11 mounted on the vehicle 2 based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2. The calculation method update unit 12a can update a method for calculating the importance of the content for emphasizing the object to be higher than a reference value based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2. In other words, the calculation method update unit 12a can also update a method for calculating the importance of the content to be lower than a reference value. That is, the calculation method update unit 12a sets a method for calculating the importance of the content to be higher than a reference value based on the vehicle information and the occupant information, and updates it to the set method. Furthermore, the calculation method update unit 12a sets a method for calculating the importance of the content to be lower than a reference value based on the vehicle information and the occupant information, and updates the method to the set method. For example, the calculation method update unit 12a updates the calculation method of the importance of the content by storing the updated calculation method in a storage unit of the in-vehicle system.

[0042] The superimposed drawing control unit 12 calculates the importance by using the method updated by the calculation method update unit 12a, and controls the display unit 11 to display the content on the display medium 3 according to the calculated importance. The reference value is a preset value and may be set for each content. The superimposed drawing control unit 12 may also calculate the importance for each content.

[0043] The voice recognition device 23 can recognize the voices, particularly the conversations, of occupants present in the cabin of the vehicle 2. The voice recognition device 23 is composed of a microphone, a voice recognition circuit capable of recognizing the voices of the occupants input to the microphone, and the like. The voice recognition device 23 can accept input of an object to be added to the content from the conversation of the occupants. Therefore, the voice recognition device 23 is an example of a second acquisition unit.

[0044] That is, when the second acquisition unit is the voice recognition device 23, the driver 19 can input the occupant information to the voice recognition device 23 by voice. The voice recognition device 23 can also accept input of occupant information by voice, including, for example, the interests (concerns) of the driver 19, matters to which the driver 19 wants to pay attention, and display requests from the driver 19 for highlighting and displaying objects by content. The voice recognition device 23 can acquire the occupant information input by the driver 19 by voice.

[0045] Next, the forward visibility of the driver 19 while driving will be described with reference to FIG.

[0046] 2 is a front view showing an example of a forward field of vision when the driver 19 is driving. The direction perpendicular to the paper surface of FIG. 2 is the forward traveling direction of the vehicle 2, and is also the depth direction of the field of vision.

[0047] 1 and 2, a plurality of independent detected obstacles D01 and D02 appear in the forward field of view and are detected by the first acquisition unit 21. In Fig. 2, a preceding vehicle is illustrated as the detected obstacle D01, and a pedestrian is illustrated as the detected obstacle D02.

[0048] The placement prohibited area A0 formed as a rectangular range surrounding the detected obstacle D01 is an area in which the virtual image display is restricted to prevent the virtual image 17 displayed by the display unit 11 from interfering with the visibility of the detected obstacle D01. The placement prohibited area A1 formed as a rectangular range surrounding the detected obstacle D02 is also an area in which the virtual image display is restricted to prevent the virtual image 17 from interfering with the visibility of the detected obstacle D02. These placement prohibited areas A0 and A1 are determined for each obstacle detected by the first acquisition unit 21 based on the obstacle center position Pc.

[0049] The gaze center position Pp represents the coordinates of the gaze point in the field of view ahead of the line of sight of the driver 19 detected by the line of sight detection device 14. Therefore, for example, when the driver 19 moves the eye position EP or moves the direction of the line of sight by moving the head or eyes, the position of the gaze center position Pp also changes.

[0050] 2, in each of the multiple content display areas 20B, 20C, and 20D, visual information of various contents generated by the superimposed drawing control unit 12 is displayed as a virtual image 17. The position and display size of each of the content display areas 20B, 20C, and 20D are controlled by the superimposed drawing control unit 12 so as to appropriately superimpose the object as an augmented reality in accordance with the state of the object reflected in the field of vision of the driver 19 through the display medium 3.

[0051] Specific examples of content generated by the overlap drawing control unit 12 include the following. (1) Marks and other warning signs to help drivers 19 notice obstacles. (2) An arrow pattern that indicates the direction in which to change lanes at intersections, etc. (3) Virtual signs and pavement marking patterns that do not actually exist on the road being traveled. (4) Text information indicating the driving status of vehicle 2, such as the current speed of vehicle 2.

[0052] That is, the superimposed drawing control unit 12 can display the above-mentioned content as the virtual image 17 within the field of vision of the driver 19, thereby supporting safe driving.

[0053] However, for example, as shown in Fig. 2, if each content display area 20B, 20D is located near a detected obstacle D02 in the forward field of view, the displayed virtual image 17 may overlap the real object, hindering the driver 19 from viewing the object. Also, the driver 19 may be confused by the virtual image display, and may be delayed in viewing the detected obstacle D02 that appears nearby. To solve such problems, the superimposed drawing control unit 12 performs the control described below.

[0054] Next, with reference to FIG. 3 etc., a virtual image 17 of an object and content reflected in the forward field of vision of a driver 19 will be described.

[0055] FIG. 3 is a diagram showing objects and content that appear in the driver's 19 field of vision.

[0056] As shown in Fig. 1 and Fig. 3, when the driver 19 is actually driving the vehicle 2, the situation reflected in the field of view of the driver 19 through the display medium 3 may change from the state shown in Fig. 3(a) to the state shown in Fig. 3(b), for example. In the example shown in Fig. 3(a), only a detected obstacle D01 corresponding to a preceding vehicle exists as an obstacle related to the driving of the vehicle 2, and necessary content is displayed in each of the content display areas 20B, 20C, and 20D. On the other hand, Fig. 3(b) shows a situation in which a pedestrian has newly appeared as a detected obstacle D02 in addition to the detected obstacle D01 as an obstacle related to the driving of the vehicle 2.

[0057] For example, if the driver 19 has not yet recognized the detected obstacle D02, in order to assist safe driving, it is desirable for the system to provide an attention alert to the driver 19 to make him / her aware of the detected obstacle D02 in the state shown in FIG. 3(b).

[0058] Therefore, the superimposed drawing control unit 12 displays, on the display medium 3, a content for calling attention, such as a blinking arrow pattern, in a position immediately adjacent to the actual detected obstacle D02. In addition, the superimposed drawing control unit 12 rearranges other content with low importance to move it to a position away from the gaze center position Pp and the detected obstacle D02 so as not to interfere with the visual recognition action of the driver 19 with respect to the detected obstacle D02.

[0059] That is, the display positions of the content display areas 20B, 20C, and 20D shown in Fig. 3(a) change from the state shown in Fig. 3(a) to the state shown in Fig. 3(b) by the movement as shown by the outline arrows in Fig. 3(b). This makes it easier for the driver 19 to notice the newly detected obstacle D02.

[0060] In the examples shown in Figures 3(a) and 3(b), it is assumed that the display contents of the virtual image 17 projected and displayed by the head-up display include the following four types of content CA, CB, CC, and CD. CA: For warning about obstacles, priority level 1 (highest) CB: Second content, priority=2 CC: 3rd content, priority=3 CD: 4th content, priority=4 (lowest) The contents CB, CC, and CD are displayed in the positions of the content display areas 20B, 20C, and 20D, respectively. The content CA is displayed, for example, in a position adjacent to the obstacle range A2. In the above example, a priority is assigned to each of the four types of contents CA, CB, CC, and CD. The priority may change to reflect changes in the driving situation.

[0061] Therefore, when rearranging the content display areas 20B, 20C, and 20D as shown in FIG. 3B, the positions are adjusted taking into consideration the priorities assigned to the contents CB, CC, and CD to be displayed in the corresponding areas. For example, there is no problem with moving the content display area 20D, in which the content CD with the lowest priority is displayed, to a relatively distant position. Moreover, it is preferable in terms of visibility that the content CB with a relatively high priority be moved to a position closer to the driver 19.

[0062] Next, the positional relationship between the two will be described.

[0063] As shown in FIG. 1, the eye position EP of the driver 19, the line of sight, and the position of each image can be detected by the line of sight detection device 14.

[0064] The superimposed drawing control unit 12 can calculate, for example, a gaze center position Pp in a predetermined two-dimensional plane based on the eye position EP of the driver 19 detected by the gaze detection device 14 and the gaze direction detected by the gaze detection device 14. The superimposed drawing control unit 12 can also calculate the positional relationship between the virtual image 17 of each content, the detected obstacle D02, the placement prohibited area A1, and the gaze center position Pp displayed in the content display areas 20B, 20C, and 20D in the depth direction to which the gaze is extended.

[0065] Next, the relationship between the obstacles, which are real images, the driver's gaze point, and each area will be described with reference to FIG.

[0066] FIG. 4 is a diagram showing the relationship between obstacles, the gaze point of the driver 19, and each area.

[0067] As shown in FIG. 1 and FIG. 4, it is assumed that a pedestrian appears in the forward field of vision of the driver 19 as a detected obstacle D02, and the gaze center position Pp is not within the obstacle range A2.

[0068] Here, the obstacle range A2 is determined by the superimposed drawing control unit 12 as a rectangular area surrounding the obstacle center position Pc of the detected obstacle D02 detected by the first acquisition unit 21. This obstacle range A2 is specified by, for example, the positions of the upper left coordinate PLT and the lower right coordinate PRB on a two-dimensional plane.

[0069] The superimposed drawing control unit 12 determines the placement prohibited area A1 for the detected obstacle D02 based on the obstacle range A2 and the gaze center position Pp. That is, the superimposed drawing control unit 12 determines the placement prohibited area A1 as a rectangular area with rounded corners that includes the range of the obstacle range A2 and has a range expanded by the distance Lmin compared to the obstacle range A2. Here, the distance Lmin is determined by the superimposed drawing control unit 12 as the minimum distance from the gaze center position Pp to the outside of the obstacle range A2. However, when the distance Lmin has a width equal to or greater than half the display range, the superimposed drawing control unit 12 determines the range of the placement prohibited area A1 so that the distance Lmin is fixed to half the width of the display range. The placement prohibited area A1 may be determined by the superimposed drawing control unit 12 as a circular range having a radius of the distance Lmax.

[0070] Next, the relationship between the obstacles and the gaze point of the driver 19 and each area will be described with reference to FIG.

[0071] FIG. 5 is a front view showing the relationship between the detected obstacles and the gaze point of the driver 19 and each area.

[0072] In the examples shown in Fig. 5(a) and Fig. 5(b), it is assumed that the two-dimensional plane in the forward field of vision of the driver 19 in Fig. 1 is divided into four areas, namely, a first area A01, a second area A02, a third area A03, and a fourth area A04, based on the gaze center position Pp. The first area A01 is a range on the lower right side of the gaze center position Pp, the second area A02 is a range on the upper right side of the gaze center position Pp, the third area A03 is a range on the lower left side of the gaze center position Pp, and the fourth area A04 is a range on the upper left side of the gaze center position Pp.

[0073] 1 and 5, in the field of view of the actual driver 19, the first area A01 and the third area A03 correspond to areas closer to the driver 19 in the actual distance in the depth direction than the gaze center position Pp, and the second area A02 and the fourth area A04 correspond to areas farther from the driver 19 in the actual distance. In the example shown in Fig. 5(a) and Fig. 5(b), a detected obstacle D01 exists in the fourth area A04, and a detected obstacle D02 exists in the second area A02.

[0074] 5(a), the content display area 20B is initially allocated to a position that overlaps with the prohibited placement area A1 allocated to the newly detected obstacle D02. Therefore, in order to avoid this overlap, the overlap drawing control unit 12 moves and rearranges the content display area 20B by moving the frame shown by the two-dot chain line along the radial direction of the white arrow from the gaze center position Pp.

[0075] However, even after rearranging the content display area 20B etc. as shown in the example of Fig. 5(a), the content display area 20B may still overlap with the placement prohibited area A1. In such a case, the content display area 20B etc. is further rearranged as shown in the example of Fig. 5(b).

[0076] 5B, a line connecting the gaze center position Pp and the obstacle center position Pc is used as a reference, and the line is rotated in various angles around the gaze center position Pp to find a direction that is not included in the placement prohibited area A1. Then, based on the position of the line in that direction, the frame shown by the two-dot chain line is moved along the direction of the white arrow to move the content display area 20B outside the placement prohibited area A1, and rearranged.

[0077] Furthermore, since the display screen of the superimposed head-up display allows three-dimensional arrangement according to the real image in the same way as augmented reality, the virtual image 17 of each content can be displayed taking into consideration the position in the depth direction even when rearranging each of the content display areas 20B, 20C, and 20D. For example, when a new detected obstacle D02 appears, the position in the depth direction of each of the content display areas 20B, 20C, and 20D is moved to a position farther away than the current position and to a position that does not overlap with the placement prohibited area A1 on the two-dimensional plane.

[0078] Next, specific examples (1) to (12) in which the calculation method update unit 12a updates the direction in which the importance is calculated based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2 will be described.

[0079] In the following, explanations may be given using FIG. 6 and the like. FIG. 6 is a diagram showing an object reflected in the forward field of vision of the driver 19 and content highlighted for the object. FIG. 6(a) shows an object in which the driver 19 is interested and content highlighted for the object in which the driver 19 is interested. FIG. 6(b) shows a desired object that the driver 19 wants to highlight with content and the content highlighted for the desired object.

[0080] (1) As shown in Fig. 1, there is a case where the driver 19 looks at a specific object for a certain period of time. In this case, the calculation method update unit 12a may update the method for calculating the importance of content according to the viewing time of the driver 19.

[0081] For example, the second acquisition unit 22 detects the line of sight of the driver 19, and thereby the second acquisition unit 22 acquires information indicating the line of sight of the driver 19 as passenger information. The first acquisition unit 21 acquires information indicating objects present around the vehicle 2 as vehicle information. The calculation method update unit 12a updates a method for calculating the importance of content for a specific object that is in the driver 19's line of sight and is an object present around the vehicle 2. Specifically, the calculation method update unit 12a may update the method so as to calculate the importance higher than a reference value if the period during which the driver 19 directs his / her line of sight to the specific object is longer than a predetermined period, and may update the method so as to calculate the importance lower than a reference value if the period during which the driver 19 directs his / her line of sight to the specific object is shorter than a predetermined period. If the driver 19 is gazing at the object, the superimposed drawing control unit 12 controls the display unit 11 to highlight the content for the specific object and display it on the display medium 3. This makes it possible to draw the driver's 19's attention to an object that is difficult for the driver 19 to see.

[0082] (2) In addition, the driver 19 may have an interest (interest) in a specific object. In this case, in order to emphasize the object in which the driver 19 has an interest (interest) with the content, the calculation method update unit 12a may update the method to calculate the importance of the content according to the interest (interest) of the driver 19 to be higher than a reference value.

[0083] For example, as shown in (a) of FIG. 3, when the driver 19 is searching for a parking lot, a store such as a convenience store, or a public facility such as a toilet, as shown in (a) of FIG. 1 and FIG. 6, a store may start to be seen around the vehicle 2. The second acquisition unit 22 acquires the interests (interests) of the driver 19 as passenger information. The first acquisition unit 21 acquires information indicating objects such as parking lots, stores, and public facilities that exist around the vehicle 2 from an external server, etc. as vehicle information. The calculation method update unit 12a updates the method so as to calculate the importance of the content for the objects such as parking lots, stores, and public facilities that are the interests (interests) of the driver 19 higher than a reference value. As shown in (a) of FIG. 1 and FIG. 6, the superimposed drawing control unit 12 controls the display unit 11 to highlight the content A2 for the object of interest (interest) that the driver 19 is searching for and display it on the display medium 3. As a result, the object of interest (interest) that the driver 19 is searching for is dynamically displayed in the content A2, thereby drawing the driver 19's attention.

[0084] In this case, the overlay drawing control unit 12 controls the display unit 11 to move and display the content display areas 20B, 20C, and 20D from the positions indicated by the dotted dashed lines to the positions indicated by the solid lines with white arrows so that the content A2 stands out.

[0085] (3) Furthermore, the driver 19 may wish to set a high importance to the content for an object with a high degree of danger according to past accident data (location and circumstances of the accident). In this case, in order to emphasize the object with a high degree of danger with the content, the calculation method update unit 12a may update the method to calculate the importance of the content to be higher than a reference value according to the object with a high degree of danger.

[0086] For example, the driver 19 may want to know danger information such as places where many accidents have occurred in the past, which is obtained from a public institution such as a police station, and may request the public institution to display the danger information. In this case, the driver 19 inputs a display request for danger information to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the display request for danger information as passenger information. In addition, the first acquisition unit 21 acquires information indicating places where many accidents have occurred in the past as vehicle information from the public institution. The calculation method update unit 12a updates the method so as to calculate the importance of the content for the object such as the place where many accidents have occurred in the past higher than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to display the content for the object such as the place where many accidents have occurred in the past on the display medium 3 in an emphasized manner. This makes it possible to give the driver 19 a warning that is more effective in preventing accidents.

[0087] The calculation method update unit 12a may use information on places with a high rate of fatal accidents and update the method to calculate a higher importance than the importance of content for objects such as places where many accidents have occurred in the past.

[0088] (4) In addition, the driver 19 may wish to set the importance of the content according to the road condition, since the objects to be paid attention to differ depending on the road condition. The road condition includes road conditions such as slopes, bad roads, road width, intersections with traffic lights, pedestrian crossings, and passages with train barriers. In order to emphasize, in the content, objects that make it difficult for the driver 19 to drive on the road, the calculation method update unit 12a may update the method so as to calculate the importance higher than a reference value according to the road condition.

[0089] For example, the driver 19 may want to know in detail about road conditions around the vehicle 2, which are difficult for the driver 19 to drive on. In this case, the driver 19 inputs a display request for road conditions to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the display request for road conditions around the vehicle 2 as passenger information. The first acquisition unit 21 also acquires information indicating road conditions around the vehicle 2 from an external server or the like as vehicle information. The calculation method update unit 12a updates the calculation method so as to calculate the importance of the content of the object indicating the road conditions around the vehicle 2 higher than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to display on the display medium 3 the content of the object such as a place where many accidents have occurred in the past, in an emphasized manner. This makes it possible to warn the driver 19 about objects that may cause an accident.

[0090] (5) In addition, the driver 19 may wish to set the importance level according to the weather, since the weather may make it difficult to recognize an object. When the weather makes it difficult to recognize an object, the calculation method update unit 12a may update the method to calculate the importance level higher than the reference value according to the road condition, in order to highlight the object in the content.

[0091] For example, in the case of weather conditions such as heavy rain making it difficult to see the surroundings and difficult to hear surrounding sounds, the driver 19 may want to know the presence of objects around the vehicle 2. In this case, the driver 19 inputs a request for displaying weather information to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the request for displaying weather information around the vehicle 2 as passenger information. The first acquisition unit 21 also acquires weather information around the vehicle 2 from an external server or the like as vehicle information. The calculation method update unit 12a updates the method so as to calculate the importance of content for objects around the vehicle 2 higher than a reference value. In particular, the calculation method update unit 12a may update the method so as to calculate the importance of content for dynamic objects such as pedestrians and the vehicle 2 higher than a reference value, or update the method so as to calculate the importance of content indicating that a horn is being sounded and content indicating the direction from which the horn is being sounded higher. The superimposed drawing control unit 12 controls the display unit 11 so as to highlight the content for the object and display it on the display medium 3. This allows the content to support the driver 19 in situations where it is difficult to see ahead or hear sounds, and therefore allows the driver 19 to be notified of danger.

[0092] (6) Furthermore, there may be a passenger other than the driver 19 who is included in the occupants of the vehicle 2. In this case, if an object exists in a direction from the driver 19 toward the passenger, the driver 19 cannot see the object. When the driver 19 cannot see the object, in order to emphasize the object with content, the calculation method update unit 12a may update the method so as to calculate the importance of the content that the display unit 11 displays on the display medium 3 for the object hidden by the passenger to be higher than a reference value.

[0093] For example, when a passenger is present in the passenger seat, the driver 19 has difficulty seeing objects present on the passenger seat side and the mirror on the passenger seat side. In this case, the second acquisition unit 22 acquires, as passenger information, information indicating the position of the driver 19, the presence of the passenger, and the position of the passenger. In addition, the first acquisition unit 21 acquires, as vehicle information, information on objects hidden by the passenger, etc. The calculation method update unit 12a updates the calculation method so as to calculate the importance of the content for the object hidden by the passenger to be higher than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to display the content of the object hidden by the passenger on the display medium 3 with emphasis. This makes it possible to warn the driver 19 that an object exists in a blind spot caused by the passenger.

[0094] (7) Furthermore, if the driver 19 does not direct his / her gaze to objects such as other vehicles and pedestrians, and if objects such as drivers of oncoming vehicles and oncoming pedestrians do not direct their gaze to the vehicle 2 of the driver 19, the risk between the driver 19 and the objects increases. In this case, it is considered that the driver 19 should direct his / her gaze to objects such as other vehicles and pedestrians, and that objects such as oncoming vehicles and oncoming pedestrians should direct their gaze to the vehicle 2 of the driver 19. For this reason, the calculation method update unit 12a may update the method so as to calculate the importance of the content to be higher than the reference value according to the viewing time of the driver 19.

[0095] For example, the second acquisition unit 22 detects the line of sight of the driver 19, and thereby the second acquisition unit 22 acquires information indicating the line of sight of the driver 19 as passenger information. The first acquisition unit 21 also acquires information indicating the line of sight of objects such as the driver of an oncoming vehicle and an oncoming pedestrian as vehicle information. The calculation method update unit 12a updates the calculation method so as to calculate the importance of content for objects such as other vehicles and pedestrians to which the driver 19 does not direct his / her line of sight higher than a reference value, or updates the calculation method so as to calculate the importance of content for objects such as the driver of an oncoming vehicle and an oncoming pedestrian not directing his / her line of sight to the driver 19 higher than a reference value. The superimposed drawing control unit 12 controls the display unit 11 so as to highlight the content for these objects and display it on the display medium 3. As a result, even if the driver 19, the driver of an oncoming vehicle, and the oncoming pedestrian are looking elsewhere, the importance of the content can be increased to call attention, and therefore the driver 19 can be called to attention even in unexpected cases.

[0096] (8) In addition, when the speed difference between the vehicle ahead and the own vehicle 2 is large, there is a risk of a rear-end collision, or of being rear-ended by the following vehicle due to the own vehicle's sudden braking. Therefore, when the speed difference between the vehicle ahead and the own vehicle 2 is equal to or greater than a predetermined speed, the calculation method update unit 12a may update the method to calculate the importance to be higher than a reference value according to road conditions in order to emphasize the object in the content.

[0097] For example, when a traffic jam occurs on a highway, it is difficult to notice that a vehicle ahead is decelerating, and there is a risk of rear-ending or being rear-ended. In this case, the driver 19 may want to know the speed difference between the vehicle and the surrounding object, which is another vehicle. Therefore, the driver 19 inputs a speed difference display request to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the speed difference display request between the vehicle and the surrounding object as passenger information. In addition, the first acquisition unit 21 acquires information indicating the speed difference between the vehicle and the surrounding object as vehicle information from various sensors and the like mounted on the vehicle 2. The information indicating the speed difference between the vehicle and the surrounding object can be acquired by various sensors and the like mounted on the vehicle 2. The calculation method update unit 12a updates the method so as to calculate the importance of the content for the surrounding object, which is another vehicle, higher than a reference value. The superimposed drawing control unit 12 controls the display unit 11 so as to highlight the content for the surrounding object, which is another vehicle, and display it on the display medium 3. This makes it possible to notify the driver 19 of the risk of a rear-end collision or of being rear-ended.

[0098] (9) In addition, there may be cases where an obstacle exists on the travel route. In this case, in order to emphasize the obstacle existing on the travel route with the content, the calculation method update unit 12a may update the calculation method so as to calculate the importance of the content to be displayed on the display medium 3 by the display unit 11 with respect to the obstacle to be higher than a reference value.

[0099] For example, if an obstacle exists on the travel route, there is a risk of the vehicle 2 coming into contact with the obstacle. In this case, the driver 19 inputs a display request for the obstacle to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the display request such as the type, size, shape, and moving speed of the obstacle as passenger information. The first acquisition unit 21 also acquires information indicating the obstacle from an external server or the like as vehicle information. The calculation method update unit 12a updates the calculation method so as to calculate the importance of the content for the obstacle existing on the travel route higher than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to display the content for the obstacle on the display medium 3 with emphasis. This allows the driver 19 to be warned of the presence of the obstacle on the travel route, thereby avoiding danger.

[0100] (10) In addition, there are cases where it is difficult to visually recognize an object depending on the time of day, such as at night or in the evening. When the driver 19 has difficulty in visually recognizing an object, the calculation method update unit 12a may update the method of calculating the importance depending on the current time in order to highlight the object in the content.

[0101] For example, a black object may be difficult to see at night, or an object may be difficult to see due to backlight caused by an oncoming vehicle using high beams at night. For this reason, the driver 19 may want to know the presence of an object that is difficult to see. Then, the driver 19 inputs a display request for an object that is difficult to see to the second acquisition unit (navigation device 13) in advance, so that the second acquisition unit (navigation device 13) acquires information indicating the display request for the object that is difficult to see as passenger information. In addition, the first acquisition unit 21 acquires information indicating the object that is difficult to see and information indicating the current time as vehicle information from an external server or the like. The calculation method update unit 12a updates the method so as to calculate the importance of the content for the object that is difficult to see higher than a reference value according to the time. On the other hand, the calculation method update unit 12a may update the method so as to calculate the importance of the content for an object that is sufficiently visible to be the same as or lower than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to highlight the content of a difficult-to-see object and display it on the display medium 3. This makes it possible to warn the driver 19 of the presence of an obstacle that is difficult to see under certain conditions.

[0102] (11) Furthermore, there are cases where it is difficult for the driver 19 to visually recognize an object depending on the position of the vehicle 2, the current time, and the traveling direction of the vehicle 2. In this case, in order to emphasize the object that is difficult to visually recognize with content, the calculation method update unit 12a may update the method so as to calculate the importance of the content that the display unit 11 displays on the display medium 3 for the object to be higher than a reference value.

[0103] For example, depending on the combination of the position, time, and traveling direction of the vehicle 2, the driver 19 may be exposed to the setting sun. In this case, the driver 19 inputs a display request for an object that is difficult to see into the second acquisition unit (navigation device 13) in advance, so that the second acquisition unit (navigation device 13) acquires information indicating the display request for the object that is difficult to see as passenger information. In addition, the first acquisition unit 21 acquires information indicating the object that is difficult to see, information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2 as vehicle information. The calculation method update unit 12a updates the method so as to calculate the importance of the content for the object that is difficult to see higher than the reference value. The superimposed drawing control unit 12 controls the display unit 11 to display the content of the object that is difficult to see on the display medium 3 with emphasis. This makes it possible to warn the driver 19 even if an object that is difficult to see exists due to the conditions.

[0104] The position, current time, and traveling direction of the vehicle 2 may be interpreted as the traveling direction of the vehicle 2. The above description is the same when interpreted as the traveling direction of the vehicle 2.

[0105] (12) There may also be cases where the driver 19 wants to freely emphasize content for a desired object. In this case, in order to emphasize the desired object with the content, the calculation method update unit 12a may update the method so as to calculate the importance of the content to be displayed on the display medium 3 by the display unit 11 for the desired object to be higher than a reference value.

[0106] For example, if the driver 19 feels that the kick scooter is dangerous, he or she may wish to set the kick scooter as a desired object and as a content requiring caution. The driver 19 inputs a display request for the desired object to the second acquisition unit (navigation device 13) in advance, and the second acquisition unit (navigation device 13) acquires information indicating the display request for the desired object as passenger information. In addition, the first acquisition unit 21 acquires information indicating the presence of a desired object that the driver 19 wants to highlight and display by content from an external server or the like as vehicle information. The calculation method update unit 12a updates the method to calculate the importance of the content for the desired object to be higher than a reference value.

[0107] For example, when the state shown in Fig. 3(a) changes to the state shown in Fig. 6(b), the superimposed drawing control unit 12 controls the display unit 11 to highlight the content A3 for the desired object and display it on the display medium 3. This makes it possible to alert the driver 19 to the object that the driver 19 perceives as dangerous.

[0108] <Example of operation> Next, with reference to FIG. 7 etc., an operation example of the display control device, the vehicle display device, the display control method, and the program according to the present embodiment will be described.

[0109] Fig. 7 is a flowchart showing an operation example of the in-vehicle system. As shown in Fig. 1 and Fig. 7, the superimposed drawing control unit 12 projects the images of each generated content on the display unit 11, and also performs superimposed display of a virtual image 17 and a real image by applying an augmented reality technique.

[0110] First, the first acquisition unit 21 acquires vehicle information relating to the vehicle 2 and its surroundings (S11). The first acquisition unit 21 outputs the acquired vehicle information to the calculation method update unit 12a of the superimposed drawing control unit 12.

[0111] Next, the second acquisition unit 22 acquires occupant information related to the occupant of the vehicle 2 (S12). The second acquisition unit 22 outputs the acquired occupant information to the calculation method update unit 12a of the superimposed drawing control unit 12.

[0112] Next, the calculation method update unit 12a acquires the vehicle information from the first acquisition unit 21, and acquires the occupant information from the second acquisition unit 22. The calculation method update unit 12a updates a method for calculating the importance of the content displayed by the display unit 11 mounted on the vehicle 2, based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2 (S13).

[0113] Next, the calculation method update unit 12a of the superimposed drawing control unit 12 periodically updates the method for calculating the importance for each of the multiple contents (CA, CB, CC, CD) and updates the importance to the one calculated using the updated method (S14). For example, it is assumed that the importance of each content is appropriately calculated so as to reflect changes in the traveling speed of the vehicle 2, changes in the distance to each detected obstacle, changes in the number of detected obstacles, changes in the characteristics of the traveling road, changes in the brightness of the environment, changes in the time of day, etc.

[0114] Next, the superimposed drawing control unit 12 compares the change in importance of each content with a predetermined threshold. That is, the superimposed drawing control unit 12 determines whether the change in importance of the content is equal to or greater than the threshold (S15). If the change in importance is less than the threshold (NO in S15), the superimposed drawing control unit 12 returns to the process of S11.

[0115] On the other hand, when the change in importance becomes equal to or greater than the threshold (YES in S15), the superimposed drawing control unit 12 proceeds to the process of S16 and onwards and executes the rearrangement of each piece of content. That is, in the operation shown in Fig. 7, the rearrangement of each piece of content is performed in accordance with the change in importance, regardless of the presence or absence of an event in which a new obstacle is detected or the line of sight of the driver 19 changes significantly. Note that by limiting the timing of rearrangement to only when the change in importance is large, it is possible to avoid frequent rearrangement, thereby eliminating the deterioration of visibility and annoyance.

[0116] Next, the overlay drawing control unit 12 assigns a priority to each piece of content based on the latest importance updated in S14 (S16). That is, the priority of a piece of content with a high importance value is set high, and the priority of a piece of content with a low importance value is set low.

[0117] Next, the superimposed drawing control unit 12 judges whether or not there is any content that needs to be superimposed on an obstacle for each content to be processed (S17). That is, the superimposed drawing control unit 12 distinguishes between content that needs to be superimposed on an obstacle and content that does not need to be superimposed on an obstacle for each content to be processed. For example, content for calling attention to obstacles and content such as road signs and road markings need to be displayed in accordance with the positions of the obstacles and the road. On the other hand, for example, content that indicates the state of the vehicle 2, such as the traveling speed, does not need to be adjusted to overlap with the obstacle.

[0118] When processing content that requires superimposed display with an obstacle (YES in S17), the superimposed drawing control unit 12 proceeds from S17 to S18. Then, while reflecting the priority assigned to the content to be processed in S16, the display position in the two-dimensional plane is moved radially outward from the gaze center position Pp, that is, the display position is changed to move radially outward according to the priority (S18). However, high priority content such as content for calling attention to an obstacle is not subject to rearrangement.

[0119] Furthermore, when processing content that does not need to be superimposed on an obstacle (NO in S17), the overlay drawing control unit 12 proceeds from S17 to S19. Then, the overlay drawing control unit 12 controls the display unit 11 to move the display position of the content to be processed to an area closer to the driver 19 than before the movement (S19). This improves the visibility of the relocated content.

[0120] For example, in the example shown in Fig. 5(a) and Fig. 5(b), the first area A01 and the third area A03 below the gaze center position Pp are closer to the driver in the depth direction, and the second area A02 and the fourth area A04 above the gaze center position Pp are farther from the driver in the depth direction. Therefore, the superimposed drawing control unit 12 determines the destination of the content that does not need to be superimposed on an obstacle to be the first area A01 or the third area A03 regardless of the position of the obstacle. Furthermore, the superimposed drawing control unit 12 controls the display unit 11 to move the content to a position lower than before the movement, or to a position outside in the radial direction.

[0121] Furthermore, when the content is rearranged as shown in S19, the overlap drawing control unit 12 judges whether or not the display position of the corresponding content overlaps with the arrangement prohibited area A1 (S20). As a result of the overlap drawing control unit 12 rearranging the content, the display position of the corresponding content may overlap with the arrangement prohibited area A1 (YES in S20). In this case, the overlap drawing control unit 12 proceeds to the process from S20 to S21, and controls the display unit 11 to move the display position of the corresponding content outward again (S21).

[0122] 5(b), the superimposed drawing control unit 12 uses a straight line connecting the two points, the gaze center position Pp and the obstacle center position Pc, as a reference, and rotates the direction of this line around the gaze center position Pp. Furthermore, the superimposed drawing control unit 12 searches for an angle direction that is outside the placement prohibited area A1, and controls the display unit 11 to move the content display area 20B, etc. to a position outside the placement prohibited area A1 based on this angle.

[0123] As shown in S21, when rearranging each content, the superimposed drawing control unit 12 also adjusts the three-dimensional arrangement (S22). That is, when moving the display position outward in the radial direction on the two-dimensional plane, the superimposed drawing control unit 12 controls the display unit 11 to move the display position to a position farther away than the current display position and outside the arrangement prohibited areas A0 and A1, in accordance with, for example, an obstacle, that is, a position in the depth direction in the scenery outside the vehicle 2.

[0124] Also, in the case where the result of S20 is NO and the process goes through S22, the overlay drawing control unit 12 judges whether or not the processing of all the contents has been completed (S23).

[0125] When the superimposed drawing control unit 12 determines that the processing of all the contents has been completed (YES in S23), the process returns to S11. On the other hand, when the superimposed drawing control unit 12 determines that the processing of all the contents has not been completed (NO in S23), the process returns to S17.

[0126] <Action and effect> Next, the effects of the display control device, the vehicle display device, the display control method, and the program according to the present embodiment will be described.

[0127] As described above, in the display control device of this embodiment, the first aspect includes an acquisition unit (first acquisition unit 21 and second acquisition unit 22) that acquires vehicle information regarding the vehicle 2 and its surroundings, and occupant information regarding the occupants including the driver 19 who drives the vehicle 2, and a calculation method update unit 12a that updates a method for calculating the importance of content displayed by the display unit 11 mounted on the vehicle 2 based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2.

[0128] This allows the calculation method update unit 12a to update the method for calculating the importance of content with respect to an object, taking into account the intention of the driver 19. Furthermore, even if the awareness of the driver 19 changes, the calculation method update unit 12a can update the method for calculating the importance of content with respect to an object again, taking into account the awareness of the driver 19. In other words, the method for calculating the importance of content is dynamically changed, taking into account the intention of the driver 19. Therefore, the intention of the driver 19 can be dynamically reflected in the calculation of the importance.

[0129] Therefore, the present disclosure makes it possible to make the driver aware of content with high importance.

[0130] In addition, in the display control device according to the present embodiment, a second aspect is the display control device according to the second aspect. In this case, the occupant information includes information indicating an object in which the driver 19 is interested. Furthermore, the display unit 11 displays the content so as to emphasize the object. Then, the calculation method update unit 12a updates the method based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2 so as to calculate the importance of the content for highlighting the object to be higher than a reference value.

[0131] This makes it possible to update the method of calculating the importance of content higher than the reference value for an object in which the driver 19 has shown interest. Since the importance of the content is calculated to be high, the driver 19 can easily recognize information of interest through the content.

[0132] In addition, in the display control device according to the present embodiment, a third aspect is the display control device according to the first or second aspect. In this case, when a passenger other than the driver 19 included in the occupants is in the vehicle 2 and an object is displayed in a direction from the driver 19 toward the passenger, the calculation method update unit 12a updates the method so as to calculate the importance of the content displayed by the display unit 11 to be higher than a reference value.

[0133] According to this, even if the driver 19 cannot recognize the object due to the passenger, the calculation method update unit 12a can update the method so that the calculation method update unit 12a calculates the importance of the content for the object to be higher than the reference value. Since the importance of the content is calculated to be high, the display unit 11 can display the content for the object in a different location. Therefore, it is possible to inform the driver 19 of the presence of an object hidden by the passenger.

[0134] Moreover, in the display control device according to the present embodiment, a fourth aspect is the display control device according to any one of the first to third aspects. In this case, the display unit 11 can display the travel route of the vehicle 2 as the content. Furthermore, the object includes an obstacle to the vehicle 2. Then, when an obstacle exists on the travel route, the calculation method update unit 12a updates the method so as to calculate the importance of the content for highlighting the obstacle to be higher than a reference value.

[0135] According to this, the calculation method update unit 12a updates the method for calculating the importance of the content for highlighting the obstacle so that the importance of the content is calculated to be higher than the reference value. Therefore, the display unit 11 can display the content in which the obstacle is highlighted. Therefore, the driver 19 can be notified of the presence of an obstacle on the driving route.

[0136] Furthermore, in the display control device according to the present embodiment, a fifth aspect is the display control device according to any one of the first to fourth aspects. In this case, the acquisition unit (first acquisition unit 21 and second acquisition unit 22) further acquires information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2. Furthermore, the vehicle information includes information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2. Then, the calculation method update unit 12a updates the method to calculate the importance of the content based on the occupant information, information indicating the position of the vehicle 2, information indicating the current time, and information indicating the traveling direction of the vehicle 2.

[0137] According to this, the calculation method update unit 12a can update the method so as to make the importance of the content for the object higher than a reference value, taking into consideration the influence caused by changes in the environment, such as the position of the vehicle 2, the current time, and the traveling direction of the vehicle 2. Even if a situation occurs in which it is difficult for the driver 19 to recognize the object due to a change in the environment, the importance of the content is calculated to be high, so that the driver 19 can be notified of the presence of the object.

[0138] In addition, in the display control device according to the present embodiment, a sixth aspect is the display control device according to any one of the first to fifth aspects. In this case, the occupant information includes information indicating a desired object that the driver 19 wants to highlight and display by the content. Then, the calculation method update unit 12a updates the method based on the vehicle information of the vehicle 2 and information indicating matters to which the driver 19 wants to pay attention so as to calculate the importance of the content to be higher than a reference value.

[0139] According to this, the calculation method update unit 12a can update the method for calculating the importance of the content for an object that the driver 19 feels is dangerous to a value higher than the reference value. Since the importance of the content is calculated to be high, the driver 19 can be notified of the presence of an object that the driver 19 feels is dangerous.

[0140] In addition, in a seventh aspect of the present embodiment, a vehicle display device includes the display control device according to any one of the first to sixth aspects and a display unit 11 mounted on the vehicle 2.

[0141] This vehicle display device also provides the same advantageous effects as those described above.

[0142] Furthermore, in the display control method of this embodiment, the eighth aspect includes an acquisition unit (first acquisition unit 21 and second acquisition unit 22) acquiring vehicle information regarding the vehicle 2 and its surroundings, and occupant information regarding the occupants including the driver 19 who drives the vehicle 2, and updating a method by which the calculation method update unit 12a calculates the importance of the content displayed by the display unit 11 mounted on the vehicle 2 based on the vehicle information of the vehicle 2 and the occupant information of the vehicle 2.

[0143] This method also provides the same effects as those described above.

[0144] Furthermore, in the program according to the present embodiment, a ninth aspect is a program that enables a computer to execute the display control method of the eighth aspect.

[0145] This program also provides the same effects as those described above.

[0146] (Other variations) The display control device, the vehicle display device, the display control method, and the program according to the present disclosure have been described above based on the above-mentioned embodiments, but the present disclosure is not limited to these embodiments. As long as the modifications do not deviate from the spirit of the present disclosure, modifications that a person skilled in the art may make to the embodiments may also be included in the scope of the present disclosure.

[0147] For example, in the display control device, the vehicle display device, the display control method, and the program according to the above-mentioned embodiments, the calculation method update unit 12a of the superimposed drawing control unit 12, the first acquisition unit 21, and the second acquisition unit 22 may constitute the display control device. The display control device may also include other components in the present embodiment. The display control device and the display unit 11 may also constitute the vehicle display device. The vehicle display device may also include other components in the present embodiment. In the present embodiment, the first acquisition unit 21 and the second acquisition unit 22 may be integrated into one acquisition unit.

[0148] Moreover, the overlay drawing control unit, navigation device, advanced driving support device, voice recognition device, and the like included in the display control device and the vehicle display device according to the above-mentioned embodiments are typically realized as an LSI, which is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include some or all of them.

[0149] The integrated circuit is not limited to an LSI, but may be realized by a dedicated circuit or a general-purpose processor. A field programmable gate array (FPGA) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of the circuit cells inside the LSI may also be used.

[0150] In the above embodiment, each component may be realized by a dedicated hardware or by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

[0151] In addition, the division of functional blocks in the block diagram is an example, and multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple blocks, or some functions may be transferred to another functional block. Furthermore, the functions of multiple functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

[0152] In addition, the order in which each step is performed in the flowchart is merely for illustrative purposes and may be other than the above. In addition, some of the steps may be performed simultaneously (in parallel) with other steps.

[0153] In addition, the present disclosure also includes forms obtained by applying various modifications to the above-described embodiments that a person skilled in the art may conceive, and forms realized by arbitrarily combining the components and functions of the embodiments within the scope that does not deviate from the spirit of the present disclosure. [Explanation of symbols]

[0154] 2 Vehicles 11 Display section 12a Calculation method update part 13 Navigation device (second acquisition unit) 19 Driver 21 1st Acquisition Department (Acquisition Department) 22 Second Acquisition Department (Acquisition Department)

Claims

1. An acquisition unit that acquires vehicle information regarding the vehicle and its surroundings, and occupant information regarding occupants including a driver who drives the vehicle; a calculation method update unit that updates a method for calculating the importance of content displayed by a display unit mounted on the vehicle based on the vehicle information of the vehicle and the occupant information of the vehicle. Display control device.

2. The occupant information includes information indicating an object in which the driver is interested, the display unit displays the content in such a way as to emphasize the object; The calculation method update unit updates the method so as to calculate the importance of the content for highlighting the object to be higher than a reference value, based on the vehicle information of the vehicle and the occupant information of the vehicle. The display control device according to claim 1 .

3. When a passenger other than the driver, who is included in the occupants, is riding in the vehicle and the object is displayed in a direction from the driver toward the passenger, the calculation method update unit updates the method so as to calculate the importance of the content displayed by the display unit to be higher than a reference value. The display control device according to claim 2 .

4. the display unit is capable of displaying a driving route of the vehicle as the content, the object includes an obstacle to the vehicle; When the obstacle is present on the travel route, the calculation method update unit updates the method so as to calculate the importance of the content for emphasizing the obstacle to be higher than a reference value. The display control device according to claim 2 or 3.

5. The acquisition unit further acquires information indicating a position of the vehicle, information indicating a current time, and information indicating a traveling direction of the vehicle, The vehicle information includes information indicating a position of the vehicle, information indicating a current time, and information indicating a traveling direction of the vehicle, The calculation method update unit updates the method to calculate the importance of the content based on the occupant information, information indicating a position of the vehicle, information indicating a current time, and information indicating a traveling direction of the vehicle. The display control device according to any one of claims 1 to 3.

6. the occupant information includes information indicating a desired object that the driver wants to highlight and display by the content, The calculation method update unit updates the method so as to calculate the importance of the content to be higher than a reference value, based on the vehicle information of the vehicle and information indicating matters to which the driver should pay attention. The display control device according to any one of claims 1 to 3.

7. A display control device according to any one of claims 1 to 3, A display unit mounted on the vehicle. Vehicle display device.

8. An acquisition unit acquires vehicle information relating to the vehicle and its surroundings, and occupant information relating to occupants including a driver who drives the vehicle; and updating a method for calculating the importance of content displayed by a display unit mounted on the vehicle, based on the vehicle information of the vehicle and the occupant information of the vehicle, by a calculation method update unit. Display control method.

9. A display control method according to claim 8, program.

Images