Vehicle display control device

Abstract

To provide a display control device for a vehicle capable of appropriately controlling a display unit based on at least one of information regarding a line of sight of an occupant and information regarding head shaking condition.SOLUTION: A control unit provided on a wearable device attached to a head of an occupant of a vehicle and controls a display unit 32 that is located immediately in front of the eyes of the occupant when the wearable device is attached to the head portion and is capable of displaying a plurality of object images is provided, and it is determined whether or not the control unit causes the display unit to display specific object images OP1 and OP2 that are predetermined object images based on at least one of information regarding the line of sight of the occupant and information regarding the head shaking condition of the occupant.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a display control device for a vehicle.

Background Art

[0002] Patent Document 1 below discloses a wearable terminal worn on the head of a vehicle occupant. This wearable terminal has a display unit that is positioned immediately in front of the occupant's eyes when worn on the head and can display a plurality of types of object images.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In Patent Document 1 above, there is room for improvement in appropriately controlling the display unit based on at least one of information regarding the occupant's line of sight and information regarding head shaking.

[0005] In consideration of the above facts, an object of the present invention is to obtain a display control device for a vehicle that can appropriately control a display unit based on at least one of information regarding the occupant's line of sight and information regarding head shaking.

Means for Solving the Problems

[0006] The vehicle according to claim 1 The dual-use display control device isA wearable terminal is provided on the head of a vehicle occupant, and includes a control unit that controls a display unit that is positioned directly in front of the occupant's eyes when the wearable terminal is worn on the head and is capable of displaying multiple types of object images, and the control unit determines whether or not to display a specific object image, which is a predetermined object image, on the display unit based on at least one of information regarding the occupant's gaze and information regarding the occupant's head movements. When the control unit determines that the occupant is visually observing a predetermined object located around the vehicle, the control unit deletes a first specific object image from the display unit that is displayed on the display unit, is included in the specific object image, and is different from the object. .

[0007] The control unit of the vehicle display control device according to claim 1 controls a display unit provided in a wearable terminal that is capable of displaying multiple types of object images. Furthermore, the control unit determines whether or not to display a specific object image, which is a predetermined object image, on the display unit based on at least one of information regarding the occupant's gaze and information regarding the occupant's head movements. Therefore, the vehicle display control device according to claim 1 can appropriately control the display unit based on at least one of information regarding the occupant's gaze and information regarding head movements. [Effects of the Invention]

[0008] As described above, the vehicle display control device according to the present invention has the excellent effect of being able to appropriately control the display unit based on at least one of the information regarding the occupant's gaze and the information regarding head movement. [Brief explanation of the drawing]

[0009] [Figure 1] This is a schematic side view showing the interior of a vehicle to which the vehicle display control device according to the embodiment is applied. [Figure 2] This is a control block diagram of the hardware configuration of the vehicle's ECU and AR glasses. [Figure 3] This is a functional block diagram of the hardware configuration of AR glasses. [Figure 4] This diagram shows the objects that can be seen by the crew. [Figure 5] This diagram shows the objects that can be seen by the crew. [Figure 6]This diagram shows the objects that can be seen by the crew. [Figure 7] This is a magnified view of the object image. [Figure 8] This is a flowchart illustrating the processes performed by the CPU of AR glasses. [Modes for carrying out the invention]

[0010] Hereinafter, embodiments of the vehicle display control device according to the present invention will be described with reference to the attached drawings. The vehicle display control device 100 of the embodiment (hereinafter, control device 100) is applied to a vehicle 10 and AR glasses (wearable terminal) 30. Arrows FR shown as appropriate in each figure indicate the front of the vehicle in the front-rear direction, arrow UP indicates the upper side of the vehicle in the vertical direction, and arrow LH indicates the left side of the vehicle in the left-right direction (vehicle width direction).

[0011] As shown in Figure 1, the vehicle body 11 of the vehicle 10 is equipped with a front windshield 12. Furthermore, the vehicle body 11 is equipped with an instrument panel 13, an ECU 15, and a driver's seat 25.

[0012] As shown in Figure 2, the ECU 15 consists of a CPU (Central Processing Unit: processor) 16, ROM (Read Only Memory) 17, RAM (Random Access Memory) 18, storage 19, communication interface 20, and input / output interface 21. The CPU 16, ROM 17, RAM 18, storage 19, communication interface 20, and input / output interface 21 are connected to each other via bus 22 so that they can communicate with one another. The ECU 15 can obtain date and time information from a timer (not shown).

[0013] The CPU 16 is a central processing unit that executes various programs and controls each component. That is, the CPU 16 reads a program from the ROM 17 or the storage 19 and executes the program using the RAM 18 as a work area. The CPU 16 performs control of each component and various arithmetic processes (information processing) according to the program recorded in the ROM 17 or the storage 19.

[0014] The ROM 17 stores various programs and various data. The RAM 18 temporarily stores a program or data as a work area. The storage 19 is composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs and various data. The communication I / F 20 is an interface capable of communicating with a device located outside the vehicle 10. For example, the communication I / F 20 can communicate wirelessly with the AR glasses 30. The communication I / F 20 uses communication standards such as Bluetooth (registered trademark), Wi-Fi (registered trademark), etc. Further, the communication I / F 20 can communicate with an ECU different from the ECU 15 provided in the vehicle 10 via an external bus.

[0015] As shown in FIG. 1, an AR glasses 30, which is a wearable terminal of a head-mounted display type, is worn on the head P1 of the occupant P sitting in the driver's seat 25 of the vehicle 10. The AR glasses 30 uses AR (Augmented Reality) technology to superimpose and display contents such as images and characters on an object or the scenery outside the vehicle that the occupant P visually recognizes through the AR glasses 30 (display unit 32). The AR glasses 30 includes a main body 31, a display unit (display part) 32, a line-of-sight sensor 33, a camera 34, an acceleration sensor (IMU sensor) 35, a hardware configuration 36, and a battery (not shown).

[0016] The main body 31 is a part worn on the head P1.

[0017] The display unit 32 is provided at the front part of the main body 31. That is, when the main body 31 is worn on the head part P1, the display unit 32 is positioned immediately in front of both eyes of the occupant P. The display unit 32 is a transmissive display that displays various types of object images (contents, holograms) such as images, characters, and icons that can be visually recognized by the occupant P. In the following description, the front of the display unit 32 (head part P1) is defined as the unit front, the left side of the display unit 32 is defined as the unit left, the right side of the display unit 32 is defined as the unit right, the upper side of the display unit 32 is defined as the unit upper, and the lower side of the display unit 32 is defined as the unit lower. Therefore, for example, only when the head part P1 is facing forward, the vehicle front FR coincides with the unit front, the vehicle left LH coincides with the unit left, and the vehicle upper UP coincides with the unit upper. The occupant P can visually recognize objects in front of the unit through the display unit 32. Furthermore, since the display unit 32 is semi-transparent, the occupant P can visually recognize the scenery in front of the AR glasses 30 through the display unit 32.

[0018] The line-of-sight sensor 33 detects the direction of the line of sight EL of the occupant P wearing the AR glasses 30.

[0019] The camera 34 can photograph objects located in front of the unit and objects located around them. That is, the camera 34 can photograph objects located within the range of its own angle of view.

[0020] The acceleration sensor 35 detects the accelerations in the unit upper, unit lower, unit left, and unit right of the AR glasses 30 (head part P1).

[0021] The battery supplies power to the display unit 32, the line-of-sight sensor 33, the camera 34, the acceleration sensor 35, and the hardware configuration 36.

[0022] As shown in Figure 2, the display unit 32, gaze sensor 33, camera 34, and acceleration sensor 35 are connected to the hardware configuration 36 (input / output I / F 42). The hardware configuration 36 includes a CPU (control unit) 37, ROM 38, RAM 39, storage 40, communication I / F 41, and input / output I / F 42. The CPU 37, ROM 38, RAM 39, storage 40, communication I / F 41, and input / output I / F 42 are connected to each other via bus 43 so that they can communicate with one another. The functions of the CPU 37, ROM 38, RAM 39, storage 40, communication I / F 41, and input / output I / F 42 are the same as those of the CPU 16, ROM 17, RAM 18, storage 19, communication I / F 20, and input / output I / F 21, respectively. The ROM 38 or storage 40 stores a program (application) for displaying object images OP1, OP2, OP3, and OP4 on the display unit 32.

[0023] Storage 40 records various object information. This object information includes, for example, the object images (specific object image) (first specific object image) OP1, object image (specific object image) (first specific object image) OP2, object image (specific object image) OP3, and object image (specific object image) (second specific object image) OP4 shown in Figures 4 to 6. Object image OP1 is an image representing an arrow indicating the direction of a driving route set using the navigation system installed in the vehicle 10. Object image OP2 is an image representing predetermined advertising content. Object image OP3 is an image representing the position of a moving object moving around the vehicle 10. This moving object includes, for example, pedestrians, vehicles, and bicycles. Object image OP4 is an image representing an emergency vehicle, including an ambulance and a police vehicle, approaching the vehicle 10. For example, the alarm sound analysis unit installed in vehicle 10 analyzes the alarm sound emitted by the emergency vehicle, or the wireless receiver installed in vehicle 10 receives the wireless signal indicating that the emergency vehicle is departing, thereby allowing vehicle 10 (CPU 16) to recognize that an emergency vehicle is approaching vehicle 10.

[0024] As shown in Figure 3, the hardware configuration 36 of the AR glasses 30 has, as a functional configuration, an acceleration calculation unit 45, an image processing unit 46, and a display control unit 47. The acceleration calculation unit 45, the image processing unit 46, and the display control unit 47 are realized when the CPU 37 of the hardware configuration 36 reads and executes a program stored in the ROM 38 or storage 40.

[0025] The image processing unit 46 determines whether or not a predetermined subject is included in the captured data by processing the captured data acquired by the camera 34. This predetermined subject includes, for example, a driving route (road) set using the navigation system, and a moving object. Note that the computational load on the CPU 37 when the image processing unit 46 performs image processing is greater than the computational load on the CPU 37 when the acceleration calculation unit 45 calculates relative acceleration. Therefore, the image processing unit 46 (CPU 37) performs image processing every time a first predetermined time, which is longer than a first predetermined time, has elapsed. The first predetermined time is, for example, 1.0 second. However, the first predetermined time may be a time of a different length than 1.0 second.

[0026] The acceleration calculation unit 45 calculates the relative acceleration of the head P1 with respect to the vehicle 10 (hereinafter referred to as relative acceleration) based on the acceleration of the head P1 acquired by the acceleration sensor 35. The acceleration calculation unit 45 (CPU 37) calculates the relative acceleration every time a second predetermined time has elapsed. This second predetermined time is, for example, 1 / 100 of a second. However, the second predetermined time may be a time of a different length than 1 / 100 of a second.

[0027] The display control unit 47 reads object information from the storage 40 when a predetermined condition is met, and displays the object images OP1, OP2, OP3, and OP4 represented by the object information on the display unit 32.

[0028] As shown in Figure 1, the head direction UL is defined as a straight line extending from the midpoint between the eyes of the head P1 toward the front of the unit and passing through the center of the display unit 32. Furthermore, the head direction UL when the head P1 of an occupant P seated in the driver's seat 25 is facing toward the front FR side of the vehicle and the head direction UL extends toward the front (horizontal) side of the unit is referred to as the first reference direction SD1. Furthermore, the angle between the head direction UL and the first reference direction SD1 is defined as the head angle θ1. The head direction UL may change, for example, in the left-right and up-down directions. Also, the direction of the line of sight EL when the head P1 of an occupant P seated in the driver's seat 25 is facing toward the front FR side of the vehicle and the line of sight EL extends toward the front FR side of the vehicle (horizontal) is referred to as the second reference direction SD2. Furthermore, the angle between the line of sight EL and the second reference direction SD2 is defined as the line of sight angle θ2. The line of sight EL may change, for example, in the left-right and up-down directions. For example, when the head angle θ1 is zero degrees and occupant P is looking forward FR of the vehicle, the line of sight EL extends from occupant P to FR of the vehicle. Also, when the head angle θ1 is zero degrees and occupant P is looking upward UP of the vehicle, the line of sight EL extends from occupant P to upward UP of the vehicle.

[0029] Figure 4(a) shows the objects visible to the occupant P when the head direction UL is the first reference direction SD1 and the line of sight EL is the second reference direction SD2. The objects visible in this case include the front windshield 12 of the vehicle 10, as well as objects and scenery on the FR side of the front windshield 12 that the occupant P sees through the front windshield 12.

[0030] Figure 4(b) shows the objects of view when AR glasses 30 are attached to the head P1 in the state shown in Figure 1, the head direction UL coincides with the first reference direction SD1, and the direction of the line of sight EL coincides with the second reference direction SD2. At this time, the display unit 32 is located in front of (directly in front of) the head unit P1, and the line of sight EL passes through the center of the display unit 32. The objects of view at this time include the display unit 32, the front windshield 12, and objects and scenery on the FR side in front of the vehicle beyond the front windshield 12. Furthermore, the occupant P can see the driving route 50 (see Figure 4) set using the navigation system through the display unit 32 and the front windshield 12. This driving route 50 includes the road 51 on which the vehicle 10 is traveling, and a road 52 that extends to the right from a part of road 51.

[0031] For example, in the state shown in Figure 4(b), the ECU 15 determines that vehicle 10 is traveling along route 50 based on the map information of the navigation system and the location information of vehicle 10 acquired by the GNSS (Global Navigation Satellite System) receiver mounted on vehicle 10. At this time, the display control unit 47 determines, based on the information received from the ECU 15, that vehicle 10 is traveling near an intersection on route 50. This intersection is where a part of road 51 and road 52 intersect. At this time, as shown in Figure 4(b), the display control unit 47 causes the display unit 32 to display object image OP1. At this time, the display control unit 47 causes the display unit 32 to display object image OP1 so that the occupant P recognizes that object image OP1 is superimposed on the intersection of route 50 recognized by the image processing unit 46. The display position of object image OP1 on the display unit 32 in this case is the set display position of object image OP1.

[0032] Furthermore, the display control unit 47 causes the display unit 32 to display the object image OP2 as shown in Figure 4(b) while predetermined conditions are met. For example, if the display control unit 47 determines that the vehicle 10 is stopped based on the detection value of the vehicle speed sensor installed on the vehicle 10, the object image OP2 is displayed on the display unit 32. At this time, the object image OP2 is displayed in a predetermined area of ​​the display unit 32. For example, this predetermined area is the upper left corner of the display unit 32. This position is the set display position for the object image OP2.

[0033] Furthermore, if the head P1 is facing a direction different from the front FR side of the vehicle, the head angle θ1 will be greater than zero regardless of the direction of the line of sight EL. For example, if the head direction UL moves upward from the first reference direction SD1, the display unit 32 (AR glasses 30) moves upward relative to the driver's seat 25 by a distance corresponding to the magnitude of the head angle θ1, as shown by the dashed line in Figure 4(b).

[0034] For example, in the state shown in Figure 4(b), if the head direction UL moves to the left of the first reference direction SD1, the display unit 32 (AR glasses 30) moves to the left from the position in Figure 4(b) by a distance corresponding to the size of the head angle θ1, as shown in Figure 4(c). Furthermore, if the head angle θ1 is greater than or equal to the first threshold, the display unit 32 controlled by the display control unit 47 erases the object images OP1 and OP2. In other words, when the display control unit 47 determines that the occupant P is not visually perceiving the object images OP1 and OP2, the object images OP1 and OP2 are erased from the display unit 32. In this case, it is highly likely that the occupant P's attention is directed in a predetermined direction different from the front FR side of the vehicle (for example, the left LH side of the vehicle). That is, in this case, it is highly likely that the act of directing one's attention in that predetermined direction is of greater importance to the occupant P than the act of visually recognizing the object images OP1 and OP2. In this case, the object images OP1 and OP2 are removed from the display unit 32, making it easier for the crew member P to concentrate on directing their attention in a predetermined direction.

[0035] On the other hand, in the state shown in Figure 4(b), when the orientation of the head P1 is changed so that the head angle θ1 is less than the first threshold and greater than the second threshold which is smaller than the first threshold, the display unit 32 controlled by the display control unit 47 changes the display position of the object image OP1 on the display unit 32 using the processing result of the image processing unit 46, while keeping the object image OP2 displayed at the set display position. That is, as shown in Figure 4(d), the display control unit 47 moves the object image OP1 on the display unit 32 so that the object image OP1 is superimposed on a predetermined part of the travel route 50 recognized by the image processing unit 46. This object image position adjustment process using the processing result of the image processing unit 46 will be referred to as the first adjustment process in the following description. The first adjustment process can be executed at first predetermined time intervals.

[0036] Furthermore, when the head angle θ1 is less than the first threshold and greater than the second threshold, the display control unit 47 adjusts the display position of the object image OP1 in the display unit 32 based on the relative acceleration. Hereinafter, the adjustment of the object image position based on relative acceleration will be referred to as the second adjustment process. The second adjustment process can be executed at second predetermined time intervals. This second adjustment process moves the position of the object image OP1 in the display unit 32 to the opposite side of the relative acceleration direction. That is, as shown in Figure 4(d), the second adjustment process moves the position of the object image OP1 in the display unit 32 to the right.

[0037] In this way, the first and second adjustment processes bring the position of the object image OP1 on the display unit 32 closer to a position where it overlaps with a predetermined area. Since the first threshold is a small value, in this case, there is a high probability that the occupant P will recognize that the object image OP1, whose position has been adjusted by the first and second adjustment processes, is overlapping with the predetermined area.

[0038] Here, we assume that in the state shown in Figure 4(b), the display control unit 47 determines, based on relative acceleration, that vibration has occurred in the head P1 within a range where the head angle θ1 is less than or equal to a second threshold, which is smaller than the first threshold. In this case, as shown by dashed lines in Figure 4(e), the object image OP1 moves on the display unit 32 by an amount corresponding to the amount of vibration due to the first and second adjustment processes. Therefore, there is a high probability that the occupant P will recognize that the position-adjusted object image OP1 is superimposed on a predetermined area.

[0039] If the orientation of the head P1 is subsequently changed so that the head direction UL is exactly or nearly coincides with the first reference direction SD1, the display unit 32 returns to the state shown in Figure 4(b).

[0040] Next, let's consider the case where the moving object 55, located diagonally to the left and in front of the vehicle 10, moves to the right, as shown in Figure 5(a). In this case, the occupant P turns their head P1 to the left while changing the head angle θ1 by more than the first threshold in order to see the moving object 55. In this case, compared to the case in Figure 4(b), the display unit 32 moves to the left, and the left end of the display unit 32 overlaps with the moving object 55. Furthermore, the display control unit 47 causes the display unit 32 to display the object image OP3 so that it overlaps with the area around the moving object 55 recognized by the image processing unit 46 using a pattern matching method or the like. The display position of the object image OP3 in this case is the set display position of the object image OP3. When the moving object 55 moves further, the first adjustment process changes the set display position of the object image OP3 to a position that overlaps with the area around the moving object 55.

[0041] At this time, the head angle θ1 exceeds the first threshold, so the object images OP1 and OP2 are removed from the display unit 32, as shown in Figure 5(a). As a result, the occupant P can concentrate their attention on the act of visually identifying the moving object 55, which is a more important act than the act of visually recognizing the object images OP1 and OP2.

[0042] In this case, when the head angle θ1 changes, the first and second adjustment processes are performed on the object image OP3 regardless of the magnitude of the head angle θ1.

[0043] Figure 5(b) shows the state in which the moving body 55 has moved to the right side of the road 51. That is, Figure 5(b) shows the state in which the moving body 55 has completed its crossing of the road 51. At this time, the occupant P does not need to see the moving body 55. Therefore, as shown in Figure 5(b), the head direction UL coincides with the first reference direction SD1. As a result, the display unit 32 controlled by the display control unit 47 displays the object images OP1 and OP2 again at their respective set display positions.

[0044] As shown in Figure 5(c), when the head direction UL coincides with the first reference direction SD1, the occupant P may see the moving object 55 by moving their line of sight EL to the left of the second reference direction SD2. That is, the occupant P may see the moving object 55 while the line of sight angle θ2 is greater than or equal to the first threshold. In this case, the display control unit 47 determines that the occupant P is seeing the moving object 55 based on the captured data from the camera 34 and the detected value from the line of sight sensor 33. Furthermore, since the line of sight angle θ2 is greater than or equal to the first threshold, the object images OP1 and OP2 are removed from the display unit 32. In this case as well, when the moving object 55 moving to the right overlaps with a part of the display unit 32, the object image OP3 is displayed on the display unit 32.

[0045] Furthermore, let's consider the situation in Figure 4(b), where a moving object 55 (not shown in Figure 4(b)) located diagonally to the left front of vehicle 10 moves to the right, and an emergency vehicle (not shown) is approaching vehicle 10. At this time, the head P1 is turned towards the left side LH of the vehicle, causing the head angle θ1 to exceed the first threshold. Therefore, as shown in Figure 6(a), the left end of the display unit 32 overlaps with the moving object 55. Furthermore, the display unit 32 displays object image OP3 so that the occupant P recognizes that it is overlapping the area around the moving object 55. The display control unit 47 then causes the display unit 32 to display object image OP4. As shown in Figure 7, object image OP4 contains the words "Emergency vehicle approaching". Therefore, the occupant P, upon seeing object image OP4, recognizes that an emergency vehicle is approaching vehicle 10. Furthermore, at this time, the display control unit 47 causes the display unit 32 to display the object image OP4 so that the object image OP4 is superimposed on a predetermined portion 12A of the front windshield 12. The display position of the object image OP4 in this case is the set display position of the object image OP4. Furthermore, when the head angle θ1 changes, regardless of the magnitude of the head angle θ1, the first adjustment process and the second adjustment process are performed on the object image OP4.

[0046] Even when object image OP3 is displayed on display unit 32, object image OP4 is not removed from display unit 32. In other words, object image OP4 continues to be displayed on display unit 32 regardless of whether crew member P is viewing object image OP4 or not. Therefore, even when crew member P is viewing the moving object 55 (object image OP3), they can still view object image OP4, which represents highly important information.

[0047] Furthermore, when the object image OP4 is displayed on the display unit 32, a speaker (not shown) provided on the vehicle 10 may output sound to notify the approach of an emergency vehicle.

[0048] Figure 6(b) shows the state where the moving object 55 has moved to the right side of the road 51. At this time, the occupant P does not need to see the moving object 55. Therefore, as shown in Figure 6(b), the head direction UL coincides with the first reference direction SD1. Furthermore, if the vehicle 10 (CPU 16) recognizes that an emergency vehicle is approaching the vehicle 10, the object image OP4 will continue to be displayed on the display unit 32.

[0049] The ECU 15 and AR glasses 30, among the components described above, are the components of the control device 100 in this embodiment.

[0050] (Mechanism of action and effect) Next, the operation and effects of the embodiment will be described.

[0051] The following describes the processing flow performed by the CPU 37 of the AR glasses 30 using the flowchart in Figure 8. The CPU 37 repeatedly executes the processing shown in the flowchart in Figure 8 after a predetermined amount of time has elapsed. It is assumed that the AR glasses 30 are attached to the head P1 and that the AR glasses 30 are communicating wirelessly with the communication I / F 20 of the ECU 15.

[0052] First, in step S10, the CPU 37 determines whether or not the vehicle 10 is traveling along the set travel route 50.

[0053] If the CPU 37 determines Yes in step S10, it proceeds to step S11, where it displays the object image OP1 on the display unit 32 and, if necessary, executes the first adjustment process and the second adjustment process.

[0054] After completing the process in step S11, the CPU 37 proceeds to step S12 to determine whether a predetermined condition has been met. For example, if the vehicle 10 is stopped, the CPU 37 determines Yes in step S12.

[0055] If the CPU 37 determines "Yes" in step S12, it proceeds to step S13 and displays the object image OP2 on the display unit 32.

[0056] After completing the processing in step S13, the CPU 37 proceeds to step S14 and determines whether at least one of the head angle θ1 and the line of sight angle θ2 is greater than or equal to the first threshold.

[0057] If the CPU 37 determines "Yes" in step S14, it proceeds to step S15, instructing the display unit 32 to erase object images OP1 and OP2. If object image OP1 is displayed on the display unit 32 and object image OP2 is not displayed, the display unit 32 erases object image OP1. If object image OP2 is displayed on the display unit 32 and object image OP1 is not displayed, the display unit 32 erases object image OP2. If neither object images OP1 nor OP2 are displayed on the display unit 32, the display unit 32 maintains its current state.

[0058] After completing the process in step S15, the CPU 37 proceeds to step S16 and determines whether or not there is a moving object 55 that overlaps with the display unit 32.

[0059] If the CPU 37 determines Yes in step S16, it proceeds to step S17, where it displays the object image OP3 on the display unit 32 and, if necessary, executes the first and second adjustment processes. Furthermore, in step S17, the CPU 37 executes the same process as in S15.

[0060] After completing the process in step S17, the CPU 37 proceeds to step S18 and determines whether or not an emergency vehicle is approaching vehicle 10.

[0061] If the CPU 37 determines Yes in step S18, it proceeds to step S19, where it displays the object image OP4 on the display unit 32 and, if necessary, executes the first adjustment process and the second adjustment process.

[0062] After completing the process in step S19, CPU 37 terminates the process shown in the flowchart in Figure 8.

[0063] As described above, the CPU 37 of the control device 100 in this embodiment controls a display unit 32 capable of displaying multiple types of object images OP1, OP2, OP3, and OP4. Furthermore, the CPU 37 determines whether or not to display the object images OP1, OP2, OP3, and OP4 on the display unit 32 based on at least one of the information regarding the occupant P's line of sight EL and the information regarding the head direction UL (the occupant P's head movement). Therefore, the CPU 37 can appropriately control the display unit 32 based on at least one of the information regarding the line of sight EL and the information regarding the head direction UL.

[0064] Furthermore, when the control device 100 determines that the occupant P is not viewing the object images OP1 and OP2 displayed on the display unit 32, it deletes the object images OP1 and OP2 from the display unit 32. Object images OP1 and OP2 are object images that the occupant P does not need to view. Therefore, the control device 100 can prevent object images OP1 and OP2 from being displayed on the display unit 32 when the occupant P is not viewing them. As a result, the computational load on the CPU 37 is reduced compared to when object images OP1 and OP2 continue to be displayed on the display unit 32 in such cases. Furthermore, when at least one of the head angle θ1 and the line of sight angle θ2 is below the first threshold, the first adjustment process and the second adjustment process are executed with respect to the object image OP1 displayed on the display unit 32. However, depending on the vehicle speed and vibration magnitude of the vehicle 10 and the manner of head movement of P1, the object image OP1 may not be accurately superimposed on a predetermined part on the travel route 50. It is undesirable to continue displaying object image OP1 on the display unit 32 without it overlapping with a predetermined area. However, in this embodiment, this problem is not likely to occur when it is determined that the occupant P is not visually viewing object images OP1 and OP2 displayed on the display unit 32.

[0065] Furthermore, when the control device 100 determines that the occupant P has identified a predetermined object, the moving body 55, located around the vehicle 10, it erases the object images OP1 and OP2 from the display unit 32. As a result, the occupant P can concentrate on identifying the moving body 55 (object image OP3), which requires more visual identification than the object images OP1 and OP2.

[0066] Furthermore, in this embodiment, the control device 100 continues to display the object image OP4 on the display unit 32 regardless of whether the occupant P is viewing the object image OP4 or not. The object image OP4 is an object image that the occupant P has a high need to view. Therefore, the control device 100 continues to display the object image OP4, which is of high importance to the occupant P, on the display unit 32 regardless of whether the occupant P is viewing the object image OP4 or not.

[0067] Although the control device 100 according to the embodiment has been described above, the control device 100 can be modified as appropriate without departing from the spirit of the present invention.

[0068] For example, the gaze line EL of the occupant P may be detected using a gaze detection camera (not shown) installed inside the vehicle 10.

[0069] The accelerometer 35 may be omitted from the AR glasses 30. [Explanation of symbols]

[0070] 10 vehicles 30 AR Glasses (Wearable Devices) 32 Display Unit (Display Section) 37. CPU (Control Unit) 55 Moving object (object) EL line of sight UL head direction OP1 Object Image (Specific Object Image) (First Specific Object Image) OP2 Object Image (Specific Object Image) (First Specific Object Image) OP3 Object Image (Specific Object Image) OP4 Object Image (Specific Object Image) (Second Specific Object Image) P Crew P1 head

Claims

[Claim 1] A wearable terminal is attached to the head of a vehicle occupant, and includes a control unit that controls a display unit that is positioned directly in front of the occupant's eyes when the wearable terminal is attached to the head and is capable of displaying multiple types of object images. The control unit, Based on at least one of the information relating to the occupant's line of sight and the information relating to the occupant's head movements, it is determined whether or not to display a specific object image, which is a predetermined object image, on the display unit. A vehicle display control device that, when the control unit determines that the occupant is visually viewing a predetermined object located around the vehicle, deletes a first specific object image from the display unit that is displayed on the display unit, is included in the specific object image, and is different from the object.

Images