Vehicle display apparatus

Abstract

A vehicle display apparatus includes: a movement detection unit configured to detect movement of a portion of an operator's body; and a pattern display unit configured to display a first pattern indicating a part of the body and a second pattern different from the first pattern on an external scene around the vehicle. The pattern display unit changes the first pattern according to a detection result of the movement detection unit and changes the second pattern such that the first pattern operates the second pattern.

Description

TECHNICAL FIELD

[0001] The present application relates to a vehicle display device. BACKGROUND

[0002] In the related art, a vehicle display device described in JP 2013-114647 A and JP 2020-107030 A has been proposed.

[0003] JP 2013-114647 A and JP 2020-107030 A disclose that the display position of a pointer is moved in conjunction with a gesture operation of an operator. However, unlike actual operation, the above gesture operation does not have an operation sense. Therefore, there is a problem that discomfort is high, for example, it is not known how much to move the hand, how to move the hand, and the like, which also leads to deterioration of convenience. SUMMARY

[0004] The present application has been made in view of the above circumstances, and an object of the present application is to provide a vehicle display device that reduces discomfort and improves convenience.

[0005] According to an aspect of the present disclosure, there is provided a vehicle display device including: a movement detection unit configured to detect movement of a part of a body of an operator; and a pattern display unit configured to display, on an external scene around a vehicle, a first pattern indicating the part of the body and a second pattern different from the first pattern, wherein the pattern display unit changes the first pattern in accordance with a detection result of the movement detection unit, and changes the second pattern so that the first pattern operates the second pattern.

[0006] The vehicle display device according to the present application achieves an effect of improving convenience.

[0007] The present application is briefly described above. Furthermore, the details of the present application can be clarified by reading the modes for carrying out the present application (hereinafter, referred to as "embodiments") described below with reference to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0008] The present disclosure will become more fully understood from the detailed description given hereinbelow and the accompanying drawings, which are given by way of illustration only, and thus are not restrictive of the present disclosure, wherein:

[0009] Figure 1 is a schematic configuration diagram illustrating a vehicle display device according to an embodiment;

[0010] Figures 2A to 2C a real image visually recognized by an operator through a windshield and a virtual image displayed by the vehicle display device 1 are illustrated;

[0011] Figures 3A to 3CA real image visually recognized by the operator through the windshield and a virtual image displayed by the vehicle display device 1 are shown;

[0012] Figures 4A to 4C A real image visually recognized by the operator through the windshield and a virtual image displayed by the vehicle display device 1 are shown; and

[0013] Figures 5A to 5C A real image visually recognized by the operator through the windshield and a virtual image displayed by the vehicle display device 1 are shown. DETAILED DESCRIPTION

[0014] Hereinafter, a specific embodiment of the present application will be described with reference to the drawings.

[0015] Hereinafter, for the purpose of description, as shown in Figure 1 "front", "rear", "left", "right", "upper", and "lower" are defined. The "front-rear direction", "left-right direction", and "up-down direction" are orthogonal to each other.

[0016] As shown in Figure 1 The vehicle display device 1 of the present embodiment is installed on the vehicle 100 and constitutes a head-up display. The vehicle display device 1 is provided, for example, inside an instrument panel 101. The instrument panel 101 has an opening 101a which is open upward. The opening 101a faces a windshield 102 in the up-down direction of the vehicle 100.

[0017] The vehicle display device 1 includes a housing 4, a cover 5, an image display unit 20, a control unit 23, and an optical system 25. The image display unit 20, the control unit 23, and the optical system 25 are housed inside the housing 4. The housing 4 includes a main body 2 and a cover member 3 which is joined to the main body 2. The main body 2 includes an opening portion which is open upward. The cover member 3 closes the opening portion of the main body 2 from above. The cover member 3 includes a wall portion 30 which faces the opening 101a. The wall portion 30 has an opening 31 which is open upward. The housing 4 is provided so that the opening 31 faces the opening 101a. The cover 5 is a plate-like member which closes the opening 31 of the cover member 3. The cover 5 is made of a light-transmissive resin such as polycarbonate (PC) and acrylic resin.

[0018] The image display unit 20 is a device which emits display light 70 for an image. The image display unit 20 shown is a liquid crystal display device, and is, for example, a thin film transistor liquid crystal display (TFT-LCD). However, the image display unit 20 is not limited to a liquid crystal display device. The image display unit 20 can be, for example, a device which generates an image on a transmissive screen by scanning a screen with a laser.

[0019] The optical system 25 includes a first reflector 21 and a second reflector 22. The first reflector 21 reflects the display light 70 emitted from the image display unit 20 toward the second reflector 22. The first reflector 21 is, for example, a plane mirror. The second reflector 22 reflects the display light 70 toward the windshield 102. The shape of the reflective surface of the second reflector 22 is, for example, a free-form surface. The second reflector 22 is, for example, a concave mirror that amplifies the display light 70.

[0020] The display light 70 reflected by the second reflector 22 passes through the opening 31 and the opening 101a, and is reflected by the reflective surface 102a of the windshield 102 toward the operator 200, who is a vehicle occupant (e.g., the driver). A virtual image is formed by the display light 70 incident on the pupil 201 of the operator 200. The instrument panel 101 is provided with a tubular wall portion 103. The wall portion 103 surrounds the optical path of the display light 70 from the opening 31 toward the opening 101a.

[0021] The control unit 23 serving as a pattern display unit includes a control circuit that controls the image display unit 20. The control unit 23 is mounted on, for example, a control substrate provided inside the housing 4. The control unit 23 controls the image display unit 20 to generate an image according to, for example, a pre-stored program.

[0022] The vehicle 100 includes a movement detection unit 104 . The movement detection unit 104 includes, for example, a time-of-flight (TOF) sensor and a camera. The movement detection unit 104 detects movement of the operator's 200 hand (hand position, finger shape, etc.) and outputs the movement to the control unit 23 .

[0023] Next, we will refer to Figures 2A to 2C An operation example of the vehicle display device 1 having the above-described configuration is described. Figures 2A to 2C A real image visually recognized by the operator 200 through the windshield and a virtual image displayed by the vehicle display device 1 are shown.

[0024] The vehicle display device 1 is connected to an obstacle detection sensor (not shown), such as a light detection and ranging (LiDAR). Figure 2A As shown, when the obstacle detection sensor detects an obstacle around the vehicle, the control unit 23 displays an obstacle mark M21 (second pattern) indicating the obstacle around the obstacle 300 (real image) on the external scene around the vehicle that can be visually recognized through the windshield. Figures 2A to 2C In the example shown, a bicycle traveling ahead is detected as an obstacle 300. The obstacle mark M21 is a virtual image.

[0025] like Figure 2BAs illustrated, when the hand of the operator 200 is detected within the detection range of the movement detection unit 104, the control unit 23 displays a hand pattern M1 (first pattern) indicating the hand of the operator 200. The hand pattern M1 is a virtual image. The control unit 23 changes the hand pattern M1 in conjunction with the movement of the hand of the operator 200 detected by the movement detection unit 104.

[0026] Specifically, when the hand of the operator 200 has a shape with the index finger up, the control unit 23 also changes the hand pattern M1 to the shape with the index finger up, as illustrated in Figure 4B and 4C As illustrated, when the hand of the operator 200 has a shape with the index finger up, the control unit 23 also changes the hand pattern M1 to the shape with the index finger up, as illustrated in Figure 2B and 2C That is, the control unit 23 changes the shape of the hand pattern M1 in accordance with the shape of the hand of the operator 200. When the hand of the operator 200 moves in the left-right and front-back directions, the control unit 23 also changes the display position of the hand pattern M1 in the left-right and front-back directions.

[0027] When the movement detection unit 104 detects movement of the hand of the operator 200 gripping the obstacle marker M21 to bring the obstacle marker M21 outside the display area, the control unit 23 performs display so that the hand pattern M1 moves while gripping the obstacle marker M21 and moves the obstacle marker M21 out of the display area, as illustrated in Figure 2C Thereafter, the control unit 23 performs display so that the obstacle marker M21 disappears outside the display area.

[0028] As the movement of the hand of the operator 200 to bring the obstacle marker M21 outside the display area, movement to sweep the obstacle marker M21 out of the display area with the index finger is also considered in addition to the above-described gripping and moving movement. In this case, the control unit 23 changes the hand pattern M1 to the shape with the index finger up, and performs display so that the hand pattern M1 is sweeping the obstacle marker M21 with the index finger.

[0029] Next, an example of another operation of the vehicle display device 1 having the above-described configuration will be described with reference to Figures 3A to 3C As illustrated, when the navigation device receives route guidance information, the control unit 23 displays an arrow M22 (second pattern) for route guidance on a route superimposed on the outside scene. Figure 3A As illustrated in

[0030] As illustrated in Figure 3BAs shown, when the hand of operator 200 is detected within the detection range of movement detection unit 104, control unit 23 displays a hand pattern M1 (first pattern) indicating the hand of operator 200. Hand pattern M1 is a virtual image. Control unit 23 changes hand pattern M1 in accordance with the movement of operator 200's hand detected by movement detection unit 104.

[0031] When the movement detection unit 104 detects the movement of the operator 200's hand grasping the tip of the arrow M22 to change the direction of the tip, the control unit 23 performs display so that the hand pattern M1 moves while grasping the tip of the arrow M22 to change the direction of the arrow M22, as shown in FIG. Figure 3C Thereafter, the control unit 23 functions as a transmitting unit to transmit an instruction for changing the route to the direction of the changed arrow M22 to the navigation device.

[0032] Next, we will refer to Figures 4A to 4C Another example of the operation of the vehicle display device 1 having the above configuration will be described. The vehicle display device 1 is connected to a navigation device or smartphone. A location associated with map data is pre-registered in the map application of the navigation device or smartphone. This location is a store or tourist spot that the operator 200 or the like wants to visit, and this location is pre-registered by operating the navigation device or smartphone.

[0033] like Figure 4A As shown, the control unit 23 displays a position mark M23 (second pattern) on or around a building constructed at a pre-registered position of the external scene.

[0034] like Figure 4B As shown, when the hand of the operator 200 is detected within the detection range of the movement detection unit 104, the control unit 23 displays a hand pattern M1 indicating the hand of the operator 200. The hand pattern M1 is a virtual image. The control unit 23 changes the hand pattern M1 in accordance with the movement of the hand of the operator 200 detected by the movement detection unit 104.

[0035] When the movement detection unit 104 detects the operator 200's hand pressing the position marker M23, the control unit 23 changes the position marker M23 so that the hand pattern M1 presses the position marker M23. In this embodiment, for example, the position marker M23 is pressed and then closed (disappears). A window W1 containing information corresponding to the location is then superimposed on the external scene. Window W1 displays information such as the reservation screen, congestion status, and phone number for that location. Furthermore, when a phone number is touched by the hand pattern M1, a call can be made.

[0036] With reference Figures 2A to 2C Similar to the described example, the position mark M23 can be moved to the outside of the display area by the hand pattern M1.

[0037] Next, we will refer to Figures 5A to 5C An operation example of the vehicle display device 1 having the above configuration will be described. Figure 5A As shown, the control unit 23 displays a plurality of icons M24 (second pattern) associated with electronic devices such as a smartphone, a navigation device, and an air conditioner. Thereafter, when one of the icons M24 is touched with the hand pattern M1, as shown in FIG. Figure 5B As shown, the control unit 23 displays the operation panel P1 of the corresponding electronic device, such as Figure 5C When one of the icons M24 corresponding to the smartphone is touched, the same screen as that of the smartphone is mirror-displayed on the operation panel P1 and can be operated by the hand pattern M1.

[0038] When one of the icons M24 associated with an electronic device, such as an air conditioner, is touched, a switch pattern for operating that electronic device is displayed as a second pattern on the operation panel P1. The switch pattern displayed on the operation panel P1 can be operated by the hand pattern M1. When operated by the hand pattern M1, the switch pattern changes similarly to an actual switch. For example, if the switch pattern is a toggle switch, rocker switch, or push button switch, the switch pattern changes so that the direction or position of the lever or button is switched by the hand pattern M1.

[0039] Furthermore, if the switch pattern is a rotary switch, the switch pattern is changed so that the rotary switch is rotated by the hand pattern M1. If the switch pattern is a sliding switch, the switch pattern is changed so that the lever slides by the hand pattern M1. Furthermore, the switch pattern can be turned on, off, or change color by the operation of the hand pattern M1, rather than physically changing.

[0040] According to the above embodiment, since the obstacle mark M21, arrow M22, position mark M23, and icon M24 can be operated by changing the hand pattern M1 in the same manner as the hand, it is easy to intuitively understand how to move the hand, and convenience can be improved. In addition, since the hand pattern M1 is displayed on the external scene around the vehicle, the hand pattern M1 can be visually recognized as a part of the actual body, and discomfort can be reduced.

[0041] according to Figures 2A to 2C In the embodiment shown above, when the movement detection unit 104 detects the movement of a hand that moves the obstacle mark M21 outside the display area, the control unit 23 displays the hand pattern M1 so that the obstacle mark M21 moves outside the display area. Therefore, by intuitively moving the hand, the obstacle mark M21 can be made to disappear outside the display area.

[0042] according to Figures 3A to 3CIn the above-described embodiment, the control unit 23 displays the arrow M22 for route guidance as superimposed on the route of the external scene based on the route information from the navigation device, and then when the movement detecting unit 104 detects the movement of the hand that changes the direction of the tip of the arrow M22, the control unit 23 performs display so that the hand pattern M1 moves the tip of the arrow M22 to change the direction of the arrow M22, and transmits an instruction for changing the route to the navigation device. Thus, the route can be changed by moving the hand intuitively.

[0043] The present application is not limited to the above-described embodiment, and appropriate modifications, improvements, and the like can be made. Furthermore, the materials, shapes, sizes, numbers, arrangement positions, and the like of the components in the above-described embodiment are freely selected, and are not limited as long as the present application can be achieved.

[0044] According to the above-described embodiment, the hand pattern M1 is displayed in conjunction with the movement of the hand, but the present application is not limited thereto. For example, the arm and hand pattern can be displayed in conjunction with the movement of the arm and hand.

[0045] According to the above-described embodiment, the vehicle display device 1 displays the hand pattern M1, the obstacle mark M21, the arrow M22, the position mark M23, and the icon M24, which are virtual images on the external scene of the real image, but the present application is not limited thereto. It is also conceivable to display the external scene image around the vehicle taken by the camera on the display monitor displayed in the vehicle, and to display the hand pattern M1, the obstacle mark M21, the arrow M22, the position mark M23, and the icon M24 to be superimposed on the external scene image.

[0046] The following [1] to [5] briefly summarize and list the features of the above-described vehicle display device embodiment according to the present application.

[0047] [1] A vehicle display device (1) comprising:

[0048] a movement detecting unit (104) configured to detect movement of a part of a body of an operator (200); and

[0049] a pattern display unit (23) configured to display a first pattern (M1) indicating the part of the body and a second pattern (M21 to M24) different from the first pattern (M1) on an external scene around a vehicle, wherein

[0050] the pattern display unit (23) changes the first pattern (M1) in accordance with a detection result of the movement detecting unit (104), and changes the second pattern (M21 to M24) so that the first pattern (M1) operates the second pattern (M21 to M24).

[0051] According to the vehicle display device (1) having the configuration [1], since the second pattern (M21 to M24) can be operated by changing the first pattern (M1) in the same manner as a part of the body, it is easy to intuitively understand how to move the hand, and the convenience can be improved. Further, since the first pattern (M1) is displayed on the outside scene around the vehicle, the first pattern (M1) can be visually recognized as a part of the actual own body, and the discomfort can be reduced.

[0052] [2] The vehicle display device (1) according to [1], wherein

[0053] When the movement detection unit (104) detects the movement of the part of the body that brings the second pattern (M21) to the outside of the display region, the pattern display unit (23) performs display so that the first pattern (M1) moves the second pattern (M21) to bring the second pattern (M21) to the outside of the display region.

[0054] According to the vehicle display device (1) having the configuration [2], the second pattern (M21 to M24) can disappear to the outside of the display region by intuitively moving the part of the body.

[0055] [3] The vehicle display device (1) according to [1], wherein

[0056] The pattern display unit (23) displays an arrow (M22) for route guidance on a route to be superimposed on the outside scene as the second pattern based on route information from the navigation device, and then performs display so that, when the movement detection unit (104) detects the movement of the part of the body that changes the tip direction of the arrow (M22), the first pattern (M1) moves the tip of the arrow (M22) to change the direction of the arrow (M22), and

[0057] The vehicle display device further includes a transmission unit (23) configured to transmit an instruction for changing the route to the navigation device when the movement detection unit (104) detects the movement of the part of the body that changes the tip direction of the arrow (M22).

[0058] According to the vehicle display device (1) having the configuration [3], the route can be changed by intuitively moving the part of the body.

[0059] [4] The vehicle display device (1) according to [1], wherein

[0060] The pattern display unit (23) displays a second pattern (M23) on a building or around a building built at a position registered in advance on the outside scene, and then when the movement detection unit (104) detects movement of a part of the body operating the second pattern (M23), changes the second pattern (M23) so that the first pattern (M1) operates the second pattern (M23), and then displays information about the position on the outside scene.

[0061] According to the vehicle display device (1) having the configuration [4], it is possible to display position information related to the second pattern (M23) by moving a part of the body intuitively.

[0062] [5] The vehicle display device (1) according to [1], in which

[0063] The pattern display unit (23) displays an icon (M24) corresponding to an electronic device as the second pattern, and then when the movement detection unit (104) detects movement of a part of the body operating the icon (M24), changes the icon (M24) so that the first pattern (M1) operates the icon (M24), and then displays an operation panel (P1) of the electronic device.

[0064] According to the vehicle display device (1) having the configuration [5], it is possible to operate an electronic device associated with the icon (M24) by moving a part of the body intuitively.

Claims

1. A vehicle display device, comprising: a movement detection unit configured to detect movement of a part of an operator's body; and a pattern display unit configured to display a first pattern indicating a part of a body and a second pattern different from the first pattern on an external scene around the vehicle, wherein The pattern display unit changes the first pattern according to a detection result of the movement detection unit, and changes the second pattern so that the first pattern operates the second pattern.

2. The vehicle display device according to claim 1, wherein When the movement detection unit detects movement of the body part that brings the second pattern outside the display area, the pattern display unit performs display so that the first pattern moves the second pattern to bring the second pattern outside the display area.

3. The vehicle display device according to claim 1, wherein the pattern display unit displays an arrow for route guidance on a route to be superimposed on the external scene as the second pattern based on route information from the navigation device, and then performs display so that when the movement detection unit detects movement of a part of the body that changes the direction of the tip of the arrow, the first pattern moves the tip of the arrow to change the direction of the arrow, and The vehicle display device further includes a transmitting unit configured to transmit an instruction for changing the route to the navigation device when the movement detection unit detects movement of the part of the body that changes the direction of the tip of the arrow.

4. The vehicle display device according to claim 1, wherein The pattern display unit displays the second pattern on or around a building constructed at a pre-registered position on the external scene, and then when the motion detection unit detects movement of a part of the body operating the second pattern, changes the second pattern so that the first pattern operates the second pattern, and then displays information about the position on the external scene.

5. The vehicle display device according to claim 1, wherein The pattern display unit displays an icon corresponding to the electronic device as the second pattern, and then when the movement detection unit detects movement of a part of the body operating the icon, changes the icon so that the first pattern operates the icon, and then displays the operation panel of the electronic device.

Images