Vehicle display device

The vehicle display device addresses discomfort and poor convenience by using a movement detection unit to synchronize hand movements with virtual representations, enhancing the sense of operation and convenience.

JP2025160693APending Publication Date: 2025-10-23YAZAKI CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024063413
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-10
Publication Date
2025-10-23

AI Technical Summary

Technical Problem

Existing vehicle display devices do not provide a sense of actual operation, leading to discomfort and poor convenience due to unclear hand movements and gestures.

Method used

A vehicle display device that includes a movement detection unit to detect body movements and a design display unit to show virtual representations of hands and other designs, allowing these to be manipulated in conjunction with actual hand movements, thereby enhancing the sense of operation and convenience.

Benefits of technology

The device improves user convenience by allowing intuitive understanding of hand movements through visual representation, reducing discomfort and enhancing the sense of actual operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025160693000001_ABST
    Figure 2025160693000001_ABST
Patent Text Reader

Abstract

To provide a vehicle display device that reduces discomfort and enhances convenience.SOLUTION: A motion detection section 104 detects a hand movement of an operator 200. A control section 23 displays a hand symbol M1 representing a hand and an obstacle mark M21 which is distinct from the hand symbol M1 on an external view around a vehicle. The control section 23 changes the hand symbol M1 based on a detection result from the motion detection section 104 and modifies the obstacle mark M21 as if the obstacle mark M21 were being operated by the hand symbol M1.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a display device for a vehicle. [Background technology]

[0002] Conventionally, the display devices for vehicles described in Patent Documents 1 and 2 have been proposed. Patent Documents 1 and 2 describe moving the display position of a pointer in conjunction with a gesture operation by an operator. However, the above-mentioned gesture operation is different from an actual operation and does not provide a sense of operation. This creates a sense of discomfort, and there are problems such as not knowing how much to move one's hand and how to move one's hand, and poor convenience. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-114647 [Patent Document 2] Japanese Patent Publication No. 2020-107030 Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to provide a vehicle display device that reduces the sense of discomfort and improves convenience. [Means for solving the problem]

[0005] In order to achieve the above object, the vehicle display device according to the present invention has the following features. a movement detection unit that detects a movement of a part of the operator's body; a design display unit that displays a first design showing the part of the body and a second design different from the first design on an external scene around the vehicle; The design display unit changes the first design in accordance with the detection result of the motion detection unit, and also changes the second design so that the first design manipulates the second design. It must be a display device for vehicles. [Effects of the Invention]

[0006] The vehicle display device according to the present invention has the effect of improving convenience.

[0007] The present invention has been briefly described above. The details of the present invention will become clearer by reading the following detailed description of the invention (hereinafter referred to as "embodiments") with reference to the accompanying drawings. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing an embodiment of a vehicle display device according to the present invention. [Figure 2] FIG. 2 shows a real image viewed by an operator through the windshield and a virtual image displayed by the vehicle display device 1. [Figure 3] FIG. 3 shows a real image viewed by an operator through the windshield and a virtual image displayed by the vehicle display device 1. [Figure 4] FIG. 4 shows a real image viewed by an operator through the windshield and a virtual image displayed by the vehicle display device 1. [Figure 5] FIG. 5 shows a real image viewed by the operator through the windshield and a virtual image displayed by the vehicle display device 1. DETAILED DESCRIPTION OF THE INVENTION

[0009] Specific embodiments of the present invention will be described below with reference to the accompanying drawings.

[0010] For convenience of explanation, the following definitions are used to define "front," "rear," "left," "right," "upper," and "lower" as shown in Figure 1. The "front-rear direction," "left-right direction," and "up-down direction" are perpendicular to each other.

[0011] As shown in Fig. 1, a vehicle display device 1 according to this embodiment is mounted on a vehicle 100 and constitutes a head-up display. The vehicle display device 1 is disposed, for example, inside an instrument panel 101. The instrument panel 101 has an opening 101a that opens upward. The opening 101a faces a windshield 102 in the vertical direction of the vehicle 100.

[0012] The vehicle display device 1 has a housing 4, a cover 5, an image display unit 20, a control unit 23, and an optical system 25. The image display unit 20, the control unit 23, and the optical system 25 are housed inside the housing 4. The housing 4 has a main body 2 and a lid member 3 that engages with the main body 2. The main body 2 has an opening that opens upward. The lid member 3 closes the opening of the main body 2 from above. The lid member 3 has a wall portion 30 that faces the opening 101a. The wall portion 30 has an opening 31 that opens upward. The housing 4 is arranged so that the opening 31 faces the opening 101a. The cover 5 is a plate-shaped member that closes the opening 31 of the lid member 3. The cover 5 is made of a translucent resin such as polycarbonate (PC) or acrylic.

[0013] The image display unit 20 is a device that emits image display light 70. The illustrated image display unit 20 is a liquid crystal display device, for example, a TFT-LCD (Thin Film Transistor-Liquid Crystal Display). However, the image display unit 20 is not limited to a liquid crystal display device. The image display unit 20 may be, for example, a device that generates an image on a transparent screen by scanning laser light.

[0014] The optical system 25 has a first mirror 21 and a second mirror 22. The first mirror 21 reflects the display light 70 emitted from the image display unit 20 toward the second mirror 22. The first mirror 21 is, for example, a flat mirror. The second mirror 22 reflects the display light 70 toward the windshield 102. The shape of the reflective surface of the second mirror 22 is, for example, a free-form surface. The second mirror 22 is, for example, a concave mirror that magnifies the display light 70.

[0015] The display light 70 reflected by the second mirror 22 passes through the opening 31 and the opening 101a, and is reflected by the reflecting surface 102a of the windshield 102 toward the operator 200, who is a vehicle occupant (e.g., the driver). A virtual image is formed by the display light 70 incident on the pupil 201 of the operator 200. The instrument panel 101 is provided with a cylindrical wall portion 103. The wall portion 103 surrounds the optical path of the display light 70 traveling from the opening 31 toward the opening 101a.

[0016] The control unit 23, which functions as a design display unit, has a control circuit configured to control the image display unit 20. The control unit 23 is mounted on, for example, a control board disposed inside the housing 4. The control unit 23 controls the image display unit 20 to generate an image according to, for example, a program stored in advance.

[0017] The vehicle 100 has a motion detection unit 104. The motion detection unit 104 is configured with, for example, a TOF (Time of Flight) sensor and a camera. The motion detection unit 104 detects the hand motion (hand position, finger shape, etc.) of the operator 200 and outputs the detected hand motion to the control unit 23.

[0018] Next, an example of the operation of the vehicle display device 1 having the above-described configuration will be described with reference to Fig. 2. Fig. 2 shows a real image visually recognized by an operator 200 through the windshield and a virtual image displayed by the vehicle display device 1.

[0019] The vehicular display device 1 is connected to an obstacle detection sensor (not shown) such as a LiDAR (Light Detection and Ranging) sensor. As shown in FIG. 2(A), when an obstacle is detected around the vehicle by the obstacle detection sensor, the control unit 23 displays an obstacle mark M21 (second design) indicating the obstacle around the obstacle 300 (real image) in the external scene around the vehicle visible through the window. In the example shown in FIG. 2, the obstacle 300 is detected as a bicycle traveling ahead. The obstacle mark M21 is a virtual image.

[0020] 2(B), when the hand of the operator 200 is detected within the detection range of the movement detection unit 104, the control unit 23 displays a hand design M1 (first design) representing the hand of the operator 200. The hand design M1 is a virtual image. The control unit 23 changes the hand design M1 in conjunction with the movement of the hand of the operator 200 detected by the movement detection unit 104.

[0021] Specifically, if the hand of the operator 200 is in a shape with the index finger pointed up, the control unit 23 changes the hand design M1 to a shape with the index finger pointed up, as shown in Fig. 4. If the hand of the operator 200 is in a shape with the index finger pointed up, the control unit 23 changes the hand design M1 to a shape with the index finger pointed up, as shown in Fig. 2. That is, the control unit 23 changes the shape of the hand design M1 to match the shape of the hand of the operator 200. When the hand of the operator 200 moves left and right, forward and backward, the control unit 23 also changes the display position of the hand design M1 left and right, forward and backward.

[0022] When the motion detection unit 104 detects the motion of the hand of the operator 200 pinching the obstacle mark M21 and moving it out of the display area, the control unit 23 displays the hand design M1 pinching and moving the obstacle mark M21 toward the outside of the display area, as shown in Fig. 2(C). Thereafter, the control unit 23 displays the obstacle mark M21 as if it is disappearing out of the display area.

[0023] As a movement of the hand of the operator 200 to take the obstacle mark M21 out of the display area, in addition to the above-mentioned pinching and moving movement, a movement of sweeping the obstacle mark M21 out of the display area with the index finger is conceivable. In this case, the control unit 23 changes the hand design M1 into a shape in which the index finger is raised, and displays the hand design M1 as if sweeping the obstacle mark M21 with the index finger.

[0024] Next, another example of the operation of the vehicular display device 1 having the above-described configuration will be described with reference to Fig. 3. The vehicular display device 1 is connected to a navigation device. As shown in Fig. 3(A), when the control unit 23 receives route guidance information from the navigation device, it displays a route guidance arrow M22 (second design) superimposed on the route in the external view.

[0025] As shown in Fig. 3(B), when the hand of the operator 200 is detected within the detection range of the movement detection unit 104, the control unit 23 displays a hand design M1 (first design) representing the hand of the operator 200. The hand design M1 is a virtual image. The control unit 23 changes the hand design M1 in conjunction with the movement of the hand of the operator 200 detected by the movement detection unit 104.

[0026] When the motion detection unit 104 detects a motion in which the hand of the operator 200 pinches the tip of the arrow M22 and changes the direction of the tip, the control unit 23 displays a hand design M1 as if the hand is pinching and moving the tip of the arrow M22 to change the direction of the arrow M22, as shown in Fig. 3(C). Thereafter, the control unit 23 functions as a transmission unit and transmits an instruction to the navigation device to change the route to the direction of the changed arrow M22.

[0027] Next, another example of the operation of the vehicular display device 1 having the above-described configuration will be described with reference to Fig. 4. The vehicular display device 1 is connected to a navigation device or a smartphone. Locations linked to map data are pre-registered in the map application of the navigation device or the smartphone. These locations are stores or tourist spots that the operator 200 or the like wants to visit, and are pre-registered by operating the navigation device or the smartphone.

[0028] As shown in FIG. 4(A), the control unit 23 displays a point mark M23 (second design) on a building erected at a pre-registered point on the outside scene or on the periphery of the building.

[0029] 4(B), when the hand of the operator 200 is detected within the detection range of the movement detection unit 104, the control unit 23 displays a hand design M1 representing the hand of the operator 200. The hand design M1 is a virtual image. The control unit 23 changes the hand design M1 in conjunction with the movement of the hand of the operator 200 detected by the movement detection unit 104.

[0030] When the hand of the operator 200 pushes the location mark M23, the control unit 23 changes the location mark M23 as if the hand design M1 were pushing the location mark M23 using the movement detection unit 104. In this embodiment, for example, the location mark M23 is pushed and turned off (disappears). After that, a window W1 containing information corresponding to the location is superimposed on the external scene. The window W1 displays the reservation screen, congestion status, telephone number, etc. for the location. Also, it may be possible to make a call by touching the telephone number with the hand design M1.

[0031] Also, this point mark M23 may be made movable outside the display area by the hand design M1, similar to the example described in FIG.

[0032] Next, an example of the operation of the vehicular display device 1 configured as described above will be described with reference to Fig. 5. As shown in Fig. 5(A), the control unit 23 displays multiple icons M24 (second design) linked to electronic devices such as smartphones, navigation devices, and air conditioners. Thereafter, as shown in Fig. 5(B), when an icon M24 is touched with the hand design M1, the control unit 23 displays an operation panel P1 of the corresponding electronic device as shown in Fig. 5(C). When the icon M24 corresponding to a smartphone is touched, the operation panel P1 displays a mirror image of the smartphone, which can be operated with the hand design M1.

[0033] Furthermore, when an icon M24 associated with an electronic device such as an air conditioner is touched, a switch design for operating the electronic device is displayed as a second design on the operation panel P1. The switch design displayed on the operation panel P1 can be operated using the hand design M1. When operated using the hand design M1, the switch design changes in the same way as an actual switch. For example, if the switch design is a toggle switch, rocker switch, or push button switch, the hand design M1 changes the switch design so that the direction or position of the lever or button is changed.

[0034] If the switch design is a rotary switch, the hand design M1 changes the switch design so that the rotary switch rotates. If the switch design is a slide switch, the hand design M1 changes the switch design so that the lever slides. Furthermore, rather than a physical change, the operation of the hand design M1 may cause the switch design to turn on or off or change color.

[0035] According to the above-described embodiment, the hand design M1 can be changed in the same way as a hand to operate the obstacle mark M21, the arrow M22, the location mark M23, and the icon M24, so that it is easy to intuitively understand how to move the hand, thereby improving convenience. Furthermore, because the hand design M1 is displayed on the external scenery around the vehicle, the hand design M1 can be visually recognized as if it were a part of the user's own body, reducing the sense of discomfort.

[0036] 2, when the motion detection unit 104 detects a hand motion to take the obstacle mark M21 out of the display area, the control unit 23 displays the hand design M1 to move the obstacle mark M21 so that it appears to be taken out of the display area. This allows the user to intuitively move their hand to remove the obstacle mark M21 from the display area.

[0037] 3, the control unit 23 displays the route guidance arrow M22 superimposed on the route in the external scene based on the route information from the navigation device, and then, when the movement detection unit 104 detects the hand movement changing the direction of the tip of the arrow M22, the hand design M1 moves the tip of the arrow M22 to change the direction of the arrow M22, and transmits a command to change the route to the navigation device. This allows the user to change the route intuitively by moving their hand.

[0038] The present invention is not limited to the above-described embodiments, and can be appropriately modified, improved, etc. Furthermore, the material, shape, size, number, location, etc. of each component in the above-described embodiments are arbitrary and not limited as long as they can achieve the present invention.

[0039] According to the above-described embodiment, the hand design M1 is displayed in conjunction with the movement of the hand, but this is not limited to this. For example, the arm and hand designs may be displayed in conjunction with the movement of the arm and hand.

[0040] According to the above-described embodiment, the vehicle display device 1 displays the hand design M1, the obstacle mark M21, the arrow M22, the location mark M23, and the icon M24, which are virtual images, on the real image of the external scenery, but the present invention is not limited to this. It is also conceivable that an external scenery image around the vehicle captured by a camera is displayed on a display monitor displayed in the vehicle, and the hand design M1, the obstacle mark M21, the arrow M22, the location mark M23, and the icon M24 are superimposed on the external scenery image.

[0041] Here, the features of the above-described embodiments of the vehicle display device according to the present invention will be briefly summarized and listed below in [1] to [5].

[0042] [1] a movement detection unit (104) that detects the movement of a part of the body of an operator (200); a design display unit (23) that displays a first design (M1) showing a part of the body and second designs (M21 to M24) different from the first design (M1) on an external scene around the vehicle; The design display unit (23) changes the first design (M1) in accordance with the detection result of the motion detection unit (104), and also changes the second designs (M21 to M24) so ​​that the first design (M1) operates the second designs (M21 to M24). Vehicle display device (1).

[0043] According to the vehicle display device (1) having the configuration [1] above, the first design (M1) can be changed in the same way as a part of the body, and the second designs (M21 to M24) can be operated, so it is easy to intuitively understand how to move your hands, improving convenience. In addition, because the first design (M1) is displayed on the external scenery around the vehicle, the first design (M1) can be visually recognized as if it were a part of the driver's own body, reducing the sense of discomfort.

[0044] [2] In the vehicle display device (1) described in [1], When the movement detection unit (104) detects a movement of the body part taking the second design (M21) out of the display area, the design display unit (23) displays the first design (M1) as if it were moving the second design (M21) to take the second design (M21) out of the display area. Vehicle display device (1).

[0045] According to the vehicle display device (1) having the configuration [2] above, the second designs (M21 to M24) can be made to disappear from the display area by intuitively moving a part of the body.

[0046] [3] In the vehicle display device (1) described in [1], The design display unit (23) displays a route guidance arrow (M22) as the second design superimposed on the route in the external scene based on route information from a navigation device, and thereafter, when the movement detection unit (104) detects a movement of a part of the body that changes the direction of the tip of the arrow (M22), the first design (M1) is displayed so that the tip of the arrow (M22) moves to change the direction of the arrow (M22); a transmitter (23) that transmits a route change instruction to the navigation device when the motion detector (104) detects a motion of the body part that changes the direction of the tip of the arrow (M22), Vehicle display device (1).

[0047] According to the vehicle display device (1) configured as described above in [3], the route can be changed intuitively by moving a part of the body.

[0048] [4] In the vehicle display device (1) described in [1], The design display unit (23) displays the second design (M23) on a building or the periphery of a building erected at a pre-registered point on the exterior scene, and then, when the movement detection unit (104) detects a movement of a part of the body manipulating the second design (M23), the design display unit (23) changes the second design (M23) so that the first design (M1) is manipulating the second design (M23), and then displays information about the point on the exterior scene. Vehicle display device (1).

[0049] According to the vehicle display device (1) configured as [4] above, information about the location linked to the second design (M23) can be displayed by intuitively moving a part of the body.

[0050] [5] In the vehicle display device (1) described in [1], The design display unit (23) displays an icon (M24) corresponding to the electronic device as the second design, and then, when the movement detection unit (104) detects a movement of the part of the body operating the icon (M24), it changes the icon (M24) so ​​that the first design (M1) is operating the icon (M24), and then displays an operation panel (P1) of the electronic device. Vehicle display device (1).

[0051] According to the vehicle display device (1) configured as described above in [5], the user can intuitively move a part of his or her body to operate the electronic device linked to the icon (M24). [Explanation of symbols]

[0052] 1. Vehicle display device 23 Control unit (design display unit, transmission unit) 104 Motion detection unit 200 Operator M1 Hand Design M21 Obstacle Mark (2nd Design) M22 Arrow (2nd design) M23 Location Mark (2nd design) M24 Icon (2nd design) P Operation panel

Claims

1. a movement detection unit that detects a movement of a part of the operator's body; a design display unit that displays a first design showing the part of the body and a second design different from the first design on an external scene around the vehicle; the design display unit changes the first design in accordance with the detection result of the motion detection unit, and also changes the second design so that the first design manipulates the second design; Vehicle display device.

2. The vehicle display device according to claim 1, When the movement detection unit detects a movement of the body part taking the second design out of a display area, the design display unit displays the first design as if it is moving the second design out of the display area. Vehicle display device.

3. The vehicle display device according to claim 1, the design display unit displays a route guidance arrow as the second design superimposed on the route in the external scene based on route information from a navigation device, and thereafter, when the movement detection unit detects a movement of the part of the body that changes the direction of the tip of the arrow, the first design is displayed as if the tip of the arrow is moving to change the direction of the arrow; a transmitter that transmits a route change instruction to the navigation device when the motion detector detects a motion of the body part changing the direction of the tip of the arrow, Vehicle display device.

4. The vehicle display device according to claim 1, The design display unit displays the second design on a building or the periphery of a building erected at a pre-registered point in the external scene, and thereafter, when the motion detection unit detects a motion of the part of the body manipulating the second design, the design display unit changes the second design so that the first design appears to be manipulating the second design, and then displays information about the point in the external scene. Vehicle display device.

5. The vehicle display device according to claim 1, the design display unit displays an icon corresponding to the electronic device as the second design, and then, when the movement detection unit detects a movement of the body part operating the icon, changes the icon so that the first design is operating the icon, and then displays an operation panel of the electronic device. Vehicle display device.

Citation Information

Patent Citations

  • Gesture input system

    JP2013114647A

  • Gesture detection apparatus and gesture detection method

    JP2020107030A