Vehicle operating device

The vehicle operating device uses a hand detection system to project operation function indicators onto the user's hand, addressing the issue of obscured displays and ensuring clear function recognition during operation.

JP7786196B2Active Publication Date: 2025-12-16NIPPON SEIKI CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2021209456
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-12-23
Publication Date
2025-12-16
Estimated Expiration
2041-12-23

AI Technical Summary

Technical Problem

Existing vehicle operating devices, such as those with hand-operated units like push buttons or touch panels, face issues where the function display unit can be obscured by the user's hand, making it difficult to recognize the function of the operating unit.

Method used

A vehicle operating device equipped with a hand detection unit, such as a TOF camera, to detect the user's hand and project function indicators onto the hand or near it using a projector, ensuring visibility of the operation functions even when the hand overlaps the unit.

Benefits of technology

Enables proper recognition of the operation functions by projecting images onto the user's hand or nearby areas, allowing intuitive operation even when the function display is hidden by the hand.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007786196000001
    Figure 0007786196000001
  • Figure 0007786196000002
    Figure 0007786196000002
  • Figure 0007786196000003
    Figure 0007786196000003
Patent Text Reader

Abstract

To provide an operation device for vehicles, configured to properly recognize a function of an operation unit operated by a hand.SOLUTION: An operation device 1 for a vehicle, equipped with an operation unit 2 to be operated by a hand 8, includes: a hand detection unit 3 for detecting a hand 8 overlapping the operation unit 2; a projection display unit 4 which projection-displays a character or an image indicating a function of the operation unit 2; and a control unit 5 for controlling the projection display unit 4. When the hand detection unit 3 detects a hand 8 overlapping the operation unit 2, the control unit 5 projection-displays the character or the image indicating the function of the operation unit 2 near the operation unit 2 or the hand 8 overlapping the operation unit 2.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an operating device for a vehicle. [Background technology]

[0002] Typically, vehicles such as automobiles are equipped with an operation unit (push button switch, touch panel, etc.) that is operated by hand. For example, Patent Document 1 discloses a technology in which an operation unit that is operated by hand is provided on a steering wheel, and the display on the display unit is scrolled in response to an operation on this operation unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-78988 Summary of the Invention [Problem to be solved by the invention]

[0004] In this type of vehicle operating device, the functions of the operating unit are indicated by letters or images on or near the operating unit (hereinafter referred to as the function display unit, as appropriate), but when operating the operating unit by hand, the function display unit may be hidden by the hand, leaving room for improvement.

[0005] Therefore, an object of the present disclosure is to provide a vehicle operating device that allows a user to properly recognize the function of an operating unit when operating the operating unit by hand. [Means for solving the problem]

[0006] In one aspect, the following solution is provided. (1) A vehicle operating device having an operating unit that is operated by hand, a hand detection unit that detects a hand placed on the operation unit; a projection display unit that projects and displays characters or images indicating the functions of the operation unit; a control unit that controls the projection display unit, When the hand detection unit detects a hand placed on the operation unit, the control unit projects and displays characters or an image indicating a function of the operation unit on the hand placed on the operation unit or in the vicinity of the operation unit. 、 Furthermore, when it is determined that the operation unit has been operated, the hand placed over the operation unit or the characters or images projected and displayed near the operation unit are changed as an answer back to the operation. The device is characterized by being equipped with an operation function projection display control means. (2) In the configuration of (1) above, the hand detection unit is capable of detecting the shape of a hand, and the operation function projection display control means, when the hand detection unit detects a hand placed over the operation unit, projects and displays characters or images indicating the function of the operation unit onto the nail of the finger placed over the operation unit. (3) In the configuration of (1) or (2) above, the hand detection unit is capable of detecting the shape of a hand, and the operation function projection display control means is characterized in that, when the hand detection unit detects a hand placed over the operation unit, it projects and displays characters or images indicating the function of the operation unit on the back of the hand placed over the operation unit. (4) In any of the configurations (1) to (3) above, the operation unit has a function display unit that indicates the function of the operation unit, and the operation function projection display control means, when the hand detection unit detects a hand overlapping the operation unit, projects and displays characters or images indicating the function of the operation unit larger than the function display unit on the hand overlapping the operation unit or in the vicinity of the operation unit. [Effects of the Invention]

[0007] According to the present disclosure, when operating an operation unit by hand, it is possible to properly recognize the function of the operation unit. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a schematic side view showing an operating state of a vehicle operating device according to an embodiment of the present invention; [Figure 2] FIG. 2 is a schematic front view showing an operating state of the vehicle operating device. [Figure 3] 1 is a block diagram showing a configuration of a vehicle operating device; [Figure 4] FIG. 10 is a diagram illustrating an example of overlap determination. [Figure 5] FIG. 10 is a diagram showing an example of a hand operation function projection display area. [Figure 6] FIG. 10 is a diagram showing another example of the hand operation function projection display area. [Figure 7] 5A and 5B are diagrams showing the operation of the vehicle operating device, in which FIG. 5A shows the operation when hands are not overlapped, and FIG. 5B shows the operation when hands are overlapped. [Figure 8] 10A and 10B are diagrams showing the operation of a vehicle operating device when an operation is being performed, in which (a) is a diagram showing when hands are overlapped, (b) is a diagram showing an example of when an operation is being performed, and (c) is a diagram showing another example of when an operation is being performed. [Figure 9] FIG. 10 is a diagram showing an operation function projection display area other than for hands. [Figure 10] 10 is a flowchart showing a processing procedure of operation function projection control by a control unit. DETAILED DESCRIPTION OF THE INVENTION

[0009] Each embodiment will be described in detail below with reference to the accompanying drawings.

[0010] As shown in FIGS. 1 to 3, a vehicle operating device 1 according to one embodiment of the present invention includes an operating unit 2, a hand detecting unit 3, a projection display unit 4, and a control unit 5.

[0011] The operation unit 2 is provided at an appropriate location in the vehicle. For example, the operation unit 2 of this embodiment is a liquid crystal panel with a touch panel provided on the steering wheel 7, which detects touch operations while displaying characters or images indicating the functions of the operation unit 2. For example, in the example shown in Fig. 7, four operation function images G1 (function display units) are displayed on the operation unit 2, and touch operations at positions corresponding to each operation function image G1 are detected.

[0012] The operating devices constituting the operating unit 2 are not limited to touch panels, but may be contact switches such as push button switches, seesaw switches, toggle switches, etc. In the case of contact switches, characters or images indicating the operating function are printed or added on or near the switch.

[0013] The hand detection unit 3 detects the hand 8 of the user (driver) that is placed on the operation unit 2. For example, the hand detection unit 3 of this embodiment is configured using a TOF camera (Time-of-Flight Camera) that acquires distance measurement images of a subject, and captures an image of the area around the steering wheel 7 from the ceiling of the vehicle cabin. Images captured by such a TOF camera make it possible to detect the position of the hand 8 and recognize the shape of the hand 8. Note that, although a TOF camera is used as the hand detection unit 3 in this embodiment, any imaging method can be used as long as it is possible to perform image recognition of the user's hand 8, such as an infrared camera or an RGB camera.

[0014] The projection display unit 4 projects and displays characters or images indicating the functions of the operation unit 2. For example, the projection display unit 4 of this embodiment is configured using a projector that uses a DMD (Digital Mirror Device), and projects and displays characters or images indicating the functions of the operation unit 2. For example, in the examples shown in FIGS. 2 and 7 to 9, an operation function image G2 indicating the functions of the operation unit 2 is projected and displayed. The projection and display timing and projection and display area of ​​the operation function image G2 will be described later. Although the projection display unit 4 of this embodiment is of the DMD type, it may also be of the TFT type or LCOS type.

[0015] The control unit 5 is configured using a control processor such as a microcontroller. As shown in Fig. 3, the operation unit 2 and the hand detection unit 3 are connected to the input side of the control unit 5, and the projection display unit 4 is connected to the output side of the control unit 5.

[0016] The control unit 5 includes an operation function projection display control means as a functional configuration realized by cooperation between hardware and software. When the hand detection unit 3 detects a hand 8 overlapping the operation unit 2, the operation function projection display control means projects and displays an operation function image G2 indicating the functions of the operation unit 2 onto the hand 8 overlapping the operation unit 2, as shown in Figures 2, 7, and 8.

[0017] According to such an operation function projection display control means, even if the user's hand 8 overlaps the operation unit 2, the operation function image G2 indicating the operation function of the operation unit 2 is projected and displayed on the user's hand 8. Therefore, even in a situation where the operation function image G1 of the operation unit 2 is hidden by the user's hand 8, the user can correctly recognize the operation function of the operation unit 2 and operate the operation unit 2 appropriately.

[0018] The operation function projection display control means determines whether the hand 8 overlaps the operation unit 2, for example, using the determination rule shown in Fig. 4. Specifically, when the overlapping area ratio of the hand 8 to the operation unit 2 exceeds 30% and the amount of movement of the hand 8 exceeds 3 cm, it is determined that the user has overlapped the hand 8 over the operation unit 2 in order to operate the operation unit 2. Note that the determination value used for overlap determination can be changed according to the user's preference, etc.

[0019] 5 and 6, when the hand detection unit 3 detects a hand 8 overlapping the operation unit 2, the operation function projection display control means recognizes the shape of the hand 8 based on the detection signal acquired from the hand detection unit 3, and projects and displays an operation function image G2 indicating the functions of the operation unit 2 onto the nail portion 8a of the finger overlapping the operation unit 2 or the back portion 8b of the hand 8 overlapping the operation unit 2. The projection area of ​​the operation function image G2 can be selected by the user according to preference, etc.

[0020] For example, if the user selects the nail portion 8a as the projection area, when the user tries to operate the operation unit 2 with his / her index finger, the operation function image G2 is projected and displayed on the nail portion 8a of the index finger as shown in Fig. 5, and when the user tries to operate the operation unit 2 with his / her thumb, the operation function image G2 is projected and displayed on the nail portion 8a of the thumb as shown in Fig. 6. In this way, the operation function of the operation unit 2 over which the user places his / her finger to operate is projected and displayed on the fingertip as it is, so that the user can intuitively recognize the operation function and perform the operation appropriately.

[0021] Furthermore, when the user selects the back of the hand 8b as the projection area, when the user tries to operate the operation unit 2 with the index finger as shown in Fig. 5, the operation function image G2 is projected and displayed on the front part of the back of the hand 8b, and when the user tries to operate the operation unit 2 with the thumb as shown in Fig. 6, the operation function image G2 is projected and displayed on the side part of the back of the hand 8b. In this way, even a user with a small hand 8 or a user with decorations on the nail part 8a can recognize the operation functions of the operation unit 2 hidden by the finger from the operation function image G2 projected onto the back of the hand 8b.

[0022] The projection area of ​​the operation function image G2 is not limited to the hand 8, but may be near the operation unit 2 as shown in Fig. 9. In this way, even in a situation where the operation function image G1 of the operation unit 2 is hidden by the user's hand 8, the user can correctly recognize the operation functions of the operation unit 2 and operate the operation unit 2 appropriately.

[0023] 7, it is desirable that the operation function image G2 projected onto the hand 8 placed on the operation unit 2 or near the operation unit 2 is larger than the operation function image G2 displayed on the operation unit 2. For example, the operation function projection display control means determines the size of the operation function image G2 that does not extend beyond the nail portion 8a based on information from the hand detection unit 3, and enlarges and projects the operation function image G2 as much as possible. This not only improves the visibility of the operation function image G2, but also enables the operation function image G2 to be appropriately projected and displayed even on a projection display unit 4 with low resolution.

[0024] As shown in (b) and (c) of FIG. 8, when the operation function projection display control means determines that the operation unit 2 has been operated, it changes the operation function image G2 projected and displayed on the hand 8 placed over the operation unit 2 or near the operation unit 2. For example, in the example shown in (b) of FIG. 8, the projection size of the operation function image G2 is reduced in response to the operation of the operation unit 2, and in the example shown in (c) of FIG. 8, the color of the operation function image G2 is changed in response to the operation of the operation unit 2. By changing the operation function image G2 as an answerback to the operation of the operation unit 2, it is possible to not only create a sense of operation but also to make the user aware of the execution of the operation. Note that the operation function projection display control means may shrink or enlarge the operation function image G2 in conjunction with the operation status of the operation unit 2, or gradually change the color of part or all of the operation function image G2 at a speed that the user can recognize. By gradually changing the display of the operation function image G2 using animation, the user can easily notice the operation status of the operation unit 2.

[0025] Next, the processing procedure of the control unit 5 that realizes the above-described operation function projection display control means will be described with reference to FIG.

[0026] As shown in FIG. 10, in the operation function projection display control, the control unit 5 first determines whether or not the hand 8 is overlapping the operation unit 2 (step S1), and if the result of this determination is NO, stops the projection of the projection display unit 4 and returns to the upper routine (step S2).

[0027] If the judgment result of step S1 is YES, the control unit 5 identifies the position of the operation unit 2 where the hand 8 is placed (step S3), and determines the projection position of the operation function image G2 based on the shape recognition of the hand 8 and the user settings (step S4).

[0028] Next, the control unit 5 determines the operation of the operation unit 2 on which the hand 8 is placed (step S5), and if the determination result is NO, it projects the operation function image G2 for non-operation (see, for example, (a) of Figure 8) onto the projection position determined in step S4 (step S6), and if the determination result is YES, it projects the operation function image G2 for operation (see, for example, (b) and (c) of Figure 8) onto the projection position determined in step S4 (step S7).

[0029] Next, another embodiment of the present invention will be described. However, for configurations common to the above-described embodiment, the same reference numerals as in the above-described embodiment are used, and the description of the above-described embodiment may be used.

[0030] The vehicle operating device of another embodiment is similar to the above-described embodiment in that it comprises an operating unit 2 that is operated by a hand 8, a projection display unit 4 that projects and displays characters or images indicating the functions of the operating unit 2 onto or near the operating unit 2, and a control unit 5 that controls the projection display unit 4, but differs from the above-described embodiment in that it does not comprise a hand detection unit 3.

[0031] That is, the vehicle operation device according to the other embodiment projects and displays characters or images indicating the functions of the operation unit 2 on or near the operation unit 2, regardless of whether the hand 8 is overlapping the operation unit 2. In such other embodiment, when the user's hand 8 overlaps the operation unit 2, characters or images indicating the operation functions of the operation unit 2 are projected and displayed on or near the user's hand 8. Therefore, even in a situation where the operation function image G1 of the operation unit 2 is hidden by the user's hand 8, the user can correctly recognize the operation functions of the operation unit 2 and operate the operation unit 2 appropriately.

[0032] Although each embodiment has been described in detail above, it is not limited to the specific embodiment, and various modifications and changes are possible within the scope of the claims. It is also possible to combine all or a plurality of components of the above-described embodiments. [Explanation of symbols]

[0033] 1 Vehicle operating device 2 Control section 3 Hand detection unit 4 Projection display section 5. Control section 7. Steering wheel 8 moves 8a Claw part 8b Instep G1 Operation function image (function display section) G2 Operation Function Image

Claims

1. An operating device for a vehicle having an operating unit that is operated by hand, a hand detection unit that detects a hand placed on the operation unit; a projection display unit that projects and displays characters or images indicating the functions of the operation unit; a control unit that controls the projection display unit, when the hand detection unit detects a hand placed on the operation unit, the control unit projects and displays characters or an image indicating a function of the operation unit on the hand placed on the operation unit or in the vicinity of the operation unit; The vehicle operating device further includes an operation function projection display control means that, when it is determined that the operating unit has been operated, changes a hand placed over the operating unit or characters or images projected and displayed near the operating unit as an answer back to the operation.

2. the hand detection unit is capable of detecting a shape of a hand, 2. The vehicle operation device according to claim 1, wherein the operation function projection display control means projects and displays characters or images indicating the functions of the operation unit onto the nail of the finger that is placed on the operation unit when the hand detection unit detects a hand placed on the operation unit.

3. the hand detection unit is capable of detecting a shape of a hand, 3. The vehicle operation device according to claim 1, wherein the operation function projection display control means projects and displays characters or images indicating the functions of the operation unit onto the back of the hand that is placed on the operation unit when the hand detection unit detects a hand placed on the operation unit.

4. the operation unit has a function display unit that indicates a function of the operation unit, The vehicle operation device according to any one of claims 1 to 3, wherein when the hand detection unit detects a hand overlapping the operation unit, the operation function projection display control means projects and displays characters or images indicating the function of the operation unit larger than the function display unit on the hand overlapping the operation unit or in the vicinity of the operation unit.

Citation Information

Patent Citations

  • Fingernail clock

    CN108803301A

  • Keyboard device

    JP1993027886A

  • On-vehicle apparatus operating system

    JP1993294192A

  • Display item selection device and display item selection system

    JP2012078988A

  • Operation device

    JP2016049863A