Operation device

Abstract

To provide an operation device capable of improving operability.SOLUTION: An operation device includes: an operation unit that is disposed in a vehicle 8 and receives a first operation; a sight line detection unit that detects a sight line 40 of a crew member 9 of the vehicle 8; and a control unit that enables, when the operation unit receives a first operation and it is determined that a sight line position display area 41 where the sight line 40 of the crew member 9 is positioned is present among a plurality of display areas that display images, only operation on the sight line position display area 41 via the operation unit. The operation device is roughly configured with the components mentioned above.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an operating device. [Background technology]

[0002] 2. Description of the Related Art A display device that includes a display unit that performs display in a display area and a display control unit that causes the display unit to perform display in the display area is known as a conventional technique (see, for example, Patent Document 1).

[0003] The display control unit of the display device can enlarge the display mode of the displayed symbol in accordance with the line of sight of the user. The symbol is an operation icon for operating the display device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-148024 A Summary of the Invention [Problem to be solved by the invention]

[0005] When there are multiple display areas, the total of the multiple display areas is larger than each individual display area. In a conventional display device, for example, when the entirety of the multiple display areas is to be operated, even if the icon that the user is gazing at is enlarged, the totality of the multiple display areas is large, so that the operability of the icon is not necessarily improved.

[0006] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to provide an operating device that can improve operability. [Means for solving the problem]

[0007] One aspect of the present invention provides an operating device that is disposed in a vehicle and includes an operating unit that accepts a first operation, a gaze detection unit that detects the gaze of a vehicle occupant, and a control unit that, when the operation unit accepts the first operation and determines, among a plurality of display areas that display images, the existence of a gaze position display area in which the occupant's gaze is located, enables only operation on the gaze position display area via the operation unit. Effect of the Invention

[0008] According to the present invention, operability can be improved. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1(a) is a diagram showing an example of a vehicle, and FIG. 1(b) is a diagram showing an example of a steering wheel on which an operating device is arranged. [Diagram 2] FIG. 2(a) is an example of a block diagram of an operating device, and FIG. 2(b) is an example of a block diagram of a vehicle control system. [Diagram 3] FIG. 3(a) is a diagram for explaining an example of gaze detection, and FIG. 3(b) and FIG. 3(c) are diagrams showing examples of a display device. [Figure 4] FIG. 4(a) is a diagram for explaining an example of a first operation, FIG. 4(b) is a diagram showing an example of a display area in which the gaze is detected, and FIG. 4(c) is a diagram showing an example of a gaze position display area. [Diagram 5] FIG. 5(a) is a diagram showing an example of an operation for changing the layout, FIG. 5(b) is a diagram showing an example of a display area where the gaze is detected, and FIG. 5(c) is a diagram showing an example of a change in the layout. [Figure 6] FIG. 6(a) is a diagram showing an example of an operation for switching display areas, FIG. 6(b) is a diagram showing an example of a display area where a gaze is detected, and FIG. 6(c) is a diagram showing an example of switching display areas. [Figure 7] FIG. 7 is a flowchart showing an example of an operation for enabling a desired display area to be operated. [Figure 8]FIG. 8 is a flowchart showing an example of an operation for changing the layout of a display area. [Figure 9] FIG. 9 is a flowchart showing an example of an operation for switching the display areas. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (Summary of the embodiment) The operating device of the embodiment is generally configured to include an operating unit that is disposed in a vehicle and accepts a first operation, a gaze detection unit that detects the gaze of a vehicle occupant, and a control unit that, when the operating unit accepts the first operation and determines, among a plurality of display areas that display images, the existence of a gaze position display area in which the occupant's gaze is located, enables only operation on the gaze position display area via the operating unit.

[0011] This operating device allows operation of only the gaze position display area where the occupant directs his or her gaze among multiple display areas, so that the area that can be operated is limited, improving operability, compared to when the entire multiple display areas are the target of operation.

[0012] [Embodiment Mode] (Overview of operation device 1) Fig. 1(a) is a diagram showing an example of a vehicle in which an operating device according to an embodiment is arranged, and Fig. 1(b) is a diagram showing an example of a steering wheel in which the operating device is arranged. Fig. 2(a) is an example of a block diagram of an operating device according to an embodiment, and Fig. 2(b) is an example of a block diagram of a vehicle control system including the operating device. Fig. 3(a) is a diagram for explaining an example of gaze detection by a gaze detection unit of an operating device according to an embodiment, and Figs. 3(b) and 3(c) are diagrams showing an example of a display device.

[0013] In the drawings relating to the embodiments described below, the ratios and shapes of figures may differ from the actual ratios and shapes. In Figures 2(a) and 2(b), arrows indicate the flow of main signals and information.

[0014] As shown in Figures 1(a) to 3(a), the operating device 1 is disposed in a vehicle 8 and is generally configured to include an operating unit 2 that accepts a first operation, a gaze detection unit 4 that detects the gaze 40 of an occupant 9 of the vehicle 8, and a control unit 6 that, when the operating unit 2 accepts the first operation and determines the presence of a gaze position display area 41 in which the gaze 40 of the occupant 9 is located among a plurality of display areas that display images, enables only operation of the gaze position display area 41 via the operating unit 2.

[0015] The control unit 6 is configured to allow only operation via the operation unit 2 on the gaze position display area 41 , and to cause a pointer 410 operable via the operation unit 2 to be displayed in the gaze position display area 41 .

[0016] The operation unit 2 also has a left operation unit and a right operation unit arranged on the left and right of the steering wheel 81 of the vehicle 8. The control unit 6 defines an operation performed on the left operation unit and the right operation unit, which overlap for at least a partial period, as a first operation. This operation which overlaps for at least a partial period indicates that the period of the operation performed on the left operation unit and the period of the operation performed on the right operation unit overlap for at least a partial period.

[0017] The left and right operation sections of this operation unit 2 are touchpads that accept touch operations. In the following, as an example, the left operation section is referred to as a left touchpad 20, and the right operation section is referred to as a right touchpad 21. Note that the left and right operation sections are not limited to touchpads, and may be a joystick or a cross key with a push button located in the center.

[0018] When the control unit 6 receives touch operations performed on the left touchpad 20 and the right touchpad 21, which overlap for at least a partial period, and determines the presence of the gaze position display area 41, it enables only operations on the gaze position display area 41. As an example, the first operation is a touch operation performed on the left touchpad 20 and the right touchpad 21, which overlap for at least a partial period.

[0019] 4(a), which will be described later, this touch operation indicates a contact of a left operating finger 910 of a left hand 91 with the operating surface 200 of the left touchpad 20, and a contact of a right operating finger 920 of a right hand 92 with the operating surface 210 of the right touchpad 21. Note that the left operating finger 910 and the right operating finger 920 are thumbs as an example, but are not limited to this, and one may be a thumb and the other another finger, or both may be fingers other than thumbs.

[0020] The operation unit 2 further accepts a second operation. The control unit 6 is configured to move the gaze position display area 41 to change the layout of the multiple display areas when a second operation is performed on the operation unit 2 after enabling only the operation on the gaze position display area 41, and then a third operation is performed.

[0021] Therefore, the operation unit 2 has a left touchpad 20 and a right touchpad 21 arranged on the left and right sides of the steering wheel 81 of the vehicle 8, and a specific operation unit that is provided adjacent to at least one of the left touchpad 20 and the right touchpad 21 and accepts a second operation.

[0022] As an example, the specific operation unit in this embodiment is a left operation bar 22 arranged adjacent to the left touch pad 20, and a right operation bar 23 arranged adjacent to the right touch pad 21. The left operation bar 22 and the right operation bar 23 are push switches, but are not limited to this, and may be capacitive touch sensors.

[0023] As an example, the second operation is a long press operation performed on at least one of the left operation bar 22 and the right operation bar 23, but is not limited to this, and may be a long press operation, touch operation, tap operation, etc., performed at a specific position on at least one of the left touchpad 20 and the right touchpad 21.

[0024] The third operation is, for example, a drag-and-drop operation performed on one of the left touchpad 20 and the right touchpad 21, or an operation including a selection operation of a destination display area by changing the line of sight of the occupant 9 and a release of the second operation, but is not limited thereto, and may be a flick operation or a tracing operation performed on one of the left touchpad 20 and the right touchpad 21. In the case of a flick operation or a tracing operation, the desired display area may be moved to a position corresponding to the end position of the operation, or the position of the desired display area may be changed by repeating a flick operation or a tracing operation multiple times until the second operation is released and releasing the second operation. The third operation of the present embodiment is, for example, an operation that enables a layout change by a drag-and-drop operation and a layout change by moving the line of sight.

[0025] The occupant 9 can perform touch operations on the left touchpad 20 and the right touchpad 21 and direct his / her gaze 40 toward the display area he / she wishes to operate, thereby activating the desired display area, that is, selecting the desired display area and making it operable.

[0026] In the present embodiment, the occupant 9 is, for example, a driver seated in the driver's seat 800, but is not limited thereto, and may be an occupant seated in the passenger seat 801. In this case, the occupant 9 seated in the passenger seat 801 can, for example, perform a first operation on the touch pad device 86 arranged on the floor console 802 and send the line of sight 40 to the desired display area, thereby making only the desired display area operable. The occupant 9 seated in the passenger seat 801 can also change the layout of the above-mentioned multiple display areas or swap the display positions by combining the operation with a switch arranged near the touch pad device 86.

[0027] As shown in FIG. 1(a), the vehicle 8 is provided with a display device 84 having a large display screen 840 that extends from the front of the driver's seat 800 to the front of the passenger seat 801. As shown in FIG. 1(a), the display screen 840 is so large that it covers most of the left and right direction of the instrument panel 803. However, since it is disposed on the steering wheel 81, the operation surface 200 of the left touch pad 20 and the operation surface 210 of the right touch pad 21 are much smaller than the large display screen 840. It is difficult for the occupant 9 to operate the entire display screen 840 by operating the operation surface 200 and the operation surface 210. The operation device 1 of the present embodiment is configured to reduce the difficulty caused by the difference in ratio by allowing operation on a display area basis, rather than on the entire display screen 840.

[0028] Note that, as an example, the display area is an area obtained by dividing the display screen 840 in the vertical direction, but is not limited to this, and the display area may have a shape in which at least a part of the display area overlaps in the vertical direction.

[0029] 2(b), the operation device 1, together with a display device 84, constitutes a vehicle control system 82. The vehicle control system 82 is generally configured to include, for example, a vehicle control device 83, a display device 84, a mirror device 85, a touch pad device 86, an in-vehicle device 87, and a vehicle LAN 88 (Local Area Network).

[0030] The vehicle control device 83 is a microcomputer that comprehensively controls the vehicle 8, and is configured to control the drive device, automatic driving control, driving assistance control, etc. The vehicle control device 83 controls the display device 84, as an example.

[0031] The display device 84 is, for example, an organic EL (Electro-Luminescence) display, a mini LED (Light Emitting Diode), a micro LED display, etc. The display device 84 has, for example, a display screen 840 that is long in the left-right direction of the vehicle 8. The display screen 840 is divided into a plurality of display areas.

[0032] The multiple display areas may be configured with multiple displays. In other words, the display device 84 may be configured with multiple displays. As a modified example, the display device 84 may be configured with a head-up display that projects an image onto the windshield 804, or may be configured to include a head-up display.

[0033] FIG. 3(b) shows an example in which a display screen 840 is divided into four display areas, a first display area 841 to a fourth display area 844. The first display area 841 to the fourth display area 844 may have the same shape or may have different shapes. In the first display area 841, as an example, a display image 841a relating to a plurality of functions of an air conditioner is displayed. In the second display area 842, as an example, a display image 842a relating to a map image of a navigation device is displayed. In the third display area 843, as an example, a display image 843a relating to speed, direction indication, etc. is displayed. In the fourth display area 844, as an example, a display image 844a relating to a fuel gauge, a water temperature gauge, etc. is displayed.

[0034] 3(c) shows an example in which the display screen 840 is divided into three display areas: a first display area 841 to a third display area 843. In the first display area 841, as an example, a display image 841a relating to the adjustment function of the mirror device 85 is displayed. In the second display area 842, as an example, a display image 842a relating to the seat device is displayed. In the third display area 843, as an example, a display image 843a relating to speed, direction indication, etc. is displayed.

[0035] Here, the control unit 6 is configured to keep at least the display area displaying the speed of the vehicle 8, among the multiple display areas, in front of the occupant 9, and to restrict changes in the layout of the display area and changes in the display position of the display area. The third display area 843 in FIG. 3(b) and the third display area 843 in FIG. 3(c) are display areas displaying the speed. As an example, the display area displaying the speed is required by law to be displayed in front where it is easily visible to the driver. Therefore, the control unit 6 is configured to keep the display position of the display area displaying the speed, and not to change the layout including this display area or to change the display position.

[0036] The mirror device 85 is for checking the rear of the vehicle 8, and may be a physical mirror or an electronic mirror. When the mirror device 85 is a physical mirror, it is configured to change the angle of the mirror portion as shown in the first display area 841 of FIG. 3(c). When the mirror device 85 is an electronic mirror, it is configured to include a camera and to display, in the display area, the enlargement, reduction, and brightness adjustment of the image of the rear, a warning of the approach of another vehicle, and the like. When the mirror device 85 is an electronic mirror, the display device 84 displays the left and right rear images in the display areas located at the left and right ends. When the image on the passenger seat 801 side is difficult to see, the occupant 9 can display it near himself by changing the layout of the display area.

[0037] 1(a), the touchpad device 86 is disposed on a floor console 802 between a driver's seat 800 and a passenger seat 801. The touchpad device 86 is a capacitive touchpad similar to the left touchpad 20 and the right touchpad 21, and is configured to detect touch operations and the like.

[0038] Examples of the in-vehicle device 87 include an air conditioner that adjusts the temperature inside the vehicle, a navigation device that displays a map of the current location and provides guidance to the destination, a seat device that controls the position and inclination of the seat, a music and video playback device that plays music and videos, etc. The display device 84 is configured to display information related to these in-vehicle devices 87, as well as to display images to which adjustments, function on / off, etc. are assigned.

[0039] The vehicle control system 82 is connected to the operation device 1, the vehicle control device 83, the display device 84, and the like via a vehicle LAN 88. The vehicle LAN 88 is a vehicle network such as a Controller Area Network (CAN) or a Local Interconnect Network (LIN) that enables mutual exchange of signals, information, and the like by wire and wirelessly.

[0040] As described above, the operation unit 2 is configured to include the left touch pad 20, the right touch pad 21, the left operation bar 22, and the right operation bar 23.

[0041] The left touchpad 20 and the right touchpad 21 are, for example, capacitive touchpads, but are not limited thereto, and may be pressure-sensitive touchpads, etc. The left touchpad 20 and the right touchpad 21 are capable of, for example, touch operations, tap operations, double tap operations, tracing operations, drag-and-drop operations, flick operations, pinch-out (pinch open) operations, and pinch-in (pinch close) operations. These operations may be performed on the left touchpad 20 and the right touchpad 21 separately, or may be performed separately.

[0042] Here, in order to distinguish it from a tap operation, the touch operation refers to an operation of continuously touching the operation surface or an operation of pressing and holding the operation surface, rather than an operation of momentarily touching the operation surface.

[0043] 1(a), the steering wheel 81 on which the operation unit 2 is arranged is an irregular-shaped steering wheel that has no top and makes it easy to see the display device 84. The left touchpad 20 is arranged on the tip side of the left grip portion 810 of the steering wheel 81. The right touchpad 21 is arranged on the tip side of the right grip portion 811. The operation surface 200 of the left touchpad 20 and the operation surface 210 of the right touchpad 21 each have a rectangular shape with one corner facing upward.

[0044] The left operation bar 22 is disposed along the upper side of the operation surface 200 of the left touchpad 20. The right operation bar 23 is disposed along the upper side of the operation surface 210 of the right touchpad 21.

[0045] The left touchpad 20 and the right touchpad 21 output left touchpad operation information S1 and right touchpad operation information S2, which are information relating to the performed operation, to the control unit 6. In addition, the left operation bar 22 and the right operation bar 23 output left operation information S3 and right operation information S4 to the control unit 6 based on the performed push operation or long press operation.

[0046] (Configuration of gaze detection unit 4) The gaze detection unit 4 is, for example, electrically connected to a camera 3. As shown in Fig. 1(a) and Fig. 3(a), the camera 3 is disposed so that a face 90 of an occupant 9 seated in a driver's seat 800 falls within an imaging range 30. The camera 3 is, for example, disposed on an instrument panel 803 in front of the occupant 9.

[0047] As an example, camera 3 captures an image of imaging range 30 using infrared rays, and outputs image information S5, which is information about the captured image, to gaze detection unit 4. Camera 3 may be disposed as an in-vehicle device 87, and connected to gaze detection unit 4 via vehicle LAN 88.

[0048] The gaze detection unit 4 detects the gaze 40 of the occupant 9 based on the image information S5 acquired from the camera 3. One example of a method for detecting the gaze 40 is a method for detecting the gaze 40 from the positional relationship between a stationary part (reference point) and a moving part (moving point) of the eye of the occupant 9, but is not limited to this.

[0049] As an example, the gaze detection unit 4 outputs gaze information S6, which is information on the coordinates of the gaze 40 in a coordinate system set on the display screen 840, to the control unit 6. That is, the gaze detection unit 4 calculates the coordinates where the gaze 40 intersects with the display screen 840, and outputs it as the gaze information S6.

[0050] (Configuration of communication unit 5) The communication unit 5 is configured to exchange information and signals between the operation device 1, the vehicle control device 83, the display device 84, and the like via the vehicle LAN 88.

[0051] (Configuration of control unit 6) The control unit 6 is a microcomputer including a CPU (Central Processing Unit) that performs calculations and processing on acquired data according to a stored program, a RAM (Random Access Memory) that is a semiconductor memory, and a ROM (Read Only Memory). The ROM stores, for example, a program for operating the control unit 6. The RAM is used, for example, as a storage area for temporarily storing calculation results. The control unit 6 also has a means for generating a clock signal therein and operates based on this clock signal.

[0052] 2(a), the control unit 6 has operation pattern information 60. The operation pattern information 60 includes information on an operation pattern that enables a desired display area to be operated, information on an operation pattern for changing the layout of the gaze position display area 41, and information on an operation pattern for switching the display area. Note that the operation pattern can be set by the occupant 9, for example. That is, as described later, when changing the layout, the occupant 9 may be determined to perform a long press on the right operation bar 23 but a long press on the left operation bar 22.

[0053] 2(b), the control unit 6 acquires display area information S9 related to the display area from the vehicle control device 83. Note that the display area information S9 is not limited to the vehicle control device 83, and if there is a control device other than the vehicle control device 83 that controls the display device 84, the display area information S9 may be acquired from this control device.

[0054] The display area information S9 is, for example, information specifying the range of the display area for the display screen 840. The control unit 6 determines in which display area the line of sight 40 is located, that is, the line of sight position display area 41, based on the line of sight information S6 acquired from the line of sight detection unit 4 and the display area information S9 acquired from the vehicle control device 83.

[0055] The control unit 6 outputs display instruction information S7 related to the gaze position display area 41 to the vehicle control device 83 via the vehicle LAN 88. The control unit 6 also generates operation unit operation information S8 based on an operation performed on the operation unit 2, and outputs the information to the vehicle control device 83 via the vehicle LAN 88. The display instruction information S7 includes information related to a change in the layout of the display area, and information related to a change in the display position of the display area. The control unit 6 may also be configured to transmit the operation unit operation information S8 to an in-vehicle device 87 corresponding to the gaze position display area 41.

[0056] The vehicle control device 83 generates display control information S for controlling the display of the display device 84 based on the acquired display instruction information S7. 10 This display control information S 10The image information includes at least information on an image related to the in-vehicle device 87 to be displayed on the display device 84, and information on which display area the image is to be displayed in.

[0057] 3(b), for example, when the display device 84 divides the display screen 840 into a first display area 841 to a fourth display area 844 to display display images 841a to 844a, the vehicle control device 83 acquires information relating to the display images 841a to 844a from the associated in-vehicle device 87 or the like, and displays them on the display screen 840. Then, when the vehicle control device 83 acquires operation section operation information S8 from the operation device 1, it moves the pointer 410 displayed in the operable display area, scrolls the menu, or the like.

[0058] Furthermore, when the vehicle control device 83 acquires the display instruction information S7, it activates the gaze position display area 41, changes the layout, or switches the display position.

[0059] In the following, an example of an operation for enabling a desired display area to be operated, an operation for changing the layout of the display areas, and an operation for switching the display areas will be described.

[0060] - Operations to enable desired display area FIG. 4(a) is a diagram for explaining an example of a first operation of the operating device according to the embodiment, FIG. 4(b) is a diagram showing an example of a display area where a gaze is detected, and FIG. 4(c) is a diagram showing an example of an eye gaze position display area that has become operable. In FIG. 4(b), a first display area 841 that displays a display image 841a of "A", a second display area 842 that displays a display image 842a of "B", a third display area 843 that displays a display image 843a of "C", and a fourth display area 844 that displays a display image 844a of "D" are displayed on a display screen 840 as a plurality of display areas. In FIG. 4(c), the eye gaze position display area 41 that has become operable is indicated by diagonal lines. In FIG. 5(a) to FIG. 5(c) and FIG. 6(a) to FIG. 6(c) described later, display areas and display images are illustrated based on FIG. 4(a) to FIG. 4(c).

[0061] In order to operate a desired display area, the occupant 9 performs a first operation on the operation unit 2, and then directs the line of sight 40 to the desired display area. FIG. 4(b) shows a case where the line of sight 40 is directed to the second display area 842. That is, the desired display area of ​​the occupant 9 is the second display area 842.

[0062] As an example, this first operation is, as shown in Figure 4 (a), an operation of pressing and holding the operation surface 200 of the left touchpad 20 with the left operating finger 910 of the left hand 91 and pressing and holding the operation surface 210 of the right touchpad 21 with the right operating finger 920 of the right hand 92, with the periods of pressing and holding at least partially overlapping.

[0063] When the control unit 6 determines that a first operation has been performed based on the left touchpad operation information S1 output from the left touchpad 20 and the right touchpad operation information S2 output from the right touchpad 21, and the operation pattern information 60, the control unit 6 controls the gaze detection unit 4 to check the gaze 40. Note that the control unit 6 may be configured to check the operation after determining that the gaze 40 is located on the display screen 840.

[0064] When the control unit 6 detects the line of sight 40 in any of the multiple display areas while the long press operation on the left touchpad 20 and the right touchpad 21 continues, the control unit 6 outputs display instruction information S7 for designating the display area in which the line of sight 40 was detected as the line of sight position display area 41. In Fig. 4(b), since the display area in which the line of sight 40 was detected is the second display area 842, the control unit 6 outputs display instruction information S7 for displaying the pointer 410 in the second display area 842, since the second display area 842 is the line of sight position display area 41 and is the desired display area of ​​the occupant 9.

[0065] When the occupant 9 wishes to operate a display area other than the second display area 842, the occupant 9 performs a long press operation on the left touchpad 20 and the right touchpad 21, and moves the gaze 40 to the desired display area to move the pointer 410, thereby enabling operation.

[0066] How to change the layout of the display area FIG. 5(a) is a diagram showing an example of an operation for changing a layout using an operating device in accordance with an embodiment, FIG. 5(b) is a diagram showing an example of a display area in which a line of sight is detected, and FIG. 5(c) is a diagram showing an example of a change in the layout.

[0067] When changing the layout of a desired display area, the occupant 9 first performs a first operation to make the display area to be changed operable, and then directs the line of sight 40 to the desired display area. Fig. 5(b) shows a case where the line of sight 40 is directed to the first display area 841. Note that if the display area to be changed is already active, it is not necessary to perform the first operation.

[0068] Next, after the pointer 410 moves to the first display area 841, the occupant 9 performs a long press operation on the right operation bar 23 as a second operation and a drag-and-drop operation on the operation surface 200 of the left touchpad 20 as a third operation, as shown in Fig. 5(a). Note that the occupant 9 may perform a drag-and-drop operation on the operation surface 210 of the right touchpad 21 while performing a long press operation on the left operation bar 22.

[0069] When the occupant 9 wishes to display the first display area 841 at the position of the third display area 843, the occupant 9 performs a drag operation from left to right on the operation surface 200 as shown in FIG. 5(c), and when the first display area 841 reaches the desired position, a drop operation is performed, i.e., the left operation finger 910 is released from the operation surface 200.

[0070] The control unit 6 determines that a drag-and-drop operation is being performed on the first display area 841, based on right operation information S4 output from the right operation bar 23 when a second operation is performed, left touchpad operation information S1 output from the left touchpad 20 when a third operation is performed, and operation pattern information 60. The control unit 6 outputs display instruction information S7 indicating to change the layout of the first display area 841 to the fourth display area 844 while keeping the first display area 841 active.

[0071] About switching the display area FIG. 6(a) is a diagram showing an example of an operation to switch display areas performed on an operating device in accordance with an embodiment, FIG. 6(b) is a diagram showing an example of a display area in which a line of sight is detected, and FIG. 6(c) is a diagram showing an example of switching display areas.

[0072] When switching the display position of a desired display area, the occupant 9 first performs a first operation to set the display area to be switched to the gaze position display area 41, and then sends the gaze 40 to the desired display area. Fig. 6(b) shows a case where the first display area 841 is set to the gaze position display area 41. Note that if the desired display area is already active, it is not necessary to perform the first operation.

[0073] Next, as shown in Fig. 6(a), the occupant 9 performs a long press operation on the right operation bar 23 as a second operation, and sends the line of sight 40 to a display area to be replaced with the line of sight position display area 41. Fig. 6(b) shows the case where the line of sight 40 is sent to a fourth display area 844.

[0074] Next, as shown in Fig. 6(a) to Fig. 6(c), the occupant 9 can switch the display areas by performing a long press on the right operation bar 23 as a second operation, sending the line of sight 40 to the fourth display area 844, and then releasing the right operation finger 920 from the right operation bar 23. As an example, the third operation is an operation including an operation of sending the line of sight 40 to the fourth display area 844 and an operation of releasing the right operation finger 920 from the right operation bar 23. Note that the occupant 9 may also perform a long press on the left operation bar 22, and send the line of sight 40 in the long press state.

[0075] The control unit 6 determines that the long press operation of the right operation bar 23 has been released for swapping based on the gaze information S6 output from the gaze detection unit 4, the right operation information S4 output from the right operation bar 23, and the operation pattern information 60. The control unit 6 outputs display instruction information S7 indicating to swap the display positions of the first display area 841 and the fourth display area 844 with the first display area 841 being active.

[0076] (operation) An example of the operation of the operating device 1 of this embodiment will be described below with reference to the flowcharts of FIGS.

[0077] - Operation to enable operation of desired display area The control unit 6 of the operation device 1 monitors whether a first operation is performed on the operation unit 2. When "Yes" in step 1 is established, that is, when a touch operation in which at least a part of a period overlaps on the left touchpad 20 and the right touchpad 21, that is, a first operation, is detected (Step 1: Yes), the control unit 6 controls the gaze detection unit 4 to start detecting the gaze 40 of the occupant 9 (Step 2).

[0078] When the touch operation on the left touchpad 20 and the right touchpad 21, i.e., the first operation, continues and a line of sight 40 is detected in any of the multiple display areas (Step 3: Yes), the control unit 6 outputs display instruction information S7 to activate, i.e., make operable, the display area in which the detected line of sight 40 is located (Step 4).

[0079] Here, in step 3, if the first operation continues and the line of sight 40 is not detected in any of the display areas among the plurality of display areas (Step 3: No), the control unit 6 advances the process to step 1.

[0080] - Actions that change the layout of the display area If "Yes" in Step 10 is satisfied, i.e., there is an active display area (Step 10: Yes), and a long press operation is performed on the operation bar, i.e., a second operation is performed (Step 11: Yes), and a drag-and-drop operation is performed as a third operation during the second operation (Step 12: Yes), the control unit 6 outputs display instruction information S7 to change the layout of the display area based on the drag-and-drop operation that was performed (Step 13).

[0081] Here, in step 11, if the second operation has not been performed (Step 11: No), the control unit 6 advances the process to step 10.

[0082] Furthermore, in step 12, if the third operation is not performed during the second operation (Step 12: No), the control unit 6 advances the process to step 10.

[0083] Swapping display areas If "Yes" in step 20 is satisfied, i.e., if there is an active display area (Step 20: Yes), and a long press operation, i.e., the second operation, is performed on the operation bar (Step 21: Yes), the control unit 6 controls the gaze detection unit 4 to start detecting the gaze 40 of the occupant 9 (Step 22).

[0084] When the control unit 6 detects a third operation in which the line of sight 40 is located in any of the display areas when the second operation is released (Step 23: Yes), it outputs display instruction information S7 to swap these display areas in order to swap the active display area with the display area in which the line of sight 40 was detected (Step 24).

[0085] Here, in step 21, if the second operation has not been performed (Step 21: No), the control unit 6 advances the process to step 20.

[0086] Furthermore, in step 23, if the third operation is not detected (Step 23: No), the control unit 6 advances the process to step 20.

[0087] (Effects of the embodiment) The operation device 1 according to this embodiment can improve operability. Specifically, the operation device 1 can operate only a desired display area based on a first operation on the operation unit 2 and the position of the line of sight 40. Therefore, compared to a case where a plurality of display areas are operated, the operation device 1 can reduce the difficulty caused by the difference in ratio and improve operability by enabling operation on a display area basis.

[0088] The operating device 1 can display the pointer 410 so that only the desired display area can be operated by combining a first operation on the operating unit 2 and the position of the line of sight 40, so that the starting point of the pointer 410 can be easily changed compared to a case where this configuration is not adopted.

[0089] The operating device 1 can operate a pointer 410 and the like displayed on a large display screen 840 using a left touchpad 20 and a right touchpad 21, each having a small operating surface 200 and operating surface 210 arranged on the steering wheel 81, thereby reducing the time required for operation compared to when the entire display screen is the target of operation.

[0090] The operating device 1 can easily perform the layout and replacement of the display area based on the operation on the operating part 2 and the position of the line of sight 40, so that the display area to be operated can be moved to a position closer to the occupant 9, as compared to a case where this configuration is not adopted, thereby further improving operability.

[0091] In the operation device 1, since the gaze position display area 41 has a difference in color and brightness between the display of the pointer 410 and other display areas, it is easier to see which display area has become active than when this configuration is not adopted.

[0092] By limiting the operable display area, the operating device 1 can be operated using the left touchpad 20 and the right touchpad 21 in a manner similar to that of a multi-function mobile phone or a tablet terminal, making it easy to operate even if the display screen 840 is large.

[0093] The controller device 1 according to the above-described embodiment and modified examples may be partially realized by a program executed by a computer, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like, depending on the application.

[0094] Although some embodiments and modifications of the present invention have been described above, these embodiments and modifications are merely examples and do not limit the invention according to the claims. These novel embodiments and modifications can be implemented in various other forms, and various omissions, substitutions, modifications, etc. can be made without departing from the gist of the present invention. In addition, not all combinations of features described in these embodiments and modifications are necessarily essential to the means for solving the problems of the invention. Furthermore, these embodiments and modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0095] 1...operation device, 2...operation section, 4...gaze detection section, 6...control section, 8...vehicle, 9...occupant, 20...left touch pad, 21...right touch pad, 22...left operation bar, 23...right operation bar, 40...gaze, 41...gaze position display area, 81...steering wheel, 84...display device, 410...pointer, 840...display screen, 841-844...first display area to fourth display area

Claims

1. an operation unit disposed in the vehicle and configured to receive a first operation; A gaze detection unit that detects the gaze of an occupant of the vehicle; a control unit that, when the operation unit receives the first operation and determines that a gaze position display area in which the gaze of the occupant is located is present among a plurality of display areas that display images, enables only an operation on the gaze position display area via the operation unit; An operating device comprising:

2. the control unit enables only an operation via the operation unit with respect to the gaze position display area, and causes a pointer operable via the operation unit to be displayed in the gaze position display area. The operating device according to claim 1 .

3. The operation unit includes a left operation unit and a right operation unit disposed on the left and right sides of a steering wheel of the vehicle, The control unit determines, as the first operation, operations performed on the left operation unit and the right operation unit, the operations having at least a partial overlapping period. The operating device according to claim 1 .

4. The operation unit further receives a second operation, the control unit, after enabling only the operation on the gaze position display area, when the second operation is performed on the operation unit and then a third operation is performed, moves the gaze position display area to change a layout of the plurality of display areas. The operating device according to claim 1 .

5. The operation unit includes a left operation unit and a right operation unit arranged on the left and right sides of a steering wheel of the vehicle, and a specific operation unit provided adjacent to at least one of the left operation unit and the right operation unit and configured to receive the second operation. The operating device according to claim 4.

6. the control unit keeps at least a display area displaying the speed of the vehicle in front of the occupant among the plurality of display areas, and restricts changes in the layout of the display area and replacement of the display position of the display area. The operating device according to claim 5.

Images