Operation detection device and operation detection method

Abstract

An operation detection device and an operation detection method are provided that can accurately detect a proximity operation in which a part of a user's body approaches a panel. [Solution] The operation detection device 1 detects proximity operations in which a user brings their hand close to the panel 3 based on the output of multiple detection elements 5 arranged along the panel 3. The actual detected position Xd, which is the position of the user's hand during the proximity operation, is detected based on the detection values ​​detected by the multiple detection elements 5. The actual detected position Xd is corrected based on a first hand angle θ, which is the angle made by the hand in a coordinate plane along the plane of the panel 3; a second hand angle p, which is the angle made by the hand in a Cartesian coordinate plane perpendicular to the coordinate plane; a line of sight angle e, which is the angle made by the user's line of sight to the panel 3; and distance information (first distance L1, second distance L2) obtained from the detection values ​​of the multiple detection elements 5 regarding the position of the user's hand.

Description

[Technical Field]

[0001] The present invention relates to an operation detection device and an operation detection method for detecting a proximity operation in which a user brings a part of their body close to a panel. [Background technology]

[0002] Conventionally, as disclosed in Patent Document 1, there is a well-known operation input device having an operation panel that accepts floating touch operations and touch operations. In Patent Document 1, when a floating touch operation is input to the operation panel, a pointer displayed on the display screen is shown at a position corresponding to the operation position of the floating touch operation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-11679 Summary of the Invention [Problem to be solved by the invention]

[0004] By the way, floating touch operation is not limited to operations where the hand is brought to the control panel from directly above, but also includes operations where the hand is brought to the control panel from an oblique angle, for example. In the case of operations where the hand is brought to the control panel from an oblique angle, the position directly below the hand may be detected even though the user's intended operating position is in line with their eyes. In this case, the detection position directly below the hand is detected instead of the position the user wants to operate, which resulted in a problem with the accuracy of floating touch operation detection. [Means for solving the problem]

[0005] An operation detection device that solves the above problem is a device that detects a proximity operation in which a user brings their hand close to a panel based on the output of a plurality of detection elements arranged along the panel, and comprises: a position detection unit that detects an actual detected position, which is the position of the user's hand during the proximity operation, based on the detection values ​​detected by the plurality of detection elements; and a correction unit that corrects the actual detected position detected by the position detection unit based on a first hand angle, which is the angle made by the hand in a coordinate plane along the plane of the panel; a second hand angle, which is the angle made by the hand in a Cartesian coordinate plane perpendicular to the coordinate plane; a line of sight angle, which is the angle made by the user's line of sight to the panel; and distance information obtained from the detection values ​​of the plurality of detection elements with respect to the position of the user's hand.

[0006] An operation detection method for solving the above problem is a method in which at least one processor detects a proximity operation in which a user brings their hand close to a panel, based on the output of a plurality of detection elements arranged along the panel, and includes: detecting an actual detected position, which is the position of the user's hand during the proximity operation, based on the detection values ​​detected by the plurality of detection elements; and correcting the actual detected position based on a first hand angle, which is the angle made by the hand in a coordinate plane along the plane of the panel; a second hand angle, which is the angle made by the hand in a Cartesian coordinate plane perpendicular to the coordinate plane; a line of sight angle, which is the angle made by the user's line of sight to the panel; and distance information obtained from the detection values ​​of the plurality of detection elements with respect to the position of the user's hand. [Effects of the Invention]

[0007] The present invention can accurately detect a proximity operation in which a part of the user's body is brought closer to a panel. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a perspective view illustrating an overview of an operation detection device according to an embodiment. [Figure 2] This is a diagram showing the configuration of the operation detection device. [Figure 3]FIG. 10 is a model diagram showing a specific example of a user performing a proximity operation on the panel, along with a graph showing the detection values ​​of the detection elements during the proximity operation. [Figure 4] This is a model diagram showing the parameters necessary to correct the actual detection position of the user's proximity operation. [Figure 5] FIG. 1 is a schematic diagram of a biaxial panel. [Figure 6] This is an explanatory diagram showing how the panel is operated from two directions. [Figure 7] This is a diagram illustrating the configuration of an operation detection device when parameters are treated as variables. DETAILED DESCRIPTION OF THE INVENTION

[0009] An embodiment of this disclosure is described below. (Overview of operation detection device 1) As shown in Figure 1, the vehicle's interior component 2 includes an operation detection device 1 that detects operations for operating in-vehicle equipment. The operation detection device 1 detects proximity operations in which the user brings their hand close to the panel 3 from an oblique direction. Proximity operations include not only operations where the hand is simply brought close to the panel 3, but also operations where a pointing hand is brought close. When used in a vehicle, the operation detection device 1 is located, for example, in the instrument panel, center cluster, or center console. Examples of in-vehicle equipment include car navigation systems, air conditioning systems, and audio systems.

[0010] Panel 3 displays multiple symbols 4 as targets for user proximity operations. The multiple symbols 4 are arranged, for example, in a line along the horizontal direction of Panel 3 (the X-axis direction in Figure 1). The multiple symbols 4 may be provided for each function in the same in-vehicle device, or for each in-vehicle device. In this example, for example, five symbols 4 are provided, and from the left-hand side of the page, they are designated as the first symbol 4a, the second symbol 4b, the third symbol 4c, the fourth symbol 4d, and the fifth symbol 4e. The symbols 4 may be, for example, printed materials on Panel 3, or projected images of light onto Panel 3.

[0011] (Electrical configuration of operation detection device 1) As shown in Figure 2, the operation detection device 1 includes a plurality of detection elements 5 that detect proximity operations when a user brings their hand close to the panel 3. In this example, the detection elements 5 are, for example, electrodes whose capacitance changes in response to the approach of the user's body. The plurality of detection elements 5 are arranged on the back surface of the panel 3 and along the panel 3. In this example, the plurality of detection elements 5 are arranged in a horizontal direction (the X-axis direction in Figure 2). In this example, for example, nine detection elements 5 are provided, and from the left seat side of the page, they are designated as the first detection element 5a, the second detection element 5b, the third detection element 5c, the fourth detection element 5d, the fifth detection element 5e, the sixth detection element 5f, the seventh detection element 5g, the eighth detection element 5h, and the ninth detection element 5i.

[0012] The multiple detection elements 5 are arranged in only one row in the lateral direction (the X-axis direction in Figure 2). Therefore, when the operation detection device 1 in this example detects a user's proximity operation, it detects the operation position in the X-axis direction. In this way, the operation detection device 1 in this example detects the operation position of a user's proximity operation in only one axis direction. The operation detection device 1 detects the user's hand proximity operation to the panel 3 based on the detection values ​​of the multiple detection elements 5 arranged along the panel 3.

[0013] The operation detection device 1 includes a control unit 6 that controls the operation of the operation detection device 1. The control unit 6 is composed of, for example, a processor, memory, and communication circuits. The processor is composed of, for example, a CPU (Central Processing Unit), an MPU (Micro Processor Unit), a GPU (Graphics Processing Unit), and an ASIC. The control unit 6 detects the user's proximity operation to the panel 3 based on the output of a plurality of detection elements 5. If the detection elements 5 are electrodes, the control unit 6 detects the capacitance of the plurality of electrodes and detects the user's proximity operation to the panel 3 from the changes in these capacitances.

[0014] (Relationship between symbol 4 and detector element 5) 3, the multiple symbols 4 are arranged to face every other one of the multiple detection elements 5. In this example, the first symbol 4a is arranged to face the first detection element 5a, the second symbol 4b is arranged to face the third detection element 5c, the third symbol 4c is arranged to face the fifth detection element 5e, the fourth symbol 4d is arranged to face the seventh detection element 5g, and the fifth symbol 4e is arranged to face the ninth detection element 5i. Based on the detection values ​​of each detection element 5, the control unit 6 detects which of the multiple symbols 4 is the target of the proximity operation (pointing operation).

[0015] (Position detection unit 8) 2, the operation detection device 1 includes a position detection unit 8 that detects an actual detection position Kd, which is the position of the user's hand during a proximity operation, based on detection values ​​detected by multiple detection elements 5. The position detection unit 8 is provided in the control unit 6, and repeatedly detects the actual detection position Kd at a predetermined cycle. When the position detection of a proximity operation on the panel 3 is uniaxial, in the X-axis direction, the actual detection position Kd is the actual detection position Xd of the operation position of the proximity operation in the X-axis direction.

[0016] In this example, the position detection unit 8 calculates the center of gravity position of the user's hand as the actual detected position Kd based on the detection values ​​detected by the multiple detection elements 5a to 5i. The center of gravity position is, for example, a coordinate position (coordinate position in the X-axis direction in this example) where the detection values ​​are balanced among the multiple detection values ​​(capacitances) detected by the detection elements 5a to 5i. There is no particular restriction on the method for calculating the center of gravity position. The position detection unit 8 treats the calculated center of gravity position as the actual detected position Kd.

[0017] (Correction Unit 9) 2, the operation detection device 1 includes a correction unit 9 that corrects the actual detection position Kd detected by the position detection unit 8. The correction unit 9 is provided in the control unit 6, and repeatedly corrects the actual detection position Kd at a predetermined cycle. The correction unit 9 corrects the actual detection position Kd to calculate a corrected detection position Kp, which is the operation position intended by the user. When the position detection of the proximity operation on the panel 3 is uniaxial, in the X-axis direction, the actual detection position Kd is the actual detection position Xd in the X-axis direction, and the corrected detection position Kp is the corrected detection position Xp in the X-axis direction.

[0018] As shown in Figures 3 and 4, the correction unit 9 corrects the actual detected position Kd (in this example, "Xd") based on a first hand angle θ, which is the angle formed by the hand in a coordinate plane along the plane of the panel 3, a second hand angle p, which is the angle formed by the hand in a Cartesian coordinate plane perpendicular to the coordinate plane along the plane of the panel 3, an eye angle e, which is the angle formed by the user's eye line E1 with respect to the panel 3, and distance information L obtained from the detection values ​​of multiple detection elements 5 regarding the position of the user's hand.

[0019] The coordinate plane along the plane of the panel 3 is, for example, the XY coordinate plane in the figure. The orthogonal coordinate plane is, for example, the XZ coordinate plane in the figure. The distance information L includes a first distance L1, which is the distance from the panel 3 to the user's fingertip, and a second distance L2, which is the distance from the user's fingertip to the center of gravity. The control unit 6 outputs a detection signal St (see FIG. 2) based on the corrected detection position Kp ("Xp" in this example) corrected by the correction unit 9 to another ECU or the like that requires the operation result of the user's proximity operation on the panel 3.

[0020] (Effect of the embodiment) Next, the operation of the operation detection device 1 (operation detection method) of this embodiment will be described. Here, we will describe the case in which the actual detected position Xd in the X-axis direction is corrected when detecting operation on only one axis in the X-axis direction.

[0021] As shown in Fig. 3, for example, suppose a user sitting in the driver's seat performs a proximity operation, specifically a pointing operation, on the third symbol 4c, which is the center of five horizontally arranged symbols 4 displayed on the panel 3. Because the pointing operation is performed from a diagonal direction of the panel 3, there is a discrepancy between the operation position intended by the user and the position directly below the fingertip on the panel 3. During the illustrated pointing operation, the detection values ​​of the sixth to eighth detection elements 5f to 5h, which are close to the user's hand, are high, while the detection values ​​of the first to fifth detection elements 5a to 5e, which are far from the user's hand, are low.

[0022] The position detection unit 8 sequentially executes a process to obtain the actual detected position Xd from the detection values ​​of the first detection element 5a to the ninth detection element 5i. When the center of gravity position of the hand is calculated from the outputs of the first detection element 5a to the ninth detection element 5i, a predetermined position on the palm is obtained as the coordinate position of the center of gravity position. Therefore, if the center of gravity position is used as the actual detected position Xd, a position completely different from the actual pointing position will be detected as the operation position. In the example shown in the figure, even though the user intended to select the third symbol 4c in the center of the pointing finger, the fourth symbol 4d to the right of it on the page would be selected. Therefore, the center of gravity position cannot simply be detected as the proximity position of the user's hand.

[0023] The correction unit 9 calculates a corrected detected position Xp by correcting the actual detected position Xd detected by the position detection unit 8 using the following equation (1). Xp=Xd-L1×cose×cosθ-L2×cosp×cosθ…(1) The first hand angle θ is the angle formed by the hand on the XY coordinate plane, which is a coordinate plane along the plane of the panel 3. In this example, the first hand angle θ is set as a predetermined fixed value by determining the approximate position of the user's shoulder through experiments or models. A preferred method of calculating the first hand angle θ is to, for example, assume a virtual three-dimensional pointing line E2 extending from the user's shoulder toward the panel 3, and treat the angle that this pointing line E2 forms with the arrangement line R1 of the detection elements 5 (the X-axis in this example) on the XY coordinate plane as the first hand angle θ.

[0024] As shown in Fig. 4, the second hand angle p is the angle formed by the hand on the XZ coordinate plane, which is the Cartesian coordinate plane of the panel 3. In this example, the second hand angle p is set as a predetermined fixed value by determining the approximate position of the user's shoulder through experiments and models. In order to calculate the second hand angle p, it is preferable to assume, for example, that the aforementioned pointing line E2 is positioned on the XZ coordinate plane, and treat the angle that this pointing line E2 forms with a parallel line R2 on the panel surface on the XZ coordinate plane as the second hand angle p.

[0025] The eye angle e is the angle of the user's eye line E1 relative to the panel 3 in the XZ coordinate plane, which is the Cartesian coordinate plane of the panel 3. In this example, the eye line angle e is set as a predetermined fixed value by determining the approximate position of the user's eyes through experiments or models. A preferred method of calculating the eye line angle e is to assume a virtual three-dimensional eye line E1 extending from the position of the user's eyes toward the panel 3, and treat the angle that this eye line E1 makes with respect to the panel surface as the eye line angle e. The eye line E1 is, for example, a straight line connecting the user's eyes and the panel 3 with an inclination of the eye line angle e.

[0026] The first distance L1 is calculated by, for example, defining the aforementioned line of sight E1 using the highest value among the detection values ​​detected by the multiple detection elements 5. In this example, of the detection values ​​of the first detection element 5a to the ninth detection elements 5i, the detection value of the sixth detection element 5f is the highest. The central coordinates of the sixth detection element 5f with the highest detection value are identified as the position Xr directly below the fingertip.

[0027] To calculate the first distance L1, first, the position of the aforementioned line of sight E1 on the XZ plane coordinate system is assumed using the detection value of the detection element 5 with the highest detection value among the detection values ​​of the multiple detection elements 5. In this way, the position of line of sight E1 on the XZ plane coordinate system is identified according to the detection value of the detection element 5 to which the fingertip is closest. Then, the position Xr directly below the fingertip is projected onto the identified line of sight E1, and the distance on the line from this projection point to the panel 3 is treated as the first distance L1.

[0028] The second distance L2 is calculated, for example, by defining the aforementioned pointing line E2 using the highest value among the detection values ​​detected by the multiple detection elements 5. The method of calculating the second distance L2 is as follows: first, the start point of the pointing line E2 on the XZ plane coordinate system is determined using the detection value of the detection element 5 with the highest value among the detection values ​​of the multiple detection elements 5. Then, the center of gravity position, i.e., the actual detection position Xd, is projected onto the pointing line E2 whose start point has been identified, and the distance on the line from this projection point to the start point is treated as the second distance L2.

[0029] The correction unit 9 calculates the corrected detection position Xp by correcting the actual detection position Xd according to the above-mentioned formula (1) using the first hand angle θ, second hand angle p, eye line angle e, first distance L1, and second distance L2 defined as above. Then, the control unit 6 outputs the calculated corrected detection position Xp to an external ECU or the like as a detection signal St indicating the operation position of the proximity operation of the user's hand.

[0030] Incidentally, when detecting the proximity action of a pointing hand, if not only the finger but also the palm of the hand is detected at the same time, the detection element 5 facing the palm will also react, which may result in an inaccurate detection of the proximity position of the pointing hand. However, in this example, when detecting the proximity position of the pointing hand, the actual detected position Xd is corrected taking into account not only the finger but also the palm, which is advantageous for accurately detecting the pointing hand position. This makes it possible to improve the detection accuracy of the proximity action of the pointing hand.

[0031] (Operation position detection for two axes, X and Y) 5, the detection elements 5 are not limited to being arranged only in the column direction (X-axis direction), but may be arranged in multiple rows in both the column direction (X-axis direction) and the row direction (Y-axis direction). That is, the detection elements 5 may be arranged along two axes, the X-axis and the Y-axis. In this case, the panel 3 may be, for example, a touch display.

[0032] The correction unit 9 calculates a corrected detection position Xp in the X-axis direction by correcting the actual detection position Xd in the X-axis direction detected by the position detection unit 8 using the above-mentioned equation (1). Also, the correction unit 9 calculates a corrected detection position Yp in the Y-axis direction by correcting the actual detection position Yd in the Y-axis direction detected by the position detection unit 8 using the following equation (2). Yp=Yd-L1×cose×sinθ-L2×cosp×sinθ…(2) The detection of the operation position in the Y-axis direction is derived using the same concept as the detection of the operation position in the X-axis direction, so the details will be omitted. As a result, even with a two-axis compatible panel 3, it is possible to accurately detect the user's proximity position.

[0033] (Determining which seat the proximity operation originated from) As shown in Fig. 6, the proximity operation of the panel 3 may be performed, for example, by a user seated on the right seat or by a user seated on the left seat. That is, the panel 3 can be operated from both one side in the width direction of the panel 3 and the other side in the width direction of the panel 3. The width direction of the panel 3 is the X-axis direction in the figure. Furthermore, one side in the width direction of the panel 3 is, for example, the driver's seat side, and the other side in the width direction of the panel 3 is, for example, the passenger seat side.

[0034] The correction unit 9 determines from which direction the panel 3 has been operated based on the tendency of changes in the detection values ​​of the multiple detection elements 5. In this example, the correction unit 9 determines from which direction the panel 3 has been operated by checking, for example, whether the detection values ​​of the multiple detection elements 5 are increasing from one side in the arrangement direction of the detection elements 5 or from the other side in the arrangement direction. For example, if the change in the detection value increasing from the ninth detection element 5i is detected, it is determined that the operation has been performed from the right seat, and if the change in the detection value increasing from the first detection element 5a is detected, it is determined that the operation has been performed from the passenger seat.

[0035] Based on the determination result of which direction the operation was performed on the panel 3, the correction unit 9 corrects the actual detection position Xd using the first hand angle θ, second hand angle p, line of sight angle e, and distance information L according to the determination result. Therefore, whether the proximity operation on the panel 3 is performed from the driver's seat side or the passenger's seat side, it is possible to accurately detect the proximity operation.

[0036] (Making fixed values ​​in the formula into variables) 7, the operation detection device 1 may change the fixed values ​​of formula (1) and formula (2) used in correcting the actual detected position Xd into variables. That is, the first hand angle θ, the second hand angle p, and the eye angle e may be variables according to, for example, the position or posture of the user, rather than being predetermined fixed values.

[0037] In this case, the operation detection device 1 includes a data acquisition unit 16 that acquires image data Da from an imaging unit 15 that captures an image of a user operating the panel 3, and a parameter adjustment unit 17 that adjusts at least one of the first hand angle θ, the second hand angle p, and the eye angle e based on the image data Da. The data acquisition unit 16 and the parameter adjustment unit 17 are provided in the control unit 6. The imaging unit 15 is, for example, a camera, and it is preferable that a plurality of imaging units 15 are installed inside the vehicle.

[0038] The data acquisition unit 16 sequentially acquires image data Da of the user operating the panel 3 from the imaging unit 15 and outputs this image data Da to the parameter adjustment unit 17. The parameter adjustment unit 17 adjusts at least one of the first hand angle θ, the second hand angle p, and the eye angle e based on this image data Da. Specifically, for example, by performing image recognition on the image data Da, the position of the user's eyes and shoulders is extracted, and the first hand angle θ, the second hand angle p, and the eye angle e are set according to each user from these positions. This makes it possible to optimize the first hand angle θ, the second hand angle p, and the eye angle e for each user, further contributing to improving the detection accuracy of a proximity operation of the panel 3 by a user.

[0039] (Effects of the embodiment) According to the configuration of the above embodiment, the following effects can be obtained. (1) The operation detection device 1 detects a proximity operation in which a user brings their hand close to the panel 3, based on the outputs of multiple detection elements 5 arranged along the panel 3. The operation detection device 1 includes a position detection unit 8 and a correction unit 9. The position detection unit 8 detects an actual detection position Kd (in this example, "Xd" or "Yd"), which is the position of the user's hand during the proximity operation, based on detection values ​​detected by the multiple detection elements 5. The correction unit 9 corrects the actual detection position Kd detected by the position detection unit 8 based on a first hand angle θ, which is the angle formed by the hand on a coordinate plane along the plane of the panel 3, a second hand angle p, which is the angle formed by the hand on a rectangular coordinate plane perpendicular to the coordinate plane, an eye angle e, which is the angle formed by the user's eye line E1 with respect to the panel 3, and distance information L, which is obtained from the detection values ​​of the multiple detection elements 5, regarding the position of the user's hand.

[0040] According to this configuration, the actual detected position Kd, which is detected as the position of the user's hand performing the proximity operation, is corrected using various parameters, including the first hand angle θ, the second hand angle p, the eye line angle e, and the distance information L. This makes it easier to detect the position ahead of the user's eye line E1 as the operation position intended by the user. This makes it possible to accurately detect the proximity operation of bringing part of the user's body closer to the panel 3.

[0041] (2) The position detection unit 8 calculates the center of gravity position of the user's hand based on the detection values ​​detected by the multiple detection elements 5, and treats the center of gravity position as the actual detection position Kd. This configuration makes it possible to accurately estimate the operation position ahead of the user's intended line of sight E1 by using the center of gravity position of the hand calculated from the output of the detection elements 5. This further contributes to improving the detection accuracy of the user's proximity operation on the panel 3.

[0042] (3) The distance information L includes a first distance L1, which is the distance from the panel 3 to the user's fingertip, and a second distance L2, which is the distance from the user's fingertip to the center of gravity. With this configuration, the actual detected position Kd is corrected using the first distance L1 and the second distance L2, which are distance information L corresponding to the hand posture of the user during proximity operation of the panel 3. This further contributes to improving the detection accuracy of proximity operation of the panel 3 by the user.

[0043] (4) Multiple detection elements 5 are arranged in both the row and column directions. The position detection unit 8 determines the actual detected position Kd using coordinates on two axes: the row axis (Y-axis in this example) and the column axis (X-axis in this example). The correction unit 9 corrects each of the actual detected positions Kd detected at the coordinates on the two axes based on the first hand angle θ, the second hand angle p, the line of sight angle e, and the distance information L. With this configuration, the operating position of the user's proximity operation can be accurately detected in the two-axis compatible panel 3.

[0044] (5) Panel 3 can be operated from both sides in the width direction of Panel 3 and the other side in the width direction of Panel 3. The correction unit 9 determines from which direction Panel 3 was operated based on the trend of changes in the detected values ​​of the multiple detection elements 5, and corrects the actual detected position Kd using the first hand angle θ, second hand angle p, line of sight angle e, and distance information L according to the determination result. With this configuration, regardless of whether the proximity operation to Panel 3 is performed from one side or the other side in the width direction of Panel 3, each proximity operation can be detected with high accuracy.

[0045] (6) The operation detection device 1 includes a data acquisition unit 16 that acquires image data Da from an imaging unit 15 that photographs a user operating the panel 3. The operation detection device 1 includes a parameter adjustment unit 17 that adjusts at least one of the first hand angle θ, the second hand angle p, and the eye line angle e based on the image data Da. With this configuration, the target parameter among the first hand angle θ, the second hand angle p, and the eye line angle e is optimized to a value appropriate for each user. This further contributes to improving the detection accuracy of proximity operations of the panel 3 by the user.

[0046] (Other embodiments) This embodiment can be modified as follows: This embodiment and the following modifications can be combined and implemented within the scope of technical compatibility.

[0047] Panel 3 is not limited to displaying a predetermined symbol; it may also be a display panel that displays various images or videos. Symbol 4 is normally off, but may be made to appear when the user's body approaches.

[0048] The detection elements 5 are not limited to being arranged in a single line; for example, they may be arranged in a cross shape. The detection element 5 is not limited to electrodes; for example, it may be an optical element (light sensor).

[0049] The actual detected position Kd is not limited to the center of gravity; it can be any predetermined position of the hand estimated from the output of the detection element 5. The operation detection device 1 may be used not only in vehicles but also in other equipment.

[0050] The phrase "at least one" as used in this disclosure means "one or more" of the desired options. As an example, the phrase "at least one" as used in this disclosure means "only one option" or "both of two options" if the number of options is two. As another example, the phrase "at least one" as used in this disclosure means "only one option" or "any combination of two or more options" if the number of options is three or more.

[0051] The position detection unit 8 and the correction unit 9 may be configured by [1] one or more processors operating according to a computer program (software), or [2] a combination of such a processor and one or more dedicated hardware circuits, such as an application-specific integrated circuit (ASIC), that execute at least some of the various processes. The processor includes a CPU and memory, such as RAM and ROM, that stores program code or instructions configured to cause the CPU to execute the processes. The memory (computer-readable medium) includes any available medium that can be accessed by a general-purpose or dedicated computer. Alternatively, instead of a computer including the processor, a processing circuit configured by one or more dedicated hardware circuits that execute all of the various processes may be used.

[0052] The position detection unit 8 and the correction unit 9 may be configured from independent processors, or may be configured from a processor that shares some of its functions. In this way, the position detection unit 8 and the correction unit 9 are not limited to being independent functional blocks, but may be configured from a single functional block, or may be configured from a functional block that shares some of its functions.

[0053] While the present disclosure has been described with reference to the embodiments, it is understood that the present disclosure is not limited to those embodiments or structures. The present disclosure also encompasses various modifications and equivalent modifications. In addition, various combinations and forms, including only one element, more than one element, or less than one element, are also within the scope and spirit of the present disclosure. [Explanation of symbols]

[0054] 1...Operation detection device, 3...Panel, 5...Detection element, 8...Position detection unit, 9...Correction unit, 15...Shooting unit, 16...Data acquisition unit, 17...Parameter adjustment unit, Kd...Actual detected position, Xd...Actual detected position, Yd...Actual detected position, θ...First hand angle, p...Second hand angle, e...Eye line angle, L...Distance information, L1...First distance, L2...Second distance, Da...Image data.

Claims

1. An operation detection device that detects a proximity operation in which a user brings a hand close to a panel based on outputs of a plurality of detection elements arranged along the panel, a position detection unit that detects an actual detection position, which is the position of a user's hand performing a proximity operation, based on detection values ​​detected by the plurality of detection elements; an operation detection device comprising: a correction unit that corrects the actual detection position detected by the position detection unit based on a first hand angle that is an angle formed by the hand in a coordinate plane that is along the plane of the panel; a second hand angle that is an angle formed by the hand in a rectangular coordinate plane that is perpendicular to the coordinate plane; an eye line angle that is an angle formed by the user's eye line with respect to the panel; and distance information regarding the position of the user's hand obtained from the detection values ​​of the multiple detection elements.

2. The operation detection device according to claim 1 , wherein the position detection unit calculates a center-of-gravity position of the user's hand based on detection values ​​detected by the plurality of detection elements, and treats the center-of-gravity position as the actual detection position.

3. The distance information is a first distance from the panel to a user's fingertip; The operation detection device according to claim 2 , further comprising: a second distance that is a distance from a fingertip of the user to the position of the center of gravity.

4. The plurality of detection elements are arranged in both the row direction and the column direction, the position detection unit determines the actual detected position as a coordinate position on two axes, an axis in the row direction and an axis in the column direction; 2. The operation detection device according to claim 1, wherein the correction unit corrects each of the actual detection positions detected at the coordinate positions of the two axes based on the first hand angle, the second hand angle, the eye angle, and the distance information.

5. the panel can be operated from both one side in the width direction of the panel and the other side in the width direction of the panel, 2. The operation detection device according to claim 1, wherein the correction unit determines from which direction the panel is operated based on a tendency of changes in the detection values ​​of the plurality of detection elements, and corrects the actual detection position using the first hand angle, the second hand angle, the eye angle, and the distance information according to the determination result.

6. a data acquisition unit that acquires image data from an image capture unit that captures an image of a user operating the panel; 2. The operation detection device according to claim 1, further comprising: a parameter adjustment unit that adjusts at least one of the first hand angle, the second hand angle, and the eye angle based on the image data.

7. An operation detection method in which at least one processor detects a proximity operation in which a user brings a hand close to a panel based on outputs of a plurality of detection elements arranged along the panel, the method comprising: Detecting an actual detection position, which is the position of a hand performed by a user for proximity operation, based on detection values ​​detected by the plurality of detection elements; correcting the actual detected position based on a first hand angle which is an angle made by the hand in a coordinate plane along the plane of the panel, a second hand angle which is an angle made by the hand in a Cartesian coordinate plane perpendicular to the coordinate plane, an eye line angle which is an angle made by the user's line of sight with respect to the panel, and distance information regarding the position of the user's hand obtained from detection values ​​of the plurality of detection elements.

Images