Input Devices

Abstract

To provide an input device that facilitates a user to grasp the selected status of a GUI button.SOLUTION: An input device includes: a display unit that displays an image of at least one GUI button 111 that is visible through an operation surface; a detecting unit that detects a center position FT1 of a finger facing the operation surface, and a distance from the operation surface to the finger; and a control unit which controls an image displayed by the display unit on the basis of an output by the detecting unit, and which determines presence or absence of an input to the GUI button. The control unit displays the image of a cursor 112 at the position on the display unit facing the finger on the basis of the center position of the finger, changes the size of the cursor in accordance with the distance between the operation surface and the finger, identifies a selected GUI button among the at least one GUI button on the basis of the center position of the finger, and shifts the center position of the cursor from the center position of the finger to cause the cursor to surround the selected GUI button when the selected GUI button is out of the cursor with the center position of the cursor being aligned with the center position of the finger.SELECTED DRAWING: Figure 5A

Description

[Technical field]

[0001] The present invention relates to an input device. [Background technology]

[0002] Conventionally, there is an input device including a touch panel capable of touch input and hover input by an operating object and a display device capable of displaying a plurality of selection items, the input device including a display control unit that highlights a selection item selected by the hover input, and a confirmation unit that confirms the selection of one of the selection items when a duration of a state in which any one of the selection items is selected by the hover input reaches a predetermined time, the confirmation unit confirms the selection of the one selection item when the touch input to the one selection item is detected before the duration reaches the predetermined time. Also, the display control unit causes the display device to display an operation frame representing the distance from the operating object to the operation surface of the touch panel when the hover input is being performed. The display control unit causes the display device to display an operation frame that becomes smaller as the distance from the operating object to the operation surface of the touch panel becomes closer, and the confirmation unit confirms the selection of the selection item when the number of selection items included in the operation frame becomes one (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2021 / 117446 Summary of the Invention [Problem to be solved by the invention]

[0004] The operation frame of a conventional input device is displayed like a cursor, and the selection items are input keys (GUI buttons) displayed by a GUI (Graphic User Interface). In the embodiment of Patent Document 1, the spacing between the input keys is large enough relative to the size of a finger, so it is easy to see which input key is selected. For this reason, in the embodiment of Patent Document 1, no special effort is made to make it easy to see which input key is selected.

[0005] An object of the present invention is to provide an input device that makes it easy to see which GUI button has been selected even if the GUI buttons are closely spaced apart. [Means for solving the problem]

[0006] An input device according to an embodiment of the present invention includes a top panel having an operation surface, a display unit that displays an image of at least one GUI button visible through the operation surface, a detection unit that detects a center position of a finger facing the operation surface and a distance from the operation surface to the finger, and a control unit that controls an image displayed by the display unit based on an output of the detection unit and determines whether or not an input has been made to the GUI button, and the control unit displays an image of a cursor at a position facing the finger on the display unit based on the center position of the finger, changes a size of the cursor according to the distance between the operation surface and the finger, identifies a selected GUI button of the at least one GUI button based on the center position of the finger, and, if the selected GUI button protrudes from the cursor when the center position of the cursor is aligned with the center position of the finger, shifts the center position of the cursor from the center position of the finger to surround the selected GUI button with the cursor. Effect of the Invention

[0007] To provide an input device that makes it easy to understand the selection status of GUI buttons. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of a configuration of an input device 100 according to an embodiment. [Diagram 2] 1 is a diagram illustrating an example of a configuration of an input device 100 according to an embodiment. [Diagram 3] 2 is a diagram illustrating an example of the configuration of an electrostatic sensor 120 and a control device 130 of the input device 100. FIG. [Figure 4A] 1 is a diagram illustrating a GUI button 111, a selection circle 111A, a cursor 112, and a threshold range in the XY coordinate system. [Figure 4B] 13 is a diagram showing the center of a GUI button 111 and the position of a fingertip FT. [Figure 5A] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 5B] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 5C] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6A] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6B] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6C] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6D] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6E] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6F] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 6G] FIG. 13 is a diagram for explaining the operation at the time of selection in chronological order. [Figure 7] FIG. 1 is a diagram showing the input device 100 in a state in which a hover input for a selected GUI button 111 has been confirmed. [Figure 8] 1 is a flowchart showing a process executed by a control device 130 of the input device 100. FIG. [Figure 9] 1 is a flowchart showing a process executed by a control device 130 of the input device 100. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment to which the input device of the present invention is applied will be described.

[0010] <Embodiment> 1 and 2 are diagrams showing an example of the configuration of an input device 100 according to an embodiment. FIG. 1 shows a state in which the input device 100 is in an operating state and the display device 110 is displaying an input image. FIG. 2 shows a state in which the input device 100 is in a standby state and the display device 110 is displaying a standby image. In the standby state, the display device 110 is generally displayed in gray and is in a state in which power consumption is low. FIG. 3 is a diagram showing an example of the configuration of an electrostatic sensor 120 and a control device 130 of the input device 100. The display device 110 is an example of a display unit, the electrostatic sensor 120 is an example of a detection unit, and the control device 130 is an example of a control unit.

[0011] In the following, an XYZ coordinate system is defined and described. The direction parallel to the X axis (X direction), the direction parallel to the Y axis (Y direction), and the direction parallel to the Z axis (Z direction) are mutually perpendicular. In the following, the -Z direction is described as the direction approaching the electrostatic sensor 120, and the +Z direction is described as the direction away from the electrostatic sensor 120. In addition, a planar view refers to an XY plane view. In the following, the length, width, thickness, etc. of each part may be exaggerated to make the configuration easier to understand.

[0012] The input device 100 includes a housing 101, a display device 110, an electrostatic sensor 120, and a control device 130. Although the control device 130 (see FIG. 3) is omitted in FIGS. 1 and 2, the control device 130 is provided, for example, below the display device 110 and the electrostatic sensor 120 inside the housing 101. The input device 100 includes the electrostatic sensor 120 and the control device 130 shown in FIG. 3.

[0013] The housing 101 is a case made of resin, metal, or the like that houses the display device 110, the electrostatic sensor 120, and the control device 130. The display device 110 is arranged, for example, below the transparent electrostatic sensor 120, and is visible through an operation surface 105A that is the upper surface of a transparent top panel 105 provided in an opening at the top of the housing 101.

[0014] The input device 100 can be operated with a fingertip approaching the operation surface 105A of the input device 100 without touching it. The input device 100 detects the position of the fingertip that is not in contact with the operation surface 105A (the position in the XY coordinate system and the position in the Z direction from the operation surface 105A) and accepts a non-contact operation input.

[0015] Although details will be described later, the position of the fingertip in the XY coordinate system detected by the input device 100 using the electrostatic sensor 120 is, for example, the XY coordinate system with the largest capacitance in the area where the fingertip FT exists. In addition, the Z-direction position of the fingertip detected by the input device 100 using the electrostatic sensor 120 is a value inversely proportional to the capacitance detected by the electrostatic sensor 120, so that obtaining the Z-direction position of the fingertip is synonymous with obtaining the capacitance between the fingertip FT and the electrostatic sensor 120. As an example, the input device 100 determines the Z-direction position of the fingertip FT by the capacitance between the fingertip FT and the electrostatic sensor 120, but hereinafter, when it is easier to understand to explain it as the Z-direction position of the fingertip FT, it will be explained as the Z-direction position of the fingertip FT.

[0016] A non-contact operation input refers to operating the input device 100 with a fingertip without touching the operation surface 105A with the fingertip. A non-contact operation input may be called a hover input or a touchless input. The input device 100 may also detect the position of a fingertip touching the operation surface 105A and accept the operation input. An operation input made by touching the operation surface 105A may be called a touch input.

[0017] The input device 100 can perform both non-contact operation input (hover input or touchless input) and contact operation input (touch input), but the following describes a form of non-contact operation input as an example. In addition, the non-contact operation input is hereinafter referred to as hover input.

[0018] The input device 100 may be, for example, a tablet-type input device that is placed in a store or facility and used by an unspecified number of users, or an input section of an ATM (Automatic Teller Machine). It may also be an input section of a cooking appliance that needs to be kept clean. The input device 100 may also be a tablet computer, smartphone, game machine, or the like that is used by an individual.

[0019] The display device 110 is, for example, a liquid crystal display or an organic EL (Electroluminescence) display. The display device 110 is a display for realizing a GUI (Graphic User Interface). The display device 110 displays an image of GUI buttons 111, a cursor, and an image of an input content display section 115 that displays input contents. The GUI buttons 111 are, for example, arranged in a matrix in a planar view. The GUI buttons 111 are, for example, circular in shape to imitate a push button. The cursor will be described later with reference to FIG. 4A.

[0020] 1 to 3 show, as an example, a total of 45 GUI buttons 111, including 26 alphabetical GUI buttons 111, 15 numeric keypad-style GUI buttons 111, and four GUI buttons 111: a menu key (the key with three lines at the top left), a Caps Lock key, a backspace key (top right), and an enter key (bottom left). The 45 GUI buttons 111 are arranged in 5 rows in the Y direction and 11 rows in the X direction. The rows extend in the X direction, and Y extends in the column direction. Note that the GUI buttons 111 are not limited to alphabetical characters or numeric keypad numbers, and may be characters or symbols of other languages.

[0021] The electrostatic sensor 120 is disposed on the display device 110, and has a plurality of sensor electrodes 121X extending in the X direction and a plurality of sensor electrodes 121Y extending in the Y direction, as shown in FIG. 3. The sensor electrodes 121X and 121Y are an example of electrodes of a detection unit, and are connected to the control device 130 via wirings 122X and 122Y, respectively. For example, such an electrostatic sensor 120 may be formed by forming a transparent conductive film such as ITO (Indium Tin Oxide) on the surface of transparent glass, and patterning the sensor electrodes 121X and 121Y and wirings 122X and 122Y. The electrostatic capacitance of the electrostatic sensor 120 is input to the control device 130.

[0022] 3 shows, as an example, a plurality of sensor electrodes 121X and a plurality of sensor electrodes 121Y. The intervals between the sensor electrodes 121X and between the sensor electrodes 121Y are narrower than the intervals between the GUI buttons 111.

[0023] The sensor electrodes 121X are scanned row by row, and the sensor electrodes 121Y are scanned column by column, and the AD conversion unit 132 converts the capacitances at the intersections between the sensor electrodes 121X and the sensor electrodes 121Y into digital values. The counter 133 counts the change in the output of the AD conversion unit 132 and outputs the difference value ΔAD at each intersection. It is also possible to increase the resolution by using an interpolation method based on the spacing between the sensor electrodes 121X and the spacing between the sensor electrodes 121Y. In this case, the spacing between the sensor electrodes 121X and the spacing between the sensor electrodes 121Y may be wider than the spacing between the GUI buttons 111. Although not shown, when the interpolation method is used, the GUI buttons 111 may correspond one-to-one to sensor electrodes of approximately the same size as the GUI buttons 111.

[0024] The control device 130 is realized by a computer including a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), an input / output interface, an internal bus, and the like.

[0025] The control device 130 has a main control unit 131, an AD (Analog to Digital) conversion unit 132, a counter 133, a determination unit 134, an operation control unit 135, a display control unit 136, and a memory 137. The main control unit 131, the AD conversion unit 132, the counter 133, the determination unit 134, the operation control unit 135, and the display control unit 136 are functional blocks showing the functions of the programs executed by the control device 130. The memory 137 is a functional representation of the memory of the control device 130.

[0026] The main control unit 131 is a processing unit that controls the processing of the control device 130, and executes processing other than the processing executed by the AD conversion unit 132, the counter 133, the determination unit 134, the operation control unit 135, and the display control unit 136. For example, the main control unit 131 scans the multiple sensor electrodes 121X and the multiple sensor electrodes 121Y.

[0027] The AD conversion unit 132 converts the output of the electrostatic sensor 120 into a digital value. The output of the AD conversion unit 132 is a detection value of the capacitance at each intersection of the sensor electrodes 121X and 121Y of the electrostatic sensor 120. The counter 133 counts and outputs a difference value of the output of the AD conversion unit 132 with respect to a reference value. The difference value is a count value of the change in the output with respect to the reference value. Hereinafter, this is referred to as a difference value ΔAD. The reference value is the capacitance at each intersection of the sensor electrodes 121X and 121Y when there is no finger around the sensor electrodes 121X and 121Y. The difference value ΔAD is the capacitance between each intersection of the sensor electrodes 121X and 121Y and the finger.

[0028] The difference value ΔAD is obtained for each intersection. The AD conversion unit 132 converts the capacitance of each intersection of the sensor electrodes 121X and 121Y into a digital value, and the counter 133 counts the change in the output of the AD conversion unit 132 relative to a reference value and outputs the difference value ΔAD for each intersection.

[0029] The determination unit 134 determines the position of the fingertip in the XY coordinates in a non-contact state with respect to the operation surface 105A and the position of the fingertip in the Z direction from the operation surface 105A based on the difference value ΔAD output from the counter 133. In the input device 100, the determination unit 134 determines the position of the tip of the fingertip (the position in the XY coordinates and the position in the Z direction) as the position of the hover input performed by the user. The determination method executed by the determination unit 134 will be described later using a flowchart.

[0030] The operation control unit 135 controls the operation of the input device 100 based on the position of the hover input determined by the determination unit 134. The display control unit 136 controls the display of the display device 110 based on the position of the hover input determined by the determination unit 134. The memory 137 stores programs, data, etc. used when the main control unit 131, the determination unit 134, the operation control unit 135, and the display control unit 136 execute processes. The memory 137 also stores data indicating the number of rows and the number of columns of the sensor electrodes 121X and 121Y.

[0031] <Cursor 112 and threshold value in XY coordinates> Fig. 4A is a diagram for explaining the GUI button 111, the selection circle 111A, the cursor 112, and the range of the threshold in the XY coordinates. Fig. 4A shows the GUI buttons 111 of the alphabet G and H, the position of the fingertip FT, the selection circle 111A, the cursor 112, and the circular range determined by the threshold.

[0032] The position of the fingertip FT is indicated by a symbol combining a cross and a circle (hereinafter referred to as a cross-shaped symbol). The position of the fingertip FT is the position of the tip of the finger stretched straight from the +Z direction side with respect to the operation surface 105A, and the intersection of the cross-shaped symbol indicates the position of the fingertip FT in the XY coordinates detected by the control device 130 based on the output of the electrostatic sensor 120. As an example, the XY coordinates indicating the position of the fingertip FT are the XY coordinates with the largest electrostatic capacitance in the area where the fingertip FT exists. In order to eliminate the influence of noise, as an example, the apex of a parabola approximated by the least squares method from the distribution of electrostatic capacitance on the X axis is set as the X coordinate, and the apex of a parabola approximated by the least squares method from the distribution of electrostatic capacitance on the Y axis is set as the Y coordinate. The position of the fingertip FT obtained in this way is an example of the center position of the finger. In the following, the position of the intersection of the cross-shaped symbol will be described as the position of the fingertip FT in the XY coordinates.

[0033] Here, as an example, the position of fingertip FT in the XY coordinate system is inside GUI button 111 for G, and thus GUI button 111 for G is selected. It is assumed that fingertip FT is sufficiently close to operation surface 105A to be able to select GUI button 111 for G, and in Fig. 4A, the position of cursor 112 and the range of threshold values ​​will be described in relation to the position of fingertip FT in the XY coordinate system.

[0034] A selection circle 111A is displayed over the entire interior of the selected GUI button 111. In Fig. 4A, the selection circle 111A is shown in dark gray. The selection circle 111A is a highlighting display for making the selected GUI button 111 stand out (emphasizing) so that it is visually distinguishable from unselected GUI buttons 111, and as one example, is displayed superimposed over the entire GUI button 111.

[0035] Here, since GUI button 111 is circular, selection circle 111A is also circular. If GUI button 111 is a shape other than circular, a highlighting display of a similar shape that emphasizes selected GUI button 111 may be used instead of selection circle 111A. Also, a highlighting display that emphasizes a part of selected GUI button 111 may be used instead of selection circle 111A. Also, instead of displaying selection circle 111A, selected GUI button 111 may be made to stand out by blinking, etc.

[0036] Moreover, cursor 112 is circular. The shape of cursor 112 may be any convex figure, but here, a form in which it is circular will be described. The reason why cursor 112 is shaped as a convex figure is that it is easy to determine whether selected GUI button 111 protrudes beyond cursor 112. Furthermore, if cursor 112 is shaped as a circle, it is easier to determine whether selected GUI button 111 protrudes beyond cursor 112.

[0037] Also, the size of the cursor 112 is proportional to the distance between the fingertip FT and the operation surface 105A. In other words, the size of the cursor 112 is inversely proportional to the magnitude of the electrostatic capacitance detected by the electrostatic sensor 120. However, here, the position of the fingertip FT in the Z direction with respect to the operation surface 105A will be described as being constant in a state where the fingertip FT is sufficiently close to the operation surface 105A so that the GUI button 111 of G can be selected. Note that the presence or absence of selection and confirmation depending on the positional relationship between the fingertip FT and the operation surface 105A will be described later with reference to FIGS. 6A to 6G.

[0038] 4A, GUI button G 111 is selected and a selection circle 111A is displayed superimposed thereon, and is therefore shown in dark gray. Cursor 112, shown in light gray, surrounds GUI button G 111. As an example, GUI button 111 is transparent, selection circle 111A is semi-transparent, and the image of GUI button 111 is displayed in front of the image of selection circle 111A. Furthermore, the image of selection circle 111A is displayed in front of the image of cursor 112.

[0039] Displaying the image of GUI button 111 on the front side of the image of selection circle 111A means that the image of GUI button 111 is displayed superimposed on the image of selection circle 111A. The front side is the side from which the display of display device 110 is viewed. In other words, the image of selection circle 111A is displayed on the back side of the image of GUI button 111. The back side is the side opposite the front side, and means the back side of the display.

[0040] Moreover, selection circle 111A being displayed in front of cursor 112 means that in the portion where selection circle 111A and cursor 112 overlap, selection circle 111A is displayed above cursor 112. In other words, in the portion where selection circle 111A and cursor 112 overlap, cursor 112 is located behind selection circle 111A.

[0041] Moreover, the H GUI button 111 is in a non-selected state and is therefore shown in white, and the portion that overlaps with the cursor 112 is shown behind the cursor 112. Therefore, from the front side to the back side, the image of the selected GUI button 111, the image of the selection circle 111A, the image of the cursor 112, and the image of the non-selected GUI button 111 are displayed in this order.

[0042] In reality, the display can be in color, so for example, the selection circle 111A can be shown in a conspicuous color such as yellow, the cursor 112 can be shown in a color such as blue that is less conspicuous than the selection circle 111A, and the unselected GUI buttons 111 can be displayed in a color such as white or light gray that makes it easy to distinguish the boundaries with the parts other than the GUI buttons 111. The image of the GUI buttons 111 is transparent, so it shows through the color of the selection circle 111A on the back side and is displayed in the color of the selection circle 111A.

[0043] In addition, in FIG. 4A, the range of the cursor fixation threshold THA is indicated by a dashed line inside the selected GUI button 111 of G, the range of the selection circle threshold THB is indicated by a dashed line slightly outside the GUI buttons 111 of G and H, and the range of the cursor movement threshold THC is indicated by a two-dot chain line outside the selected GUI button 111 of G. The range of the cursor fixation threshold THA, the range of the selection circle threshold THB, and the range of the cursor movement threshold THC are ranges surrounded by circles of radii ra, rb, and rc centered on the center of the selected GUI button 111 of G. The cursor fixation threshold THA, the selection circle threshold THB, and the cursor movement threshold THC represent the radii (distances) ra, rb, and rc from the center of the selected GUI button 111 of G. Therefore, the cursor fixation threshold THA, the selection circle threshold THB, and the cursor movement threshold THC represent thresholds in the XY coordinates. The radii (distances) ra, rb, and rc are constant values.

[0044] In this case, in order to explain the case where the G GUI button 111 is selected, the range of the cursor fixation threshold THA is shown inside the G GUI button 111, and the range of the cursor movement threshold THC is shown by a dotted line on the outside; however, when a GUI button 111 other than G is selected, similar ranges of the cursor fixation threshold THA and cursor movement threshold THC are set.

[0045] In addition, since the selection circle threshold THB is a threshold set for all GUI buttons 111, in FIG. 4A, the range of the selection circle threshold THB is shown slightly outside the GUI buttons 111 of G and H, but in reality, as an example, the range of the selection circle threshold THB is equal to the display area of ​​the GUI buttons 111 of G and H. This is similar for GUI buttons 111 other than the GUI buttons 111 of G and H. Note that the position of the fingertip FT, the range of the cursor fixation threshold THA, the range of the selection circle threshold THB, and the range of the cursor movement threshold THC are not displayed on the display device 110, but are shown in FIG. 4A for the purpose of explanation. The same is true for other figures used in the following explanation.

[0046] The cursor fixation threshold THA is a threshold (radius ra) for fixing the position of the cursor 112 so as to include the selected GUI button 111. The cursor fixation threshold THA is provided for matching the center of the cursor 112 with the center of the fingertip FT when the position of the fingertip FT is within the range of the cursor fixation threshold THA inside the selected GUI button 111. In other words, when the position of the fingertip FT moves within the cursor fixation threshold THA inside the selected GUI button 111, the position of the center of the cursor 112 is matched with the position of the fingertip FT in the XY coordinates.

[0047] The selection circle threshold THB is provided for selecting a GUI button 111 when the position of the fingertip FT enters the range of the selection circle threshold THB in a state where none of the GUI buttons 111 is selected. In other words, if the distance D between the position of the fingertip FT in the XY coordinates and the center of the GUI button 111 is equal to or smaller than the radius rb (D≦rb), the GUI button 111 is selected.

[0048] The cursor movement threshold THC is provided to cancel the selection of a selected GUI button 111. For example, if the fingertip FT is outside the range of the cursor movement threshold THC of the GUI button 111 of G and moves into the selection circle threshold THB of the GUI button 111 of H, the GUI button 111 of H is selected. Also, if the fingertip FT is outside the range of the cursor movement threshold THC of the GUI button 111 of G and outside the range of the selection circle threshold THB of all the GUI buttons 111, none of the GUI buttons 111 is selected. When none of the GUI buttons 111 is selected, the center of the cursor 112 is made to coincide with the center of the fingertip FT.

[0049] Since the range of the cursor movement threshold THC extends beyond the GUI button 111, even if the position of the fingertip FT moves outside the GUI button 111, the GUI button 111 remains selected as long as it is within the range of the cursor movement threshold THC.

[0050] However, when the selected GUI button 111 extends beyond the cursor 112, it becomes difficult to tell that it is selected. Therefore, when the position of the fingertip FT exceeds the range of the cursor fixation threshold THA, the cursor 112 shifts the center of the cursor 112 from the position of the fingertip FT, encloses the selected GUI button 111 with the cursor 112, and is displayed such that the circle of the GUI button 111 is inscribed in the circle of the cursor 112. When the cursor 112 is moved centered on the position of the fingertip FT while the position of the fingertip FT exceeds the range of the cursor fixation threshold THA, the selected GUI button 111 extends beyond the cursor 112, and it may become visually difficult to tell that the GUI button 111 is selected.

[0051] That is, when the position of the fingertip FT exceeds the range of the cursor fixation threshold THA, if the center position of the cursor 112 is made to coincide with the position of the fingertip FT, the selected GUI button 111 extends beyond the cursor 112. Therefore, the cursor 112 shifts the center of the cursor 112 from the position of the fingertip FT, encloses the selected GUI button 111 with the cursor 112, and is displayed such that the circle of the GUI button 111 is inscribed in the circle of the cursor 112.

[0052] In this way, even when the position of the fingertip FT is outside the range of the cursor fixation threshold THA, if the distance D between the position of the fingertip FT in the XY coordinates and the center of the selected GUI button 111 is rc or less (D ≤ rc), the state in which the GUI button 111 is selected is maintained. And at this time, according to the position of the fingertip FT, the center of the cursor 112 is shifted from the position of the fingertip FT toward the center of the GUI button 111 so that the circle of the GUI button 111 is inscribed in the circle of the cursor 112. This operation will be described later with reference to FIGS. 5A to 5C.

[0053] <Center of GUI button 111 and position of fingertip FT> Fig. 4B is a diagram showing the center of the GUI button 111 and the position of the fingertip FT. The GUI button 111 shown in Fig. 4 is selected, so a selection circle 111A is displayed superimposed on it. In Fig. 4B, the alphabet and other characters displayed on the GUI button 111 are omitted.

[0054] The coordinates of the center of the selected GUI button 111 are (xs, ys), and the XY coordinates of the position of the fingertip FT are (xf, yf). In Fig. 4B, a half line connecting the center of the selected GUI button 111 and the position of the fingertip FT is shown by a dashed line. The distance D between the center of the selected GUI button 111 and the position of the fingertip FT in the XY coordinates is the distance between the point with the coordinates (xs, ys) and the point with the coordinates (xf, yf), and is expressed by the following formula (1). D={(xs-xf) 2 +(ys-yf) 2} 1 / 2 (1)

[0055] <Action when selected> 5A to 5C are diagrams for explaining the operation at the time of selection in a time series. 12 GUI buttons 111 corresponding to the alphabetical letters A to D, F to I, and K to N are shown in FIG. 5A. Also, in FIG. 5A, the GUI button G 111 is assumed to be selected, and a selection circle 111A is shown superimposed on the GUI button G 111, and the range of the cursor movement threshold THC surrounding the GUI button G 111 is shown. The state shown in FIG. 5A transitions to the states shown in FIG. 5B and FIG. 5C with the passage of time. Note that in FIG. 5A to FIG. 5C, unselected GUI buttons 111 are shown in white.

[0056] 5A shows the cursor 112 when the fingertip position has moved from FT1 to FT2. Position FT1 is close to the center of the GUI button 111, while position FT2 is just before the outer edge of the cursor movement threshold THC. When the fingertip has moved from position FT1 to position FT2, the distance between the position of the fingertip FT and the center of the selected GUI button 111 is equal to or less than rc, and the selected state of the GUI button 111 is maintained, but the center position of the cursor 112 has shifted from the fingertip position FT toward the center of the GUI button 111 so that the GUI button 111 is inscribed in the cursor 112.

[0057] In FIG. 5B, the position of the fingertip has moved to a position FT3 further in the +X direction than FT2 shown in FIG. 5A. Since the position FT3 is outside the range of the cursor movement threshold THC for the GUI button 111 of G, the selection of the GUI button 111 of G is deselected. Furthermore, since the position FT3 is within the range of the selection circle threshold THB for the GUI button 111 of H, the GUI button 111 of H is selected. Therefore, the selection circle 111A is displayed superimposed on the GUI button 111 of H, and the cursor 112 surrounds the GUI button 111 of H. Here, in order to explain the deselection of the GUI button 111 of G, the range of the cursor movement threshold THC for the GUI button 111 of H is omitted.

[0058] In Fig. 5C, the range of the cursor movement threshold THC is shown around the GUI button 111 of H. This is because the GUI button 111 of H was selected in Fig. 5B. Although the position of the fingertip FT is not shown in Fig. 5C, as long as it is within the range of the cursor movement threshold THC for the GUI button 111 of H, the GUI button 111 of H remains selected, and a cursor 112 surrounding the GUI button 111 of H is displayed.

[0059] <Action when confirmed> Figures 6A to 6G are diagrams for explaining the operation at the time of selection in a chronological order. The upper side of Figures 6A to 6G shows the position of the fingertip FT of the hand 10 on the operation surface 105A, cross sections of the display device 110 and the electrostatic sensor 120, the selection threshold TH1, and the decision threshold TH2. The lower side of Figures 6A to 6G shows the operation surface 105A, nine GUI buttons 111 of the alphabets A to C, F to H, and K to M, a selection circle 111A, the position of the fingertip FT, a cursor 112, and a ring indicator 113.

[0060] <Selection threshold TH1 and decision threshold TH2> The selection threshold TH1 and the definite threshold TH2 are thresholds used when the control device 130 determines the position of the fingertip FT relative to the operation surface 105A based on the capacitance of the electrostatic sensor 120, and in Fig. 6A to Fig. 6G, the selection threshold TH1 and the definite threshold TH2 are shown at distances from the operation surface 105A according to the capacitances of the selection threshold TH1 and the definite threshold TH2 so that they can be visually recognized. Since the definite threshold TH2 represents a capacitance larger than the selection threshold TH1, the dashed line corresponding to the definite threshold TH2 is closer to the operation surface 105A than the dashed line corresponding to the selection threshold TH1.

[0061] The selection threshold TH1 is used to determine whether or not the GUI button 111 has been selected by a hover input. The confirmation threshold TH2 is used to determine whether or not the selection of the selected GUI button 111 may be confirmed by a hover input.

[0062] Hereinafter, the position of the dashed line in the vertical direction from operation surface 105A corresponding to selection threshold TH1 will be referred to as the position of selection threshold TH1, and the position of the dashed line in the vertical direction from operation surface 105A corresponding to final threshold TH2 will be referred to as the position of final threshold TH2.

[0063] When the fingertip FT is farther away from the operation surface 105A than the position of the selection threshold TH1, the capacitance of all the intersections of the electrostatic sensor 120 is less than the selection threshold TH1. When the fingertip FT approaches the operation surface 105A and reaches the position of the selection threshold TH1, the capacitance of the intersection closest to the fingertip FT becomes equal to the selection threshold TH1. When the fingertip FT approaches the operation surface 105A further than the position of the selection threshold TH1, the capacitance of the intersection closest to the fingertip FT becomes larger than the selection threshold TH1. The position of the selection threshold TH1 is, for example, about 3 cm from the operation surface 105A.

[0064] When the fingertip FT approaches the operation surface 105A to operate one of the GUI buttons 111 and reaches the position of the selection threshold TH1, the GUI button 111 including the position of the fingertip FT is selected, and a selection circle 111A is displayed inside the selected GUI button 111, and a cursor 112 is displayed surrounding the selected GUI button 111. Since the diameter of the cursor 112 is inversely proportional to the magnitude of the capacitance, the cursor 112 becomes smaller as the fingertip FT approaches the operation surface 105A. This allows the user to visually recognize that the fingertip FT is approaching the operation surface 105A.

[0065] When the fingertip FT approaches the operation surface 105A and reaches the position of the selection threshold TH1, if there is no GUI button 111 including the position of the fingertip FT, none of the GUI buttons 111 is selected, and a cursor 112 centered on the position of the fingertip FT is displayed. The diameter of the cursor 112 is inversely proportional to the magnitude of the capacitance.

[0066] The same is true for the definite threshold TH2. When the fingertip FT is farther away from the operation surface 105A than the position of the definite threshold TH2, the capacitance of all intersections is less than the definite threshold TH2. When the fingertip FT approaches the operation surface 105A and reaches the position of the definite threshold TH2, the capacitance of the intersection closest to the fingertip FT becomes equal to the definite threshold TH2. Also, when the fingertip FT is closer to the operation surface 105A than the position of the definite threshold TH2, the capacitance of the intersection closest to the fingertip FT becomes larger than the definite threshold TH2. Note that the position of the definite threshold TH2 is, for example, about 1 cm from the operation surface 105A.

[0067] Furthermore, when any of the GUI buttons 111 is selected and the position of the fingertip FT reaches the position of the confirmation threshold TH2, a confirmation operation for confirming the input to the selected GUI button 111 is being performed. When the confirmation operation is being performed, the cursor 112 becomes equal in size to the GUI button 111 and is hidden behind the GUI button 111, and the ring indicator 113 is displayed. When the confirmation operation is being performed for a predetermined time or more, the ring indicator 113 becomes hidden and the GUI button 111 becomes recessed, and the input to the selected GUI button 111 is confirmed. The user can visually recognize that the input has been confirmed by the ring indicator 113 becoming hidden and the GUI button 111 becoming recessed.

[0068] <Ring Indicator 113> The ring indicator 113 is a ring-shaped indicator that is displayed superimposed on the front side of the selected GUI button 111 along the outer edge of the GUI button 111, and starts to be drawn when the position of the fingertip FT reaches the position of the confirmation threshold TH2 by a hover input. When the position of the fingertip FT reaches the position of the confirmation threshold TH2, a confirmation operation for confirming the selection of the GUI button 111 is being performed. At this time, the cursor 112 becomes the same size as the GUI button 111 and is hidden behind the GUI button 111, so it is no longer displayed.

[0069] The circular indicator 113 indicates the elapsed time (duration) from the start of the confirmation operation and the remaining time until the confirmation operation is completed. Here, the operation when performing a hover input will be described, but when a touch input is performed, the position of the fingertip FT becomes closer to the operation surface 105A than the position of the confirmation threshold TH2, so that the circular indicator 113 is similarly displayed. Alternatively, when a touch input is performed, the input may be confirmed immediately without displaying the circular indicator 113.

[0070] The ring indicator 113 is an indicator that extends in a clockwise circular shape from the 12 o'clock direction (the top side) in a plan view while a hover input is being performed, and becomes a circular shape when the hover input is confirmed.

[0071] <Explanation of the operations shown in FIGS. 6A to 6G> 6A, the fingertip FT has reached the position of the selection threshold TH1 in the Z direction. And since the position of the fingertip FT in the XY coordinates is outside all of the GUI buttons 111, a cursor 112 centered on the position of the fingertip FT is displayed.

[0072] In Fig. 6B, the position of fingertip FT in the Z direction does not change from the state in Fig. 6A, but the position of fingertip FT in the XY coordinate system has moved and is now located inside the GUI button 111 for G, so a selection circle 111A is displayed superimposed on the GUI button 111 for G. Also, at this time, the position of fingertip FT is within the range (not shown) of the cursor fixation threshold THA, so the cursor 112 is displayed surrounding the selection circle 111A, and the circle of the cursor 112 is not inscribed in the circle of the GUI button 111. The center of the cursor 112 coincides with the position of fingertip FT in the XY coordinate system.

[0073] In Fig. 6C, as the fingertip FT approaches the operation surface 105A from the state in Fig. 6B, the position of the fingertip FT in the XY coordinates moves outside the GUI button 111 of G, but the position of the XY coordinates of the fingertip FT is within the range of the cursor movement threshold THC for the GUI button 111 of G, so the state in which the GUI button 111 of G is selected is maintained. Also, since the position of the fingertip FT exceeds the range (not shown) of the cursor fixing threshold THA, the center of the cursor 112 is shifted toward the center of the GUI button 111 of G from the position of the XY coordinates of the fingertip FT so that the circle of the GUI button 111 of G is inscribed in the circle of the cursor 112. In this way, once the position of the XY coordinates of the fingertip FT enters inside the GUI button 111, the same GUI button 111 continues to be selected unless it exceeds the range of the cursor movement threshold THC.

[0074] In Fig. 6D, the position of the fingertip FT in the XY coordinates is within the range of the cursor movement threshold THC, and the Z-direction position of the fingertip FT has reached the confirmation threshold TH2. The diameter of the cursor 112 shown in Fig. 6C decreases as the fingertip FT approaches the operation surface 105A, and becomes invisible when the Z-direction position of the fingertip FT reaches the confirmation threshold TH2. In addition, because a confirmation operation is being performed, the drawing of the circular indicator 113 has begun.

[0075] In Fig. 6E, the position of the fingertip FT in the XY coordinates is within the range of the cursor movement threshold THC (not shown), and the state in which the position of the fingertip FT in the Z direction has reached the confirmation threshold TH2 continues. Note that the position of the fingertip FT in the XY coordinates is outside the GUI button 111, but as described above, when the GUI button 111 is selected, the same GUI button 111 continues to be selected as long as the position of the fingertip FT in the XY coordinates is within the range of the cursor movement threshold THC. The confirmation operation is being performed continuously from the state shown in Fig. 6D, and the ring indicator 113 has reached approximately 2 / 3 of its circumference.

[0076] In Fig. 6F, the position of fingertip FT is slightly farther from operation surface 105A than in Fig. 6E, but the position of fingertip FT in the XY coordinates is outside GUI button 111 and within the range (not shown) of cursor movement threshold THC, and the position of fingertip FT in the Z direction has reached confirmation threshold TH2. The confirmation operation is being performed following the states shown in Fig. 6D and Fig. 6E, and this is the state immediately before the ring indicator 113 reaches approximately one revolution.

[0077] In Fig. 6G, immediately after the state shown in Fig. 6F, the ring indicator 113 reaches approximately one revolution, and the selection circle 111A displayed superimposed on the GUI button 111 of G becomes a concave image, indicating that the input has been confirmed. Although the state in which the ring indicator 113 reaches approximately one revolution is not shown here, when the ring indicator 113 reaches approximately one revolution, the selection circle 111A displayed superimposed on the GUI button 111 of G switches to a concave image as shown in Fig. 6G to indicate that the input has been confirmed. The concave image represents a state in which the GUI button 111 is pressed toward the back and deformed.

[0078] As an example, the recessed state of GUI button 111 is shown by shining light from the +Y direction side and the -X direction side, casting a shadow on the +Y direction side and the -X direction side of GUI button 111 in the recessed state, and depicting the state in which light is shining on the -Y direction side and the +X direction side.

[0079] <Display on the entire input device 100> 7 is a diagram showing the input device 100 in a state where a hover input for the selected GUI button 111 has been confirmed. FIG. 7 shows a state where a hover input for the G GUI button 111 has been confirmed, and compared to the state shown in FIG. 1, the selection circle 111A displayed over the G GUI button 111 has been changed to a depressed image, and the alphabet G is displayed in the input content display section 115. FIG. 7 shows an enlarged view of the G GUI button 111. Among the 45 GUI buttons 111 displayed on the display device 110 of the input device 100, only the G GUI button 111 has been changed to a depressed image, so that the user can visually recognize that the input for the G GUI button 111 has been confirmed.

[0080] <Flowchart> Figures 8 and 9 are diagrams showing a flowchart showing the processing executed by the control device 130 of the input device 100. The flows shown in Figures 8 and 9 are called and executed by application software (not shown). If the application software is in an input waiting state, the flows shown in Figures 8 and 9 are repeatedly executed from Start to End at a predetermined control period.

[0081] When the control device 130 starts the process, the determination unit 134 detects the position (xf, yf) of the fingertip FT in the XY coordinate system and the capacitance of the fingertip FT (step S1). The capacitance of the fingertip FT corresponds to the position of the fingertip FT in the Z direction.

[0082] The operation control unit 135 determines whether the capacitance of the fingertip FT is equal to or greater than the proximity threshold (step S2). The proximity threshold is a threshold for determining whether the state is to be the standby state shown in Fig. 2 or the operating state shown in Fig. 1. The capacitance represented by the proximity threshold is smaller than the selection threshold TH1.

[0083] When the operation control unit 135 determines that the capacitance of the fingertip FT is greater than the proximity threshold (S2: Yes), it causes the display control unit 136 to display an input image on the display device 110 (step S3).

[0084] The operation control unit 135 determines whether the capacitance of the fingertip FT is equal to or greater than a selection threshold TH1 (step S4).

[0085] When the operation control unit 135 determines that the capacitance of the fingertip FT is equal to or greater than the selection threshold TH1 (S4: Yes), it calculates the radius rf of the cursor 112 (step S5). The radius rf of the cursor 112 is inversely proportional to the capacitance, and therefore may be calculated, for example, by multiplying the reciprocal of the capacitance by a predetermined coefficient. The predetermined coefficient may be set to an appropriate value in relation to the diameter of the GUI button 111, etc., so that the cursor 112 having an appropriate diameter is obtained according to the capacitance.

[0086] The operation control unit 135 determines whether the selection circle 111A is displayed (step S6). More specifically, the operation control unit 135 determines whether the selection circle 111A was displayed by the previous control cycle. This is because the selection circle 111A continues to be displayed until it is made invisible. Step S6 is a process provided for determining whether the GUI button 111 is selected or not.

[0087] When the operation control unit 135 determines that the selection circle 111A is not displayed (S6: No), it sets the confirmation waiting time to zero (step S7). The confirmation waiting time is the waiting time from when a confirmation operation is started for the selected GUI button 111 until the input is confirmed. When the confirmation waiting time reaches a predetermined time, the input for the selected GUI button 111 is confirmed. Step S7 is a process of resetting the count value of a counter for counting the confirmation waiting time. This counter is built into the operation control unit 135.

[0088] The operation control unit 135 determines whether the distance between the position of the fingertip FT in the XY coordinates and the center of any of the GUI buttons 111 is smaller than the selection circle threshold THB (step S8). The process of step S8 is a process of determining whether the position of the fingertip FT in the XY coordinates is within the display area of ​​any of the GUI buttons 111. In other words, the process of step S8 is a process of searching for a GUI button 111 corresponding to a distance less than the selection circle threshold THB among the distances between the position of the fingertip in the XY coordinates and the centers of all the GUI buttons 111 when none of the GUI buttons 111 is selected.

[0089] When the operation control unit 135 determines that the distance between the position of the fingertip FT in the XY coordinates and the center of any one of the GUI buttons 111 is smaller than the selection circle threshold THB (S8: Yes), the operation control unit 135 displays a selection circle 111A superimposed on the GUI button 111 corresponding to step S8 (step S9). The GUI button 111 corresponding to step S8 is the GUI button 111 whose distance is determined to be smaller than the selection circle threshold THB in step S8, and is the selected GUI button 111. Note that the operation control unit 135 stores the coordinates of the center of the corresponding GUI button 111 (selected GUI button 111) in the memory 137 in step S8.

[0090] The motion control unit 135 determines whether the distance between the XY coordinate position of the fingertip and the center of the selected GUI button 111 is greater than the cursor fixation threshold THA (step S10). The process of step S10 is a process of determining whether the XY coordinate position of the fingertip is outside the range of the cursor fixation threshold THA.

[0091] When the operation control unit 135 determines that the distance between the position of the fingertip in the XY coordinates and the center of the selected GUI button 111 is greater than the cursor fixing threshold THA (S10: Yes), it displays a circle that satisfies condition A as the cursor 112 (step S11A). Condition A is composed of three conditions: (1) the center of the cursor 112 is located on a half line that has the center of the selected GUI button 111 as one end and passes through the position of the fingertip FT in the XY coordinates, (2) the radius rf of the cursor 112 is a value obtained by multiplying the reciprocal of the capacitance of the fingertip FT by a predetermined coefficient, and (3) the circle of the GUI button 111 is inscribed in the circle of the cursor 112. By the process of step S11A, for example, as shown in FIG. 6C, the center of the cursor 112 is shifted toward the center of the GUI button 111 of G from the position of the XY coordinates of the fingertip FT, and the cursor 112 is displayed so that the circle of the GUI button 111 of G is inscribed in the circle of the cursor 112.

[0092] Furthermore, when the operation control unit 135 determines in step S10 that the distance between the position of the fingertip in the XY coordinates and the center of the selected GUI button 111 is not greater than the cursor fixing threshold THA (S10: No), it displays a circle that satisfies condition B as the cursor 112 (step S11B). Condition B is composed of two conditions: (1) the center of the cursor 112 is the center of the selected GUI button 111 of G, and (2) the radius rf of the cursor 112 is a value obtained by multiplying the reciprocal of the capacitance of the fingertip FT by a predetermined coefficient. By the process of step S11B, for example, the cursor 112 is displayed in a state where the center of the cursor 112 coincides with the center of the selected GUI button 111 of G, as shown in FIG. 6B.

[0093] After completing the process of step S11A or S11B, the operation control unit 135 determines whether the capacitance of the fingertip FT is equal to or greater than the finalization threshold TH2 (step S12). The process of step S12 is a process for determining whether a finalization operation has been performed on the selected GUI button G 111.

[0094] When the operation control unit 135 determines that the capacitance of the fingertip FT is equal to or greater than the confirmation threshold TH2 (S12: Yes), it increments the confirmation waiting time (step S13). That is, the confirmation waiting time=confirmation waiting time+1. Here, as an example, the confirmation waiting time is represented by a count value, and is incremented each time the process of step S13 is performed. When the count value reaches a predetermined value corresponding to a predetermined time, the input performed by the confirmation operation is confirmed.

[0095] The operation control unit 135 causes the display control unit 136 to display an arc of 2π × (confirmation waiting time / predetermined time) [rad] as a ring indicator 113 along the circumference of the selection circle 111A that is displayed superimposed on the selected G GUI button 111.

[0096] The operation control unit 135 determines whether the confirmation waiting time is equal to or longer than a predetermined time (step S15). Step S15 is a process for determining whether the confirmation waiting time, which is the elapsed time from when the confirmation operation is started, has reached a predetermined time, which is the elapsed time until the input is confirmed.

[0097] When the operation control unit 135 determines that the confirmation waiting time is equal to or longer than the predetermined time (S15: Yes), it causes the display control unit 136 to change the image of the selection circle 111A to a depressed state (step S16). This is because the input has been confirmed. On the other hand, when the operation control unit 135 determines that the confirmation waiting time is less than the predetermined time (S15: No), it ends the series of processes (End). When the series of processes ends, the process returns to Start in FIG. 8 and is repeated.

[0098] The operation control unit 135 performs input processing (step S17). The input processing is processing for displaying the inputted alphabet in the input content display unit 115 (see FIG. 7). For example, as shown in FIG. 7, the alphabet G is displayed in the input content display unit 115.

[0099] The operation control unit 135 stops for a certain period of time (step S18). The process of step S18 is provided to maintain the state in which the selection circle 111A has been changed to an image in a depressed state for a certain period of time. When the certain period of time has elapsed, the operation control unit 135 advances the flow to step S19. The length of the certain period of time may be long enough to ensure that the user can recognize that the selection circle 111A has been changed to an image in a depressed state, and is, for example, about 0.3 seconds to 1 second.

[0100] The operation control unit 135 causes the display control unit 136 to return the selection circle 111A from the image in a recessed state to the original (non-recessed) image (step S19). When the operation control unit 135 finishes the process of step S19, it ends the series of processes (End). When the series of processes ends, it returns to the application software (not shown). If the application software continues to wait for input, the process is repeated from Start in FIG. 8. For example, the process from Start in FIG. 8 to End in FIG. 9 is repeated until the Enter button at the bottom right of the display device 110 is pressed.

[0101] Furthermore, when the operation control unit 135 determines in step S12 that the capacitance of the fingertip FT is not equal to or greater than the confirmation threshold TH2 (S12: No), it resets the confirmation waiting time (step S12A). That is, the confirmation waiting time=0. Since no confirmation operation has been performed, the confirmation waiting time is reset. When the operation control unit 135 finishes the process of step S12A, it ends the series of processes (End). When the series of processes ends, the process returns to Start in FIG. 8 and is repeated.

[0102] Furthermore, when the operation control unit 135 determines in step S8 that the distance between the position of the fingertip FT in the XY coordinates and the center of any of the GUI buttons 111 is not smaller than the selected circle threshold value THB (S8: No), it displays a circle that satisfies condition C as the cursor 112 (step S11C). Condition C is composed of two conditions: (1) the center of the cursor 112 is the position of the fingertip FT, and (2) the radius rf of the cursor 112 is a value obtained by multiplying the reciprocal of the capacitance of the fingertip FT by a predetermined coefficient. The flow proceeds to step S11C when there is no selected GUI button 111, so that the processing of step S11C displays the cursor 112 at a position that does not overlap with any of the GUI buttons 111, for example, as shown in FIG. 6A.

[0103] Furthermore, when it is determined in step S6 that the selection circle 111A is displayed (S6: Yes), the operation control unit 135 reads the coordinates of the center of the GUI button 111 on which the selection circle 111A is displayed from the memory 137 (step S20). The GUI button 111 on which the selection circle 111A is displayed is the selected GUI button 111.

[0104] The operation control unit 135 determines whether or not the distance between the XY coordinate position of the fingertip and the center of the selected GUI button 111 is equal to or less than the cursor movement threshold THC (step S21). The process of step S21 is a process of determining whether or not the XY coordinate position of the fingertip is within the range of the cursor movement threshold THC.

[0105] When the operation control unit 135 determines that the distance between the XY coordinate position of the fingertip and the center of the selected GUI button 111 is equal to or less than the cursor movement threshold THC (S21: Yes), it advances the flow to step S10. As described above, the center of the cursor 112 changes depending on whether the XY coordinate position of the fingertip FT is inside or outside the range of the cursor fixation threshold THA, so in step S10, it is determined whether the XY coordinate position of the fingertip is outside the range of the cursor fixation threshold THA.

[0106] Furthermore, when the operation control unit 135 determines in step S21 that the distance between the position of the fingertip in the XY coordinates and the center of the selected GUI button 111 is not equal to or less than the cursor movement threshold THC (S21: No), it causes the display control unit 136 to hide the selection circle 111A and cancel the selection of the selected GUI button 111 (step S22). Since the position of the fingertip FT has exceeded the range of the cursor movement threshold THC for the selected GUI button 111, the selection circle 111A is hidden and the selection is cancelled. When the process of step S22 ends, the flow proceeds to step S7.

[0107] Furthermore, when the operation control unit 135 determines in step S4 that the capacitance of the fingertip FT is not equal to or greater than the selection threshold TH1 (S4: No), it determines whether the selection circle 111A or the cursor 112 is displayed (step S23). If the operation control unit 135 determines that the capacitance of the fingertip FT is not equal to or greater than the selection threshold TH1 (S4: No), the precision of the XY coordinates of the fingertip FT is insufficient, and the GUI button 111 cannot be selected or the cursor 112 cannot be displayed. If the selected GUI button 111 exists and the selection circle 111A is displayed or the cursor 112 is displayed in the previous control cycle, a process of switching to non-display is required.

[0108] When the operation control unit 135 determines that the selection circle 111A is displayed (S23: Yes), it causes the display control unit 136 to hide the selection circle 111A and the cursor 112 (step S24). After completing the process of step S24, the operation control unit 135 causes the flow to proceed to step S12A. Since no GUI button 111 has been selected, the confirmation waiting time is reset (step S28).

[0109] Furthermore, when the operation control unit 135 determines in step S23 that the selection circle 111A is not displayed (S23: No), it causes the flow to proceed to step S12A. Since no selection has been made and the selection circle 111A is not displayed, the determination waiting time is reset to prepare for the next control cycle.

[0110] Furthermore, when the operation control unit 135 determines in step S2 that the capacitance of the fingertip FT is not greater than the proximity threshold (S2: No), it determines whether the selection circle 111A or the cursor 112 is displayed (step S25). When the operation control unit 135 determines that the capacitance of the fingertip FT is not greater than the proximity threshold (S2: No), in order to enter a standby state, if the GUI button 111 was selected and the selection circle 111A was displayed in the previous control cycle, a process of switching to non-display is required.

[0111] When the operation control unit 135 determines that the selection circle 111A is displayed (S25: Yes), it causes the display control unit 136 to hide the selection circle 111A and the cursor 112 (step S26).

[0112] The operation control unit 135 displays a standby image on the display control unit 136 (step S27). In addition to displaying the standby image, the operation control unit 135 may also perform processing such as putting the CPU into a power saving mode.

[0113] When the operation control unit 135 finishes the process of step S27, it advances the flow to step S12A. Since it is in a standby state, it resets the confirmation waiting time (step S28).

[0114] Furthermore, when the operation control unit 135 determines in step S25 that the selection circle 111A is not displayed (S25: No), the operation control unit 135 advances the flow to step S27. Since the selection circle 111A is not displayed, the process of step S26 is skipped.

[0115] <Effects> As described above, when the center of cursor 112 is made to coincide with the position of the fingertip in the XY coordinates, if the selected GUI button 111 protrudes from cursor 112, the center of cursor 112 is shifted from the position of the fingertip in the XY coordinates to surround the selected GUI button 111 with cursor 112, making it easier to visually recognize the selected GUI button 111.

[0116] Furthermore, since the XY coordinates of the fingertip lie in the direction from the center of GUI button 111 to the center of cursor 112, it is possible to provide input device 100 that allows the direction of finger positional deviation relative to GUI button 111 to be known.

[0117] In addition, when the distance between the position of the fingertip FT in the XY coordinates and the center of the selected GUI button 111 exceeds the cursor fixation threshold THA, the center of the cursor 112 is shifted from the position of the fingertip in the XY coordinates so that the GUI button 111 is inscribed in the cursor 112. Therefore, even if the deviation of the position of the fingertip in the XY coordinates from the center of the GUI button 111 becomes large, it is easy to visually recognize the selected GUI button 111.

[0118] In addition, when none of the multiple GUI buttons 111 was selected in the previous control cycle, a selection circle 111A is displayed superimposed on the GUI button 111 that corresponds to the distance between the position of the fingertip FT in the XY coordinates and the center of the multiple GUI buttons 111 that is less than the selection circle threshold value THB, so that the selected GUI button 111 can be easily recognized visually.

[0119] Furthermore, after a GUI button 111 is selected, if the distance between the position of the fingertip FT in the XY coordinates and the center of the selected GUI button 111 exceeds the cursor movement threshold THC, the selection of the GUI button 111 is deselected. By using a cursor movement threshold THC that is greater than the selection circle threshold THB used to determine whether any of the GUI buttons 111 is selected, it is possible to provide hysteresis and maintain the selected state over a wider range, thereby preventing the selected GUI button 111 from changing frequently.

[0120] In addition, the electrostatic sensor 120 detects the electrostatic capacitance between the fingertip FT and the sensor electrodes 121X, 121Y by using the sensor electrodes 121X, 121Y provided along the operation surface 105A, and since the size of the cursor 112 is inversely proportional to the magnitude of the electrostatic capacitance, it is possible to intuitively and visually recognize that the fingertip FT is approaching the operation surface 105A.

[0121] Also, when the capacitance of the fingertip FT is equal to or greater than the selection threshold TH1, the selected GUI button 111 is identified based on the position of the fingertip FT in the XY coordinates, and when the capacitance of the fingertip FT is equal to or greater than the confirmation threshold TH2 that is greater than the selection threshold TH1, the size of the GUI button 111 is made to match the size of the cursor 112, and the GUI button 111 is displayed overlapping the cursor 112. Since the cursor 112 is hidden behind the GUI button 111 and becomes invisible, it is possible to visually recognize how close the fingertip FT needs to be to the operation surface 105A to confirm the input, thereby improving operability. Also, since the confirmation threshold TH2 is greater than the selection threshold TH1, the operation of confirming the input is performed with the fingertip FT closer to the operation surface 105A than the operation of selecting the GUI button 111. The closer the fingertip FT is to the operation surface 105A, the more accurately the position of the fingertip FT in the XY coordinates can be detected, so that the fingertip can be guided to the correct position for the GUI button 111 where the input is to be confirmed, and the input can be confirmed with high accuracy.

[0122] In addition, the control device 130 confirms the input when the capacitance continues to be equal to or greater than the confirmation threshold TH2 for a predetermined time, so that it is possible to prevent unintended confirmation of the input in cases where the user unintentionally moves the fingertip FT and momentarily faces a certain GUI button 111. In other words, it is possible to prevent erroneous input.

[0123] In addition, since the cursor 112 is drawn behind the selected GUI button 111 and also in front of the GUI buttons 111 other than the selected GUI button 111, it is possible to clearly distinguish the selected GUI button 111 and the unselected GUI buttons 111. In addition, since the selected GUI button 111 appears to float, it is easy to visually recognize that it can be operated by a non-contact hover input on the operation surface 105A, making it easier to use non-contact operation.

[0124] In addition, since the shape of the cursor 112 is a convex figure, it is easy to determine whether the selected GUI button 111 protrudes from the cursor 112 .

[0125] Furthermore, since the shape of the cursor 112 is circular, it is easier to determine whether the selected GUI button 111 protrudes from the cursor 112.

[0126] <Modification> Although the embodiment in which the cursor fixation threshold THA is a fixed value has been described above, the cursor fixation threshold THA may be a variable. For example, when the diameter of the GUI button 111 is rs, the radius rf of the cursor 112 may be used to set the radius ra of the cursor fixation threshold THA to a variable of rf-rs.

[0127] In this case, the radius ra of the cursor fixed threshold THA can be expressed by the following equation (2).

[0128] ra=rf-rs (2)

[0129] For example, in step S10, when determining whether the distance D between the position of the fingertip in the XY coordinates and the center of the selected GUI button 111 is greater than the radius ra of the cursor fixation threshold THA, the radius ra of the cursor fixation threshold THA can be varied according to equation (2) in accordance with the radius rf of the cursor 112, which varies in accordance with the inverse of the capacitance of the fingertip FT.

[0130] When the radius ra of the cursor fixation threshold THA is varied according to equation (2), as the fingertip FT approaches the operation surface 105A and the cursor 112 becomes smaller, the range of the cursor fixation threshold THA also becomes smaller, and as the fingertip FT moves away from the operation surface 105A and the cursor 112 becomes larger, the range of the cursor fixation threshold THA also becomes larger.

[0131] By doing this, compared to when the radius ra of the cursor fixation threshold THA is a fixed value, for example, when the fingertip FT is relatively far from the operation surface 105A and the position of the fingertip in the XY coordinates is just outside the range of the cursor fixation threshold THA when it is a fixed value, the position of the cursor 112 is not shifted toward the center of the GUI button 111 so that the GUI button 111 is inscribed in the cursor 112.

[0132] Also, for example, when a user brings fingertip FT close to operation surface 105A to confirm an input, cursor 112 is relatively small, and the position of the fingertip in the XY coordinates is immediately inside the range of cursor fixation threshold THA, if cursor fixation threshold THA is a fixed value, there is a risk that GUI button 111 will protrude from cursor 112. In such a case, by setting cursor fixation threshold THA to a variable as described above, the radius ra of cursor fixation threshold THA becomes smaller than when it is a fixed value, and the probability of GUI button 111 being inscribed in cursor 112 increases, so that the possibility of GUI button 111 protruding from cursor 112 can be reduced.

[0133] Therefore, according to the modified embodiment, by varying the radius ra of the cursor fixation threshold THA in accordance with equation (2), it is possible to provide an input device 100 in which the direction of the positional deviation of the finger from the GUI button 111 is easier to understand.

[0134] In addition, if the cursor fixation threshold THA is set to a fixed value, there are advantages such as reducing the amount of calculations performed by the control device 130 and making it possible to reduce the capacity of the memory 137, so the decision as to whether to make the cursor fixation threshold THA a fixed value or a variable can be made after making a comprehensive judgment.

[0135] The above describes an input device according to an exemplary embodiment of the present invention. However, the present invention is not limited to the specifically disclosed embodiment, and various modifications and changes are possible without departing from the scope of the claims. [Explanation of symbols]

[0136] 100 Input Device 105 Top Panel 105A Operation surface 110 Display device (an example of a display unit) 111 GUI button 111A Selection Circle 112 Cursor 113 Ring Indicator 115 Input content display section 120 Electrostatic sensor (an example of a detection unit) 121X, 121Y Sensor electrodes (examples of electrodes) 130 Control device (an example of a control unit) 134 Judgment section 135 Motion control section 136 Display control unit 137 Memory

Claims

1. A top panel having an operation surface; a display unit that displays an image of at least one GUI button visible through the operation surface; a detection unit that detects a center position of a finger facing the operation surface and a distance from the operation surface to the finger; a control unit that controls an image to be displayed by the display unit based on an output from the detection unit and determines whether or not an input is made to the GUI button; Including, The control unit is displaying a cursor image at a position facing the finger on the display unit based on the center position of the finger; changing a size of the cursor in accordance with a distance between the operation surface and the finger; identifying a selected GUI button of the at least one GUI button based on a center position of the finger; and an input device which, if the selected GUI button protrudes from the cursor when the center position of the cursor is aligned with the center position of the finger, shifts the center position of the cursor from the center position of the finger to surround the selected GUI button with the cursor, and executes this process each time the center position of the finger is detected by the detection unit.

2. 2. The input device according to claim 1, wherein the control unit, when a distance between a center position of the finger and a center position of the selected GUI button exceeds a cursor fixation threshold, shifts the center position of the cursor from the center position of the finger so that the GUI button is inscribed in the cursor.

3. the display unit displays a plurality of the GUI buttons; 3. The input device according to claim 1, wherein when none of the plurality of GUI buttons is selected, the control unit displays a selection circle superimposed on the GUI button that corresponds to a distance between the center position of the finger and the center positions of the plurality of GUI buttons that is less than a selection circle threshold.

4. 4. The input device of claim 3, wherein after the GUI button is selected, when a distance between a center position of the finger and a center of the selected GUI button exceeds a cursor movement threshold that is greater than the selection circle threshold, the GUI button is deselected.

5. the detection unit detects a capacitance between the finger and an electrode provided along the operation surface, The input device according to claim 1 , wherein the size of the cursor is inversely proportional to the magnitude of the capacitance.

6. The control unit is identifying a selected GUI button of the at least one GUI button based on a center position of the finger when the capacitance is equal to or greater than a selection threshold; 6. The input device according to claim 5, wherein when the capacitance reaches or exceeds a confirmation threshold value that is greater than the selection threshold value, a size of the GUI button is made to match a size of the cursor, and the GUI button is displayed on the display unit overlapping the cursor.

7. The input device according to claim 6 , wherein the control unit confirms the input when the capacitance remains equal to or greater than the confirmation threshold for a predetermined period of time.

8. the display unit displays a plurality of the GUI buttons; 8. The input device according to claim 1, wherein the control unit draws the cursor behind the selected GUI button and in front of GUI buttons other than the selected GUI button.

9. The input device according to claim 1 , wherein the cursor has a convex shape.

10. The input device of claim 9 , wherein the cursor is circular in shape.

Images