Input Devices

Abstract

To provide an input device capable of quickly determining operation by an object while suppressing effect of noise.SOLUTION: An input device includes a detection unit for detecting a capacitance corresponding to a distance between an operation surface and an object, and a control unit for determining whether a relative state between the operation surface and the object is a non-detection state or one of a plurality of states on the basis of the detection result of the detection unit. The control unit: measures, regarding each of the plurality of states, a duration in which the capacitance is equal to or greater than a plurality of capacitance thresholds defined for the plurality of states; determines whether a plurality of durations obtained by measurement for each of the plurality of states is equal to or greater than a plurality of time thresholds each defined for the plurality of states; determines that the relative state is a non-detection state if the plurality of durations is not equal to or greater than each of the corresponding time thresholds; and determines that the relative state is the highest state of the capacitance thresholds in one or more states if one or more durations among the plurality of durations are equal to or greater than the corresponding time thresholds.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present disclosure relates to an input device. [Background technology]

[0002] Conventionally, there has been an input device for receiving a specific non-contact operation on an operation screen by an object, which includes a display control unit that displays the operation screen on a display surface, and a detection unit that detects the position of the object on each of a plurality of sensing layers in the air that are aligned in a direction approximately perpendicular to the display surface (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-170297 [Patent Document 2] International Publication No. 2021 / 117446 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when detecting the position of an object such as a hand based on capacitance, the detection unit may detect noise generated by a display device or other electronic devices around the detection unit. Conventional input devices do not take such noise into consideration when detecting the position of an object among multiple sensing layers in the air.

[0005] Therefore, an object of the present invention is to provide an input device that can quickly determine the positions of multiple sensing layers of an object in the air while suppressing the influence of noise. [Means for solving the problem]

[0006] An input device according to an embodiment of the present disclosure includes a top panel having an operation surface, a detection unit that detects capacitance according to the distance between the operation surface and an object, and a control unit that determines, based on the detection result of the detection unit, whether the relative state between the operation surface and the object is a non-detection state in which the object is not detected, or a plurality of states other than the non-detection state. The control unit measures, for each of the plurality of states, the duration during which the capacitance is equal to or greater than a plurality of capacitance thresholds respectively defined for the plurality of states, and determines whether the plurality of durations measured for each of the plurality of states are equal to or greater than a plurality of time thresholds respectively defined for the plurality of states. If the plurality of durations are not equal to or greater than the corresponding plurality of time thresholds, the control unit determines that the relative state is the non-detection state, and if any one or more of the plurality of durations are equal to or greater than the corresponding time threshold, the control unit determines that the relative state is the state with the highest capacitance threshold among the one or more states corresponding to the one or more durations. [Effects of the Invention]

[0007] It is possible to provide an input device that can quickly determine the positions of multiple sensing layers of an object in the air while suppressing the influence of noise. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a configuration of an input device according to an embodiment. [Figure 2] FIG. 1 illustrates an example of a configuration of an input device according to an embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a configuration of an electrostatic sensor and a control device of the input device. [Figure 4A] 1A to 1C are diagrams illustrating the operation of the input device in time series when it is operated. [Figure 4B] 1A to 1C are diagrams illustrating the operation of the input device in time series when it is operated. [Figure 4C] 1A to 1C are diagrams illustrating the operation of the input device in time series when it is operated. [Figure 4D]1A to 1C are diagrams illustrating the operation of the input device in time series when it is operated. [Figure 5] FIG. 10 is a diagram showing the input device 100 in a state where a hover input for a selected GUI button has been confirmed. [Figure 6] FIG. 10 is a flowchart showing a process executed by a control device of the input device. [Figure 7] FIG. 10 is a flowchart showing a process executed by a control device of the input device. [Figure 8] 10 is a flowchart showing a process for determining a relative state. [Figure 9] FIG. [Figure 10] 10 is a flowchart showing a key selection process. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment to which the input device of the present disclosure is applied will be described.

[0010] <Embodiment> 1 and 2 are diagrams illustrating an example of the configuration of an input device 100 according to an embodiment. FIG. 1 illustrates a state in which the input device 100 is in an operating state and the display device 110 is displaying an input image. When the display device 110 is displaying an input image, the input device 100 is in an input mode. The input mode is a mode in which operation input to the input device 100 is possible. FIG. 2 illustrates a state in which the input device 100 is in a standby state and the display device 110 is displaying a standby image. When the display device 110 is displaying a standby image, the input device 100 is in a power-saving mode. In the standby state, the display device 110 is displayed entirely in gray, consuming little power. FIG. 3 is a diagram illustrating an example of the configuration of an electrostatic sensor 120 and a control device 130 of the input device 100. The display device 110 is an example of a display unit, the electrostatic sensor 120 is an example of a detection unit, and the control device 130 is an example of a control unit.

[0011] In the following description, an XYZ coordinate system is defined. The direction parallel to the X axis (X direction), the direction parallel to the Y axis (Y direction), and the direction parallel to the Z axis (Z direction) are perpendicular to one another. In the following description, the -Z direction is the direction approaching the electrostatic sensor 120, and the +Z direction is the direction away from the electrostatic sensor 120. A planar view refers to a view from the XY plane. In the following description, the length, width, thickness, etc. of each part may be exaggerated to make the configuration easier to understand.

[0012] The input device 100 may be, for example, a tablet-type input device installed in a store or facility and used by an unspecified number of users, or an input section of an ATM (Automatic Teller Machine). It may also be an input section of a cooking appliance that needs to be kept clean. The input device 100 may also be a tablet computer, smartphone, game console, or the like for personal use.

[0013] <Overall Configuration of Input Device 100> The input device 100 includes a housing 101, a top panel 105, a display device 110, an electrostatic sensor 120, and a control device 130. Although the control device 130 (see FIG. 3) is omitted in FIGS. 1 and 2, the control device 130 is provided, for example, inside the housing 101 below the display device 110 and the electrostatic sensor 120. The input device 100 includes the electrostatic sensor 120 and the control device 130 shown in FIG. 3.

[0014] <Chassis 101 and top panel 105> The housing 101 is a case made of resin, metal, or the like that houses the display device 110, the electrostatic sensor 120, and the control device 130. The display device 110 is arranged below the transparent electrostatic sensor 120, for example, and is visible through an operation surface 105A, which is the upper surface of a transparent top panel 105 provided in an opening at the top of the housing 101.

[0015] <Types of operation methods of the input device 100> There are four types of operation methods for the input device 100: proximity operation, selection operation, confirmation operation, and contact operation. The input device 100 uses multiple capacitance thresholds and multiple time thresholds when determining the operation method. The multiple time thresholds are used to prevent erroneous determination of the operation method when sudden noise occurs, etc., and determines that an operation using one of the operation methods has been performed when the capacitance detected by the electrostatic sensor 120 remains at or above the capacitance threshold for a period of time greater than or equal to the time threshold. Details of this will be described later, and here, four operation methods will be described. Note that the input device 100 can also be operated with a palm or other object other than a fingertip, but the following description will be given of operation with a fingertip. A fingertip is an example of an object.

[0016] The proximity operation is an operation of bringing a fingertip close to the operation surface 105A of the input device 100 without touching it, and is an operation for switching the input device 100 from the standby state shown in FIG. 2 to the operating state shown in FIG.

[0017] The selection operation is an operation in which, after a proximity operation, the fingertip is brought closer to the operation surface 105A of the input device 100 without touching it, and a GUI button displayed on the display device 110 is selected.

[0018] The confirmation operation is an operation of confirming an operation input for a selected GUI button by bringing a fingertip closer to the operation surface 105A of the input device 100 without touching it, after having performed a selection operation. The confirmation operation is a contactless operation input, in other words, an operation of the input device 100 without touching the operation surface 105A with a fingertip. An operation input performed by a contactless selection operation and confirmation operation may be referred to as a hover input or a touchless input.

[0019] A contact operation is an operation in which, after a selection operation has been performed, a fingertip is brought closer to the operation surface 105A of the input device 100 and touches the operation surface 105A to confirm an operation input for a selected GUI button. A contact operation may also be referred to as a touch input.

[0020] <Display device 110> The display device 110 is, for example, a liquid crystal display or an organic EL (Electroluminescence) display. The display device 110 is a display for realizing a GUI (Graphical User Interface). The display device 110 displays images of GUI buttons 111, a cursor, and an image of an input content display section 115 that displays input content. The GUI buttons 111 are an example of an operation section, and are, for example, arranged in a matrix in a planar view. Furthermore, the GUI buttons 111 are, for example, circular in shape to resemble push buttons.

[0021] 1 to 3 show, as an example, a total of 45 GUI buttons 111, including 26 alphabetical GUI buttons 111, 15 numeric keypad-style GUI buttons 111, and four GUI buttons 111: a menu key (the key with three lines at the top left), a Caps Lock key, a backspace key (at the top right), and an enter key (at the bottom left). The 45 GUI buttons 111 are arranged in five rows in the Y direction and 11 rows in the X direction. The rows extend in the X direction, and the Y direction extends in the column direction. Note that the GUI buttons 111 are not limited to alphabetical buttons, numeric keys, or the like, and may be characters or symbols of other languages.

[0022] <Electrostatic sensor 120> The electrostatic sensor 120 is disposed on top of the display device 110, and as shown in FIG. 3, has a plurality of sensor electrodes 121X extending in the X direction and a plurality of sensor electrodes 121Y extending in the Y direction. The sensor electrodes 121X and 121Y are an example of electrodes of a detection unit, and are connected to the control device 130 via wiring 122X and 122Y, respectively. For example, such an electrostatic sensor 120 can be formed by forming a transparent conductive film such as ITO (Indium Tin Oxide) on the surface of transparent glass and patterning it into the sensor electrodes 121X and 121Y and the wiring 122X and 122Y. The electrostatic capacitance detected by the electrostatic sensor 120 is input to the control device 130. The electrostatic capacitance detected by the electrostatic sensor 120 is an example of a detection result of the electrostatic sensor 120.

[0023] 3 shows, as an example, a plurality of sensor electrodes 121X and a plurality of sensor electrodes 121Y. The intervals between the sensor electrodes 121X and between the sensor electrodes 121Y are narrower than the intervals between the GUI buttons 111.

[0024] The plurality of sensor electrodes 121X are scanned row by row, and the plurality of sensor electrodes 121Y are scanned column by column. An AD conversion unit 132 converts the capacitances at the intersections of the plurality of sensor electrodes 121X and the plurality of sensor electrodes 121Y into digital values. A counter 133 counts the change in the output of the AD conversion unit 132 and outputs a difference value ΔAD at each intersection. It is also possible to increase the resolution by using an interpolation method based on the spacing between the sensor electrodes 121X and the spacing between the sensor electrodes 121Y. In this case, the spacing between the sensor electrodes 121X and the spacing between the sensor electrodes 121Y may be wider than the spacing between the GUI buttons 111. Although not shown, when using the interpolation method, the GUI buttons 111 may be in one-to-one correspondence with sensor electrodes of approximately the same size as the GUI buttons 111.

[0025] The XY coordinate position of the fingertip detected by the input device 100 using the electrostatic sensor 120 is, for example, the XY coordinate with the largest capacitance within the area where the fingertip FT is present. Furthermore, the Z-direction position of the fingertip detected by the input device 100 using the electrostatic sensor 120 is a value that is inversely proportional to the capacitance detected by the electrostatic sensor 120, so determining the Z-direction position of the fingertip is synonymous with determining the capacitance between the fingertip FT and the electrostatic sensor 120. As an example, the input device 100 determines the Z-direction position of the fingertip FT based on the capacitance between the fingertip FT and the electrostatic sensor 120. However, in the following, when it is easier to understand if the Z-direction position of the fingertip FT is used, the Z-direction position of the fingertip FT will be used.

[0026] <Control device 130> The control device 130 is realized by a computer including a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), an input / output interface, an internal bus, and the like.

[0027] The control device 130 has a main control unit 131, an AD (Analog to Digital) conversion unit 132, a counter 133, a determination unit 134, an operation control unit 135, a display control unit 136, and a memory 137. The main control unit 131, the AD conversion unit 132, the counter 133, the determination unit 134, the operation control unit 135, and the display control unit 136 are functional blocks representing the functions of a program executed by the control device 130. The memory 137 is a functional representation of the memory of the control device 130.

[0028] The main control unit 131 is a processing unit that controls the processing of the control device 130, and performs processing other than the processing performed by the AD conversion unit 132, the counter 133, the determination unit 134, the operation control unit 135, and the display control unit 136. For example, the main control unit 131 scans the plurality of sensor electrodes 121X and the plurality of sensor electrodes 121Y.

[0029] The AD conversion unit 132 converts the output of the electrostatic sensor 120 into a digital value. The output of the AD conversion unit 132 is a detected value of the capacitance at each intersection of the sensor electrodes 121X and 121Y of the electrostatic sensor 120. The counter 133 counts and outputs a difference value of the output of the AD conversion unit 132 from a reference value. The difference value is a count value of the change in the output from the reference value. Hereinafter, this will be referred to as a difference value ΔAD. The reference value is the capacitance at each intersection of the sensor electrodes 121X and 121Y when there is no finger around the sensor electrodes 121X and 121Y. The difference value ΔAD is the capacitance between each intersection of the sensor electrodes 121X and 121Y and the finger.

[0030] A differential value ΔAD is obtained for each intersection. An AD conversion unit 132 converts the capacitance of each intersection of the sensor electrodes 121X and 121Y into a digital value, and a counter 133 counts the change in the output of the AD conversion unit 132 relative to a reference value and outputs the differential value ΔAD for each intersection.

[0031] The determination unit 134 determines the position of the fingertip in the XY coordinates and the position of the fingertip in the Z direction from the operation surface 105A based on the difference value ΔAD output from the counter 133. The determination unit 134 determines the relative state between the fingertip and the operation surface 105A using a proximity capacitance threshold TH1, a selection capacitance threshold TH2, a determination capacitance threshold TH3, and a contact capacitance threshold TH4, which will be described later, as well as a proximity time threshold T1, a selection time threshold T2, a determination time threshold T3, and a contact time threshold T4. The relative states between the fingertip and the operation surface 105A include a non-detection state, a proximity state, a selection state, a determination state, and a contact state, which will be described later.

[0032] The operation control unit 135 controls the operation of the input device 100 based on the position of the fingertip determined by the determination unit 134. The display control unit 136 controls the display of the display device 110 based on the position of the fingertip determined by the determination unit 134. The memory 137 stores programs, data, etc. used when the main control unit 131, the determination unit 134, the operation control unit 135, and the display control unit 136 execute processes. The memory 137 also stores data indicating the number of rows and the number of columns of the sensor electrodes 121X and 121Y.

[0033] <Capacitance Threshold and Display on Display Device 110> 4A to 4D are diagrams illustrating, in chronological order, the operation of the input device 100. The upper portions of Figures 4A to 4D show the position of the fingertip FT of the hand 10 relative to the operation surface 105A, cross sections of the display device 110 and the electrostatic sensor 120, the proximity capacitance threshold TH1, the selection capacitance threshold TH2, the decision capacitance threshold TH3, and the contact capacitance threshold TH4. The lower portions of Figures 4A to 4D show the operation surface 105A, nine GUI buttons 111 representing the letters A to C, F to H, and K to M, a selection circle 111A, the position of the fingertip FT, a cursor 112, and a circular indicator 113.

[0034] The position of the fingertip FT is indicated by a symbol combining a cross and a circle (hereinafter referred to as a cross symbol). The position of the fingertip FT is the position of the tip of the finger when extended straight from the +Z direction side relative to the operation surface 105A, and the intersection of the cross symbol represents the position of the fingertip FT in XY coordinates detected by the control device 130 based on the output of the electrostatic sensor 120. As an example, the XY coordinates representing the position of the fingertip FT are the XY coordinates with the largest capacitance within the area where the fingertip FT exists. To eliminate the influence of noise, as an example, the apex of a parabola approximated by the least squares method from the capacitance distribution on the X axis is used as the X coordinate, and the apex of a parabola approximated by the least squares method from the capacitance distribution on the Y axis is used as the Y coordinate. The position of the fingertip FT obtained in this manner is an example of the center position of the finger. In the following, the position of the intersection of the cross symbol will be described as the position of the fingertip FT in XY coordinates.

[0035] Here, as an example, the position of the fingertip FT in the XY coordinate system is inside the GUI button 111 for G, and therefore the GUI button 111 for G is selected. The fingertip FT is close enough to the operation surface 105A to be able to select the GUI button 111 for G, and the capacitance detected by the electrostatic sensor 120 exceeds the selection capacitance threshold TH2.

[0036] A selection circle 111A is displayed over the entire interior of the selected GUI button 111. In FIG. 4A, the selection circle 111A is shown in dark gray. The selection circle 111A is an example of a selection image. The selection circle 111A is a highlighting display that makes the selected GUI button 111 stand out (emphasize) so that it can be visually distinguished from the unselected GUI buttons 111, and as an example, is displayed over the entire GUI button 111.

[0037] In this example, since the GUI buttons 111 are circular, the selection circle 111A is also circular. If the GUI buttons 111 are shaped other than circular, a highlighting display of a similar shape that emphasizes the selected GUI button 111 may be used instead of the selection circle 111A. Also, a highlighting display that emphasizes a portion of the selected GUI button 111 may be used instead of the selection circle 111A. Also, instead of displaying the selection circle 111A, the selected GUI button 111 may be made to stand out by, for example, blinking.

[0038] The cursor 112 is circular. The size of the cursor 112 is proportional to the distance between the fingertip FT and the operation surface 105A. In other words, the size of the cursor 112 is inversely proportional to the magnitude of the capacitance detected by the electrostatic sensor 120. However, in this description, it is assumed that the position of the fingertip FT in the Z direction relative to the operation surface 105A is constant and sufficiently close to the operation surface 105A so that the GUI button G 111 can be selected.

[0039] In FIG. 4A, GUI button G 111 is selected and a selection circle 111A is displayed over it, so it is shown in dark gray. A cursor 112, shown in light gray, surrounds GUI button G 111. As an example, GUI button 111 is transparent, selection circle 111A is semi-transparent, and the image of GUI button 111 is displayed in front of the image of selection circle 111A. Furthermore, the image of selection circle 111A is displayed in front of the image of cursor 112.

[0040] Displaying the image of the GUI button 111 on the front side of the image of the selection circle 111A means that the image of the GUI button 111 is displayed superimposed on the image of the selection circle 111A. The front side is the side from which the display on the display device 110 is viewed. In other words, the image of the selection circle 111A is displayed on the back side of the image of the GUI button 111. The back side is the side opposite the front side, and refers to the back side of the display.

[0041] Furthermore, displaying selection circle 111A in front of cursor 112 means that in the area where selection circle 111A and cursor 112 overlap, selection circle 111A is displayed above cursor 112. In other words, in the area where selection circle 111A and cursor 112 overlap, cursor 112 is not displayed on selection circle 111A.

[0042] Furthermore, the GUI button 111 marked H is in an unselected state and is therefore shown in white, and the portion that overlaps with the cursor 112 is shown behind the cursor 112. Therefore, from the front to the back, the image of the selected GUI button 111, the image of the selection circle 111A, the image of the cursor 112, and the image of the unselected GUI button 111 are displayed in this order.

[0043] In reality, the display can be done in color, so for example, the selection circle 111A can be displayed in a conspicuous color such as yellow, the cursor 112 can be displayed in a color such as blue that is less conspicuous than the selection circle 111A, and the unselected GUI buttons 111 can be displayed in a color such as white or light gray that makes it easy to distinguish the boundaries with the parts other than the GUI buttons 111. Because the image of the GUI buttons 111 is transparent, the color of the selection circle 111A on the back side is visible through the image, and the image is displayed in the color of the selection circle 111A.

[0044] <Proximity capacitance threshold TH1, selection capacitance threshold TH2, decision capacitance threshold TH3, and contact capacitance threshold TH4> When determining the relative state between the fingertip FT and the operation surface 105A, the input device 100 uses a plurality of capacitance thresholds, namely, a proximity capacitance threshold TH1, a selection capacitance threshold TH2, a decision capacitance threshold TH3, and a contact capacitance threshold TH4.

[0045] The proximity capacitance threshold TH1, the selection capacitance threshold TH2, the final capacitance threshold TH3, and the contact capacitance threshold TH4 are thresholds used by the control device 130 when determining the position of the fingertip FT relative to the operation surface 105A based on the capacitance of the electrostatic sensor 120. In Figures 4A to 4D, the proximity capacitance threshold TH1, the selection capacitance threshold TH2, the final capacitance threshold TH3, and the contact capacitance threshold TH4 are shown at distances from the operation surface 105A according to the capacitances of the proximity capacitance threshold TH1, the selection capacitance threshold TH2, the final capacitance threshold TH3, and the contact capacitance threshold TH4 so that they can be visually recognized.

[0046] Because the contact capacitance threshold TH4 represents a capacitance greater than the final capacitance threshold TH3, the dashed line corresponding to the contact capacitance threshold TH4 is closer to the operation surface 105A than the dashed line corresponding to the final capacitance threshold TH3. Because the final capacitance threshold TH3 represents a capacitance greater than the selected capacitance threshold TH2, the dashed line corresponding to the final capacitance threshold TH3 is closer to the operation surface 105A than the dashed line corresponding to the selected capacitance threshold TH2. Because the selected capacitance threshold TH2 represents a capacitance greater than the proximity capacitance threshold TH1, the dashed line corresponding to the selected capacitance threshold TH2 is closer to the operation surface 105A than the dashed line corresponding to the proximity capacitance threshold TH1.

[0047] The proximity capacitance threshold TH1 is used to determine whether the fingertip FT has approached the operation surface 105A. The selection capacitance threshold TH2 is used to determine whether the GUI button 111 has been selected by a hover input. The confirmation capacitance threshold TH3 is used to determine whether the selection of the selected GUI button 111 may be confirmed by a hover input. The contact capacitance threshold TH4 is used to determine whether the fingertip FT has come into contact with the operation surface 105A by a touch input.

[0048] Hereinafter, the vertical position from the operation surface 105A of the dashed line corresponding to the proximity capacitance threshold TH1 will be referred to as the position of the proximity capacitance threshold TH1, and the vertical position from the operation surface 105A of the dashed line corresponding to the selection capacitance threshold TH2 will be referred to as the position of the selection capacitance threshold TH2. Furthermore, the vertical position from the operation surface 105A of the dashed line corresponding to the final capacitance threshold TH3 will be referred to as the position of the final capacitance threshold TH3, and the vertical position from the operation surface 105A of the dashed line corresponding to the contact capacitance threshold TH4 will be referred to as the position of the contact capacitance threshold TH4. The position of the contact capacitance threshold TH4 is the position of the operation surface 105A in the Z direction.

[0049] <Proximity time threshold T1, selection time threshold T2, confirmation time threshold T3, and contact time threshold T4 and their relative states> When determining the relative state between the fingertip FT and the operation surface 105A, the determination unit 134 of the control device 130 of the input device 100 uses a proximity capacitance threshold TH1, a selection capacitance threshold TH2, a confirmation capacitance threshold TH3, and a contact capacitance threshold TH4, as well as a proximity time threshold T1, a selection time threshold T2, a confirmation time threshold T3, and a contact time threshold T4 as multiple time thresholds. The relative states include a non-detection state, a proximity state, a selection state, a confirmation state, and a contact state. The proximity state, the selection state, the confirmation state, and the contact state are examples of multiple states other than the non-detection state. As the state progresses from the contact state, confirmation state, selection state, proximity state, and non-detection state, the position of the fingertip FT moves away from the operation surface 105A. The Z-direction position of the fingertip FT from the operation surface 105A in each of the contact state, confirmation state, selection state, proximity state, and non-detection state is a position corresponding to the contact state, confirmation state, selection state, proximity state, and non-detection state, respectively, and is located on one of multiple sensing layers divided by the distance in the Z direction from the operation surface 105A.

[0050] The reason for using multiple time thresholds is to prevent erroneous determination of the operation method when, for example, sudden noise occurs, as described above. Note that, since multiple time thresholds are used to eliminate the influence of noise, as an example, the proximity time threshold T1, selection time threshold T2, confirmation time threshold T3, and contact time threshold T4 are all set to the same time. The times set as the proximity time threshold T1, selection time threshold T2, confirmation time threshold T3, and contact time threshold T4 are, for example, three control cycles of the control device 130, which is a very short time (150 ms) because the control cycle is, for example, 50 ms.

[0051] The determination unit 134 measures the time during which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the contact capacitance threshold TH4, and determines that the relative state is a contact state if the time continues to be equal to or greater than the contact time threshold T4.

[0052] When the relative state is not a contact state, the determination unit 134 measures the time during which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the determined capacitance threshold value TH3, and if this time period continues for equal to or greater than the determined time threshold value T3, determines that the relative state is a determined state.

[0053] When the relative state is not a contact state or a confirmed state, the determination unit 134 measures the time during which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the selection capacitance threshold TH2, and if this time continues for equal to or greater than the selection time threshold T2, determines that the relative state is a selection state.

[0054] When the relative state is not a contact state, a confirmed state, or a selected state, the determination unit 134 measures the time during which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the proximity capacitance threshold TH1, and if this time continues for equal to or greater than the proximity time threshold T1, determines that the relative state is a proximity state.

[0055] When the relative state is not a contact state, a confirmed state, a selected state, or a proximity state, the determination unit 134 determines that the relative state is a non-detection state in which a fingertip is not detected. Note that the multiple capacitance thresholds increase in the order of proximity capacitance threshold TH1, selection capacitance threshold TH2, confirmed capacitance threshold TH3, and contact capacitance threshold TH4. Therefore, when it is determined that the state is not a proximity state, it is not a contact state, a confirmed state, or a selected state. When it is determined that the state is not a proximity state or a contact state, it is not a confirmed state or a selected state. When it is determined that the state is not a proximity state, a contact state, or a confirmed state, it is not a selected state.

[0056] <Operations of the input device 100 in each relative state> When the fingertip FT is farther away from the operation surface 105A than the position of the proximity capacitance threshold TH1, the relative state between the fingertip FT and the operation surface 105A is a non-detection state, and the capacitances of all intersections of the electrostatic sensor 120 are less than the proximity capacitance threshold TH1. In the non-detection state, the input device 100 is in a standby state, and the display device 110 displays a standby image (see FIG. 2).

[0057] When the fingertip FT approaches the operation surface 105A and reaches the position of the proximity capacitance threshold TH1, the capacitance of the intersection closest to the fingertip FT becomes equal to the proximity capacitance threshold TH1. Note that the position of the proximity capacitance threshold TH1 is, for example, approximately 5 cm from the operation surface 105A.

[0058] When the state in which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the proximity capacitance threshold TH1 continues for equal to or greater than the proximity time threshold T1, the input device 100 switches to an operating state, and the display device 110 displays the input image (see FIG. 1).

[0059] When the fingertip FT is farther away from the operation surface 105A than the position of the selected capacitance threshold TH2, the capacitance of all intersections of the electrostatic sensor 120 is less than the selected capacitance threshold TH2. When the fingertip FT approaches the operation surface 105A and reaches the position of the selected capacitance threshold TH2, the capacitance of the intersection closest to the fingertip FT becomes equal to the selected capacitance threshold TH2. Furthermore, when the fingertip FT is closer to the operation surface 105A than the position of the selected capacitance threshold TH2, the capacitance of the intersection closest to the fingertip FT becomes greater than the selected capacitance threshold TH2. Note that the position of the selected capacitance threshold TH2 is, for example, approximately 3 cm from the operation surface 105A.

[0060] When the fingertip FT approaches the operation surface 105A to operate one of the GUI buttons 111, and the capacitance detected by the electrostatic sensor 120 remains at or above the selection capacitance threshold TH2 for a selection time threshold T2 or longer, the GUI button 111 including the position of the fingertip FT is selected, and a selection circle 111A is displayed inside the selected GUI button 111, and a cursor 112 is displayed surrounding the selected GUI button 111. Because the diameter of the cursor 112 is inversely proportional to the magnitude of the capacitance, the cursor 112 becomes smaller as the fingertip FT approaches the operation surface 105A. This allows the user to visually recognize that the fingertip FT is approaching the operation surface 105A.

[0061] When the fingertip FT approaches the operation surface 105A and reaches the position of the selected capacitance threshold TH2, if there is no GUI button 111 including the position of the fingertip FT, no GUI button 111 is selected, and a cursor 112 is displayed with the position of the fingertip FT as its center. The diameter of the cursor 112 is inversely proportional to the magnitude of the capacitance.

[0062] The same is true for the determined capacitance threshold TH3. When the fingertip FT is farther away from the operation surface 105A than the position of the determined capacitance threshold TH3, the capacitances of all intersections are less than the determined capacitance threshold TH3. When the fingertip FT approaches the operation surface 105A and reaches the position of the determined capacitance threshold TH3, the capacitance of the intersection closest to the fingertip FT becomes equal to the determined capacitance threshold TH3. Furthermore, when the fingertip FT is closer to the operation surface 105A than the position of the determined capacitance threshold TH3, the capacitance of the intersection closest to the fingertip FT becomes larger than the determined capacitance threshold TH3. Note that the position of the determined capacitance threshold TH3 is, for example, approximately 2 cm from the operation surface 105A.

[0063] When one of the GUI buttons 111 is selected, and the state in which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the confirmation capacitance threshold TH3 continues for equal to or longer than the confirmation time threshold T3, a confirmation operation is being performed to confirm the input to the selected GUI button 111. When the confirmation operation is being performed, the cursor 112 becomes the same size as the GUI button 111 and is hidden behind the GUI button 111, and the ring indicator 113 is displayed. When the time during which the confirmation operation is being performed reaches or exceeds the confirmation time threshold T3, the ring indicator 113 is hidden and the GUI button 111 appears recessed, thereby confirming the input to the selected GUI button 111. The user can visually recognize that the input has been confirmed by the ring indicator 113 no longer being displayed and the GUI button 111 appearing recessed.

[0064] The same is true for the contact capacitance threshold TH4. When the fingertip FT is farther away from the operation surface 105A than the position of the contact capacitance threshold TH4, the capacitances of all intersections are less than the contact capacitance threshold TH4. When the fingertip FT approaches the operation surface 105A and reaches the position of the contact capacitance threshold TH4 (operation surface 105A), the capacitance of the intersection closest to the fingertip FT becomes equal to the contact capacitance threshold TH4. Furthermore, when the contact area between the finger and the operation surface 105A becomes larger, the capacitance of the intersection closest to the fingertip FT becomes larger than the fixed capacitance threshold TH4.

[0065] When the fingertip FT is within the display area of ​​one of the GUI buttons 111, that GUI button 111 is in a selected state, and a touch operation is being performed on the selected GUI button 111. In the state where the touch operation is being performed, the cursor 112 becomes the same size as the GUI button 111 and is hidden behind the GUI button 111, and the ring indicator 113 is displayed.

[0066] When the state in which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the contact capacitance threshold TH4 continues for equal to or greater than the contact time threshold T4, the circular indicator 113 becomes hidden, the GUI button 111 appears depressed, and the input to the selected GUI button 111 is confirmed. The user can visually recognize that the input has been confirmed by the circular indicator 113 becoming hidden and the GUI button 111 appearing depressed.

[0067] <Ring Indicator 113> The ring indicator 113 is a ring-shaped indicator that is displayed along the outer edge of the selected GUI button 111 and superimposed on the front side of the GUI button 111, and begins to be drawn when the position of the fingertip FT reaches the position of the confirmation capacitance threshold TH3 or the position of the contact capacitance threshold TH4 by a hover input. When the position of the fingertip FT reaches the position of the confirmation capacitance threshold TH3, a state is entered in which a confirmation operation is being performed to confirm the selection of the GUI button 111. Furthermore, when the position of the fingertip FT reaches the position of the contact capacitance threshold TH4, a state is entered in which a contact operation is being performed to confirm the selection of the GUI button 111. At this time, the cursor 112 becomes the same size as the GUI button 111 and is hidden behind the GUI button 111, so it is no longer displayed.

[0068] The circular indicator 113 indicates the elapsed time (duration) from the start of the confirmation operation or the touch operation and the remaining time until the confirmation operation or the touch operation is completed.

[0069] The circular indicator 113 is an indicator that extends in a circular shape clockwise from the 12 o'clock direction (top side) in a plan view while a confirmation operation or a touch operation is being performed, and becomes circular when the confirmation operation or the touch operation is confirmed.

[0070] <Explanation of the operations shown in FIGS. 4A to 4D> In FIG. 4A, the fingertip FT has reached the position of the selection capacitance threshold TH2 in the Z direction. Since the position of the fingertip FT in the XY coordinates is inside the GUI button 111 for G, a selection circle 111A is displayed superimposed on the GUI button 111 for G. At this time, the cursor 112 is displayed surrounding the selection circle 111A. In the selection state shown in FIG. 4A, the input is not confirmed. By providing the selection state, it becomes possible to input by moving the fingertip FT slowly.

[0071] In FIG. 4B, the fingertip FT approaches the operation surface 105A from the state in FIG. 4A, and the position of the fingertip FT in the Z direction reaches the final capacitance threshold TH3. The cursor 112 (see FIG. 4A) is hidden when the position of the fingertip FT in the Z direction reaches the final capacitance threshold TH3. Also, since a confirmation operation is being performed, drawing of the circular indicator 113 begins. The display differs between the selected state in which the cursor 112 is displayed and the finalized state in which the circular indicator 113 is displayed, making it possible to prevent unintended input. Also, in the finalized state, the angle of the circular indicator 113 gradually increases, making it easy for the user to understand that the input will be finalized when the fingertip FT is stopped.

[0072] In FIG. 4C, the confirmation operation is being performed following the state shown in FIG. 4B, and the circular indicator 113 is about to make approximately one revolution.

[0073] 4D shows the state immediately after the state shown in FIG. 4C, in which the state in which the capacitance detected by the electrostatic sensor 120 is equal to or greater than the confirmation capacitance threshold TH3 continues for equal to or greater than the confirmation time threshold T3, causing the ring indicator 113 to make approximately one revolution, and the selection circle 111A displayed superimposed on the G GUI button 111 to become a concave image, indicating that the input has been confirmed. Although the state in which the ring indicator 113 has made approximately one revolution is not shown here, when the ring indicator 113 has made approximately one revolution, the selection circle 111A displayed superimposed on the G GUI button 111 is switched to a concave image as shown in FIG. 4D to indicate that the input has been confirmed. The concave image represents a state in which the GUI button 111 is being pressed backward and deformed.

[0074] As an example, the state in which the GUI button 111 is recessed is shown by irradiating light from the +Y direction side and the -X direction side, casting a shadow on the +Y direction side and the -X direction side of the recessed GUI button 111, and depicting the state in which light is shining on the -Y direction side and the +X direction side.

[0075] <Display on the entire input device 100> 5 is a diagram showing the input device 100 in a state where a hover input for the selected GUI button 111 has been confirmed. FIG. 5 shows a state where a hover input for the G GUI button 111 has been confirmed, and compared to the state shown in FIG. 1, the selection circle 111A displayed over the G GUI button 111 has changed to a depressed image, and the letter G is displayed in the input content display unit 115. FIG. 5 shows an enlarged view of the G GUI button 111. Of the 45 GUI buttons 111 displayed on the display device 110 of the input device 100, only the G GUI button 111 has a depressed image, so the user can visually recognize that the input for the G GUI button 111 has been confirmed.

[0076] <Flowchart> 6 and 7 are flowcharts showing the processing executed by the control device 130 of the input device 100. The flows shown in Fig. 6 and 7 are called and executed by application software (not shown). If the application software is in an input waiting state, the flows shown in Fig. 6 and 7 are repeatedly executed from START to END at a predetermined control cycle.

[0077] When the control device 130 starts the process, the determination unit 134 acquires the capacitance of each electrode (each of the sensor electrodes 121X and 121Y) (step S1).

[0078] The determination unit 134 acquires the position (xf, yf) of the fingertip FT in the XY coordinate system (step S2).

[0079] The determination unit 134 identifies the capacitance of the fingertip FT using the XY coordinates acquired in step S2 (step S3). The capacitance of the fingertip FT corresponds to the position of the fingertip FT in the Z direction and is the capacitance detected by the electrostatic sensor 120.

[0080] The determination unit 134 determines the relative state between the fingertip FT and the operation surface 105A (step S4). The processing of step S4 is a subroutine processing for determining the relative state, which will be described later with reference to Fig. 8. By the processing of step S4, the relative state between the fingertip FT and the operation surface 105A is specified to be one of the relative states.

[0081] The determination unit 134 determines whether the relative state between the fingertip FT and the operation surface 105A is a non-detection state (step S5).

[0082] When the determination unit 134 determines that the relative state between the fingertip FT and the operation surface 105A is in the non-detection state (S5: Yes), the operation control unit 135 increments the counter for the power-saving transition time (step S6). That is, the power-saving transition time=power-saving transition time+1. The power-saving transition time is the time counted to set the input device 100 to the standby state.

[0083] The operation control unit 135 determines whether the counter for the power saving transition time is equal to or greater than the power saving transition threshold (step S7). The power saving transition threshold is set to, for example, from several seconds to several minutes.

[0084] When the operation control unit 135 determines that the counter for the power saving transition time is equal to or greater than the power saving transition threshold (S7: Yes), the operation control unit 135 continues the power saving mode (standby state) of the input device 100 or transitions to the power saving mode (standby state) (step S8). In the standby state, the display device 110 displays a standby image (see FIG. 2). The input device 100 may also switch the CPU to the power saving mode.

[0085] The operation control unit 135 sets the confirmation waiting time counter to zero (step S9). That is, the confirmation waiting time becomes 0. The confirmation waiting time is the waiting time from when a confirmation operation or a touch operation is started for the selected GUI button 111 until the input is confirmed. When the confirmation waiting time reaches a predetermined time (confirmation time threshold T3 or touch time threshold T4), the operation input for the selected GUI button 111 is confirmed. This counter is built in the operation control unit 135. The confirmation waiting time is the waiting time from when a confirmation operation is performed until the operation input is confirmed. When the confirmation waiting time becomes equal to or greater than the confirmation waiting time threshold Tw, the operation input is confirmed in step S26 described below.

[0086] The operation control unit 135 sets the selected key to null (step S10). Here, the key refers to the key (GUI button 111) selected in the key selection process in step S15, which will be described later, and the selected key being null means that none of the GUI buttons 111 is selected.

[0087] When the operation control unit 135 completes the process of step S10, it ends the series of processes (END) and returns the flow to step S1.

[0088] In step S5, if the determination unit 134 determines that the relative state between the fingertip FT and the operation surface 105A is not the non-detection state (S5: No), the operation control unit 135 sets the counter for the power saving transition time to zero (step S11). That is, the power saving transition time=0.

[0089] The operation control unit 135 continues the input mode, or, if in the power saving mode, transitions to the input mode (step S12).

[0090] The determination unit 134 determines whether the relative state between the fingertip FT and the operation surface 105A is a close proximity state (step S13).

[0091] When the determination unit 134 determines that the relative state between the fingertip FT and the operation surface 105A is a close proximity state (S13: Yes), the operation control unit 135 causes the display control unit 136 to display the input image on the display device 110 (step S14). After completing the process of step S14, the operation control unit 135 causes the flow to proceed to step S9.

[0092] Furthermore, if the determination unit 134 determines in step S13 that the relative state between the fingertip FT and the operation surface 105A is not in a proximity state (S13: No), it performs key selection processing (step S15). The flow proceeds to step S15 when the relative state is one of the selected state, the confirmed state, and the contact state. The key selection processing is processing for selecting a key (GUI button 111) selected by the selected state, the confirmed state, or the contact state. The processing of step S15 is a subroutine processing, which will be described later with reference to FIG. 10. The selected key (GUI button 111) is identified by the processing of step S15.

[0093] The operation control unit 135 causes the display control unit 136 to display a selection circle 111A over the key (GUI button 111) identified in step S15 (step S16).

[0094] The determination unit 134 determines whether the relative state between the fingertip FT and the operation surface 105A is the selected state (step S17).

[0095] When the determination unit 134 determines that the relative state between the fingertip FT and the operation surface 105A is the selected state (S17: Yes), the operation control unit 135 ends the series of processes (END) and returns the flow to step S1.

[0096] Furthermore, if the determination unit 134 determines in step S17 that the relative state between the fingertip FT and the operation surface 105A is not a selected state (S17: No), it determines whether the relative state between the fingertip FT and the operation surface 105A is a fixed state (step S18).

[0097] When the operation control unit 135 determines that the relative state between the fingertip FT and the operation surface 105A is in the confirmed state (S18: Yes), it determines whether the key (GUI button 111) selected in step S15 is the same as the key (GUI button 111) selected in the previous step S15 (step S19). That is, the operation control unit 135 determines whether key=previous key. This is to determine whether the same GUI button 111 has been continuously selected and a confirmation operation has been performed.

[0098] If the operation control unit 135 determines that the key (GUI button 111) selected in step S15 is not the same as the key (GUI button 111) selected in the previous step S15 (S19: No), it sets the confirmation waiting time to zero (step S20). After completing the process of step S20, the operation control unit 135 advances the flow to step S21.

[0099] Furthermore, if the operation control unit 135 determines in step S19 that the key (GUI button 111) selected in step S15 is the same as the key (GUI button 111) selected in the previous step S15 (S19: Yes), it updates the key (GUI button 111) selected in the previous step S15 to the key (GUI button 111) selected in the current step S15 (step S21). That is, the previous key becomes key.

[0100] The operation control unit 135 increments the counter of the fixed waiting time (step S22). That is, the fixed waiting time=fixed waiting time+1.

[0101] The operation control unit 135 causes the display control unit 136 to display an arc of 2π × (confirmation waiting time / predetermined time) [rad] as the ring indicator 113 along the circumference of the selection circle 111A displayed superimposed on the selected G GUI button 111 (step S23).

[0102] The operation control unit 135 determines whether the confirmed waiting time is equal to or greater than the confirmed waiting time threshold Tw (step S24).

[0103] If the operation control unit 135 determines that the confirmation waiting time is equal to or greater than the confirmation waiting time threshold Tw (S24: Yes), it confirms the operation input for the selected key (step S25). The operation control unit 135 notifies the application software of the key (GUI button 111) whose operation input has been confirmed. As a result, the application software operates according to the notified key.

[0104] The operation control unit 135 sets the confirmation waiting time to zero (step S26). That is, the confirmation waiting time = 0. After completing the process of step S26, the operation control unit 135 ends the series of processes (END) and returns the flow to step S1.

[0105] Furthermore, if the operation control unit 135 determines in step S24 that the confirmed waiting time is not equal to or greater than the confirmed waiting time threshold Tw (S24: No), it ends the series of processes (END) and returns the flow to step S1.

[0106] Furthermore, if the operation control unit 135 determines in step S7 that the counter value of the power saving transition time is not equal to or greater than the power saving transition threshold (S7: No), the flow proceeds to step S12 because the counter value of the power saving transition time has not reached the power saving transition threshold.

[0107] Furthermore, if the operation control unit 135 determines in step S18 that the relative state between the fingertip FT and the operation surface 105A is not in a confirmed state (S18: No), it sends a message to the display control unit 136 saying, "Operation is possible without touching." The display control unit 136 causes the display device 110 to display the message (step S27). The determination in step S18 is made when the state is not a non-detection state, a proximity state, or a selection state. If it is determined in step S18 that the state is not a confirmed state, it is a contact state. This message enables the user to understand that operation is possible even without contact.

[0108] The determination unit 134 determines whether the previous relative state between the fingertip FT and the operation surface 105A was a contact state (step S28).

[0109] If the determination unit 134 determines that the previous relative state between the fingertip FT and the operation surface 105A was not in a contact state (S28: No), the operation control unit 135 advances the flow to step S25. As a result, the key (GUI button 111) confirmed by the contact operation is notified to the application software, and the application software operates according to the notified key.

[0110] Also, in step S28, if the determination unit 134 determines that the previous relative state between the fingertip FT and the operation surface 105A was a contact state (S28: Yes), the operation control unit 135 ends the series of processes (END) and returns the flow to step S1.

[0111] The key input is confirmed immediately after the fingertip FT comes into contact with the operation surface 105A. After the key input is confirmed, even if the fingertip FT continues to touch the operation surface 105A, no key is input.

[0112] <Relative state determination process> 8 is a flowchart showing the process of determining the relative state, which is a subroutine process of step S4 in FIG.

[0113] The determination unit 134 determines whether the capacitance of the fingertip FT is equal to or greater than the proximity capacitance threshold TH1 (step S40A).

[0114] If the determination unit 134 determines that the capacitance of the fingertip FT is equal to or greater than the proximity capacitance threshold TH1 (S40A: Yes), it increments the proximity time timer (step S40B). That is, proximity time = proximity time + 1. This timer is built into the determination unit 134. After completing the process of step S40B, the determination unit 134 advances the flow to step S41A.

[0115] If the determination unit 134 determines in step S40A that the capacitance of the fingertip FT is not equal to or greater than the proximity capacitance threshold TH1 (S40A: No), it sets the proximity time to zero (step S40C). That is, proximity time = 0. After completing the process of step S40C, the determination unit 134 advances the flow to step S41C.

[0116] The determination unit 134 determines whether the capacitance of the fingertip FT is equal to or greater than the selected capacitance threshold TH2 (step S41A).

[0117] If the determination unit 134 determines that the capacitance of the fingertip FT is equal to or greater than the selected capacitance threshold TH2 (S41A: Yes), it increments the selection time timer (step S41B). That is, selection time = selection time + 1. This timer is built into the determination unit 134. After completing the process of step S41B, the determination unit 134 advances the flow to step S42A.

[0118] If the determination unit 134 determines in step S41A that the capacitance of the fingertip FT is not equal to or greater than the selected capacitance threshold TH2 (S41A: No), it sets the selected time to zero (step S41C). That is, the selected time = 0. After completing the process of step S41C, the determination unit 134 advances the flow to step S42C.

[0119] The determination unit 134 determines whether the capacitance of the fingertip FT is equal to or greater than the determined capacitance threshold TH3 (step S42A).

[0120] If the determination unit 134 determines that the capacitance of the fingertip FT is equal to or greater than the determined capacitance threshold TH3 (S42A: Yes), it increments the timer for the determined time (step S42B). That is, the determined time = determined time + 1. This timer is built in the determination unit 134. After completing the process of step S42B, the determination unit 134 advances the flow to step S43A.

[0121] If the determination unit 134 determines in step S42A that the capacitance of the fingertip FT is not equal to or greater than the determined capacitance threshold TH3 (S42A: No), it sets the determined time to zero (step S42C). That is, the determined time = 0. After completing the process of step S42C, the determination unit 134 advances the flow to step S43C.

[0122] The determination unit 134 determines whether the capacitance of the fingertip FT is equal to or greater than the contact capacitance threshold TH4 (step S43A).

[0123] If the determination unit 134 determines that the capacitance of the fingertip FT is equal to or greater than the contact capacitance threshold TH4 (S43A: Yes), it increments the contact time timer (step S43B). That is, contact time = contact time + 1. This timer is built into the determination unit 134. After completing the process of step S43B, the determination unit 134 advances the flow to step S44A.

[0124] If the determination unit 134 determines in step S43A that the capacitance of the fingertip FT is not equal to or greater than the contact capacitance threshold TH4 (S43A: No), it sets the contact time to zero (step S43C). That is, the contact time = 0. After completing the process of step S43C, the determination unit 134 advances the flow to step S44A.

[0125] The determination unit 134 determines whether the proximity time is equal to or greater than the proximity time threshold T1 (step S44A).

[0126] If the determination unit 134 determines that the proximity time is equal to or greater than the proximity time threshold T1 (S44A: Yes), it sets the relative state to the proximity state (step S44B). After completing the process of step S44B, the determination unit 134 advances the flow to step S45A.

[0127] If the determination unit 134 determines in step S44A that the proximity time is not equal to or greater than the proximity time threshold T1 (S44A: No), the determination unit 134 sets the relative state to the non-detection state (step S44C). After completing the process of step S44C, the determination unit 134 advances the flow to step S45A.

[0128] The determination unit 134 determines whether the selection time is equal to or greater than the selection time threshold T2 (step S45A).

[0129] If the determination unit 134 determines that the selection time is equal to or greater than the selection time threshold T2 (S45A: Yes), it sets the relative state to the selected state (step S45B). The relative state is overwritten from the proximity state or non-detection state to the selected state. After completing the process of step S45B, the determination unit 134 advances the flow to step S46A.

[0130] If the determination unit 134 determines in step S45A that the selection time is not equal to or greater than the selection time threshold T2 (S45A: No), the flow proceeds to step S46A.

[0131] The determination unit 134 determines whether the determined time is equal to or greater than the determined time threshold T3 (step S46A).

[0132] If the determination unit 134 determines that the confirmation time is equal to or greater than the confirmation time threshold T3 (S46A: Yes), it sets the relative state to the confirmation state (step S46B). The relative state is overwritten from the selection state to the confirmation state. After completing the process of step S46B, the determination unit 134 advances the flow to step S47A.

[0133] If the determination unit 134 determines in step S46A that the confirmed time is not equal to or greater than the confirmed time threshold T3 (S46A: No), the flow proceeds to step S47A.

[0134] The determination unit 134 determines whether the contact time is equal to or greater than the contact time threshold T4 (step S47A).

[0135] If the determination unit 134 determines that the contact time is equal to or greater than the contact time threshold T4 (S47A: Yes), it sets the relative state to the contact state (step S47B). The relative state is overwritten from the fixed state to the contact state. After completing the process of step S47B, the determination unit 134 ends the series of relative state determination processes (END).

[0136] If the determination unit 134 determines in step S47A that the contact time is not equal to or greater than the contact time threshold T4 (S47A: No), the determination unit 134 ends the series of relative state determination processes (END).

[0137] Through the above-described relative state determination process, the relative state is set to any one of the non-detection state, proximity state, selection state, confirmation state, and contact state.

[0138] Here, the description has been given of a configuration in which steps S44A (determination of approach time), S45A (determination of selection time), S46A (determination of confirmation time), and S47A (determination of contact time) are performed in this order, and the relative state is overwritten in steps S45B, S46B, and S47B. However, the relative state may be determined in the following order. That is, the contact time, confirmation time, selection time, and approach time may be determined in this order, and the relative state determined by any of the determinations may be written. For example, it may be first determined that the contact time is less than or equal to the contact time threshold T4, and if the contact time is less than or equal to the contact time threshold T4, it may be secondly determined whether the confirmation time is greater than or equal to the confirmation time threshold T3, and if the confirmation time is greater than or equal to the confirmation time threshold T3, the confirmation state may be written as the relative state.

[0139] <Key selection processing> Before describing the specific processing of the key selection process, a central area 111B located in the center of the display area of ​​the GUI button 111 will be described with reference to Fig. 9. Fig. 9 is a diagram showing the central area 111B. The central area 111B is a circular area defined by a predetermined radius from the center of the display area of ​​the GUI button 111, and includes the center of the display area of ​​the GUI button 111.

[0140] Here, a form in which the central region 111B is circular will be described, but the central region 111B may have a shape other than circular. However, it is preferable that the shape of the central region 111B is the same as the shape of the display region of the GUI buttons 111 and that the central region 111B is arranged concentrically. This is because the central region 111B is the central part of the display region of each GUI button 111.

[0141] In the key selection process, the key to be selected in the key selection process is determined according to the XY coordinates of the fingertip FT, using the duration (key center time) during which the XY coordinates of the fingertip FT are within the central area 111B and the duration (key time) during which the XY coordinates of the fingertip FT are outside the central area 111B in the display area of ​​the GUI button 111.

[0142] In this case, a key center time threshold, which is a determination threshold for the key center time, and a key time threshold, which is a determination threshold for the key time, are used. When the XY coordinates of the fingertip FT are within the central area 111B, the key center time threshold is set to a time shorter than the key time threshold in order to determine the selected key more quickly.

[0143] <Key selection process flowchart> Fig. 10 is a flowchart showing the key selection process. The process shown in Fig. 10 is a subroutine process of step S15 in Fig. 5. Here, the latest temporary key is the key selected when the subroutine process of the key selection process starts, and is the key located at the XY coordinates of the current fingertip FT. The post-movement temporary key is the key selected the last time the subroutine process of the key selection process was performed.

[0144] The operation control unit 135 determines whether the previously selected key is null (step S50). That is, the operation control unit 135 determines whether key=null.

[0145] If the operation control unit 135 determines that key=null (S50: Yes), it selects the character of the key that is closest based on the X and Y coordinates of key (step S51A). The selected key (key) is the character of the key (GUI button 111) that is closest based on the X and Y coordinates of the fingertip FT. After completing the processing of step S51A, the operation control unit 135 updates the post-movement temporary key with the latest temporary key (step S60). Then, it ends the subroutine processing of the key selection processing shown in FIG. 10 (END). The key selected in the subroutine processing of the key selection processing is the key (GUI button 111) that is closest based on the X and Y coordinates of the fingertip FT.

[0146] If the operation control unit 135 determines in step S50 that the selected key is not null (S50: No), it selects the character of the key that is closest to the X and Y coordinates of the latest temporary key (step S52B). The latest temporary key is determined by the processing of step S52B.

[0147] The operation control unit 135 determines whether the selected key is the latest temporary key (step S53B). The selected key is the GUI button 111 on which a selection circle 111A is displayed superimposed.

[0148] If the operation control unit 135 determines that the selected key is the latest temporary key (S53B: Yes), it updates the post-movement temporary key with the latest temporary key (step S60). Then, it ends the subroutine processing of the key selection processing (END). Since the selected key is the latest temporary key, the subroutine processing of the key selection processing ends without changing the previous selection result.

[0149] Furthermore, if the operation control unit 135 determines in step S53B that the selected key is not the latest temporary key (S53B: No), it determines whether the latest temporary key and the temporary key after the movement are the same (step S54C).

[0150] If the operation control unit 135 determines that the latest temporary key and the temporary key after the movement are not the same (S54C: No), it sets the key time to zero (step S55C). That is, key time=0.

[0151] The operation control unit 135 sets the key center time to zero (step S56C). That is, key center time = 0. After completing the processing of step S56C, the operation control unit 135 updates the pre-movement temporary key with the latest temporary key (step S60). Then, the subroutine processing of the key selection processing is completed (END). By going through steps S55C and S56C, when the XY coordinates of the fingertip FT move into the display area of ​​a new GUI button 111, the key time and key center time are reset to zero, and counting of the key time and key center time for that GUI button 111 and the center area 111B begins.

[0152] If the operation control unit 135 determines in step S54C that the latest temporary key and the temporary key after the movement are the same (S54C: Yes), it increments the key time (step S55D). That is, key time = key time + 1. This timer is built into the operation control unit 135.

[0153] The operation control unit 135 determines whether the X and Y coordinates of the latest temporary key are within the central area 111B of the key (step S56D).

[0154] If the operation control unit 135 determines that the X and Y coordinates of the latest temporary key are within the key center area 111B (S56D: Yes), it increments the key center time (step S57D). That is, key center time = key center time + 1. This timer is built into the operation control unit 135. After completing the processing of step S57D, the operation control unit 135 advances the flow to step S58D.

[0155] If the operation control unit 135 determines in step S56D that the XY coordinates of the latest temporary key are not within the key central region 111B (S56D: No), the operation control unit 135 advances the flow to step S58D.

[0156] The operation control unit 135 determines whether the key time is equal to or greater than the key time threshold (step S58D).

[0157] If the operation control unit 135 determines that the key time is equal to or greater than the key time threshold (S58D: Yes), it updates the latest temporary key as the selected key (step S59D). After completing the process of step S59D, the operation control unit 135 ends the subroutine process of the key selection process (END). In step S59D, the selected key (key) is switched to a new key (GUI button 111).

[0158] If the operation control unit 135 determines in step S58D that the key time is not equal to or greater than the key time threshold (S58D: No), it determines whether the key median time is equal to or greater than the key median time threshold (step S59E). This is processing to determine whether the latest temporary key can be quickly updated as the key using a key median time threshold that is shorter than the key time threshold.

[0159] If the operation control unit 135 determines that the key center time is equal to or greater than the key center time threshold (S59E: Yes), it causes the flow to proceed to step S59D. As a result, the latest temporary key is updated as the selected key (key), and the subroutine processing of the key selection processing ends (END).

[0160] If the operation control unit 135 determines in step S59E that the key center time is not equal to or greater than the key center time threshold (S59E: No), it ends the subroutine processing of the key selection processing (END). In this case, the XY coordinates of the fingertip FT have just moved into the display area of ​​the new GUI button 111.

[0161] As described above, the control device 130 determines that the relative state is a non-detection state if the multiple durations are not equal to or greater than the corresponding multiple time thresholds (T1 to T4). Furthermore, if one or more of the multiple durations are equal to or greater than the corresponding time threshold (any of T1 to T4), the control device 130 determines that the relative state is the state with the highest capacitance threshold (any of TH1 to TH4) among the one or more states corresponding to one or more durations. This makes it possible to determine the relative state while suppressing the influence of noise. Furthermore, since the multiple time thresholds (T1 to T4) are short, a quick determination is possible.

[0162] Therefore, it is possible to provide an input device 100 that can quickly determine the positions of multiple sensing layers in the air of an object while suppressing the influence of noise. In particular, the input device of the embodiment divides the state into five states depending on the distance between the operation surface 105A and the fingertip FT: non-detection state, proximity state, selection state, confirmation state, and contact state. The control device 130 can accurately determine which of the many states exists in a short time.

[0163] The plurality of states includes a proximity state in which the operation surface 105A and the fingertip FT are in proximity to each other, and a selection state in which a selection operation is performed to select a GUI button 111 visible on the operation surface 105A. The plurality of capacitance thresholds include a proximity capacitance threshold TH1 and a selection capacitance threshold TH2, respectively, defined for the proximity state and the selection state, and the selection capacitance threshold TH2 is greater than the proximity capacitance threshold TH1. The plurality of time thresholds include a proximity time threshold T1 and a selection time threshold T2, respectively, defined for the proximity state and the selection state. The control device 130 determines that the relative state is the selection state when a state in which the capacitance is equal to or greater than the selection capacitance threshold TH2 continues for a selection time threshold T2 or longer. When the relative state is not the selection state, the control device 130 determines that the relative state is the proximity state when a state in which the capacitance is equal to or greater than the proximity capacitance threshold TH1 continues for a proximity time threshold T1 or longer. When the relative state is neither the selection state nor the proximity state, the control device 130 determines that the relative state is the non-detection state. Therefore, it is possible to provide the input device 100 that can stably determine the selected state, the proximity state, and the non-detection state by suppressing the influence of noise.

[0164] The multiple states include a proximity state in which the operation surface 105A and the fingertip FT are in proximity, a selection state in which a selection operation is performed to select a visible GUI button 111 on the operation surface 105A, a confirmation state in which a confirmation operation is performed to confirm an operation input to the GUI button 111 on which the selection operation is performed on the operation surface 105A, and a contact state in which a contact operation is performed in which the operation surface 105A and the fingertip FT come into contact. The multiple capacitance thresholds include a proximity capacitance threshold TH1, a selection capacitance threshold TH2, a confirmation capacitance threshold TH3, and a contact capacitance threshold TH4, which are defined for the proximity state, the selection state, the confirmation state, and the contact state, respectively. The contact capacitance threshold TH4 is greater than the confirmation capacitance threshold TH3, the confirmation capacitance threshold TH3 is greater than the selection capacitance threshold TH2, and the selection capacitance threshold TH2 is greater than the proximity capacitance threshold TH1. The plurality of time thresholds include a proximity time threshold T1, a selection time threshold T2, a confirmation time threshold T3, and a contact time threshold T4, which are respectively defined for the proximity state, the selection state, the confirmation state, and the contact state. The control device 130 determines that the relative state is a contact state when a state in which the capacitance is equal to or greater than the contact capacitance threshold TH4 continues for the contact time threshold T4 or longer. When the relative state is not a contact state, the control device 130 determines that the relative state is a confirmation state when a state in which the capacitance is equal to or greater than the confirmation capacitance threshold TH3 continues for the confirmation time threshold T3 or longer. When the relative state is neither a contact state nor a confirmation state, the control device 130 determines that the relative state is a selection state when a state in which the capacitance is equal to or greater than the selection capacitance threshold TH2 continues for the selection time threshold T2 or longer. When the relative state is not a contact state, a confirmation state, or a selection state, the control device 130 determines that the relative state is a proximity state when a state in which the capacitance is equal to or greater than the proximity capacitance threshold TH1 continues for the proximity time threshold T1 or longer. When the relative state is not a contact state, a confirmation state, a selection state, or a proximity state, the control device 130 determines that the relative state is a non-detection state. Therefore, it is possible to provide the input device 100 that can stably determine the contact state, the confirmed state, the selected state, the proximity state, and the non-detection state while suppressing the influence of noise.

[0165] Since the proximity time threshold T1, the selection time threshold T2, the confirmation time threshold T3, and the contact time threshold T4 are equal, an input device 100 can be provided that can stably determine the contact state, confirmation state, selection state, proximity state, and non-detection state in equal determination times.

[0166] The control device 130 further includes a display device 110 that displays an image of at least one GUI button 111 that is visible through the operation surface 105A, and when the relative state is a non-detection state, the control device 130 displays a standby image on the display device 110, and when the relative state switches from the non-detection state to a proximity state, displays an input image on the display device 110 that allows a selection operation to be performed on the GUI button 111. Therefore, by switching the image on the display device 110 depending on the distance of the fingertip FT from the operation surface 105A, it is possible to provide an input device 100 that is easy to use and allows the user to easily recognize that a selection operation is now possible.

[0167] The input device 100 further includes a display device 110 that displays an image of at least one GUI button 111 that is visible through the operation surface 105A, and when the relative state is a selected state, the control device 130 displays a selection circle 111A on the display device 110, superimposed on the GUI button 111 selected by the selection operation, to indicate that the GUI button 111 is selected. Therefore, by displaying the selection circle 111A according to the distance of the fingertip FT from the operation surface 105A, it is possible to provide an input device 100 that is easy to use and allows the user to easily recognize that the selection operation has been accepted.

[0168] The input device 100 further includes a display device 110 that displays an image of at least one GUI button 111 visible through the operation surface 105A, and the control device 130 confirms the input to the GUI button 111 for which the confirmation operation was performed when the confirmation state continues for a confirmation time threshold T3 or more. This makes it possible to provide an input device 100 that is easy to use, allowing the user to easily recognize that the input by the confirmation operation has been confirmed depending on the distance of the fingertip FT from the operation surface 105A. By dividing the state into a "selection state in which the GUI button 111 can be selected but the input cannot be confirmed" and a "confirmation state in which the input to the GUI button 111 can be confirmed" depending on the distance from the operation surface 105A to the fingertip FT, it is possible to prevent an erroneous input from being confirmed even if the fingertip FT is moved slowly.

[0169] The input device 100 further includes a display device 110 that displays an image of at least one GUI button 111 that is visible through the operation surface 105A, and the control device 130 confirms the input to the GUI button 111 that has been touched when the contact state continues for a contact time threshold T4 or more. This allows the user to easily recognize that the input made by the touch operation of the fingertip FT on the operation surface 105A has been confirmed, making it possible to provide an input device 100 that is easy to use.

[0170] Furthermore, when the control device 130 confirms the input to the GUI button 111 on which the touch operation has been performed, it displays a message on the display device 110 indicating that the fingertip FT is in contact with the operation surface 105A, thereby providing an input device 100 that allows the user to recognize that operation is possible even without contact.

[0171] The above describes an input device according to an exemplary embodiment of the present disclosure, but the present disclosure is not limited to the specifically disclosed embodiment, and various modifications and variations are possible without departing from the scope of the claims. [Explanation of symbols]

[0172] 100 Input Device 101 Case 105 Top Panel 110 Display device 111 GUI Button 111A Selection Circle 112 cursor 113 Ring Indicator 120 Electrostatic Sensor 130 Control device 131 Main control unit 132 AD conversion section 133 Counter 134 Judgment section 135 Motion control section 136 Display control unit 137 memory

Claims

1. a top panel having an operation surface; a detection unit that detects a capacitance corresponding to a distance between the operation surface and an object; a control unit that determines whether a relative state between the operation surface and the object is a non-detection state in which the object is not detected or a plurality of states other than the non-detection state, based on a detection result of the detection unit; Including, The control unit measuring a duration during which the capacitance is equal to or greater than a plurality of capacitance thresholds determined corresponding to each of the plurality of states; determining whether the plurality of durations measured for each of the plurality of states are equal to or greater than a plurality of time thresholds determined corresponding to each of the plurality of states; If the plurality of duration times are not equal to or greater than the plurality of corresponding time thresholds, the relative state is determined to be the non-detection state; an input device that, when any one or more of the plurality of durations is equal to or greater than the corresponding time threshold, determines that the relative state is the state with the highest capacitance threshold among the one or more states corresponding to the one or more durations.

2. the plurality of states include a proximity state in which the operation surface and the object are close to each other, and a selection state in which a selection operation is performed to select a visible operation unit on the operation surface; the plurality of capacitance thresholds include a proximity capacitance threshold and a selection capacitance threshold respectively defined for the proximity state and the selection state, the selection capacitance threshold being greater than the proximity capacitance threshold; the plurality of time thresholds include a proximity time threshold and a selection time threshold defined for the proximity state and the selection state, respectively; The control unit When a state in which the capacitance is equal to or greater than the selection capacitance threshold continues for equal to or greater than the selection time threshold, the relative state is determined to be the selection state; When the relative state is not the selected state, if a state in which the capacitance is equal to or greater than the proximity capacitance threshold continues for a period equal to or greater than the proximity time threshold, the relative state is determined to be the proximity state; The input device according to claim 1 , wherein when the relative state is neither the selection state nor the proximity state, the relative state is determined to be the non-detection state.

3. The plurality of states include a proximity state in which the operation surface and the object are close to each other, a selection state in which a selection operation for selecting a visible operation unit on the operation surface is performed, a confirmation state in which a confirmation operation for confirming an operation input to the operation unit in which the selection operation is performed on the operation surface is performed, and a contact state in which a contact operation for contacting the operation surface and the object is performed, the plurality of capacitance thresholds include a proximity capacitance threshold, a selection capacitance threshold, a determination capacitance threshold, and a contact capacitance threshold, which are defined for the proximity state, the selection state, the determination state, and the contact state, respectively; the contact capacitance threshold is greater than the final capacitance threshold, the final capacitance threshold is greater than the selected capacitance threshold, and the selected capacitance threshold is greater than the proximity capacitance threshold; the plurality of time thresholds include a proximity time threshold, a selection time threshold, a confirmation time threshold, and a contact time threshold, which are respectively defined for the proximity state, the selection state, the confirmation state, and the contact state; The control unit When a state in which the capacitance is equal to or greater than the contact capacitance threshold continues for equal to or longer than the contact time threshold, the relative state is determined to be the contact state; When the relative state is not the contact state, if a state in which the capacitance is equal to or greater than the determined capacitance threshold continues for equal to or greater than the determined time threshold, the relative state is determined to be the determined state; When the relative state is neither the contact state nor the confirmed state, if a state in which the capacitance is equal to or greater than the selection capacitance threshold continues for equal to or greater than the selection time threshold, the relative state is determined to be the selection state; when the relative state is not the contact state, the confirmed state, or the selected state, and a state in which the capacitance is equal to or greater than the proximity capacitance threshold continues for equal to or greater than the proximity time threshold, the relative state is determined to be the proximity state; The input device according to claim 1 , wherein the relative state is determined to be the non-detection state when the relative state is not any of the contact state, the confirmation state, the selection state, and the proximity state.

4. The input device of claim 3 , wherein the proximity time threshold, the selection time threshold, the commitment time threshold, and the contact time threshold are equal.

5. a display unit that displays an image of at least one of the operation units visible through the operation surface; The control unit When the relative state is the non-detection state, a standby image is displayed on the display unit; The input device according to claim 2 , wherein when the relative state is switched from the non-detection state to the proximity state, an input image that allows the selection operation to the operation unit is displayed on the display unit.

6. a display unit that displays an image of at least one of the operation units visible through the operation surface; The input device according to claim 2 , wherein when the relative state is the selected state, the control unit displays a selection image on the display unit, superimposed on the operation unit selected by the selection operation, to indicate that the operation unit is selected.

7. a display unit that displays an image of at least one of the operation units visible through the operation surface; The input device according to claim 3 , wherein the control unit confirms the input to the operation unit on which the confirmation operation was performed when the confirmation state continues for a period of time equal to or longer than the confirmation time threshold.

8. a display unit that displays an image of at least one of the operation units visible through the operation surface; The input device according to claim 3 , wherein the control unit confirms the input to the operation unit on which the touch operation has been performed when the contact state continues for a period of time equal to or longer than the contact time threshold.

9. The input device according to claim 8 , wherein the control unit, when confirming an input to the operation unit on which the touch operation has been performed, displays a message on the display unit indicating that the object is in contact with the operation surface.

Images