Touchscreen

Abstract

Provided is a touch screen that makes it possible to move content input by an operation on a GUI button by a hand such that the content does not overlap with the hand.　This touch screen comprises: a plurality of sensor electrodes 131 that detect the position of a hand 10; a display device 120 that is provided at a position overlapping with the plurality of sensor electrodes; a detection unit that is connected to the plurality of sensor electrodes and detects electrostatic capacitance between the hand and the sensor electrodes; and a control unit that controls an image displayed by the display device on the basis of output by the detection unit and confirms the content input by the hand. The control unit causes the display device to display an image of a GUI button 401 representing an operation unit for input, and an image of an input content display unit 402 representing the content input by an operation on the GUI button, and, when the electrostatic capacitance detected by the detection unit reaches a first threshold value TH1 or more, moves the image of the input content display unit to a position where the image does not overlap with the sensor electrode, which has detected the greatest electrostatic capacitance among the plurality of sensor electrodes.

Description

[Technical field]

[0001] The present invention relates to touch screens. [Background technology]

[0002] There has been a portable information terminal device in the past that allows handwritten character input by writing in a character input area displayed on a screen, characterized in that when the character input area is displayed on the screen, an area that does not overlap with the area to be edited is determined, and the character input area is displayed at a predetermined position within that area (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-067673 A [Patent Document 2] JP 2010-152827 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional portable information terminal devices require a screen larger than the size necessary for character input in order to display a character input area for inputting handwritten characters with a pen or the like so as not to overlap with the area being edited.

[0005] The present invention aims to provide a touch screen in which the image of the input content display section, which shows the input content entered by operation with a hand or the like, can be moved so as not to overlap with a hand or the like, even if most of the screen is made up of GUI (Graphic User Interface) buttons. [Means for solving the problem]

[0006] A touch screen according to an embodiment of the present invention includes a plurality of sensor electrodes that detect nearby objects by capacitance, a display device arranged to overlap the plurality of sensor electrodes, a detection unit connected to the plurality of sensor electrodes and that detects the capacitance between each sensor electrode and the object, and a control unit that controls an image displayed by the display device based on the output of the detection unit and confirms the input content by the object, wherein the control unit causes the display device to display an image of a GUI button representing an input operation unit and an image of an input content display unit representing the input content by operating the GUI button, and when the capacitance detected by the detection unit becomes equal to or greater than a first threshold value, moves the image of the input content display unit to a position that does not overlap with the sensor electrode that detected the largest capacitance among the plurality of sensor electrodes. Effect of the Invention

[0007] It is possible to provide a touch screen in which the image of the input content display section, which shows the input content input by operating a GUI button with a hand or the like, can be moved so as not to overlap with a hand or the like. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an external perspective view of a touch screen 100 according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the configuration of a position input device 130. [Diagram 3] 11 is a diagram illustrating capacitance formed in the position input device 130. FIG. [Figure 4A] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4B] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4C] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4D] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4E] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4F]FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Figure 4G] FIG. 2 is a diagram for explaining a display of the display device 120 of the first embodiment. [Diagram 5] FIG. 2 is a diagram showing the internal configuration of a touch screen 100. [Figure 6] FIG. 2 is a diagram illustrating a hardware configuration of a control device 140. [Figure 7] FIG. 2 is a diagram showing the functional configuration of a control device 140. [Figure 8] FIG. 4 is a flowchart showing a process executed by a control device 140 according to the first embodiment. [Figure 9] FIG. 4 is a flowchart showing a process executed by a control device 140 according to the first embodiment. [Figure 10A] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10B] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10C] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10D] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10E] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10F] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10G] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 10H] FIG. 11 is a diagram illustrating a display of a display device 120M according to a second embodiment. [Figure 11] FIG. 11 is a flowchart showing the process executed by a control device 140 of the second embodiment. [Figure 12] FIG. 11 is a flowchart showing the process executed by a control device 140 of the second embodiment. [Figure 13] FIG. 11 is a flowchart showing the process executed by a control device 140 of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment to which the touch screen of the present disclosure is applied will be described.

[0010] <Embodiment 1> <Touch Screen 100> FIG. 1 is an external perspective view of a touch screen 100 according to a first embodiment. The touch screen 100 shown in FIG. 1 is a device capable of performing operations by touch input and hover input. The touch input is an input method performed by contacting (touching) a finger, a hand, or the like with the operation surface 130A of the touch screen 100, and the hover input is an input method performed by bringing a finger, a hand, or the like close to the operation surface 130A in a non-contact state (a state in which the finger, the hand, or the like is floating above the operation surface 130A). The user's finger or hand is an example of an operating body, and is an example of an object close to the operation surface 130A. In the following description, the user performs an operation on the operation surface 130A with the fingertip, but the user can perform the operation with a part of the finger other than the fingertip, a part of the hand other than the finger, or a part of the body other than the hand.

[0011] The touch screen 100 receives input from the user's fingertip and controls the operation of the device to be controlled according to the content of the operation. The touch screen 100 may be used to remotely operate the device to be controlled, or may be provided integrally with the device to be controlled. The touch screen 100 may be portable, or may be fixedly installed on a wall or the like. Here, as an example, a form will be described in which the touch screen 100 passes data representing the content of the confirmed input to an application program of the device to be controlled.

[0012] As shown in FIG. 1, the touch screen 100 includes a housing 110, a display device 120, and a position input device .

[0013] The housing 110 is a box-shaped member that houses and holds various components. The display device 120 and the position input device 130 are held in the housing 110, and the position input device 130 is disposed on the display device 120. In the example shown in FIG. 1, the housing 110 has a rectangular parallelepiped shape. However, the housing 110 may have a shape other than a rectangular parallelepiped shape. Also, for example, the touch screen 100 may not have the housing 110 and may be installed so as to be embedded in a predetermined installation location.

[0014] The display device 120 is a flat, thin device. The display device 120 is provided below the position input device 130, overlapping it. The display device 120 is, for example, a liquid crystal display, an organic EL display, or the like. The display device 120 displays various display contents. The display device 120 is capable of displaying a plurality of GUI (Graphic User Interface) operation buttons in an aligned manner. The GUI buttons are images of push buttons displayed on the display device 120 by the GUI. The display contents displayed on the display device 120 can be viewed by a user from above the touch screen 100, passing through the position input device 130.

[0015] The position input device 130 is a flat, thin device. The position input device 130 is provided on the top surface of the housing 110. The position input device 130 has an operation surface 130A. The operation surface 130A is the surface of a top plate located at the topmost surface of the position input device 130, and is exposed from the top surface of the housing 110. The position input device 130 allows touch input (contact input) and hover input (non-contact input) on the operation surface 130A with the user's fingertip. A capacitive position input device is used for the position input device 130.

[0016] <An example of the configuration of the position input device 130> Fig. 2 is a diagram showing an example of the configuration of the position input device 130. As shown in Fig. 2, the position input device 130 is configured to include, in this order from the top in the figure (from the operation surface 130A side), a top plate 136, a sensor unit 130B, and a substrate 135.

[0017] The top plate 136 is a transparent, thin plate-like member provided on the top layer (above the sensor unit 130B) of the position input device 130. That is, the top surface of the top plate 136 becomes the operation surface 130A of the position input device 130. The top plate 136 is an example of a cover that the user can touch with a fingertip or the like. The top plate 136 is configured by attaching a decorative film having optical transparency to the surface of a thin plate-like glass. When the display device 120 provided on the back side of the position input device 130 is not displayed, the decorative film presents a specific surface pattern (for example, a wood grain pattern, a metal pattern, etc.) on the surface of the position input device 130. The decorative film may not be required. Also, a transparent plate may be provided on the top plate 136. In that case, the transparent plate provided on the top plate 136 is an example of a cover, and the upper surface of the plate becomes the operation surface.

[0018] Sensor unit 130B is provided between top plate 136 and substrate 135. Sensor unit 130B is configured by layering sensor film 134 (PET (Polyethyleneterephthalate) film) on the upper surface of glass plate 137. Sensor film 134 is provided with sensor electrodes 131A-131L, approach detection electrode 132, and noise detection electrode 133, all of which are formed from a thin-film material having conductive properties (e.g., copper foil, conductive polymer, etc.). When sensor electrodes 131A-131L are not particularly distinguished from one another, they are simply referred to as sensor electrodes 131. Also, approach detection electrode 132 and noise detection electrode 133 may not be provided.

[0019] In addition, an active shield electrode AS is provided overlapping the lower surface of the glass plate 137. The active shield electrode AS is driven by a position input device driver 150 (see FIG. 4), and is provided to increase the capacitance detectable by the sensor electrodes 131A-131L and the approach detection electrode 132 by preventing current from flowing out from the sensor electrodes 131A-131L and the approach detection electrode 132 to the ground.

[0020] The sensor electrodes 131A to 131L are provided corresponding to each of the multiple GUI buttons. In the example shown in FIG. 2, the sensor electrodes 131A to 131L are arranged in 4 rows and 3 columns corresponding to the multiple GUI buttons displayed as GUI buttons on the display device 120. Each of the sensor electrodes 131A to 131L is provided to detect touch input and hover input to the corresponding GUI button by a change in capacitance. The range that can be detected by the sensor electrodes 131A to 131L is, for example, within about 3 cm to about 5 cm from the operation surface 130A. The sensor electrodes 131A to 131L can detect that a fingertip is in proximity within about 3 cm to about 5 cm from the operation surface 130A. The state in which the fingertip is in proximity to the operation surface 130A includes a state in which a proximity operation, which will be described later, is being performed and a state in which a hover input or a touch input is being performed.

[0021] The approach detection electrode 132 has a shape that fills the gaps between the sensor electrodes 131A to 131L over a relatively wide range of the sensor film 134. The approach detection electrode 132 is provided to detect the approach of a fingertip to the operation surface 130A by a change in capacitance. The range in which the approach detection electrode 132 can detect the fingertip is, for example, within a range of about 10 cm from the operation surface 130A. Here, approaching means that the fingertip is located at a position farther than the range of proximity detectable by the sensor electrodes 131A to 131L within the range in which the approach detection electrode 132 can detect the fingertip. Therefore, if the range detectable by the sensor electrodes 131A to 131L is, for example, within about 5 cm from the operation surface 130A, approaching means, for example, that the position of the fingertip is farther than about 5 cm from the operation surface 130A and within about 10 cm from the operation surface 130A.

[0022] When the maximum value of the capacitance detected by the sensor electrodes 131A-131L becomes equal to or greater than the first threshold value, the control device 140 determines that a proximity operation has been performed by bringing the fingertip close to the operation surface 130A. The proximity operation is an operation for selecting one of a plurality of GUI buttons, and is an operation in a state in which the fingertip is not close enough to the operation surface 130A to enable hover input. When the maximum value of the capacitance detected by the sensor electrodes 131A-131L becomes equal to or greater than the first threshold value, the control device 140 can identify the GUI button selected by the proximity operation.

[0023] Moreover, the control device 140 determines that a hover input has been performed when the maximum value of the capacitance detected by the sensor electrodes 131A to 131L is equal to or greater than a second threshold value that is greater than the first threshold value. The second threshold value corresponds to a capacitance that allows an input to be confirmed in a state where the fingertip is not in contact with the top plate 136. Also, when a touch input is performed, the maximum value of the capacitance detected by the sensor electrodes 131A to 131L is equal to or greater than the second threshold value, and a capacitance greater than that detected when a non-contact touch input is performed on the operation surface 130A is detected. However, the control device 140 may or may not distinguish between the touch input and the hover input. When the touch input and the hover input are to be distinguished from each other, a third threshold value greater than the second threshold value may be used to determine the touch input. The first and second threshold values ​​will be described later with reference to FIGS. 4A to 4G.

[0024] The noise detection electrode 133 is a long, thin, strip-shaped electrode that extends along the outer periphery of the sensor film 134. The noise detection electrode 133 is provided to detect noise that has entered the position input device 130.

[0025] The substrate 135 is a thin plate-like member provided in the lowest layer (below the sensor unit 130B) of the position input device 130. The sensor unit 130B is formed on the upper surface of the substrate 135. The substrate 135 may be, for example, a glass substrate or a substrate made of transparent resin.

[0026] Fig. 3 is a diagram for explaining capacitance formed in the position input device 130. Fig. 3 shows a hand 10 instead of a fingertip.

[0027] As shown in FIG. 3, in the position input device 130, a capacitance Crg is formed between each detection electrode RX (that is, the sensor electrodes 131A to 131L, the approach detection electrode 132, and the noise detection electrode 133) and the hand 10.

[0028] In the position input device 130, a capacitance Crs is formed between each detection electrode RX and the active shield electrode AS.

[0029] In the position input device 130, a capacitance Csg is formed between the active shield electrode AS and the ground.

[0030] Furthermore, in the position input device 130, a parasitic capacitance Crgl is formed between each detection electrode RX and the ground.

[0031] The position input device 130 detects the capacitance Crg formed between the detection electrode RX and the hand 10, thereby being able to detect the approach of the hand 10 to the operation surface 130A, a hover input, and a touch input.

[0032] Here, in the position input device 130, the position, electrode width, and length of the noise detection electrode 133 are designed so that the Crg+Crgl of the approach detection electrode 132 and the Crg+Crgl of the noise detection electrode 133 are equal. As a result, the position input device 130 is designed so that the approach detection electrode 132 and the noise detection electrode 133 receive noise in phase and in the same amount. Therefore, the position input device 130 can remove noise with higher accuracy by subtracting the output of the noise detection electrode 133 from the amount of change of the approach detection electrode 132.

[0033] <Display on the display device 120> 4A to 4G are diagrams for explaining the display of the display device 120 of the first embodiment. The left side of FIG. 4A to FIG. 4G shows the display device 120, the display area 120A, the position input device 130, and the operation surface 130A as viewed from above, and the right side of FIG. 4A to FIG. 4G shows a cross section as viewed from the left side. The cross section additionally shows the sensor electrode 131, the first threshold TH1, the second threshold TH2, and the hand 10. The display area 120A and the operation surface 130A are approximately the same size, and as an example, the operation surface 130A overlaps the entire display area 120A.

[0034] 4A to 4G show a state in which a GUI button 401 for inputting numerical values ​​and an input content display section 402 are displayed in the display area 120A on the left side, and show the position of the fingertip FT of the hand 10 on the operation surface 130A on the right side. The first threshold TH1 and the second threshold TH2 are thresholds used when the control device 140 determines the position of the fingertip FT on the operation surface 130A based on the capacitance of the sensor electrode 131. In FIG. 4A to 4G, the first threshold TH1 and the second threshold TH2 are shown at the distance from the operation surface 130A according to the capacitance of the first threshold TH1 and the second threshold TH2 so that they can be visually recognized. Since the second threshold TH2 represents a capacitance larger than the first threshold TH1, the dashed line corresponding to the second threshold TH2 is closer to the operation surface 130A than the dashed line corresponding to the first threshold TH1.

[0035] The first threshold TH1 is used when determining whether or not a proximity operation has been performed on the operation surface 130A. The second threshold TH2 is used when determining whether or not a hover input has been performed on the operation surface 130A.

[0036] <GUIボタン401> The multiple GUI buttons 401 for inputting numerical values ​​are 12 buttons including the numbers 0 to 9 and the symbols * and #, and are arranged vertically and horizontally in 4 rows (vertical) by 3 columns (horizontal), in the arrangement of a numeric keypad. Here, with regard to the 12 GUI buttons 401 displayed on the display area 120A of the display device 120, the first row is a row including three GUI buttons 401 that display the numbers 1, 2, and 3, the second row is a row including three GUI buttons 401 that display the numbers 4, 5, and 6, the third row is a row including three GUI buttons 401 that display the numbers 7, 8, and 9, and the fourth row is a row including three GUI buttons 401 that display *, 0, and #. In this way, the 12 GUI buttons 401 are arranged vertically in four rows.

[0037] Furthermore, with regard to the 12 GUI buttons 401, the first column is a column including four GUI buttons 401 displaying the numbers 1, 4, 7, and the symbol *, the second column is a column including four GUI buttons 401 displaying the numbers 2, 5, 8, and 0, and the third column is a column including four GUI buttons 401 displaying the numbers 3, 6, 9, and the symbol #.

[0038] In the following description, in the display of the display area 120A of the display device 120, the up-down direction is the direction in which the first to fourth rows are arranged (the direction in which the numbers 1, 4, 7, and * are arranged), and the horizontal direction is the direction in which each row extends (the direction in which the numbers 1, 2, and 3 are arranged). The up-down direction is synonymous with the vertical direction. The upper half of the display area 120A refers to the half of the entire display area 120A in which the GUI buttons 401 in the first and second rows are displayed, and the lower half of the display area 120A refers to the half of the entire display area 120A in which the GUI buttons 401 in the third and fourth rows are displayed. The center of the display area 120A is the center between the GUI button 401 displaying the number 5 in the second row and the GUI button 401 displaying the number 8 in the third row.

[0039] The arrangement of the twelve GUI buttons 401 corresponds, for example, to the arrangement of the twelve sensor electrodes 131 (131A to 131L) shown in Fig. 2. Also, as an example, the size of each GUI button 401 is equal to the size of each sensor electrode 131, and the twelve GUI buttons 401 are displayed in display area 120A such that the outer edges of the twelve sensor electrodes 131 (131A to 131L) coincide with the outer edges of the twelve sensor electrodes 131 (131A to 131L).

[0040] Here, the size of each GUI button 401 being equal to the size of each sensor electrode 131 means that the vertical and horizontal lengths are equal, even if the areas are not completely the same. For example, the GUI button 401 has rounded edges and the sensor electrodes 131 do not have edges, so that the areas of the GUI button 401 and the sensor electrodes 131 are slightly different, but the vertical and horizontal lengths are equal, so that the sizes are equal.

[0041] Furthermore, the fact that the outer edges of the twelve GUI buttons 401 and the twelve sensor electrodes 131 (131A to 131L) match does not necessarily mean that the outer edges of the twelve GUI buttons 401 and the twelve sensor electrodes 131 (131A to 131L) completely match. For example, the outer edges of the GUI button 401 with rounded edges and the sensor electrodes 131 without rounded edges do not match at the four corners, but the positions of the four sides other than the four corners match, so that the outer edges of the twelve GUI buttons 401 and the outer edges of the twelve sensor electrodes 131 (131A to 131L) match.

[0042] <First threshold TH1 and second threshold TH2> Next, the first threshold TH1 and the second threshold TH2 will be described. Hereinafter, the position of the dashed line from the operation surface 130A in the vertical direction corresponding to the first threshold TH1 will be referred to as the position of the first threshold TH1, and the position of the dashed line from the operation surface 130A in the vertical direction corresponding to the second threshold TH2 will be referred to as the position of the second threshold TH2.

[0043] When the fingertip FT is farther from the operation surface 130A than the position of the first threshold TH1, the capacitance of all the sensor electrodes 131 is less than the first threshold TH1. When the fingertip FT is located directly above any of the sensor electrodes 131 to operate any of the GUI buttons 401 and reaches the position of the first threshold TH1, the capacitance of the sensor electrode 131 becomes equal to the first threshold TH1. When the fingertip FT is located directly above any of the sensor electrodes 131 to operate any of the GUI buttons 401 and is closer to the operation surface 130A than the position of the first threshold TH1, the capacitance of the sensor electrode 131 becomes larger than the first threshold TH1. The position of the first threshold TH1 is, for example, about 3 cm from the operation surface 130A.

[0044] The same applies to the second threshold value. When the fingertip FT is farther from the operation surface 130A than the position of the second threshold value TH2, the capacitances of all the sensor electrodes 131 are less than the second threshold value TH2. When the fingertip FT is located directly above any of the sensor electrodes 131 to operate any of the GUI buttons 401 and reaches the position of the second threshold value TH2, the capacitance of the sensor electrode 131 becomes equal to the second threshold value TH2. When the fingertip FT is located directly above any of the sensor electrodes 131 to operate any of the GUI buttons 401 and is closer to the operation surface 130A than the position of the second threshold value TH2, the capacitance of the sensor electrode 131 becomes larger than the second threshold value TH2. The position of the second threshold value TH2 is, for example, about 1 cm from the operation surface 130A.

[0045] <Input Content Display Section 402> The input content display section 402 is a display section that displays the input content that has been confirmed when a touch input or hover input is made to the GUI button 401, and is transparently displayed superimposed on the upper side (front side) of the image of the GUI button 401. As an example, the size of the input content display section 402 is shorter than the GUI button 401 in height and slightly longer than two GUI buttons 401 in width.

[0046] <Explanation of the operations shown in FIGS. 4A to 4G> 4A, in the initial state where the fingertip FT has not yet reached the position of the first threshold value TH1, the input content display portion 402 is displayed at a position including a position between the three GUI buttons 401 on the second row and the three GUI buttons 401 on the third row. The position between the second row and the third row is the center position of the display area 120A.

[0047] As shown in FIG. 4B, when the fingertip FT reaches the position of the first threshold TH1 directly above the GUI button 401 displaying the number 1 in the first row, a proximity operation is performed, and the input content display unit 402 moves to a position including the gap between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row. In FIG. 4B, the position of the fingertip FT on the GUI button 401 displaying the number 1 is indicated by a dashed ellipse. The position including the gap between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row is a position including the gap between any two adjacent rows below the center in the vertical direction. Also, the position including the gap between the three GUI buttons 401 in the first row and the three GUI buttons 401 in the second row is a position including the gap between any two adjacent rows above the center in the vertical direction.

[0048] The fingertip FT reaching the position of the first threshold value TH1 directly above the GUI button 401 displaying the number 1 corresponds to the sensor electrode 131A located directly above the GUI button 401 displaying the number 1 among the twelve sensor electrodes 131A to 131L arranged directly above the twelve GUI buttons 401 detecting the maximum capacitance. The sensor electrode 131A located directly above the GUI button 401 displaying the number 1 is located within the upper half of the display area 120A in plan view. The position including the gap between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row to which the input content display unit 402 has moved is a position that does not overlap with the sensor electrode 131A located directly above the GUI button 401 displaying the number 1.

[0049] 4B, when a proximity operation is performed, an emphasis marker 403 is displayed on the outer edge of the GUI button 401 displaying the number 1. The emphasis marker 403 is a display for emphasizing that the GUI button 401 has been selected by the proximity operation with the fingertip FT, and is, for example, a frame-shaped marker that outlines the outer edge of the GUI button 401 in a conspicuous color such as yellow or orange.

[0050] Here, a description will be given of a form in which the display area 120A is rectangular, but the display area 120A may be a shape other than a rectangle (for example, a circle, an ellipse, a shape with a part of a rectangle cut out, etc.). In such a case, in order to move the input content display unit 402 to a position that does not overlap with the sensor electrode 131A located directly above the GUI button 401 on which the proximity operation is being performed, when the fingertip FT is closer to the outer edge of one side than the center of the display area 120A, the input content display unit 402 may be displayed at a position closer to the outer edge opposite to the outer edge of one side than the center of the display area 120A. When the fingertip FT is closer to the outer edge opposite to the outer edge of one side than the center of the display area 120A, the input content display unit 402 may be displayed at a position closer to the outer edge of one side than the center of the display area 120A. The one side from the center may be any direction such as the upper side, right side, left side, or lower side from the center.

[0051] As shown in FIG. 4C, when the fingertip FT approaches the operation surface 130A from the state shown in FIG. 4B and reaches the position of the second threshold TH2, the drawing of the ring indicator 404 is started in a state where the input content display unit 402 moves to a position including between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row. In the state shown in FIG. 4C, the maximum value of the capacitance detected by the sensor electrodes 131A to 131L is detected by the sensor electrode 131A located directly above the GUI button 401 displaying the number 1, the capacitance of the sensor electrode 131 becomes equal to or greater than the second threshold, and a hover input is being performed. Note that the dashed ellipse indicating the position of the fingertip FT in FIG. 4B is omitted in FIG. 4C.

[0052] The ring indicator 404 is a ring-shaped indicator displayed superimposed on the GUI button 401 at the center of the selected GUI button 401, and indicates the elapsed time (duration) from the start of the hover input or touch input and the remaining time until the hover input or touch input is confirmed. The ring indicator 404 is an indicator that extends in a clockwise ring shape from the 12 o'clock direction (top side) in a plan view while the hover input or touch input is being performed, and becomes a ring shape when the hover input or touch input is confirmed. In FIG. 4C, the ring of the ring indicator 404 is incomplete, and the input of the number 1 by the hover input is in the middle of being confirmed.

[0053] When the hover input is continued from the state of FIG. 4C and the ring of the ring indicator 404 is completed as shown in FIG. 4D, the input of the number 1 by the hover input is confirmed, and the number 1 is displayed on the leftmost side of the input content display unit 402. In this manner, the input content whose input has been confirmed is displayed in the input content display unit 402. When the input is confirmed, the highlight marker 403 and the ring indicator 404 are hidden. Note that in FIG. 4D, the dashed ellipse indicating the position of the fingertip FT in FIG. 4B is omitted.

[0054] FIG. 4E shows a state in which a hover input is performed on the GUI button 401 displaying the number 2 in the first row, and the number 2 is added to the leftmost part of the input content display section 402 as a result of the input being confirmed. Since a hover input is performed on the GUI button 401 displaying the number 2 in the first row, the input content display section 402 is in a state of moving to a position including between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row, as in FIG. 4B and FIG. 4C. The sensor electrode 131B (see FIG. 2) located directly above the GUI button 401 displaying the number 2 is located in the upper half of the display area 120A in a planar view. The position of the input content display section 402 at this time is a position that does not overlap with the sensor electrode 131B located directly above the GUI button 401 displaying the number 2. Note that the highlight marker 403 and the ring indicator 404 are omitted in FIG. 4E.

[0055] FIG. 4F shows a state in which a hover input is performed on the GUI button 401 displaying the number 8 on the third line, and the number 8 is added to the leftmost part of the input content display section 402 as a result of the input being confirmed. Since a hover input is performed on the GUI button 401 displaying the number 8 on the third line, the input content display section 402 moves to a position including between the three GUI buttons 401 on the first line and the three GUI buttons 401 on the second line. The sensor electrode 131H (see FIG. 2) located directly above the GUI button 401 displaying the number 8 is located within the lower half of the display area 120A in plan view. The position of the input content display section 402 at this time is a position that does not overlap with the sensor electrode 131H located directly above the GUI button 401 displaying the number 8. Note that the highlight marker 403 and the ring indicator 404 are omitted in FIG. 4F.

[0056] <Internal configuration of touch screen 100> Fig. 5 is a diagram showing the internal configuration of touch screen 100. As shown in Fig. 5, touch screen 100 includes a display device 120, a display driver 122, a position input device 130, a position input device driver 150, and a control device 140. These are disposed inside a housing 110 (see Fig. 1), which is omitted in Fig. 5.

[0057] The display driver 122 is a drive circuit that drives the display device 120 in response to an image signal supplied from the control device 140, thereby causing the display device 120 to display various display contents.

[0058] The position input device driver 150 is an example of a detection unit, and drives the sensor electrode 131 of the position input device 130 to detect the capacitance in the position input device 130. The position input device driver 150 converts the capacitance value (analog value) of the capacitance detected by the position input device 130 into a count value (digital value), and outputs a capacitance detection signal representing the count value to the control device 140.

[0059] The control device 140 controls the entire touch screen 100. For example, the control device 140 controls the display by the display device 120, controls the operation input by the position input device 130, controls the output of an operation signal to an operation target device, etc. As the control device 140, for example, a microcomputer or the like is used.

[0060] <Hardware configuration of the control device 140> Fig. 6 is a diagram showing a hardware configuration of the control device 140. As shown in Fig. 6, the control device 140 includes a CPU (Central Processing Unit) 601, a ROM (Read Only Memory) 602, a RAM (Random Access Memory) 603, and an external I / F (Interface) 604. Each piece of hardware is connected to each other via a bus 605.

[0061] The CPU 601 controls the operation of the control device 140 by executing various programs stored in the ROM 602. The ROM 602 is a non-volatile memory. For example, the ROM 602 stores programs executed by the CPU 601, data necessary for the CPU 601 to execute the programs, and the like. The RAM 603 is a main storage device such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). For example, the RAM 603 functions as a work area used when the CPU 601 executes the programs. The external I / F 604 controls input and output of data to and from the outside (for example, the position input device driver 150, the display driver 122, a device to be operated by the touch screen 100, and the like).

[0062] <Functional configuration of the control device 140> 7 is a diagram showing the functional configuration of the control device 140. As shown in FIG. 7, the control device 140 includes a detection signal acquisition unit 141, an operation detection unit 142, a display control unit 143, a determination unit 144, and an output unit 145.

[0063] 7 are realized, for example, by the CPU 601 executing a program stored in the ROM 602 in the control device 140. This program may be provided in a state in which it is preinstalled in the control device 140, or may be provided from outside and installed in the control device 140. In the latter case, this program may be provided by an external storage medium (for example, a USB memory, a memory card, a CD-ROM, etc.), or may be provided by downloading it from a server on a network (for example, the Internet, etc.).

[0064] The detection signal acquisition unit 141 acquires the electrostatic capacitance detection signal output from the position input device driver 150. For example, the position input device driver 150 continuously outputs the electrostatic capacitance detection signal at a predetermined time interval. In response to this, the detection signal acquisition unit 141 continuously acquires the electrostatic capacitance detection signal.

[0065] The operation detection unit 142 detects an operation performed on the operation surface 130A of the position input device 130 based on the capacitance detection signal (i.e., the capacitance in the position input device 130) acquired by the detection signal acquisition unit 141. Here, the operation detection unit 142 is capable of distinguishing and detecting a proximity operation and a hover input on the operation surface 130A based on the magnitude of the capacitance in the position input device 130, the distribution of the capacitance, and the like, by utilizing a known technique, and is capable of detecting which sensor electrode 131 the position where the proximity operation or the hover input is being performed corresponds to.

[0066] As described above, the operation detection unit 142 may be capable of distinguishing between a proximity operation and a hover input, and may also be capable of distinguishing between a hover input and a touch input, and may also be capable of detecting the position where the touch input is being performed. The operation detection unit 142 may also be capable of detecting the approach of the fingertip FT to the operation surface 130A based on the magnitude of the capacitance in the position input device 130, the distribution of the capacitance, and the like.

[0067] The display control unit 143 supplies an image signal to the display driver 122 to cause the display device 120 to display various display contents such as a GUI button 401, an input content display unit 402, a highlight marker 403, and a circular indicator 404. The display control unit 143 controls switching of the displays shown in Figs. 4A to 4G.

[0068] When the operation detection unit 142 detects a hover input or a touch input on any of the GUI buttons 401 displayed on the display device 120, and the hover input or touch input on the GUI button 401 continues for a predetermined period of time, the confirmation unit 144 confirms the hover input or touch input. By confirming the hover input or touch input, the selection of the GUI button 401 on which the hover input or touch input has been performed is confirmed.

[0069] When the operation detection unit 142 detects a touch input to any of the GUI buttons 401, the confirmation unit 144 may immediately confirm the selection of the GUI button 401 without waiting for a predetermined period of time.

[0070] When the selection of any one of the GUI buttons 401 is confirmed by the confirmation unit 144, the output unit 145 outputs a control signal corresponding to the GUI button 401 to the operation target device. The output of the control signal by the output unit 145 may be via wireless communication or wired communication.

[0071] <Processing Executed by the Control Device 140> 8 and 9 are diagrams showing flow charts showing the processing executed by the control device 140. When starting the main flow shown in Fig. 8, as a prerequisite, as shown in Fig. 4A, the input content display section 402 is displayed between the second and third lines of the display area 120A of the display device 120. The position between the second and third lines is the center position of the display area 120A.

[0072] <Main flow (Fig. 8)> When the operation detection unit 142 of the control device 140 starts processing (START), it determines whether the maximum value of the capacitance is greater than or equal to a first threshold value TH1 and whether the position of the sensor electrode 131 detecting the maximum value of the capacitance overlaps with the upper half of the display area 120A (step S1).

[0073] When the operation detection unit 142 determines that the maximum capacitance is equal to or greater than the first threshold value TH1 and that the position of the sensor electrode 131 detecting the maximum capacitance overlaps with the upper half of the display area 120A (S1: Yes), the display control unit 143 displays the input content display unit 402 between the third and fourth rows, and displays a highlight marker 403 on the outer edge of the GUI button 401 below the sensor electrode 131 detecting the maximum capacitance (step S2). The position between the third and fourth rows does not overlap with the sensor electrode 131 detecting the maximum capacitance.

[0074] The control device 140 calls the subroutine "input judgment" and performs the input judgment process to judge the state of the input made by the user (step S3). The process of step S3 is a subroutine process, and is a process for judging the input as described with reference to Fig. 4C and Fig. 4D. The details of the input judgment process will be described later with reference to Fig. 9.

[0075] When the control device 140 finishes the process of step S3, it ends the series of processes (END).

[0076] When the operation detection unit 142 of the control device 140 determines in step S1 that the maximum capacitance value is greater than or equal to the first threshold value TH1 and that the position of the sensor electrode 131 detecting the maximum capacitance value is not a position overlapping with the upper half of the display area 120A (S1: No), it determines whether the maximum capacitance value is greater than or equal to the first threshold value TH1 and that the position of the sensor electrode 131 detecting the maximum capacitance value is a position overlapping with the lower half of the display area 120A (step S4).

[0077] When the operation detection unit 142 determines that the maximum capacitance is equal to or greater than the first threshold value TH1 and that the position of the sensor electrode 131 detecting the maximum capacitance overlaps with the lower half of the display area 120A (S4: Yes), the display control unit 143 displays the input content display unit 402 between the first and second rows, and displays a highlight marker 403 on the outer edge of the GUI button 401 below the sensor electrode 131 detecting the maximum capacitance (step S5). The position between the first and second rows does not overlap with the sensor electrode 131 detecting the maximum capacitance.

[0078] In step S4, if the operation detection unit 142 determines that the maximum capacitance is equal to or greater than the first threshold value TH1 and that the position of the sensor electrode 131 detecting the maximum capacitance is not overlapped with the lower half of the display area 120A (S4: No), the display control unit 143 displays the input content display unit 402 between the second and third rows (step S6). The position between the second and third rows is the center position of the display area 120A. When the control device 140 finishes the process of step S6, it returns the flow to step S1.

[0079] The flow proceeds to step S6 when the maximum value of the capacitances of all the sensor electrodes 131 is less than the first threshold value TH1. In this case, the fingertip FT is separated from the operation surface 130A of the touch screen 100.

[0080] <Input Judgment Processing (Figure 9)> When the determination unit 144 of the control device 140 starts the input determination process, it determines whether or not the maximum value of the capacitance is equal to or greater than the second threshold value TH2 (step S11). That is, the determination unit 144 determines whether or not the capacitance of the sensor electrode 131, whose maximum value of the capacitance has been determined to be equal to or greater than the first threshold value TH1 in step S1 or S4, is equal to or greater than the second threshold value TH2.

[0081] When the determination unit 144 determines that the maximum capacitance value is equal to or greater than the second threshold value TH2 (S11: Yes), the display control unit 143 draws the ring indicator 404 for an angle of 2π / n (rad) (step S11A), where n is the same value as n used as the end condition for the loop process of steps S12 to S15.

[0082] Next, the display control unit 143 performs a loop process of drawing the ring indicator 404 while increasing the value i by 1 from i=2 to i=n (steps S12 to S15). i=2, n, 1 means that the value i is increased by 1 from i=2 to i=n.

[0083] The value n is the number of divisions when drawing the ring indicator 404, and the value i ranges from 2 to n. The ring indicator 404 is drawn in increments of 2π / n (rad) from the hidden state to the center of the ring by repeating the loop processing from steps S12 to S15.

[0084] The determination unit 144 determines whether the maximum capacitance value is equal to or greater than the second threshold value TH2 and whether the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance value is the same as the previous time (step S13). In other words, if the position of the sensor electrode 131 with the maximum capacitance value has not changed since step S11A, the loop process from steps S12 to S15 is repeated.

[0085] The display control unit 143 draws the circular indicator 404 for an angle of i×2π / n (rad) over the GUI button 401 located under the sensor electrode 131 with the maximum capacitance (step S14). As an example, the circular indicator 404 is drawn in a clockwise direction from the top of the circle.

[0086] In addition, here, a form in which the GUI buttons 401 and the sensor electrodes 131 are arranged in one-to-one correspondence will be described, but in the case where a plurality of sensor electrodes 131 are included in the display area of ​​one GUI button 401, it is sufficient to determine in step S13 whether the maximum capacitance value is equal to or greater than the second threshold value TH2 and whether the GUI button 401 under the sensor electrode 131 that detects the maximum capacitance value is the same as the GUI button 401 that drew the ring indicator 404 last time. In this case, if the GUI button 401 is the same as the previous one, the sensor electrode 131 may be different. For example, if there are two sensor electrodes 131 in the display area of ​​one GUI button 401, and the capacitance of one of the two sensor electrodes 131 becomes the maximum value and is equal to or greater than the second threshold value TH2 in the next period, the capacitance of the other sensor electrode 131 becomes the maximum value and is equal to or greater than the second threshold value TH2, the GUI button 401 is regarded as the same as the previous one, and the loop process from steps S12 to S15 is repeated.

[0087] When the determination unit 144 determines that the maximum capacitance value is equal to or greater than the second threshold value TH2 and that the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance value is the same as the previous GUI button 401 on which the circular indicator 404 was drawn in the loop process of steps S12 to S15 (S13: Yes), the control device 140 repeats the loop process of steps S12 to S15. When the control device 140 completes drawing the circular indicator 404 by repeating the loop process of steps S12 to S15, it switches the circular indicator 404 and the highlight marker 403 to hidden.

[0088] When drawing of the circular indicator 404 is completed by repeating the loop process from steps S12 to S15, the determination unit 144 of the control device 140 adds the confirmed input number to the input content display unit 402 (step S16). The confirmed input number is the number represented by the GUI button 401 displayed under the sensor electrode 131 where the maximum capacitance value was detected. For example, as shown in Figs. 4D to 4G, the number is added to the input content display unit 402.

[0089] The control device 140 passes the confirmed input number to the application program (step S17). As a result, the application program performs processing according to the received number.

[0090] In addition, in step S13, if the determination unit 144 determines that the maximum capacitance value is equal to or greater than the second threshold value TH2 and that the GUI button 401 located under the sensor electrode 131 that detects the maximum capacitance value is the same GUI button 401 that drew the circular indicator 404 in the loop processing of steps S12 to S15 as the previous one (S13: No), the control device 140 returns the flow to step S1.

[0091] As described above, an image of the GUI button 401 representing an input operation unit and an image of the input content display section 402 representing the input content by operating the GUI button 401 are displayed on the display device 120, and when the capacitance detected by the position input device driver 150 becomes equal to or greater than the first threshold value TH1, the image of the input content display section 402 is moved to a position that does not overlap with the sensor electrode 131 that detected the maximum capacitance among the multiple sensor electrodes 131. Therefore, the inputted content can be confirmed on the input content display section 402 that has been moved so as not to overlap with the fingertip FT.

[0092] Therefore, it is possible to provide a touch screen 100 in which the image of the input content display portion 402, which shows the input content input by operating the GUI button 401 with a hand or the like, can be moved so as not to overlap with a hand or the like.

[0093] Furthermore, the control device 140 uses a second threshold value TH2 that corresponds to the capacitance at which an input can be confirmed when the fingertip FT is not in contact with the tabletop 136 and is greater than the first threshold value TH1, and when the capacitance detected by the position input device driver 150 becomes equal to or greater than the second threshold value TH2, the control device 140 confirms the input to the GUI button 401 corresponding to the sensor electrode 131 that detected the maximum capacitance. This makes it possible to provide a touch screen 100 that can reliably confirm an input with a non-contact hover input.

[0094] Furthermore, when the capacitance detected by the position input device driver 150 is less than the first threshold value TH1, the control device 140 displays the input content display unit 402 in the center of the display device 120, and when the capacitance is equal to or greater than the first threshold value TH1, and when the fingertip FT is closer to the upper side than the center of the display device 120, the control device 140 displays the input content display unit 402 below the center of the display device 120, and when the fingertip FT is closer to the lower side than the center of the display device 120, the control device 140 displays the input content display unit 402 above the center of the display device 120. Therefore, it is possible to provide a touch screen 100 that can display the input content display unit 402 in a position that is not hidden by the hand 10.

[0095] The control device 140 causes the display device 120 to display the images of the multiple GUI buttons 401 arranged vertically and horizontally, and also displays the image of the input content display section 402 at a position including between the images of the multiple GUI buttons 401. Therefore, the GUI buttons 401 are not completely hidden by the input content display section 402, and it is possible to provide a touch screen 100 that is capable of both displaying the input contents by the input content display section 402 and displaying the GUI buttons 401 displayed on the back side (rear side) of the input content display section 402.

[0096] Moreover, the images of the multiple GUI buttons 401 are displayed on the display device 120 in four rows in the vertical direction. When the sensor electrode 131 that detects the maximum capacitance is located in the upper half of the display area 120A of the display device 120, the image of the input content display section 402 is moved to a position including between the images of the GUI buttons 401 in the third and fourth rows. When the sensor electrode 131 that detects the maximum capacitance is located in the lower half of the display area 120A of the display device 120, the image of the input content display section 402 is moved to a position including between the images of the GUI buttons 401 in the first and second rows. For this reason, it is possible to provide a touch screen 100 that can move the image of the input content display section 402 so as not to overlap with the hand 10, etc., on an input screen that is displayed in four rows in the vertical direction, such as the numeric keypad shown in FIG. 4A to FIG. 4G.

[0097] Furthermore, the number of images of the multiple GUI buttons 401 is equal to the number of multiple sensor electrodes 131, and the sizes in a planar view are equal, and the images of the multiple GUI buttons 401 are displayed on the display device 120 so that the positions of the outer edges of the images of each GUI button 401 coincide with the positions of the outer edges of each sensor electrode 131, thereby providing a touch screen 100 that can detect input to each GUI button 401 with high accuracy.

[0098] <Embodiment 2> 10A to 10H are diagrams for explaining the display of a display device 120M of embodiment 2. The touch screen of embodiment 2 has a configuration in which the display device 120 and the position input device 130 of the touch screen 100 of embodiment 1 are replaced with a display device 120M and a position input device 130M, respectively. Since the other configurations are the same as those of the touch screen 100 of embodiment 1, the differences will be mainly described here.

[0099] The left side of Fig. 10A to Fig. 10H shows the display device 120M, the display area 120MA, the position input device 130M, and the operation surface 130MA as viewed from above, and the right side of Fig. 10A to Fig. 10H shows a cross section as viewed from the left side. The cross section additionally shows the sensor electrode 131, the first threshold TH1, the second threshold TH2, and the hand 10. The display area 120MA and the operation surface 130MA are approximately the same size, and as an example, the operation surface 130MA overlaps the entire display area 120MA.

[0100] Display device 120M differs from embodiment 1 in that GUI buttons 401 are displayed in a 4 row (vertical)×4 column (horizontal) format in display area 120MA. Accordingly, in position input device 130M, sensor electrodes 131 are arranged in a 4 row (vertical)×4 column (horizontal) format, and approach detection electrode 132 has a shape that fills the gaps between 16 sensor electrodes 131 arranged in 4 rows×4 columns.

[0101] 10A, 15 GUI buttons 401 for inputting alphabetical characters are displayed in a display area 120MA of a display device 120M of the second embodiment. The 15 GUI buttons 401 are arranged in a flick input screen on the display, and in the first to third columns of the first to third rows, GUI buttons 401 for inputting @, / , : are displayed in the first column of the first row, a, b, c, ..., and w, x, y, and z are displayed in the third column of the third row. There are eight GUI buttons 401 for inputting alphabetical characters a to z.

[0102] In addition, from the first column to the third column of the fourth row, GUI buttons 401 representing keys for inputting symbols such as the A / a key for switching between uppercase and lowercase letters, and apostrophe (') and quotation mark (") are displayed. In addition, in the fourth column, a backspace key is displayed on the first row, a space (blank) key on the second row, and an enter key on the third and fourth rows. Only the enter key GUI button 401 is approximately twice the size of the other 14 GUI buttons 401. In this way, the 15 GUI buttons 401 are displayed vertically aligned across four rows. The center of the display area 120MA is the center between the two GUI buttons 401 in the second and third columns of the second row and the two GUI buttons 401 in the second and third columns of the third row.

[0103] As in the first embodiment, the arrangement of the 14 GUI buttons 401 other than the enter key corresponds to the arrangement of the 14 sensor electrodes 131, respectively, the size of each GUI button 401 is equal to the size of each sensor electrode 131, and the outer edge of the GUI button 401 coincides with the outer edge of the sensor electrode 131. The GUI button 401 of the enter key corresponds to the arrangement of two sensor electrodes 131 in the third row and fourth row and fourth column out of the 16 sensor electrodes 131, the size of the GUI button 401 is equal to the size of the sensor electrode 131, and the outer edge of the GUI button 401 coincides with the outer edge of the sensor electrode 131.

[0104] The 15 GUI buttons 401 are arranged in the display of a flick input screen as described above, but the input method is similar to toggle input, as will be described below.

[0105] <Explanation of the operations shown in Figs. 10A to 10H> In the initial state where the fingertip FT has not yet reached the position of the first threshold value TH1 as shown in Fig. 10A, the input content display portion 402 is displayed at a position including between the GUI buttons 401 on the second and third rows. This is the same as the state shown in Fig. 4A.

[0106] As shown in FIG. 10B, when the fingertip FT reaches the position of the first threshold value TH1 directly above the GUI button 401 in the second column of the first row, a proximity operation is performed, and the input content display unit 402 moves to a position including a position between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row. In addition, as a result of the proximity operation being performed, an emphasis marker 403 is displayed on the outer edge of the GUI button 401 in the second column of the first row. In FIG. 10B, the position of the fingertip FT is indicated by a dashed ellipse on the GUI button 401 in the second column of the first row. The state shown in FIG. 10B is similar to the state shown in FIG. 4B.

[0107] The fingertip FT reaching the position of the first threshold value TH1 directly above the GUI button 401 in the second column of the first row corresponds to the sensor electrode 131 located directly above the GUI button 401 in the second column of the first row detecting the maximum capacitance. The sensor electrode 131 located directly above the GUI button 401 in the second column of the first row is located in the upper half of the display area 120MA in a planar view. The position including the gap between the three GUI buttons 401 in the third row and the three GUI buttons 401 in the fourth row to which the input content display unit 402 has moved is a position that does not overlap with the sensor electrode 131 located directly above the GUI button 401 in the second column of the first row.

[0108] As shown in FIG. 10C, when the fingertip FT approaches the operation surface 130MA from the state shown in FIG. 10B and reaches the position of the second threshold TH2, the drawing of the ring indicator 404 is started in a state where the input content display unit 402 moves to a position including between the GUI button 401 in the third row and the GUI button 401 in the fourth row. The state shown in FIG. 10C is a state where the maximum value of the capacitance detected by all the sensor electrodes 131 is detected by the sensor electrode 131 directly above the GUI button 401 in the second column of the first row, the capacitance of the sensor electrode 131 becomes equal to or greater than the second threshold, and a hover input is being performed. The state shown in FIG. 10C is the same as the state shown in FIG. 4C. Note that in FIG. 10C, the dashed ellipse indicating the position of the fingertip FT in FIG. 10B is omitted.

[0109] When the hover input is continued from the state of FIG. 10C and the ring of the ring indicator 404 is completed as shown in FIG. 10D, the input of the alphabet "a" is confirmed and the alphabet "a" is displayed on the leftmost side of the input content display section 402. In this manner, the input content whose input has been confirmed is displayed in the input content display section 402. When the input is confirmed, the highlight marker 403 and the ring indicator 404 are hidden. The state shown in FIG. 10D is the same as the state shown in FIG. 4D. Note that in FIG. 10D, the dashed ellipse indicating the position of the fingertip FT in FIG. 10B is omitted.

[0110] FIG. 10E shows a state in which a hover input is performed on the GUI button 401 in the third column of the second row, and the alphabet m is added to the leftmost side of the input content display unit 402 as a result of the input being confirmed. Since a hover input is performed on the GUI button 401 in the third column of the second row, the input content display unit 402 is in a state of being moved to a position including the area between the GUI button 401 in the third row and the GUI button 401 in the fourth row, as in FIG. 10B and FIG. 10C. The sensor electrode 131 in the third column of the second row, located directly above the GUI button 401 in the third column of the second row, is located within the upper half of the display area 120MA in a planar view. The position of the input content display unit 402 at this time is a position that does not overlap with the sensor electrode 131B in the third column of the second row. Note that the highlight marker 403 and the ring indicator 404 are omitted in FIG. 10E.

[0111] FIG. 10F shows a state in which a hover input is performed on the GUI button 401 in the second column of the third row, and before the input is confirmed, the first alphabet t of the alphabets t, u, and v included in the display of the GUI button 401 in the second column of the third row is displayed on the leftmost side of the input content display unit 402. This state is a state in which an input similar to a toggle input is being performed, and the input of the alphabet t has not yet been confirmed. Since a hover input is performed on the GUI button 401 in the second column of the third row, the input content display unit 402 moves to a position including a position between the GUI button 401 in the first row and the GUI button 401 in the second row. The sensor electrode 131H in the second column of the third row, which is located directly above the GUI button 401 in the second column of the third row, is located within the lower half of the display area 120MA in a planar view. The position of the input content display unit 402 at this time is a position that does not overlap with the sensor electrode 131 in the second column of the third row.

[0112] 10G shows a state in which a hover input is being performed on the GUI button 401 in the second column of the third row, continuing from the state shown in FIG. 10F. As a result of the continuation of the hover input, the second u of the alphabet letters t, u, and v included in the display of the GUI button 401 in the second column of the third row is displayed at the rightmost position in the input content display section 402.

[0113] Fig. 10H shows a state in which hover input is being performed on the GUI button 401 in the second column of the third row, continuing from the state shown in Fig. 10G. As the hover input is continued, the third v of the alphabet letters t, u, and v included in the display of the GUI button 401 in the second column of the third row is displayed at the rightmost position in the input content display section 402.

[0114] In embodiment 2, as shown in Figures 10F to 10G, when an input similar to a toggle input is being performed, if the position of the hover input changes to the position of another sensor electrode 131, or if the hover input is no longer performed, the input of the character displayed at the end (rightmost) of the GUI button 401 at that time is confirmed.

[0115] <Processing Executed by the Control Device 140> 11 to 13 are diagrams showing a flowchart illustrating the processing executed by the control device 140 of the embodiment 2. In the embodiment 2, it is assumed that the input content display unit 402 is not displayed when the main flow shown in Fig. 11 is started.

[0116] <Main flow (Fig. 11)> As shown in Fig. 10A, the control device 140 displays the input content display section 402 between the second and third lines of the display area 120A of the display device 120 (step S0). After completing the process of step S0, the control device 140 performs the same processes as steps S1 to S5 shown in Fig. 8. Therefore, the description of steps S1 to S5 will be omitted here. The contents of the subroutine "input judgment" of step S3 will be described below with reference to Figs. 12 and 13.

[0117] <Input Judgment Processing (Figures 12 and 13)> In the second embodiment, the control device 140 first executes steps S31 to S35 similar to steps S11 to S15 in the first embodiment.

[0118] When the determination unit 144 of the control device 140 starts the input determination process, it determines whether or not the maximum value of the capacitance is equal to or greater than the second threshold value TH2 (step S31). That is, the determination unit 144 determines whether or not the capacitance of the sensor electrode 131, whose maximum value of the capacitance has been determined to be equal to or greater than the first threshold value TH1 in step S1 or S4, is equal to or greater than the second threshold value TH2.

[0119] When the determination unit 144 determines that the maximum capacitance is equal to or greater than the second threshold value TH2 (S31: Yes), the control device 140 draws the ring indicator 404 for an angle of 2π / n on the GUI button corresponding to the sensor electrode with the maximum capacitance (step S31A). After that, a loop process is performed to draw the ring indicator 404 while increasing the value i by 1 from i=2 to n (steps S32 to S35). i=2, n, 1 means that the value i is increased by 1 from i=2 to n.

[0120] The value n is the number of divisions when drawing the ring indicator 404, and the value i ranges from 2 to n. The ring indicator 404 is drawn in increments of 2π / n (rad) from the hidden state to the center of the ring by repeating the loop processing from steps S32 to S35.

[0121] The determination unit 144 determines whether the maximum capacitance is equal to or greater than the second threshold value TH2 and whether the GUI button 401 under the sensor electrode 131 that detects the maximum capacitance is the same as the previous time (step S33). In other words, if the position of the sensor electrode with the maximum capacitance has not changed since step S31A, the loop process of steps S32 to S35 is repeated.

[0122] The display control unit 143 draws the circular indicator 404 for an angle of i×2π / n (rad) over the GUI button 401 located under the sensor electrode 131 with the maximum capacitance (step S34). As an example, the circular indicator 404 is drawn in a clockwise direction from the top of the circle.

[0123] When the determination unit 144 determines that the maximum capacitance value is equal to or greater than the second threshold value TH2 and that the GUI button 401 below the sensor electrode 131 detecting the maximum capacitance value is the same as the GUI button 401 that previously drew the circular indicator 404 (S33: Yes), the control device 140 repeats the loop process from steps S32 to S35. When the control device 140 completes drawing the circular indicator 404 by repeating the loop process from steps S32 to S35, it switches the circular indicator 404 and the highlight marker 403 to hidden.

[0124] In addition, if the determination unit 144 determines in step S33 that the condition that the maximum capacitance value is greater than or equal to the second threshold value TH2 and the GUI button 401 located under the sensor electrode 131 detecting the maximum capacitance value is the same as the GUI button 401 on which the circular indicator 404 was drawn last time is not satisfied (S33: No), the control device 140 returns the flow to step S1.

[0125] When the loop process of steps S32 to S35 is completed, determination unit 144 determines whether or not GUI button 401 located under sensor electrode 131 that detects the maximum capacitance is the backspace key (step S36).

[0126] When the determination unit 144 determines that the GUI button 401 located under the sensor electrode 131 that detects the maximum capacitance value is the backspace key (S36: Yes), it determines whether there is a string of one or more characters in the input content display unit 402 (step S37).

[0127] When the determination unit 144 determines that there is a character string of one or more characters in the input content display unit 402 (S37: Yes), it deletes the last (rightmost) character displayed in the input content display unit 402 (step S38). When the control device 140 finishes the process of step S38, it returns the flow to step S1.

[0128] The determination unit 144 also returns the flow to step S1 when it determines in step S37 that the input content display portion 402 does not have a character string of one or more characters (S37: No).

[0129] Furthermore, if the determination unit 144 determines in step S36 that the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is not the backspace key (S36: No), it determines whether the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is the A / a key that switches between uppercase and lowercase letters (step S39).

[0130] When the determination unit 144 determines that the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance is the A / a key for switching between uppercase and lowercase letters (S39: Yes), it switches the alphabets a to z displayed on the eight GUI buttons 401 for inputting the alphabets a to z to the alphabets A to Z in uppercase (step S40). When the display of the eight GUI buttons changes, the uppercase / lowercase letters are switched when inputting the next alphabet. When the control device 140 finishes the process of step S40, it returns the flow to step S1.

[0131] If the determination unit 144 determines in step S39 that the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is not the A / a key that switches between uppercase and lowercase letters (S39: No), it determines whether the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is the space key (step S41).

[0132] When the determination unit 144 determines that the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance is the space key (S41: Yes), it adds one space to the end (rightmost) of the input content display unit 402 (step S42). When the control device 140 finishes the process of step S42, it returns the flow to step S1.

[0133] When the determination unit 144 determines in step S41 that the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is not a space key (S41: No), the determination unit 144 determines whether the GUI button 401 located below the sensor electrode 131 that detects the maximum capacitance value is an enter key (step S43).

[0134] When the determination unit 144 determines that the GUI button 401 under the sensor electrode 131 that detects the maximum capacitance is the enter key (S43: Yes), it passes the display content of the input content display unit 402 to the application program (step S44). As a result, the application program performs processing according to the received character string. When the control device 140 finishes the processing of step S44, it ends the series of processing (END).

[0135] When the determination unit 144 determines in step S43 that the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance is not an enter key (S43: No), the determination unit 144 adds the first alphabet of the alphabets included in the display of the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance to the end (rightmost) of the input content display unit 402 (step S45). The alphabet displayed in the input content display unit 402 in step S45 is in a provisionally determined state. Provisional determination means a state in which there is a possibility of determination, but the alphabet may be changed. For example, if the sensor electrode 131 that detects the maximum capacitance is the sensor electrode 131 in the second column of the third row, t of the alphabets t, u, and v displayed on the GUI button 401 in the second column of the third row is displayed at the end (rightmost) of the input content display unit 402 as shown in FIG. 10F.

[0136] When the provisionally confirmed alphabet is added to the end (rightmost) of input content display section 402, display control section 143 draws ring indicator 404 over an angle of 2π / n (rad) on GUI button 401 located under sensor electrode 131 with the largest capacitance (step S46), where n is the same value as n used as the end condition for the loop process of steps S47 to S50.

[0137] Next, the control device 140 performs a loop process of drawing the ring indicator 404 while increasing the value i by 1 from i=2 to i=n (steps S47 to S50). i=2, n, 1 means that the value i is increased by 1 from i=2 to i=n.

[0138] The display control unit 143 draws the circular indicator 404 for an angle of i×2π / n (rad) over the GUI button 401 located under the sensor electrode 131 with the maximum capacitance (step S49). As an example, the circular indicator 404 is drawn in a clockwise direction from the top of the circle.

[0139] The determination unit 144 determines whether the maximum capacitance value is greater than or equal to the second threshold value TH2 and whether the GUI button 401 located under the sensor electrode 131 that detects the maximum capacitance value is the same as the GUI button 401 that previously drew the circular indicator 404 (step S48).

[0140] When the determination unit 144 determines that the maximum capacitance is equal to or greater than the second threshold value TH2 and that the GUI button 401 below the sensor electrode 131 that detects the maximum capacitance is the same as the previous time (S48: Yes), the control device 140 repeats the loop process from steps S47 to S50. In other words, if the position of the sensor electrode with the maximum capacitance has not changed since step S31A, the loop process from steps S47 to S50 is repeated. When the control device 140 completes drawing the circular indicator 404 by repeating the loop process from steps S47 to S50, it switches the circular indicator 404 to hidden.

[0141] When the determination unit 144 completes drawing the circular indicator 404 by repeating the loop process from step S47 to S50, it changes the last (rightmost) character of the input content display unit 402 to the next alphabet of the selected GUI button 401 (step S51). For example, if the sensor electrode 131 that detects the maximum capacitance is the sensor electrode 131 in the third row and second column, and the alphabet t is displayed at the end (rightmost) of the input content display unit 402 as shown in FIG. 10F when the flow proceeds to step S51, the alphabet u is displayed as shown in FIG. 10G by the process of step S51. When the process of step S51 is completed, the control device 140 returns the flow to step S46. When the flow proceeds to step S51 again thereafter, the alphabet v is displayed at the end (rightmost) of the input content display unit 402 as shown in FIG. 10H.

[0142] By holding the hover input, the processes from steps S46 to S51 are repeated, and the alphabet displayed at the end (rightmost) of the input content display portion 402 is switched as in toggle input.

[0143] Furthermore, if the determination unit 144 determines in step S48 that the maximum capacitance value is equal to or greater than the second threshold value TH2 and that the GUI button 401 located under the sensor electrode 131 detecting the maximum capacitance value is not the same as the GUI button 401 on which the circular indicator 404 was drawn last time (S48: No), it determines that the character displayed at the end (rightmost) of the input content display unit 402 at that time has been determined, and returns the flow to step S1.

[0144] As described above, an image of the GUI button 401 representing an input operation unit and an image of the input content display portion 402 representing the input content by operating the GUI button 401 are displayed on the display device 120M, and when the capacitance detected by the position input device driver 150 becomes equal to or greater than the first threshold value TH1, the image of the input content display portion 402 is moved to a position that does not overlap with the sensor electrode 131 that detected the maximum capacitance among the multiple sensor electrodes 131. Therefore, even if the GUI button 401 being operated overlaps with the fingertip FT and the GUI button 401 displayed below the fingertip FT cannot be seen, the input content can be confirmed on the input content display portion 402 that has been moved so as not to overlap with the fingertip FT.

[0145] Therefore, it is possible to provide the touch screen of the second embodiment, which allows the image of the input content display portion 402, which shows the input content input by operating the GUI button 401 with a hand or the like, to be moved so as not to overlap with a hand or the like.

[0146] Although a touch screen according to an exemplary embodiment of the present invention has been described above, the present invention is not limited to the specifically disclosed embodiment, and various modifications and variations are possible without departing from the scope of the claims.

[0147] This international application claims priority to Japanese patent application No. 2021-179665, filed on November 2, 2021, the entire contents of which are incorporated herein by reference. [Explanation of symbols]

[0148] 10 Moves 100 Touch Screen 110 Cabinet 120, 120M display device 120A, 120MA display area 122 Display Driver 130, 130M Position input device 130A, 130MA operation surface 130B Sensor section 131 Sensor Electrode 131A~131L Sensor electrodes 132 Approach detection electrode 133 Noise detection electrode 134 Sensor Film 135 Substrate 136 Tabletop 137 Glass Plate 140 Control device 141 Detection signal acquisition unit 142 Operation detector 143 Display control section 144 Determined part 145 Output section 150 Position Input Device Driver 401 GUI button 402 Input content display section 403 Emphasis Marker 404 Ring Indicator

Claims

1. a plurality of sensor electrodes for detecting nearby objects by capacitance; A display device provided at a position overlapping the plurality of sensor electrodes; a detection unit connected to the plurality of sensor electrodes and detecting a capacitance between each sensor electrode and the object; a control unit that controls an image displayed by the display device based on an output from the detection unit and determines the input content by the object; Including, The control unit is displaying, on the display device, an image of a GUI button representing an operation unit for input and an image of an input content display unit representing an input content by operating the GUI button, and when the capacitance detected by the detection unit becomes equal to or greater than a first threshold value, moving the image of the input content display unit to a position not overlapping with a sensor electrode which detects a maximum capacitance among the plurality of sensor electrodes; When the capacitance detected by the detection unit is less than the first threshold value, the input content display unit is displayed at the center of the display device; When the capacitance detected by the detection unit is equal to or greater than the first threshold value, if the object is closer to an outer edge on one side than a center of the display device, displaying the input content display unit at a position closer to an outer edge opposite to the outer edge on one side than a center of the display device; A touch screen that displays the input content display unit at a position closer to the outer edge of one side than the center of the display device when the capacitance detected by the detection unit is greater than or equal to the first threshold and the object is closer to the outer edge of the opposite side than the center of the display device.

2. A plurality of sensor electrodes for detecting nearby objects by capacitance; A display device provided at a position overlapping the plurality of sensor electrodes; a detection unit connected to the plurality of sensor electrodes and detecting a capacitance between each sensor electrode and the object; a control unit that controls an image displayed by the display device based on an output from the detection unit and determines the input content by the object; Including, The control unit is displaying, on the display device, an image of a GUI button representing an operation unit for input and an image of an input content display unit representing an input content by operating the GUI button, and when the capacitance detected by the detection unit becomes equal to or greater than a first threshold value, moving the image of the input content display unit to a position not overlapping with a sensor electrode which detects a maximum capacitance among the plurality of sensor electrodes; displaying the images of the plurality of GUI buttons arranged vertically and horizontally on the display device, and displaying the image of the input content display unit at a position including a gap between the images of the plurality of GUI buttons; displaying the images of the plurality of GUI buttons on the display device in four or more rows vertically; When the sensor electrode that detected the maximum capacitance is located within an upper half of a display area of ​​the display device, the image of the input content display unit is moved to a position including a gap between any two adjacent rows below the center in the vertical direction, A touch screen that, when the sensor electrode that detects the maximum capacitance is located within the lower half of the display area of ​​the display device, moves the image of the input content display section to a position including between any two adjacent rows above the center in the vertical direction.

3. The control unit is displaying the images of the plurality of GUI buttons on the display device in four rows vertically; When the sensor electrode that detected the maximum capacitance is located within an upper half of a display area of ​​the display device, the image of the input content display unit is moved to a position including a position between the images of the GUI buttons in the third and fourth rows from the top in the vertical direction; 3. The touch screen of claim 2, wherein when the sensor electrode which detected the maximum capacitance is located within the lower half of the display area of ​​the display device, the image of the input content display section is moved to a position including a position between the images of the GUI buttons in the first and second rows from the top in the vertical direction.

4. the number of the GUI button images is equal to the number of the sensor electrodes, and the sizes of the GUI button images in plan view are equal; The touch screen according to claim 3 , wherein the control unit causes the display device to display the images of the plurality of GUI buttons such that a position of an outer edge of each GUI button image coincides with a position of an outer edge of each sensor electrode.

5. a cover that is contactable by an object proximate to the sensor electrode; The control unit is a second threshold value corresponding to a capacitance at which an input can be confirmed in a state where the object is not in contact with the cover and which is greater than the first threshold value; 5. The touch screen according to claim 1, wherein when the capacitance detected by the detection unit becomes equal to or greater than the second threshold, an input to the GUI button corresponding to the sensor electrode that detected the maximum capacitance is confirmed.

Images