Input device

Abstract

Provided is an input device exhibiting an operability that is improved by enabling visual recognition of the distance between a sensor surface and a finger in non-contact inputting.　The input device includes: a display unit which is disposed on the back side of a sensor surface and is capable of displaying an aerial image on the front side of the sensor surface; a detection unit which is a position detection unit for detecting the position of a finger facing the sensor surface and which detects the position of the finger in biaxial directions included in the sensor surface and the distance between the sensor surface and the finger; and a control unit which controls, on the basis of the detected position and distance, the aerial image to be displayed on the display unit. The aerial image includes: a prescribed GUI operation unit; a first cursor displayed at the detected position; a second cursor displayed to overlap with the GUI operation unit; and a link connecting the first cursor and the second cursor. The control unit changes the thickness of the link in accordance with the detected distance.

Description

Input Devices

[0001] The present disclosure relates to an input device.

[0002] Conventionally, there has been an information processing device that includes a detection unit that detects the proximity of an operating object and a control unit that controls a display on a display surface as feedback for the proximity detected by the detection unit, and that enables non-contact input to the display surface. The control unit displays a predetermined cursor (predetermined display) between a finger position cursor that is displayed at a finger position on the display surface corresponding to the proximity coordinates and a button (see, for example, Patent Document 1).

[0003] JP 2012-058920 A

[0004] However, when performing contactless input, the position where the user intends to point the finger may differ from the position of the finger detected by the device due to the influence of parallax, etc. In particular, when performing contactless input, it is difficult to grasp the distance between the display surface (sensor surface) and the finger, but conventional information processing devices do not perform display control according to changes in the distance between the display surface (sensor surface) and the finger.

[0005] Therefore, an object of the present invention is to provide an input device that improves operability by making it possible to visually grasp the distance between the sensor surface and the finger in non-contact input.

[0006] An input device according to an embodiment of the present disclosure includes a display unit arranged on the back side of a sensor surface and capable of displaying an aerial image on the front side of the sensor surface; a position detection unit that detects the position of a finger facing the sensor surface, the detection unit detecting the position of the finger in two axial directions included in the sensor surface and the distance between the sensor surface and the finger; and a control unit that controls the aerial image to be displayed on the display unit based on the detected position and distance, wherein the aerial image includes a predetermined GUI operation unit, a first cursor displayed at the detected position, a second cursor displayed superimposed on the GUI operation unit, and a link connecting the first cursor and the second cursor, and the control unit changes the thickness of the link according to the detected distance.

[0007] By making it possible to visually grasp the distance between the sensor surface and the finger in non-contact input, it is possible to provide an input device with improved operability.

[0008] FIG. 1 is a cross-sectional view showing an example of a configuration of an input device according to an embodiment of the present disclosure. FIG. 2 is a diagram showing an example of a specific configuration of an input device according to an embodiment of the present disclosure. FIG. 3 is a diagram showing an example of a threshold value for distance state determination. FIG. 4 is a diagram showing a specific operation example (part 1) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 5 is a diagram showing a specific operation example (part 1) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 6 is a diagram showing a specific operation example (part 1) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 7 is a diagram showing a specific operation example (part 1) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 8 is a diagram showing a specific operation example (part 2) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 9 is a diagram showing a specific operation example (part 2) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 10 is a diagram showing a specific operation example (part 3) in a selection state of an input device according to an embodiment of the present disclosure. FIG. 11 is a diagram showing a specific operation example (part 3) in a selection state of an input device according to an embodiment of the present disclosure. 10A and 10B are diagrams illustrating a specific operation example (part 3) in a selection state of the input device according to the embodiment of the present disclosure.

[0009] Hereinafter, an embodiment to which the input device of the present disclosure is applied will be described.

[0010] 1 is a cross-sectional view showing an example of the configuration of an input device 100 according to an embodiment of the present disclosure. The input device 100 of this embodiment includes a light source 110, a light guide plate 120, a polarizing beam splitter 130, a λ / 4 plate 140, a retroreflective member 150, an electrostatic sensor 160, and a control unit 170.

[0011] The light source 110, the light guide plate 120, the polarizing beam splitter 130, the λ / 4 plate 140, and the retroreflective member 150 are an example of a display unit. The electrostatic sensor 160 is an example of a detection unit. These components are housed in, for example, a rectangular parallelepiped housing or enclosure.

[0012] The light source 110 is controlled by the control unit 170 to emit light A with a constant emission angle (or directional angle) in the X direction. The emitted light A enters the transparent light guide plate 120 from the side 122 thereof and uniformly illuminates the interior of the light guide plate 120. The light source 110 is not particularly limited, and may be, for example, a light-emitting diode or a laser diode. If the side 122 of the light guide plate 120 has a constant length in the Y direction, multiple light sources 110 may be arranged along the side 122 of the light guide plate 120 in the Y direction. Here, light is incident from one side of the light guide plate 120, but light may be incident from multiple sides.

[0013] The light guide plate 120 is a transparent, plate-shaped optical member having a flat upper surface, a flat lower surface, and side surfaces connecting the upper and lower surfaces. Known materials can be used for the light guide plate 120, such as an acrylic plastic plate, polycarbonate resin, or cycloolefin resin. The light guide plate 120 has a certain thickness in the Z direction so that light A from the light source 110 is incident from the side 122. A diffusion pattern for diffusing the incident light may be formed on the bottom 124 or the bottom surface of the light guide plate 120, for example, a dot pattern formed by laser processing or printing. In this way, light A incident from the side 122 of the light guide plate 120 is diffused or scattered by the diffusion pattern on the bottom 124 of the light guide plate 120, and the light guide plate 120 functions as a surface light source.

[0014] A light guide plate image 126 is further formed on the bottom 124 or bottom surface of the light guide plate 120 as an original image P1 of the aerial image. The method for forming the light guide plate image 126 is not particularly limited, but for example, a two-dimensional image such as grooves or unevenness may be formed on the bottom 124 by laser processing, embossing, printing, or the like. When light A is incident from the side of the light guide plate 120, the light A is reflected by the light guide plate image 126, and the two-dimensional original image P1 is generated. Note that if it is desired to increase the brightness of the light guide plate image 126, the degree of diffusion or scattering of the bottom 124 in areas other than the light guide plate image 126 may be reduced.

[0015] A polarizing beam splitter 130 is disposed above the light guide plate 120 in parallel thereto. The polarizing beam splitter 130 is a polarization separation element that can split incident light into p-polarized and s-polarized components and can transmit light components that are linearly polarized in a specific direction. If light A incident from the light source 110 is unpolarized light containing various polarization components, a portion of the light A1 reflected by the bottom 124 or the light guide plate image 126 of the light guide plate 120 will be transmitted through the polarizing beam splitter 130, while the remaining light A2 will be reflected by the polarizing beam splitter 130. If the light A incident from the light source 110 is linearly polarized, the direction of the linear polarization transmitted by the polarizing beam splitter 130 is set to be different from the direction of the linear polarization of the incident light A, so that most of the light A1 will be reflected by the polarizing beam splitter 130.

[0016] The λ / 4 plate 140 is disposed below and parallel to the light guide plate 120. The λ / 4 plate 140 receives the light A2 emitted from the light guide plate 120 and transmits the incident light A2 by imparting a phase difference of π / 2 (90 degrees) to the incident light A2. For example, if linearly polarized light is incident, it is converted into circularly polarized light (or elliptically polarized light), and if circularly polarized light (or elliptically polarized light) is incident, it is converted into linearly polarized light.

[0017] The retroreflective member 150 is disposed below and parallel to the λ / 4 plate 140. The retroreflective member 150 reflects light A2 that has passed through the λ / 4 plate 140 as light A3 in the same direction as the incident light. The structure and material of the retroreflective member 150 are not particularly limited as long as it can reflect light in the same direction as the incident direction. The retroreflective member 150 is configured, for example, by a prism-type retroreflective element such as a triangular pyramid-type retroreflective element or a full cube-corner-type retroreflective element, or a bead-type retroreflective element.

[0018] Light A3 reflected by the retroreflective member 150 is given a phase difference of π / 2 when it again passes through the λ / 4 plate 140. Therefore, light A3 transmitted through the λ / 4 plate 140 has a phase difference of π with light A2 when it entered the λ / 4 plate 140. For example, if the light incident on the λ / 4 plate 140 is linearly polarized, it becomes circularly polarized (or elliptically polarized) when it passes through the λ / 4 plate 140. This circularly polarized light becomes circularly polarized in the opposite direction when retroreflected an odd number of times by the retroreflective member 150, and when this reverse circularly polarized light passes through the λ / 4 plate 140, it becomes linearly polarized in a direction 180 degrees different from the original linearly polarized light. In this way, when light A3 transmitted through the λ / 4 plate 140 enters the polarizing beam splitter 130, most of the light A3 passes through the polarizing beam splitter 130.

[0019] An electrostatic sensor 160 is disposed above the polarizing beam splitter 130. The electrostatic sensor 160 has a surface member made of, for example, glass or plastic on its outermost surface, the upper surface of which is a sensor surface 160A. The electrostatic sensor 160 protects the surface of the polarizing beam splitter 130. The electrostatic sensor 160 is transparent, and light A3 transmitted through the electrostatic sensor 160 forms an image in the air, allowing the observer to view an aerial image I in front of their eyes at viewpoint U. The aerial image I becomes an image P2 in which the original image P1 of the light guide plate image 126 is floated upward in the same orientation. In other words, the aerial image I is displayed at a position symmetrical to the light guide plate image 126 with respect to the surface of the polarizing beam splitter 130, allowing the observer to view an image P2 that is a front view of the original image P1.

[0020] The electrostatic sensor 160 is disposed on the polarization beam splitter 130. The upper surface of the electrostatic sensor 160 is a sensor surface 160A. As an example, the electrostatic sensor 160 has electrodes made up of multiple transparent conductors extending in the X and Y directions, and detects the position of a finger facing the sensor surface 160A by detecting a change in capacitance in an area where a conductor such as a user's finger is in proximity. The electrostatic sensor 160 detects the position of the finger in two axial directions (X and Y directions) included in the sensor surface 160A, and the distance between the sensor surface 160A and the finger.

[0021] When a user holds finger F over aerial image I, electrostatic sensor 160 detects the proximity of the finger to aerial image I and outputs the detection result to control unit 170. This allows the user to perform contactless input. For example, this allows for cleaner and more hygienic input compared to input buttons that can be touched by unspecified people.

[0022] The input device 100 can be applied to any user input, such as a computer device, an in-vehicle electronic device, an ATM at a bank, a ticket machine at a station, an elevator input button, and the like.

[0023] Here, we will explain a form in which the input device 100 includes the electrostatic sensor 160, but instead of the electrostatic sensor 160, the input device 100 may also be a sensor that uses, for example, infrared rays or the like to detect the position of the finger in two axial directions (X direction and Y direction) included in the sensor surface 160A and the distance between the sensor surface 160A and the finger.

[0024] Control unit 170 controls light source 110 to control the display of aerial image I, and also controls the display of a cursor and the like according to the position and distance of the finger (distance in the Z direction from sensor surface 160A) detected by electrostatic sensor 160. Control unit 170 also accepts an input operation performed by finger F according to the position and distance of the finger detected by electrostatic sensor 160.

[0025] 2A is a diagram showing an example of a specific configuration of the input device 100. In Fig. 2A, the light source 110, the light guide plate 120, the polarizing beam splitter 130, and the λ / 4 plate 140 are shown in a simplified manner, and the control unit 170 is omitted.

[0026] 2A shows a detection area 180A, a display surface 180S, and a plurality of GUI operation units 181. The detection area 180A is a three-dimensional area above the electrostatic sensor 160 where the electrostatic sensor 160 can detect the position of the finger F in the X and Y directions and the distance from the sensor surface 160A in the Z direction. The detection area 180A is a three-dimensional area that has the same size as the light source 110, the light guide plate 120, the polarizing beam splitter 130, the λ / 4 plate 140, and the electrostatic sensor 160 in the X and Y directions, and extends a predetermined distance in the Z direction from the sensor surface 160A.

[0027] Display surface 180S is a plane on which aerial image I (see FIG. 1) is displayed. Display surface 180S has the same size in the X and Y directions as light source 110, light guide plate 120, polarizing beam splitter 130, λ / 4 plate 140, and electrostatic sensor 160, and is spaced a predetermined distance in the +Z direction from sensor surface 160A in the Z direction. In FIG. 2A , GUI operation unit 181 and first cursor 191 are displayed as aerial image I on display surface 180S.

[0028] The first cursor 191 is displayed on the display surface 180S so as to be positioned at the position (position in the X direction and Y direction) of the finger F detected by the electrostatic sensor 160. The display control of such a first cursor is performed by the control unit 170.

[0029] Furthermore, the distance L1 in the Z direction of the detection area 180A corresponds to a selection distance at which a selection operation for selecting one of the plurality of GUI operation units 181 can be performed with the finger F. The distance L1 is the distance from the sensor surface 160A to the end of the detection area 180A on the +Z direction side.

[0030] Further, the distance L2 from the sensor surface 160A to the display surface 180S corresponds to a decision distance at which the finger F can perform a decision operation to decide on an operation on one of the plurality of GUI operation units 181.

[0031] To distinguish between a selection operation and a decision operation, the input device 100 determines three distance states between the finger F and the sensor surface 160A. The three distance states are a non-detection state, a selection state, and a decision state.

[0032] The non-detection state is a state in which neither a selection operation nor a decision operation is being performed. The selection state and decision state are states in which a selection operation and a decision operation are being performed, respectively. The input device 100 uses a plurality of capacitance thresholds when determining the operation method. As the state transitions from the decision state to the selection state and from the non-detection state to the non-detection state, the position of the indicator, such as a hand, moves away from the sensor surface 160A.

[0033] 2B is a diagram showing an example of threshold values ​​for determining the distance state, which are the non-detection state, the selection state, and the decision state.

[0034] 2B shows the on threshold and off threshold for each of the three distance states. The on threshold is a threshold used to determine whether or not a distance state exists, and when the maximum capacitance detected by the electrostatic sensor 160 exceeds the on threshold, the distance state becomes the distance state of that on threshold. The off threshold is a threshold used to determine whether or not a distance state does not exist, and when the maximum capacitance detected by the electrostatic sensor 160 becomes equal to or smaller than the off threshold, the distance state does not exist.

[0035] For the selected and determined states, the on-threshold is set to a capacitance greater than the off-threshold, and hysteresis is provided to stabilize the distance state. That is, hysteresis is provided for the selected distance and determined distance.

[0036] For the non-detection state, no on-threshold or off-threshold is set. For the selected state, the on-threshold is 103 and the off-threshold is 88. For the determined state, the on-threshold is 273 and the off-threshold is 226. These values ​​are obtained by converting the capacitance detected by the electrostatic sensor 160 into digital count values.

[0037] The ON threshold and OFF threshold are set so that the ranges between the ON threshold and OFF threshold for the selected state and the determined state do not overlap with each other. Note that the selected distance L1 shown in Figure 2A is, as an example, a distance equivalent to the ON threshold for the selected state, and the determined distance L2 is a distance equivalent to the ON threshold for the determined state.

[0038] 3A to 3E are diagrams showing a specific example (part 1) of the operation of the input device 100 in the selected state. In FIGS. 3A to 3E, the light source 110, the light guide plate 120, the polarizing beam splitter 130, and the λ / 4 plate 140 are shown in a simplified form, and the control unit 170 and the detection area 180A are omitted.

[0039] Here, a description will be given of first cursor 191, second cursor 192, link 193, etc., which are displayed by control unit 170 controlling light source 110. When the distance detected by electrostatic sensor 160 is equal to or less than the selected distance, control unit 170 causes first cursor 191, second cursor 192, and link 193 to be displayed as aerial image I on the display unit.

[0040] FIG. 3A shows a first cursor 191, a second cursor 192, and a link 193.

[0041] The first cursor 191 is a cursor displayed at the position (position in the X and Y directions) of the finger F detected by the electrostatic sensor 160. In FIG. 3A , as an example, the first cursor 191 has an arrow shape. The arrow points toward the GUI operation unit 181 that is closest to the position of the finger F, and indicates the direction of the GUI operation unit 181 that is closest to the position of the finger F. In addition, the circle at the center of the first cursor 191 represents the position (position in the X and Y directions) of the finger F.

[0042] The second cursor 192 is a cursor that is displayed superimposed on the GUI operation unit 181 that is closest to the position of the finger F. In Fig. 3A, the second cursor 192 is circular, for example.

[0043] The link 193 is a linear display connecting the first cursor 191 and the second cursor 192. When the position of the finger F is not inside the GUI operation unit 181, the link 193 indicates the direction and distance in which the finger F should be moved toward the nearest GUI operation unit 181, and guides the finger F to the nearest GUI operation unit 181.

[0044] When the finger F moves into the GUI operation section 181, the second cursor 192 and the link 193 are hidden.

[0045] In Fig. 3B, finger F has moved from the position indicated by the dashed line to the position indicated by the solid line. The position of finger F indicated by the dashed line in Fig. 3B is the same as the position of finger F shown in Fig. 3A. Fig. 3B shows a state in which finger F has moved from the position of finger F shown in Fig. 3A and passed the position of the nearest GUI operation unit 181. If the nearest GUI operation unit 181 does not change even when finger F has passed the position of the nearest GUI operation unit 181, link 193 guides to the same GUI operation unit 181 as before the movement.

[0046] In Fig. 3C , finger F has moved from the position indicated by the dashed line to the position indicated by the solid line. The position of finger F indicated by the dashed line in Fig. 3C is the same as the position of finger F indicated by the solid line in Fig. 3B. Fig. 3C shows a state in which finger F has moved from the position of finger F shown in Fig. 3B and the closest GUI operation unit 181 has changed. When the closest GUI operation unit 181 changes, second cursor 192 moves to the center of the new closest GUI operation unit 181, and link 193 guides to the new closest GUI operation unit 181.

[0047] In Figure 3D, the difference between the first distance L11 between the detected position and the GUI operation unit 181 (first GUI operation unit) that is closest to the detected position among the multiple GUI operation units 181, and the second distance L12 between the detected position and the GUI operation unit 181 (second GUI operation unit) that is second closest to the detected position is less than a third predetermined distance. In this case, the control unit 170 causes the display unit to display two second cursors 192: a second cursor 192 displayed superimposed on the GUI operation unit 181 (first GUI operation unit), and a second cursor 192 displayed superimposed on the GUI operation unit 181 (second GUI operation unit); and causes the display unit to display, as links 193, a link 193 (first link) connecting the second cursor 192 displayed superimposed on the GUI operation unit 181 (first GUI operation unit) to the first cursor 191, and a link 193 (second link) connecting the second cursor 192 displayed superimposed on the GUI operation unit 181 (second GUI operation unit) to the first cursor 191. If the position of the finger F is close to both the first GUI operation unit 181 and the second GUI operation unit 181 and the distances therebetween are equal, and if the link 193 is displayed only on the closest of the first GUI operation unit 181 and the second GUI operation unit 181, there is a risk that the display of the link 193 will frequently change, resulting in an unstable display, when the closest GUI operation unit 181 changes as the finger F moves. By displaying the link 193 (the first link 193 and the second link 193) on both the first GUI operation unit 181 and the second GUI operation unit 181, it is possible to stably display the first GUI operation unit 181 and the second GUI operation unit 181 that are close to the position of the finger F.

[0048] 3E, the finger F has moved from the position indicated by the dashed line to the position indicated by the solid line, and the finger F has come closer to the sensor surface 160 A. The position of the finger F indicated by the dashed line in FIG. 3E is the same as the position of the finger F shown in FIG. 3A.

[0049] As the finger F approaches the sensor surface 160A, the thickness of the link 193 increases. The control unit 170 changes the thickness of the link 193 according to the distance between the finger F and the sensor surface 160A detected by the electrostatic sensor 160. Here, as an example, a configuration will be described in which the thickness of the link 193 increases as the finger F approaches the sensor surface 160A, but the opposite may also be true.

[0050] 4A to 4C are diagrams showing a specific example (part 2) of the operation of the input device 100 in the selected state. In FIGS. 4A to 4C, the light source 110, the light guide plate 120, the polarizing beam splitter 130, and the λ / 4 plate 140 are shown in a simplified form, and the control unit 170 and the detection area 180A are omitted.

[0051] 4A , the distance detected by the electrostatic sensor 160 is equal to or less than the selected distance and longer than the determined distance, which is shorter than the selected distance, and the control unit 170 makes the thickness of the first connection portion 193A of the link 193 with the first cursor 191 equal to the thickness of the first cursor 191, and makes the thickness of the second connection portion 193B of the link 193 with the second cursor 192 thinner than the thickness of the second cursor 192. The user can visually recognize that the distance is now equal to or less than the selected distance by the display of the link 193, and can visually recognize the distance between the finger F and the sensor surface 160A by the change in the thickness of the first connection portion 193A and the second connection portion 193B.

[0052] 4B, the distance between the finger F and the sensor surface 160A is shorter than in FIG. 4A, so the control unit 170 makes the thickness of the first connection portion 193A equal to the thickness of the first cursor 191 and makes the thickness of the second connection portion 193B thicker than in FIG. 4A. Because the second connection portion 193B is thicker, the user can visually recognize that the finger F is getting closer to the sensor surface 160A.

[0053] 4C , the distance between the finger F and the sensor surface 160A has reached the determined distance. When the distance between the finger F and the sensor surface 160A reaches the determined distance, the control unit 170 makes the thickness of the first connection portion 193A equal to the thickness of the first cursor 191, and makes the thickness of the second connection portion 193B equal to the thickness of the second cursor 192. When the thickness of the second connection portion 193B becomes equal to that of the second cursor 192, the user can visually recognize that the finger F has reached the determined distance.

[0054] 5A to 5D are diagrams showing a specific example (part 3) of the operation of the input device 100 in the selected state. In Fig. 5A to 5D, the light source 110, the light guide plate 120, the polarizing beam splitter 130, and the λ / 4 plate 140 are shown in a simplified form, and the control unit 170 and the detection area 180A are omitted.

[0055] 5A , the distance between the finger F and the sensor surface 160A is equal to or less than a first predetermined distance, which is shorter than the decision distance. In such a case, the control unit 170 makes the thickness of the second connection portion 193B thicker than the thickness of the second cursor 192. The user can visually recognize that the finger F has come too close to the sensor surface 160A when the thickness of the second connection portion 193B becomes thicker than the second cursor 192. The first predetermined distance is a distance corresponding to a capacitance greater than the on-threshold for the decision state.

[0056] 5B , the position of finger F is within GUI operation unit 181, and the distance between finger F and sensor surface 160A is exactly the decision distance. In this state, control unit 170 hides second cursor 192 and link 193. When second cursor 192 and link 193 are no longer hidden, the user can visually recognize that the position of finger F has reached GUI operation unit 181.

[0057] 5C , the position of the finger F is within the GUI operation unit 181, so the second cursor 192 and the link 193 are hidden. When the distance between the finger F and the sensor surface 160A becomes equal to or shorter than a first predetermined distance that is shorter than the determination distance while the finger F is within the GUI operation unit 181, the control unit 170 displays a plus mark 194 superimposed on the GUI operation unit 181 that is closest to the position of the finger F. The first predetermined distance is the distance from the sensor surface 160A in the Z direction. The hiding of the second cursor 192 and the link 193 allows the user to visually recognize that the position of the finger F is within the GUI operation unit 181. Furthermore, the display of the plus mark 194 allows the user to visually recognize that the finger F has come too close to the sensor surface 160A.

[0058] Furthermore, when the distance between the finger F and the sensor surface 160A is equal to or shorter than a first predetermined distance, the displayed plus mark 194 may become larger. The size of the plus mark 194 allows the user to recognize that the finger F is too close. Note that an ON threshold and an OFF threshold may also be set for a first predetermined distance that is shorter than the determined distance, and hysteresis may be provided by setting the ON threshold for the first predetermined distance to a capacitance greater than the OFF threshold.

[0059] 5D , the distance between the position of first cursor 191 and the position of second cursor 192 is equal to or greater than a second predetermined distance. The second predetermined distance is a distance in the XY plane, and is, for example, a distance equivalent to two-thirds of the length of the side of sensor surface 160A in the X or Y direction. When the distance between first cursor 191 and second cursor 192 is equal to or greater than the second predetermined distance, control unit 170 hides the section of link 193 between first connection portion 193A with first cursor 191 and second connection portion 193B with second cursor 192. When the distance between first cursor 191 and second cursor 192 is long, hiding the middle of link 193 can ensure good visibility of GUI operation unit 181 and the like. Instead of hiding the section between the first connection portion 193A and the second connection portion 193B, a dashed line may be used to connect the section, or the section between the first connection portion 193A and the second connection portion 193B may be partially displayed by increasing the transmittance, etc.

[0060] Although parts 1 to 3 of specific operation examples of the input device 100 have been described above using FIGS. 3A to 5D, various other methods may be used to notify the user of the operation state.

[0061] For example, the first cursor 191, the second cursor 192, and the link 193 are not limited to the shapes shown in FIGS. 3A to 5D, and various shapes, transmittances, colors, and the like may be used.

[0062] From the viewpoint of improving the visibility of the image, the second cursor 192 may be in a form in which the outline of the GUI operation unit 181 is highlighted with a line, color, or the like.

[0063] The first cursor 191 may be circular or have a shape including an axis of symmetry whose center can be estimated, and the center may correspond to the position of the finger F.

[0064] When the non-detection state is changed to the selection state, the second cursor 192 may be displayed, and the color of the second cursor 192 may be changed or the second cursor 192 may be made to blink.

[0065] When various displays are made using the first cursor 191, the second cursor 192, and the link 193, sound feedback may also be used in combination.

[0066] <Effects> The input device 100 includes a display unit (light source 110, light guide plate 120, polarizing beam splitter 130, λ / 4 plate 140, and retroreflective member 150) that is arranged on the back side of the sensor surface 160A and is capable of displaying an aerial image I on the front side of the sensor surface 160A, a detection unit (electrostatic sensor 160) that detects the position of a finger facing the sensor surface 160A, the detection unit (electrostatic sensor 160) detecting the position of the finger in two axial directions included in the sensor surface 160A and the distance between the sensor surface 160A and the finger, and a control unit 170 that controls the aerial image I to be displayed on the display unit based on the detected position and distance, and the aerial image I includes a predetermined GUI operation unit 181, a first cursor 191 that is displayed at the detected position, a second cursor 192 that is displayed superimposed on the GUI operation unit 181, and a link 193 that connects the first cursor 191 and the second cursor 192, and the control unit 170 changes the thickness of the link 193 according to the detected distance. Therefore, the user can visually grasp the distance between the sensor surface 160A and the finger F from the thickness of the link 193.

[0067] Therefore, it is possible to provide an input device 100 with improved operability by making it possible to visually grasp the distance between the sensor surface 160A and the finger F in non-contact input.

[0068] In addition, when the detected distance is less than or equal to the selected distance, the control unit 170 displays the first cursor 191, the second cursor 192, and the link 193 as an aerial image I on the display unit; when the detected distance is less than or equal to the selected distance and longer than a determined distance which is shorter than the selected distance, the control unit 170 makes the thickness of the first connection portion 193A of the link 193 with the first cursor 191 equal to the thickness of the first cursor 191, and makes the thickness of the second connection portion 193B of the link 193 with the second cursor 192 thinner than the thickness of the second cursor 192; and when the detected distance becomes the determined distance, the control unit 170 makes the thickness of the first connection portion 193A of the link 193 equal to the thickness of the first cursor 191, and makes the thickness of the second connection portion 193B of the link 193 equal to the thickness of the second cursor 192. The user can visually recognize that the distance is below the selected distance by the display of link 193, and can visually recognize whether the determined distance has been reached by the change in thickness of first connecting portion 193A and second connecting portion 193B, thereby providing an input device 100 with good operability for non-contact input.

[0069] Furthermore, when the detected distance becomes equal to or less than a first predetermined distance that is shorter than the decision distance, the control unit 170 may make the thickness of the second connection portion 193B of the link 193 thicker than the thickness of the second cursor 192. The user can visually recognize that the finger F has come too close to the sensor surface 160A from the change in the thickness of the second connection portion 193B, and the input device 100 can be provided with good operability for non-contact input.

[0070] Furthermore, when first cursor 191 is within the display area of ​​GUI operation unit 181 and the detected distance becomes equal to or less than the determined distance, control unit 170 may determine to operate GUI operation unit 181. The user can visually recognize the position of finger F on sensor surface 160A from changes in the thickness of first connection portion 193A and second connection portion 193B of link 193, and input device 100 with good operability of GUI operation unit 181 can be provided with non-contact input.

[0071] Furthermore, hysteresis may be provided for the selection distance and the decision distance, which can stabilize the state in which the selection operation and the decision operation are being performed.

[0072] Furthermore, the aerial image I may include a plurality of GUI operation units 181, and the control unit 170 may cause the display unit to display a second cursor 192 superimposed on a GUI operation unit 181 that is closest to the detected position among the plurality of GUI operation units 181. By visually checking the second cursor 192, the user can easily recognize the closest GUI operation unit 181, and an input device 100 can be provided that allows good operability of the GUI operation units 181 through non-contact input.

[0073] Furthermore, when the detected distance is the determined distance and the position of first cursor 191 enters the display area of ​​GUI operation unit 181, control unit 170 may hide second cursor 192 and link 193. When second cursor 192 and link 193 are hidden, the user can visually recognize that the position of finger F has reached GUI operation unit 181, and input device 100 with good operability of GUI operation unit 181 can be provided with non-contact input.

[0074] Furthermore, when the detected distance becomes equal to or shorter than a first predetermined distance, the control unit 170 may display a plus mark 194 on the GUI operation unit 181. The display of the plus mark 194 allows the user to visually recognize that the finger F has come too close to the sensor surface 160A, and the input device 100 can be provided with good operability for non-contact input.

[0075] Furthermore, when the detected distance is equal to or shorter than the first predetermined distance, the control unit 170 may display a larger plus mark 194. The user can visually recognize the degree to which the finger F is too close to the sensor surface 160A from the size of the plus mark 194, and the input device 100 can be provided with good operability for non-contact input.

[0076] Furthermore, when the distance between the position of first cursor 191 and the position of second cursor 192 is equal to or greater than a second predetermined distance, control unit 170 may hide or partially display the section of link 193 between first connection portion 193A with first cursor 191 and second connection portion 193B with second cursor 192. When the distance between first cursor 191 and second cursor 192 is long, hiding or partially displaying the middle of link 193 can ensure good visibility of GUI operation unit 181 and the like.

[0077] In addition, when the difference between the first distance between the detected position and a first GUI operation unit 181 among the multiple GUI operation units 181 that is closest to the detected position and a second distance between the detected position and a second GUI operation unit 181 that is second-closest to the detected position is equal to or less than a third predetermined distance, the control unit 170 may cause the display unit to display, as second cursors 192, two second cursors 192: a second cursor 192 displayed superimposed on the first GUI operation unit 181 and a second cursor 192 displayed superimposed on the second GUI operation unit 181; and may cause the display unit to display, as links 193, a first link 193 connecting the second cursor 192 displayed superimposed on the first GUI operation unit 181 and the first cursor 191, and a second link 193 connecting the second cursor 192 displayed superimposed on the second GUI operation unit 181 and the first cursor 191. If the position of the finger F is close to both the first GUI operation unit 181 and the second GUI operation unit 181 and the distances therebetween are equal, and if the link 193 is displayed only on the closest of the first GUI operation unit 181 and the second GUI operation unit 181, there is a risk that the display of the link 193 will frequently change, resulting in an unstable display, when the closest GUI operation unit 181 changes as the finger F moves. By displaying the link 193 (the first link 193 and the second link 193) on both the first GUI operation unit 181 and the second GUI operation unit 181, it is possible to stably display the first GUI operation unit 181 and the second GUI operation unit 181 that are close to the position of the finger F.

[0078] The above describes an input device according to an exemplary embodiment of the present disclosure, but the present disclosure is not limited to the specifically disclosed embodiment, and various modifications and variations are possible without departing from the scope of the claims.

[0079] This international application claims priority based on Japanese Patent Application No. 2023-219269, filed on December 26, 2023, the entire contents of which are incorporated herein by reference.

[0080] 100 Input device 110 Light source (the light source 110, light guide plate 120, polarizing beam splitter 130, λ / 4 plate 140, and retroreflective member 150 are an example of a display unit) 120 Light guide plate 130 Polarizing beam splitter 140 λ / 4 plate 150 Retroreflective member 160 Electrostatic sensor (an example of a detection unit) 170 Control unit 180S Display surface 180A Detection area 181 GUI operation unit 191 First cursor 192 Second cursor 193 Link 193A First connection unit 193B Second connection unit

Claims

1. A display unit disposed on the back side of the sensor surface and capable of displaying an aerial image on the front side of the sensor surface; a position detection unit that detects the position of a finger facing the sensor surface, the detection unit detecting the position of the finger in two axial directions included in the sensor surface and the distance between the sensor surface and the finger; and a control unit that controls the aerial image to be displayed on the display unit based on the detected position and distance. The aerial image includes a predetermined GUI operation unit, a first cursor displayed at the detected position, a second cursor displayed overlapping the GUI operation unit, and a link connecting the first cursor and the second cursor. The control unit is an input device that changes the thickness of the link according to the detected distance.

2. When the detected distance is equal to or less than a selection distance, the control unit causes the first cursor, the second cursor, and the link to be displayed as the aerial image on the display unit. When the detected distance is equal to or less than the selection distance and longer than a determination distance shorter than the selection distance, the thickness of the first connection portion of the link with the first cursor is made equal to the thickness of the first cursor, and the thickness of the second connection portion of the link with the second cursor is made thinner than the thickness of the second cursor. When the detected distance reaches the determination distance, the thickness of the first connection portion of the link is made equal to the thickness of the first cursor, and the thickness of the second connection portion of the link is made equal to the thickness of the second cursor. The input device according to claim 1.

3. When the detected distance is equal to or less than a first predetermined distance shorter than the determination distance, the control unit makes the thickness of the second connection portion of the link thicker than the thickness of the second cursor. The input device according to claim 2.

4. When the first cursor is within the display area of the GUI operation unit and the detected distance is equal to or less than the determination distance, the control unit determines an operation on the GUI operation unit. The input device according to claim 2 or 3.

5. Hysteresis is provided for the selection distance and the determination distance. The input device according to any one of claims 2 to 4.

6. When the detected distance is equal to or less than the determined distance and longer than a first predetermined distance shorter than the determined distance, and when the position of the first cursor enters the display area of the GUI operation unit, the control unit hides the second cursor and the link. The input device according to any one of claims 2 to 5.

7. When the detected distance becomes equal to or less than the first predetermined distance, the control unit displays a plus mark on the GUI operation unit. The input device according to claim 6.

8. When the detected distance is equal to or less than the first predetermined distance, the control unit displays the plus mark larger as the detected distance becomes shorter. The input device according to claim 7.

9. The aerial image includes a plurality of the GUI operation units. The control unit causes the display unit to display the second cursor superimposed on the GUI operation unit closest to the detected position among the plurality of GUI operation units. The input device according to any one of claims 1 to 8.

10. Among the plurality of GUI operation units, the control unit calculates the difference between a first distance between the detected position and the first GUI operation unit closest to the detected position and a second distance between the detected position and the second GUI operation unit second closest to the detected position. When the difference is equal to or less than a third predetermined distance, the control unit causes the display unit to display two second cursors, namely, a second cursor superimposed on the first GUI operation unit and a second cursor superimposed on the second GUI operation unit, as the second cursor, and causes the display unit to display, as the link, a first link connecting the second cursor superimposed on the first GUI operation unit and the first cursor and a second link connecting the second cursor superimposed on the second GUI operation unit and the first cursor. The input device according to claim 9.

11. When the distance between the position of the first cursor and the position of the second cursor is equal to or more than a second predetermined distance, the control unit hides or partially displays the section between the first connection portion of the link with the first cursor and the second connection portion of the link with the second cursor. The input device according to any one of claims 1 to 10.

Images