Input device and electronic apparatus

Abstract

An input device according to one embodiment of the present technology is provided with a mounting tool. The mounting tool has a support and a sensor unit. The support has an outer surface and an inner surface, and is configured to be mountable to a fingertip of a user. The sensor unit is disposed on the outer surface or the inner surface of the support, and is configured to be capable of detecting the distribution of pressure acting on the support.

Description

Input devices and electronic devices

[0001] The present technology relates to an input device and an electronic device equipped with a pressure distribution sensor.

[0002] In recent years, development of Augmented Reality (AR) / Mixed Reality (MR) technologies using, for example, Head Mounted Displays (HMDs) has been progressing. However, when a user performs input operations on objects or environments in a virtual space, conventional input devices unrelated to the virtual space, such as a mouse or keyboard, require procedures such as pointing or selecting an object using a cursor, which significantly reduces work efficiency compared to operations in the real space.

[0003] Therefore, a method has been proposed to improve input operations by holding a wireless controller equipped with an IMU (Inertial Measurement Unit) or multiple buttons in one or both hands. However, while this method makes it possible to comfortably perform operations such as pointing at a target object, there are problems such as many input operations that cannot be performed by holding the controller in the hand (such as pressing a button in a virtual space), and the controller in the hand can hinder the sense of immersion.

[0004] On the other hand, a method has been proposed in which the user's hands are tracked using a camera on the HMD or a fixed camera placed in the operation space, and virtual UI elements such as virtual buttons, sliders, and knobs displayed in the user's field of view are operated using a ``virtual space hand'' synchronized with the user's real hand.

[0005] JP 2018-014119 A JP 2001-265522 A

[0006] However, problems with camera tracking accuracy and latency can lead to misalignment between the real user's hand and the virtual hand. Also, objects in the real environment can obscure the real user's hand from the camera's field of view (occlusion). Furthermore, because cameras cannot detect the pressure, torque, and other factors exerted by a real user when operating virtual UI elements, the feel of the virtual UI element is inferior to that of real UI elements.

[0007] In view of the above circumstances, an object of the present technology is to provide an input device and an electronic device equipped with the same that can accurately detect the contact state between a real user's finger and a real object and gesture operations, thereby improving operability.

[0008] An input device according to one aspect of the present technology includes a wearing tool. The wearing tool includes a support and a sensor unit. The support has an outer surface and an inner surface and is configured to be wearable on a user's fingertip. The sensor unit is disposed on the outer surface or the inner surface of the support and is configured to be able to detect a distribution of pressure acting on the support.

[0009] The input device may further include a tactile sensation providing unit configured to provide a tactile sensation to the fingertip.

[0010] The tactile sense providing unit may have a balloon unit that is inflatable by the introduction of fluid pressure.

[0011] The tactile sense presentation unit may be disposed on an inner surface of the support body.

[0012] The tactile sense providing unit may include a vibration generating source capable of generating vibrations.

[0013] The input device may further include a drive unit having a control unit that generates a drive signal for driving the tactile sense providing unit based on the output of the sensor unit.

[0014] The sensor unit may be configured as an elastically deformable sensor sheet having a plurality of capacitance elements acting on the outer surface of the support, and the control unit may change the drive signal based on a change over time in the pressure detected by the plurality of capacitance elements.

[0015] The sensor sheet may have a sensor electrode layer in which the plurality of capacitance elements are arranged in a matrix, a reference electrode layer connected to a reference potential, and a deformation layer arranged between the sensor electrode layer and the reference electrode layer.

[0016] The sensor unit may further include a surface layer that covers the reference electrode layer.

[0017] The sensor electrode layer may be disposed between an outer surface of the support and the reference electrode layer.

[0018] The drive unit may further include a housing fixed to the support body, and the control unit may be housed in the housing.

[0019] The drive unit may further include a drive source housed in the housing portion that drives the tactile sense providing portion.

[0020] The input device may further include an auxiliary mounting member configured to be mountable on the user, and the drive unit may be attached to the auxiliary mounting member.

[0021] The sensor unit may be disposed opposite the pad of the fingertip.

[0022] The support may be formed in a ring shape having an outer circumferential surface which is the outer surface, and an inner circumferential surface which is the inner surface.

[0023] The support may be a metal member having a thickness of 1 mm or less and a width of 10 mm or less.

[0024] The mounting fixture may further include an adjustment portion that can adjust the inner diameter of the support body.

[0025] According to one embodiment of the present technology, an electronic device includes a display device configured to be wearable on a user's head and presenting a virtual object image displayed in real space to the user, and an input device configured to be wearable on the user's fingertip. The input device includes a wearing device, a tactile sense providing unit, and a drive unit. The wearing device includes a support having an outer surface and an inner surface and worn on the user's fingertip, and a sensor unit arranged along the outer surface or the inner surface of the support and configured to be capable of detecting a distribution of pressure acting on the support. The tactile sense providing unit is configured to provide a tactile sensation to the fingertip. The drive unit drives the tactile sense providing unit based on an output of the sensor unit.

[0026] 1A and 1B are schematic configuration diagrams showing a state in which an input device according to an embodiment of the present technology is worn by a user, where A is a plan view and B is a side view;

[0023] FIG. 1A is a schematic cross-sectional view showing a configuration example of the input device;

[0024] FIG. 1B is a development view of a plate material forming a support body in the input device;

[0025] FIG. 1C is a schematic side cross-sectional view showing a configuration example of a sensor unit in the input device;

[0026] FIG. 1D is a schematic plan view of a main part of the sensor unit;

[0027] FIG. 1E is an explanatory diagram of an electrode structure of a sensing unit in the sensor unit;

[0028] FIG. 1F is a block diagram showing a configuration of an information display system (electronic device) including the input device;

[0029] FIG. 1G is an explanatory diagram of an operation of the system;

[0030] FIG. 1H is an explanatory diagram of an operation of the system;

[0031] FIG. 1H is an explanatory diagram of an operation of the system;

[0032] FIG. 1H is an explanatory diagram of an operation of the system;

[0033] FIG. 1H is an explanatory diagram of an operation of the system;

[0034] FIG. 1H is a diagram showing a state in which an input device according to another embodiment of the present technology is worn by a user;

[0035] FIG. 1H is a diagram showing a state in which an input device according to yet another embodiment of the present technology is worn by a user;

[0027] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0028] 1A and 1B are schematic diagrams illustrating a state in which an input device 100 according to an embodiment of the present technology is worn by a user, in which A is a plan view and B is a side view. FIG. 2 is a schematic cross-sectional view illustrating the structure of the input device 100.

[0029] 1A and 1B, the input device 100 of this embodiment is configured to be wearable on a user's fingertip F. Here, an example is shown in which the input device 100 is worn on the index finger of the user's right hand, but the number of fingers on which the input device 100 is worn and the number of fingers on which the input device 100 is worn are not limited to this.

[0030] The input device 100 includes a wearing device 10 and a drive unit 20. The wearing device 10 is configured to be wearable on a user's fingertip F. In this embodiment, the drive unit 20 is attached integrally with the wearing device 10 and controls the driving of the wearing device 10.

[0031] [Worn Device] The worn device 10 has a support body 11 , a sensor unit 12 , and a tactile sense providing unit 13 .

[0032] 2, the wearing device 10 has a ring-shaped support 11 configured to be wearable on a fingertip F. The support 11 has an outer peripheral surface 11a which is the outer surface, and an inner peripheral surface 11b which is the inner surface, and is formed into a ring shape that can be worn on the fingertip F of a user.

[0033] As shown in FIG. 3 , the support 11 is formed by bending a metal plate 11s having a length L and a width W along its circumferential direction into a ring shape. The dimensions of L and W are not particularly limited, and in this embodiment, L is 40 mm to 50 mm, and W is 5 mm to 10 mm. The thickness of the metal plate 11s is also not particularly limited, and is typically 1 mm or less, and in this embodiment, it is approximately 100 μm. The metal material forming the support 11 is also not particularly limited, and in this embodiment, it is stainless steel. Note that the support 11 is not limited to being made of a metal material, and may be made of an insulating material such as a synthetic resin or ceramics.

[0034] Both ends of the support body 11 in the longitudinal direction have a fixed portion 11c that supports a housing portion 26 of the drive unit 20 (described later) and an adjustment portion 11d that adjusts the inner diameter of the support body 11. The fixed portion 11c is formed so as to be folded outward in the tangential direction of the outer surface 11a, for example. The adjustment portion 11d is formed so as to be folded outward in the diameter direction of the support body 11.

[0035] The adjustment unit 11d adjusts the inner diameter of the support body 11 by deforming the support body 11 so as to move closer to or away from the fixed unit 11c. An adjustment tool 11e, such as an elastic part such as an elastic ring or spring or a buckle mechanism, is attached between the fixed unit 11c and the adjustment unit 11d or between the adjustment unit 11d and the housing 26, so that the support body 11 can be adjusted to a predetermined inner diameter. In this embodiment, the wearing device 10 is attached near the first joint of the fingertip F.

[0036] (Sensor Unit) The sensor unit 12 is disposed along the outer peripheral surface 11a of the support body 11 and is configured to be able to detect the distribution of pressure acting on the outer peripheral surface 11a of the support body 11. The sensor unit 12 is configured of an elastically deformable sensor sheet attached so as to cover a predetermined area of ​​the outer surface 11a of the support body 11 excluding the fixed portion 11c and the adjustment portion 11d.

[0037] In this embodiment, the sensor unit 12 is disposed facing the area (excluding the nail) corresponding to the pad and both sides of the fingertip F. For example, as shown in Fig. 2, the sensor unit 12 is disposed over an angular range of about 200 degrees (the range of angle θ in Fig. 2) from the center of the fingertip.

[0038] 4 is a schematic side cross-sectional view showing the cross-sectional structure of a sensor sheet 120, which is one configuration example of the sensor unit 12. FIG. 5 is a schematic plan view showing a sensor electrode layer 122 in the sensor sheet 120.

[0039] 4 and 5, the x-axis and y-axis directions are parallel to the pressure detection surface S of the sensor sheet 120 (hereinafter also referred to as the in-plane direction), and the z-axis direction is perpendicular to the pressure detection surface S (hereinafter also referred to as the vertical direction). In Fig. 4, the upper side corresponds to the outer periphery of the wearing device 10 to which an external force is applied, and the lower side corresponds to the opposite inner periphery of the wearing device 10 (support body 11 side). The pressure detection surface S corresponds to the outer periphery of the wearing device 10.

[0040] The sensor sheet 120 as a whole has a rectangular flat plate shape in a plan view that is elongated in the circumferential direction of the support body 11. As shown in Fig. 4, the sensor sheet 120 is composed of a laminate that has a pressure sensor 121, a surface layer 123 disposed on the upper surface of the pressure sensor 121, and a support layer 124 disposed between the lower surface of the pressure sensor 121 and the outer peripheral surface 11a of the support body 11.

[0041] The pressure sensor 121 includes a sensor electrode layer 122 , a reference electrode layer 125 , and a deformation layer 127 disposed between the sensor electrode layer 122 and the reference electrode layer 125 .

[0042] The sensor electrode layer 122 is disposed between the outer peripheral surface 11a of the support 11 and the reference electrode layer 125. The sensor electrode layer 122 is configured by a flexible printed circuit board or the like. As shown in Fig. 5 , the sensor electrode layer 122 has a main body portion 122a that is rectangular in plan view and an extension portion 122b that extends outward from the main body portion 122a. A sensing portion 128, which will be described later, is provided in the main body portion 122a, and a connector part 70 that is connected to the control portion 21 of the drive unit 20 via a wiring cable 21a (see Fig. 2) is mounted on the tip of the extension portion 122b.

[0043] The sensor electrode layer 122 has a flexible substrate 129 and a plurality of sensing units 128 provided on the surface of the substrate 129 or inside the substrate 129. Examples of materials that can be used for the substrate 129 include polymer resins such as polyethylene terephthalate, polyimide, polycarbonate, and acrylic resin. The sensing units 128 are regularly arranged in a matrix at predetermined intervals in both the vertical and horizontal directions (vertical: y-axis direction, horizontal: x-axis direction). The thickness of the sensor electrode layer 122 is, for example, 100 μm to 300 μm, and is 125 μm in this embodiment.

[0044] The sensing unit 128 is composed of a plurality of capacitive elements (detection elements) that can detect a change in distance from the reference electrode layer 125 as a change in capacitance. As shown in Fig. 6 , the sensing unit 128 includes a comb-shaped pulse electrode 281 and a comb-shaped sense electrode 282. The comb-shaped pulse electrode 281 and the comb-shaped sense electrode 282 are arranged so that their teeth face each other, and each sensing unit 128 is composed of an area (node ​​area) where one comb tooth is positioned between the other comb tooth.

[0045] Each pulse electrode 281 is connected to a wiring portion 281a extending in the y-axis direction, and each sense electrode 281 is connected to a wiring portion 282a extending in the x-axis direction. The wiring portions 281a are arranged in the x-axis direction on the front surface of the substrate 129, and the wiring portions 282a are arranged in the y-axis direction on the back surface of the substrate 129. Each sense electrode 282 is electrically connected to the wiring portion 282a via a through-hole 283 provided in the substrate 29. The sensor electrode layer 122 may have a ground line. The ground line is provided, for example, on the outer periphery of the sensor electrode layer 122 or in a portion where the wiring portions 281a, 282a run parallel to each other.

[0046] The structure of the sensing unit 128 is not limited to the above example, and any structure may be used. For example, the sensor electrode layer 122 may be formed of a laminate of a first electrode sheet having a lattice-shaped first electrode pattern extending in the x-axis direction and a second electrode sheet having a lattice-shaped second electrode pattern extending in the y-axis direction. In this case, the sensing unit 128 is formed at the intersection of the first electrode pattern and the second electrode pattern.

[0047] The reference electrode layer 125 is connected to a reference potential. In this embodiment, the reference electrode layer 125 is a so-called ground electrode and is connected to the ground potential. The reference electrode layer 125 is flexible and has a thickness of, for example, about 0.05 mm to 0.5 mm, and in this embodiment, it is 0.1 mm (100 μm). Examples of materials that can be used for the reference electrode layer 125 include inorganic conductive materials, organic conductive materials, and conductive materials containing both inorganic and organic conductive materials.

[0048] Examples of inorganic conductive materials include metals such as aluminum, copper, and silver, alloys such as stainless steel, and metal oxides such as zinc oxide and indium oxide. Examples of organic conductive materials include carbon materials such as carbon black and carbon fiber, and conductive polymers such as substituted or unsubstituted polyaniline and polypyrrole. The reference electrode layer 25 may be composed of a thin metal plate such as stainless steel or aluminum, conductive fiber, or conductive nonwoven fabric. The reference electrode layer 25 may be formed on a plastic film by a method such as vapor deposition, sputtering, adhesion, or coating.

[0049] The deformation layer 127 is disposed between the sensor electrode layer 122 and the reference electrode layer 125. The deformation layer 127 is configured to be elastically deformable in response to an external force. When an external force is applied perpendicularly to the sensor sheet 120, the deformation layer 127 elastically deforms in response to the external force, and the reference electrode layer 125 approaches the sensor electrode layer 122. At this time, the capacitance between the pulse electrode 281 and the sense electrode 282 in the sensing unit 128 changes, and the sensing unit 128 can detect this change in capacitance as a pressure value.

[0050] The thickness of the deformation layer 127 is, for example, 100 μm or more and 1000 μm or less, and the weight per unit area of ​​the deformation layer 127 is, for example, 50 mg / cm ２ By setting the thickness and basis weight of the deformation layer 27 within this range, the detection sensitivity of the pressure sensor 121 in the vertical direction can be improved.

[0051] The lower limit of the thickness of deformation layer 27 may be, for example, 150 μm or more, 200 μm or more, 250 μm or more, 300 μm or more, etc. The upper limit of the thickness of deformation layer 27 may be, for example, 800 μm or less, 600 μm or less, 500 μm or less, 400 μm or less, etc. In this embodiment, the thickness of deformation layer 127 is set to 300 μm or more and 400 μm or less (e.g., 355 μm).

[0052] To facilitate deformation in the z-axis direction, the deformation layer 127 may be configured with a patterning structure including, for example, a columnar structure. This patterning structure can be a matrix, stripe, mesh, radial, geometric pattern, spiral, or other structure.

[0053] The surface layer 123 is made of any material, such as a flexible plastic film, woven fabric, nonwoven fabric, rubber, a foam material such as urethane, leather, or a coating, which covers the reference electrode layer 125. The thickness of the surface layer 123 is, for example, 100 μm or more and 1000 μm or less.

[0054] The upper surface of the surface layer 123 forms the pressure detection surface S of the mounting device 10. Since the surface layer 123 functions as the pressure detection surface S, for example, the surface layer 123 may have a surface property that can generate a predetermined or greater friction force with respect to a real object (e.g., a workpiece) in order to stably grip the real object, or may be made of a material that is slippery relative to the real object (e.g., the top surface of a desk) in order to smoothly perform a sliding operation on the real object.

[0055] The support layer 124 supports the pressure sensor 121 and functions, for example, as a bonding layer that fixes the pressure sensor 121 to the outer peripheral surface 11a of the support body 11. The support layer 124 is formed of, for example, an adhesive layer such as double-sided tape.

[0056] (Tactile sense providing unit) The tactile sense providing unit 13 is for providing a tactile sensation to the fingertip F on which the wearing device 10 is worn. In this embodiment, the tactile sense providing unit 13 is disposed along the inner circumferential surface 11b of the support body 11.

[0057] The tactile sense providing unit 13 has a balloon unit 131 (see FIG. 2) that can be inflated by introducing fluid pressure. The balloon unit 131 is a bag-shaped body formed, for example, by overlapping two sheets of plastic film, and this bag-shaped body is provided with an air inlet and an air outlet. These air inlet and air outlet are connected to intake and exhaust tubes 22a that are connected to the pump unit 22 of the drive unit 20.

[0058] The tactile sense presentation unit 13 is attached to the inner circumferential surface 11b of the support body 11 in a region that contacts a predetermined angular range centered on the pad of the fingertip F, using adhesive, double-sided adhesive tape, or the like. The angular range is not particularly limited, and may be, for example, a range equal to or greater than angle θ as shown in FIG. 2 , or may be a range equal to or less than angle θ. This allows the user to perceive a volume change caused by the introduction of fluid pressure to the tactile sense presentation unit 13. Furthermore, by modulating (temporally changing) the air pressure introduced into the tactile sense presentation unit 13, a meaningful tactile sensation can be presented according to the degree of modulation, as described below.

[0059] The tactile presentation unit 13 is not limited to the example described above in which the volume can be changed by introducing fluid pressure, but other tactile presentation elements that can be perceived by the user, such as electrical stimulation, vibration, or temperature change, may also be used.

[0060] [Drive Unit] As shown in FIG. 2, the drive unit 20 has a control unit 21, a pump unit 22, a support substrate 23, a communication unit 24, a power supply unit 25, and a housing unit 26 that houses these components.

[0061] (Control Unit) The control unit 21 is realized by hardware elements used in a computer, including, for example, a computing element such as a CPU (Central Processing Unit) and a storage unit such as a RAM (Random Access Memory) and a ROM (Read Only Memory), as well as necessary software. The control unit 21 executes a program stored in the storage unit based on a control command from the controller 2 (FIG. 7) described later, thereby acquiring information on forces in the three axial directions detected by the sensor unit 12b, and generates a drive signal for driving the tactile presentation unit 13 based on this force information.

[0062] The control unit 21 is mounted on a support substrate 23, which is a circuit board. The control unit 21 is connected to a connector 70 ( FIG. 5 ) of the sensor unit 12 via a wiring cable 21 a such as a USB (Universal Serial Bus) cable. The wiring cable 21 a may typically be connected to the control unit 21, or may be connected to a connector component mounted on the support substrate 23.

[0063] (Pump Unit) The pump unit 22 corresponds to a drive source that drives the tactile sense presentation unit 13. The pump unit 22 is mounted on a support substrate 23 and configured to be able to introduce or discharge air pressure to the tactile sense presentation unit 13 via a tube 22a. The tube 22a is configured with two tubes, one for intake and one for exhaust, but may also be configured with a single tube that serves both intake and exhaust. For example, a diaphragm-type micropump unit is used for the pump unit 22.

[0064] The pump unit 22 generates air pressure to be introduced into the tactile sense presentation unit 13 based on a drive signal input from the control unit 21. For example, different drive signals are input depending on the magnitude, direction, etc. of the pressure acquired by the sensor unit 12, and the pump unit 22 is configured to output an air pressure signal corresponding to the drive signal to the tactile sense presentation unit 13.

[0065] The support substrate 23 is a circuit board on which the control unit 21 and the pump unit 22 are mounted. The support substrate 23 is electrically connected to a power supply unit 25, and supplies drive power to the control unit 21 and the pump unit 22, respectively.

[0066] The communication unit 24 is, for example, a communication module for short-range wireless communication that communicates with the controller 2 ( FIG. 7 ), which will be described later. The communication unit 24 is electrically connected to the control unit 21. The communication unit 24 may be mounted on the support substrate 23, or may be mounted on a substrate separate from the support substrate 23.

[0067] The power supply unit 25 is a power supply source for the control unit 21, the pump unit 22, and the communication unit 24. The power supply unit 25 includes, for example, a power supply formed of a primary battery or a rechargeable secondary battery, and a power supply circuit capable of adjusting current and voltage. The power supply unit 25 may be mounted on the support substrate 23.

[0068] The housing 26 houses the control unit 21, the pump unit 22, the support substrate 23, the communication unit 24, and the power supply unit 25. The housing 26 is formed, for example, from a synthetic resin molded body. As shown in FIG. 1 , the housing 26 is formed, for example, in a hollow disk shape, but the shape and size of the housing 26 are not particularly limited. The housing 26 is placed near the nail portion of the fingertip F. The bottom of the housing 26 is fixed to the fixing portion 11d of the support 11 with screws, adhesive, or the like.

[0069] [System Configuration] FIG. 7 is a block diagram showing the configuration of an information display system (electronic device) 1 equipped with the input device 100 configured as described above.

[0070] The information display system 1 includes a controller 2, an HMD 3, and an input device 100. The controller 2 is capable of communicating with a control unit 21 via a communication unit 24 of the input device 100. The HMD 3 is worn on the head of a user wearing the input device 100. The HMD 3 is a display device that presents a virtual object image displayed in real space to the user. The HMD 3 is a transparent (or semi-transparent) HMD that displays an object image superimposed on real space, but is not limited to this, and an immersive HMD may also be used.

[0071] The controller 2 is, for example, configured with a host computer that controls the entire system. For example, when a preset event occurs, the controller 2 inputs a display control signal to the HMD 3 to display a virtual object image in real space. The controller 2 further transmits a control command including a scenario corresponding to the event to the input device 100 (control unit 21).

[0072] The control unit 21 receives the pressure detection position and its pressure value output from the sensor unit 12, as well as a control command output from the controller 11. The pressure information including the pressure detection position and its pressure value output from the sensor unit 12 is information about the stress detected when the fingertip F equipped with the input device 100 comes into contact with a real object (workpiece), or about the stress acting on the sensor unit 12 when the real object (workpiece) is grasped with the fingertip F and, for example, the thumb. The control unit 21 periodically acquires the pressure information from the sensor unit 12 at a predetermined frame rate (sampling rate).

[0073] The control unit 21 calculates the in-plane distribution of pressure acting on the pressure detection surface S based on the pressure detection positions and pressure values ​​in the in-plane direction acquired from the sensor unit 12. The load perpendicular to the pressure detection surface S is calculated, for example, as the sum of the perpendicular loads acquired by each sensing unit 128 of the sensor unit 12. In addition, the distribution of shear force in the in-plane direction of the pressure detection surface S is calculated from the change over time in the center of gravity position of the stress acquired from each sensing unit 128.

[0074] The control unit 21 generates a drive signal for driving the tactile sense providing unit 13 to the pump unit 22 based on a control command from the controller 2. The drive signal can be set arbitrarily according to a scenario included in the control command.

[0075] For example, the control unit 21 may change the drive signal based on the magnitude of the pressure detected by the sensor unit 12. For example, the control unit 21 generates a drive signal that can present different types of tactile sensations (magnitude, frequency, pattern) depending on the magnitude of the pressure acquired by the sensor unit 12, or whether the pressure detected by the sensor unit 12 is a normal load or a shear load, etc.

[0076] FIG. 8 shows an example in which an object image 51 resembling a push button is displayed on a desk 50, which is a real object, via the HMD 3. When the image 51 is pressed with a fingertip F wearing the input device 100 in the manner shown in FIG. 1B , the sensor unit 12 detects a vertical load, which is a reaction force from the top surface of the desk 50, due to contact between the wearing device 10 and the desk 50. The control unit 21 drives the pump unit 22 based on the detection signal from the sensor unit 12 and introduces air pressure to the tactile presentation unit 13. As a result, tactile feedback corresponding to the pressing pressure is presented to the user from the input device 100. As described above, the input device 100 of this embodiment can accurately detect the contact state between the real user's finger and the real object, thereby improving operability.

[0077] 8, the manner of haptic feedback when pressed may be changed depending on the type of object image 51 displayed on the HMD 3. For example, the strength of the haptic sensation may be changed depending on whether the image 51 is a rigid body, a powder or granular material, or a fluid (e.g., a water surface).

[0078] 9 shows an input operation in which the fingertip F wearing the input device 100 is tilted, for example, left and right (circumferential direction of the wearing device 10) with a predetermined position on the desk 50 as a fulcrum. This input operation is performed, for example, when moving an object image displayed on the HMD 3. The control unit 21 detects the orientation of the fingertip F (input device 100) with respect to the desk 50 based on the output change of the wearing device 10 in contact with the desk 50 (time change in pressure distribution detected by the sensing unit 128). This makes it possible to perform a desired movement operation on any object in real space without the need for a dedicated controller.

[0079] 10 shows an input operation in which the fingertip F wearing the input device 100 is slid, for example, left and right (circumferential direction of the wearing equipment 10) on the desk 50. This input operation is also performed, for example, when moving an object image displayed on the HMD 3, and the control unit 21 detects the movement direction of the fingertip F (input device 100) relative to the desk 50 based on the change over time in the center of gravity position of the stress acquired from each sensing unit 128. In this case, too, a desired movement operation can be performed on any object in real space without the need for a dedicated controller.

[0080] The input device 100 may further include an inertial sensor such as an acceleration sensor or an angular velocity sensor. In this case, it is possible to detect the amount of movement of the fingertip F described with reference to Fig. 10 based on the output of the inertial sensor. The inertial sensor may be mounted on the support substrate 23 of the drive unit 20, for example.

[0081] 11 , an uneven portion 51 in which concave and convex surfaces are repeatedly arranged in one direction may be provided on the top surface of a desk 50. In this case, the pressure value acquired by the sensor unit 12 changes periodically due to a sliding operation on the uneven portion 51, and it is possible to detect the amount of movement of the fingertip F in that one direction based on the amount of change.

[0082] The uneven portion 51 may be configured as an AR marker. In this case, a predetermined uneven pattern is formed two-dimensionally on the uneven portion 51. The controller 2 is configured to, when the uneven pattern of the uneven portion 51 is detected by the input device 100, cause the HMD 3 to display an object image corresponding to the uneven pattern near the uneven portion 51.

[0083] 12, even when an operation is performed to grasp a real object (workpiece W) using a fingertip F equipped with the input device 100, the grasping action on the workpiece W can be accurately detected based on the output of the sensor unit 12. This has the advantage that occlusion, which is a problem in existing systems that use a camera or the like to detect the positions of the fingertip F and the workpiece W, does not occur. In this case, it is not necessarily necessary to present a tactile sensation to the user, and therefore the present technology can also be applied to input devices that are not provided with a tactile sensation presentation unit 13.

[0084] Furthermore, in this embodiment, meaningful information can be input by a predetermined gesture operation of the user's fingertips. For example, as shown in Fig. 13, predetermined input operations can be performed by sliding the fingertip F of the right hand HR on which the input device 100 is attached over the back of the left hand HL, or by tapping the fingertip F on which the input device 100 is attached with the thumb FT as shown in Fig. 14.

[0085] In this case, the control unit 21 recognizes whether the operation is a slide operation or a tap operation based on the output of the sensor unit 12, and transmits the result to the controller 2. The controller 2 receives the pressure signal from the input device 100 and controls the object image displayed on the HMD 3. As described above, according to this embodiment, it is possible to accurately detect the user's gesture operation and improve operability.

[0086] [Another embodiment of the input device] Fig. 15 is a schematic configuration diagram of an input device 200 according to another embodiment of the present technology. The input device 200 of this embodiment differs from the input device 100 shown in Fig. 1 in that the drive unit 20 is configured separately from the wearing tool 10. In this figure, parts corresponding to those in Figs. 1 and 2 are given the same reference numerals, and detailed descriptions thereof will be omitted or simplified.

[0087] In the input device 200 of this embodiment, the drive unit 20 is attached to an auxiliary attachment member 30. The auxiliary attachment member 30 is a band- or belt-like member that is worn near the wrist on which the wearing device 10 is worn. The drive unit 20 is attached to the auxiliary attachment member 30 so as to be located on the back of the hand.

[0088] The wearing device 10 and the drive unit 20 are connected by a wiring cable 21a and a tube 22a for the inflow and outflow of air pressure. The wiring cable 21a connects the sensor unit 12 of the wearing device 10 and the control unit 21 (or support substrate 23) of the drive unit 20, and the tube 22a connects the tactile presentation unit (balloon unit) 13 of the wearing device 10 and the pump unit 22 of the drive unit 20.

[0089] The input device 200 of this embodiment configured as described above can also achieve the same effects as the above-described input device 100. Furthermore, according to this embodiment, since the drive unit 20 is attached to a position different from the attachment portion 10, it is possible to standardize the drive unit 20 even when the attachment 10 is attached to multiple fingers, for example.

[0090] 16 is a schematic configuration diagram of an input device 300 according to another embodiment of the present technology. The input device 300 of this embodiment differs from the above-described input devices 100 and 200 in that it is configured with a bag-like body such as a fingerstall that accommodates the tip of a fingertip F. Note that the drive unit 20 is not shown in the drawing, and may be attached to the wearing aid 30 described with reference to FIG. 15, for example.

[0091] The input device 300 has a support made of, for example, synthetic rubber, with a sensor unit disposed on its outer surface and a tactile sense providing unit disposed on its inner surface. The sensor unit is disposed at a position facing the pad of the fingertip F. In this way, the support is not limited to being ring-shaped, but may be a bag-shaped body. Even with this configuration, the same effects as those of the input devices 100 and 200 can be obtained. Furthermore, by wearing the input device 300 configured as described above on all the fingers of both hands, it becomes possible to input information using, for example, a keyboard image virtually displayed on a desk.

[0092] <Modifications> In each of the above embodiments, a balloon portion that can be inflated by introducing fluid pressure is used as the tactile presentation device, but this is not limited thereto. For example, a voice coil motor (VCM) may be used as the vibration generating source that generates vibrations. The vibration generating source may be provided in the wearing device 10, or may be attached to the fingertip F or the back of the hand independently of the wearing device 10. The vibration generating source may be attached to, for example, the nail portion or the area between the nail portion and the palm. Alternatively, the vibration generating source may be attached to the back of the user's hand using, for example, an auxiliary wearing member 30 ( FIG. 15 ).

[0093] In addition to the VCM, the tactile sensation providing unit may be configured to provide the user with, for example, a warm sensation or an electrical stimulus.

[0094] The sensor unit 12 is not limited to the structure shown in Fig. 4, and other structures may be adopted as long as they are capable of detecting the pressure distribution. Furthermore, the sensor unit 12 is not limited to the example in which it is disposed on the outer surface (outer peripheral surface 11a) of the support body 11, and may be disposed on the inner surface (inner peripheral surface 11b) of the support body 11.

[0095] Furthermore, in the above embodiment, the tactile sensation generated by the tactile sensation providing unit 13 is fed back to the user, but in addition to this, video and audio may also be fed back to the user. In this case, video and music can be provided to the user via the HMD 3 or other devices in accordance with the input operation (such as the magnitude of pressure).

[0096] Furthermore, the wearing device 10 may be equipped with sensors other than the sensor unit 12, such as a proximity sensor or a temperature sensor, in which case it is possible to detect not only pressure but also the distance to the object and the temperature of the object.

[0097] The present technology can also be configured as follows. (1) An input device comprising: a support having an outer surface and an inner surface and wearable on a user's fingertip; and a wearing tool including: a sensor unit disposed on the outer surface or the inner surface of the support and configured to be capable of detecting a distribution of pressure acting on the support. (2) The input device according to (1) above, further comprising a tactile sense presentation unit configured to be able to present a tactile sensation to the fingertip. (3) The input device according to (2) above, wherein the tactile sense presentation unit has a balloon unit that can be inflated by introducing fluid pressure. (4) The input device according to (2) or (3) above, wherein the tactile sense presentation unit is disposed on the inner surface of the support. (5) The input device according to any one of (2) to (4) above, wherein the tactile sense presentation unit includes a vibration generating source capable of generating vibrations. (6) The input device according to any one of (2) to (5) above, further comprising a drive unit having a control unit that generates a drive signal for driving the tactile presentation unit based on the output of the sensor unit. (7) The input device according to (6) above, wherein the sensor unit is formed by an elastically deformable sensor sheet having a plurality of capacitive elements acting on the outer surface of the support, and the control unit changes the drive signal based on the magnitude of pressure detected by the plurality of capacitive elements. (8) The input device according to (7) above, wherein the sensor sheet has a sensor electrode layer in which the plurality of capacitive elements are arranged in a matrix, a reference electrode layer connected to a reference potential, and a deformation layer arranged between the sensor electrode layer and the reference electrode layer. (9) The input device according to (8) above, wherein the sensor unit further has a surface layer that covers the reference electrode layer. (10) The input device according to (8) or (9) above, wherein the sensor electrode layer is arranged between the outer surface of the support and the reference electrode layer. (11) The input device according to any one of (6) to (10) above, wherein the drive unit further has a housing portion fixed to the support body, and the control portion is housed in the housing portion.(12) The input device according to (11) above, wherein the drive unit further includes a drive source housed in the housing and configured to drive the tactile sense presentation unit. (13) The input device according to any one of (6) to (12) above, further including an auxiliary attachment member configured to be wearable by the user, wherein the drive unit is attached to the auxiliary attachment member. (14) The input device according to any one of (1) to (13) above, wherein the sensor unit is disposed facing the pad of the fingertip. (15) The input device according to any one of (1) to (14) above, wherein the support body is formed in a ring shape having an outer circumferential surface that is the outer surface and an inner circumferential surface that is the inner surface. (16) The input device according to (15) above, wherein the support body is a metal member having a thickness of 1 mm or less and a width of 10 mm or less. (17) The input device according to (15) or (16), wherein the wearing fixture further has an adjustment unit capable of adjusting an inner diameter of the support. (18) An electronic device comprising: a display device configured to be wearable on a user's head and presenting a virtual object image to the user that is displayed in real space; and an input device configured to be wearable on the user's fingertip, wherein the input device comprises: a wearing fixture having a support having an outer surface and an inner surface and worn on the user's fingertip, and a sensor unit that is disposed on the outer surface or the inner surface of the support and configured to be capable of detecting a distribution of pressure acting on the support; a tactile sense providing unit configured to be able to provide a tactile sensation to the fingertip; and a drive unit that drives the tactile sense providing unit based on an output of the sensor unit.

[0098] DESCRIPTION OF SYMBOLS 1... Information display system (electronic device) 2... Controller 3... HMD 10... Wearing equipment 11... Support body 11a... Outer peripheral surface (outer surface) 11b... Inner peripheral surface (inner surface) 12... Sensor section 13... Tactile sense presentation section 20... Drive unit 21... Control section 22... Pump section (drive source) 23... Support substrate 24... Communication section 25... Power supply section 26... Housing section 30... Auxiliary wearing member 100, 200, 300... Input device

Claims

1. An input device comprising a wearable device having a support having an outer surface and an inner surface and capable of being worn on a user's fingertip, and a sensor unit disposed on the outer surface or inner surface of the support and configured to be able to detect the distribution of pressure acting on the support.

2. An input device according to claim 1, further comprising a tactile sensation providing unit configured to provide a tactile sensation to the fingertip.

3. An input device according to claim 2, wherein the tactile sensation providing unit has a balloon unit that can be inflated by the introduction of fluid pressure.

4. An input device according to claim 2, wherein the tactile sensation providing unit is disposed on the inner surface of the support body.

5. An input device according to claim 2, wherein the tactile sense providing unit includes a vibration generating source capable of generating vibrations.

6. An input device according to claim 2, further comprising a drive unit having a control unit that generates a drive signal for driving the tactile presentation unit based on the output of the sensor unit.

7. An input device according to claim 6, wherein the sensor section is composed of an elastically deformable sensor sheet having a plurality of capacitance elements acting on the outer surface of the support, and the control section changes the drive signal based on the magnitude of pressure detected by the plurality of capacitance elements.

8. An input device according to claim 7, wherein the sensor sheet has a sensor electrode layer in which the plurality of capacitance elements are arranged in a matrix, a reference electrode layer connected to a reference potential, and a deformation layer disposed between the sensor electrode layer and the reference electrode layer.

9. An input device according to claim 8, wherein the sensor section further has a surface layer that covers the reference electrode layer.

10. An input device according to claim 8, wherein the sensor electrode layer is disposed between the outer surface of the support and the reference electrode layer.

11. An input device according to claim 6, wherein the drive unit further has a housing portion fixed to the support, and the control portion is housed in the housing portion.

12. An input device according to claim 11, wherein the drive unit further has a drive source housed in the housing section for driving the tactile presentation section.

13. An input device according to claim 6, further comprising an auxiliary attachment member configured to be attachable to the user, wherein the drive unit is attached to the auxiliary attachment member.

14. An input device according to claim 1, wherein the sensor unit is disposed opposite the pad of the fingertip.

15. An input device according to claim 1, wherein the support is formed in a ring shape having an outer peripheral surface which is the outer surface and an inner peripheral surface which is the inner surface.

16. An input device according to claim 15, wherein the support is a metal member having a thickness of 1 mm or less and a width of 10 mm or less.

17. An input device according to claim 15, wherein the wearing device further has an adjustment section that can adjust the inner diameter of the support.

18. An electronic device comprising: a display device configured to be wearable on a user's head and presenting a virtual object image displayed in real space to the user; and an input device configured to be wearable on the user's fingertips, wherein the input device comprises: a wearing device having a support having an outer surface and an inner surface and worn on the user's fingertips; and a sensor unit arranged on the outer surface or the inner surface of the support and configured to be able to detect the distribution of pressure acting on the support; a tactile presentation unit configured to be able to present a tactile sensation to the fingertips; and a drive unit that drives the tactile presentation unit based on the output of the sensor unit.

Images