Finger wearing type controller

Abstract

Provided is a finger-mounted controller capable of inputting various types of operation information while minimizing the interference with the body and hand movements of a user. A finger-mounted controller (1) according to the present invention is a finger-mounted controller that is mounted on a finger (2) of a user to control an external electronic device, and is provided with: a mounting member (4) having a first opening (4a) for receiving a first finger (21) of the user; a film-like first sensor (5) which is configured so as to be at least partially disposed on the outer surface of the attachment member (4) and which detects three-axis forces in the effective region (5a); a protective layer (6) covering the first sensor (5); the control circuit (7) is accommodated in the wearing part (4) and is electrically connected with the first sensor (5); a wireless transceiver (8) which is housed in the wearing member (4), is electrically connected to the control circuit (7), and communicates with an external electronic device; and a battery (9) which is housed in the wearable member (4) and supplies power to the control circuit (7).

Description

Technical Field

[0001] The present invention relates to a finger-worn controller capable of minimizing interference with the user's body and hand movements and capable of inputting a variety of operation information. Background Art

[0002] In recent years, the use of image processing technologies that fuse digital information with information from the real world, such as augmented reality (AR), virtual reality (VR), mixed reality (MR), and alternate reality (SR), has become popular. These technologies are collectively referred to as "xR". By using xR technology, you can experience actually operating machinery in a virtual space, or actually walking in the past or a fictional world. For example, in amusement facilities, there is an attraction that allows you to experience the feeling of flying in the air when you wear goggles and ride a vehicle, even though you are not actually flying. In addition, there are games where characters that do not actually exist appear when you shoot a scene with a smartphone camera. The use of xR technology is advancing not only in the entertainment field, but also in various fields such as industry, education, medicine, and retail.

[0003] AR (Augmented Reality) is a technology that superimposes digital information such as CG and text on real-world information. By superimposing CG characters and buildings on images taken with smartphones and tablet terminals, you can experience an immersive experience.

[0004] VR (Virtual Reality) is a technology that uses CG and special effects to create a virtual world, allowing users to experience the same activities in the virtual space as in the real world. Users use head-mounted displays and dedicated controllers to view and operate images in the virtual space.

[0005] MR (Mixed Reality) is similar to AR in that digital information is superimposed on real-world information, but it superimposes real-world data on virtual space, making the real and virtual worlds overlap more complexly. Using head-mounted displays, multiple people can talk or work together in the same virtual space as in the real world, or enjoy real-world images in virtual space.

[0006] SR (Substitutional Reality) is a technology that replaces information in the virtual world with other information in the real world, thereby recognizing other real-world information as current real-world information. For example, using a head-mounted display, by showing 360-degree panoramic images of the past and other places, you can get an immersive experience.

[0007] In xR, various interfaces have been developed to further increase the sense of immersion or to capture human movements in real time into the virtual world. Interfaces are mainly divided into interfaces on the information receiving side and interfaces that input real-world information as digital information.

[0008] First, as interfaces for receiving information, there are head-mounted displays and smart glasses, for example.

[0009] Head-mounted display is a general term for displays worn on the head, and there are various shapes such as goggles and glasses. The direction the wearer is facing is detected by gyro sensors, angular velocity sensors, etc., and the corresponding image is projected. As a result, in the virtual space projected by the display, you can experience 360-degree rotation of your vision, just like in the real world. The display part has a non-transparent type that completely hides the surroundings after wearing it, a type that can confirm external images through a camera, and a type that is semi-transparent and can confirm the outside at the same time.

[0010] Smart glasses are a type of eyeglass-type head-mounted display that is equipped with a camera and a retinal projection display, and is as light and compact as ordinary glasses. Unlike goggles-type head-mounted displays, they can confirm the surrounding scenery, so they are mainly used for AR that displays digital information in the real world. For example, the operation steps are displayed for each device to assist the operator's actions.

[0011] On the other hand, as interfaces for inputting information, there are controllers equipped with acceleration sensors and gyro sensors, as well as motion sensors, glove-type sensors, tactile sensors, and the like.

[0012] In a system that performs complex operations such as surgical simulation, a controller dedicated to the system is required (see Patent Document 1). In such a controller, an acceleration sensor and a gyro sensor for checking two-dimensional motion in the XY direction and motion in the Z and θ directions are used to input motions such as moving, twisting, and rotating an object.

[0013] The motion sensor detects the body's movements from sensors worn on various parts of the human body (see Patent Document 2). Since the body's movements can be detected more accurately in real time, the movements of the characters in the virtual world can be made smoother.

[0014] Glove sensors are sensors worn on the hands of people. By detecting the subtle movements of the finger joints, it is possible to perform operations in the virtual world just like grabbing or releasing objects with real hands (see Patent Document 3). In addition, it is also possible to perform delicate tasks such as operating a keyboard in the virtual space just like in the real world.

[0015] A tactile sensor is a sensor that can measure the force and temperature applied to a contact surface. Sensors that only detect the force in the Z direction are often used, but there are also three-axis force sensors that can detect forces in three axes (XYZ directions). By measuring the forces in the three-axis directions at the contact point, the pressing force (pressure), sliding contact state, sliding state, etc. can be checked, and behaviors that are closer to human touch can be checked. For example, the feeling of friction between the fingertips and the object when sliding the fingertips on the surface of the object, the changes in grip and friction when tightening the screws with a screwdriver, etc. can be listed. In addition, there are also thinner sheet-type tactile sensors. By spreading this sheet sensor all over the ground, the pressure of the foot on the ground and the friction generated by the sole of the foot can be checked. Not only the action, but also the change of force can be reflected in the virtual space, so the action can be input more realistically (see patent document 4).

[0016] Prior art literature

[0017] Patent Literature

[0018] Patent Document 1: Japanese Patent Application No. 2020-515891

[0019] Patent Document 2: Japanese Patent Application No. 2017-511906

[0020] Patent Document 3: Japanese Patent Application Laid-Open No. 09-054540

[0021] Patent Document 4: Japanese Patent Application No. 2021-511133 Summary of the invention

[0022] Technical problem to be solved by the invention

[0023] As mentioned above, when using xR, users are usually asked to wear a head-mounted display, and computer-generated images are displayed on the display screen that covers their eyes, so that users can get the xR experience. At this time, since the user needs to input information for the item selection and character input request displayed on the display screen, a handheld controller is required.

[0024] However, when using xR, users sometimes need to use their hands to manipulate virtual objects displayed on the display screen of a head-mounted display, etc., or to manipulate objects in the real world seen through the display, or the user moves around in the virtual space by actually moving the body in the real space. For example, an operator in a mechanical assembly process at a factory site is asked to wear a head-mounted display. While confirming the assembly parts in the real world through the display, the operator receives instructions and support about the work content from the company headquarters far away using the display screen, and uses the tools in his hand to perform operations such as screw tightening in sequence. In this case, if the controller is held in the hand due to the need to input the above information, it will hinder the movement of the operator's body and hands, and thus cause problems that hinder the work.

[0025] Therefore, the object of the present invention is to solve the above-mentioned technical problems and provide a finger-worn controller that can minimize interference with the user's body and hand movements and can input a variety of operation information.

[0026] Technical solutions for solving technical problems

[0027] Hereinafter, a plurality of methods are described as technical solutions for solving the technical problems. These methods can be arbitrarily combined as needed.

[0028] A finger-worn controller according to one embodiment of the present invention is a finger-worn controller that is worn on a user's finger to control an external electronic device. The finger-worn controller includes a wearable component, a first sensor, a protective layer, a control circuit, a wireless transceiver, and a battery. The wearable component has a first opening for receiving a first finger of the user. The first sensor is a thin film-shaped sensor that is at least partially disposed on the outer side of the wearable component. In addition, the first sensor is configured to detect three-axis forces in this effective area. The protective layer covers the first sensor. The control circuit is housed in the wearable component and is electrically connected to the first sensor. The wireless transceiver is configured to be housed in the wearable component, electrically connected to the control circuit, and communicate with the external electronic device. The battery is housed in the wearable component and supplies power to the control circuit.

[0029] The finger-worn controller thus constructed does not need to be held by hand, so the interference to the user's body and hand movements can be minimized during operation. In addition, since the force of three axes is detected, a variety of operation information can be input with one finger without wearing the finger-worn controller.

[0030] The wearing component may be in the shape of a ring or a fingertip.

[0031] When the wearing member is in the shape of a fingertip, the effective area of ​​the first sensor may be located at the tip of the first finger of the user.

[0032] Input can be performed by pressing the tip of the finger wearing the finger-worn controller 1 thus constructed on a table or a certain part of the body (such as the thigh or the back of the hand not wearing the finger-worn controller).

[0033] Furthermore, the first finger may be any one of four fingers other than the thumb of one hand of the user, and the effective area of ​​the first sensor may be located at a position that can be contacted by the thumb of the same hand.

[0034] The finger-worn controller constructed in this way is easy to operate with one hand.

[0035] When the first sensor is operated with the thumb, the protective layer may be thicker only in the effective area of ​​the first sensor to form a convex portion.

[0036] With the finger-worn controller constructed in this way, the user can easily identify the position of the effective area of ​​the first sensor by simply touching it with the thumb without visual inspection.

[0037] In addition, when the first sensor is operated with the thumb, a second sensor may be provided on the outer side of the wearable component, the second sensor being arranged to be opposite to the second finger and configured to detect whether there is pressure or contact between the first finger and the second finger, the second finger being any one of the four fingers other than the thumb and adjacent to the first finger. The control circuit is also electrically connected to the second sensor, and when the second sensor detects that there is no pressure or contact, the control circuit controls the first sensor so that it becomes a state with less power consumption than when pressure or contact is detected. The finger-worn controller thus configured can control the first sensor so that when the second sensor detects that there is no pressure or contact, it becomes a state with less power consumption than when pressure or contact is detected. Here, the state with less power consumption is, for example, a state in which the first sensor is not detected, or a state in which the detection interval of the first sensor is extended.

[0038] In addition, as described above, when the wearing member is in the shape of a ring, the wearing member may also have a second opening for receiving any one of the three fingers other than the thumb and the first finger of the same hand, that is, the second finger adjacent to the first finger.

[0039] When a shear force is applied to the pressure-sensitive surface of the finger-worn controller constructed in this way in the direction around the first finger, the second finger inserted into the second opening acts as a stopper to prevent the wearing component from rotating around the first finger.

[0040] Furthermore, the first sensor may not only detect the shear force applied at least in the in-plane direction and the pressing force applied in the normal direction of the surface in the effective area, but also have a touch sensor function for further detecting the presence or absence of contact or proximity.

[0041] The finger-worn controller constructed in this way can expand the diversity of inputtable operation information.

[0042] Effects of the Invention

[0043] According to the finger-worn controller of the present invention, it is possible to minimize interference with the user's body and hand movements and to input a variety of operation information. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 This is an explanatory diagram showing a structural example of a finger-worn controller (ring-shaped) according to the present invention and an example of wearing the controller.

[0045] Figure 2 This is a schematic cross-sectional view showing a structural example of a finger-worn controller (ring shape) according to the present invention.

[0046] Figure 3 It is shown Figure 1 An explanatory diagram of an operation example of a finger-worn controller (ring shape) shown.

[0047] Figure 4 This is an explanatory diagram showing another wearing example of the finger-worn controller (ring shape) according to the present invention.

[0048] Figure 5 This is a schematic cross-sectional view showing another structural example of the finger-worn controller (ring shape) involved in the present invention.

[0049] Figure 6 This is a schematic cross-sectional view showing another structural example of the finger-worn controller (ring shape) involved in the present invention.

[0050] Figure 7 This is an explanatory diagram showing a configuration example of a finger-worn controller (in the shape of a fingertip) according to the present invention and an operation example thereof.

[0051] Figure 8 This is an explanatory diagram showing another structural example of the finger-worn controller (in the shape of a fingertip) according to the present invention and an example of wearing the controller.

[0052] Fig. 9 It is shown Figure 8 1 and 2 (b) are diagrams for explaining an operation example of a finger-worn controller (in the shape of a fingertip).

[0053] Fig.10This is a diagram showing the definitions of the front, back, left, and right sides of the operation surface of the finger-worn controller according to the present invention.

[0054] Fig.11 This is a diagram for explaining an example of hiragana input performed by a flick operation using the finger-worn controller according to the present invention.

[0055] Fig.12 This is a diagram for explaining another example of hiragana input by flicking operation using the finger-worn controller according to the present invention.

[0056] Fig.13 This is a diagram for explaining another example of hiragana input by flicking operation using the finger-worn controller according to the present invention.

[0057] Fig.14 This is a diagram for explaining an example of operation related to character input using the touch sensor function.

[0058] Fig.15 This is a schematic cross-sectional view showing a modified example of the finger-worn controller (ring shape) according to the present invention.

[0059] Fig.16 This is a diagram for explaining an example of multi-level item selection by a ring menu using the finger-worn controller according to the present invention.

[0060] Fig.17 This is a diagram for explaining an example of operation associated with item selection using a touch sensor function. DETAILED DESCRIPTION

[0061] In the following embodiments, a case where a finger-worn controller according to the present invention is applied will be described.

[0062] The application scope of the finger-worn controller of the present invention is not limited to the xR applications described in the "Background Technology" section. If the application is used in a scenario where a hand-held controller would hinder the operator's body and hand movements and thus hinder the operation, it can also be applied to other situations besides xR applications. For example, a finger-worn controller can be used to control the car's audio or telephone system while driving a car, or to control external electronic devices in other similar scenarios.

[0063] In addition, as used in this specification, the term "finger" means any finger of the user, including the thumb, index finger, middle finger, ring finger and little finger of any hand. Preferably, the finger-worn controller of the present invention is worn on the dominant hand of the user.

[0064] [First embodiment]

[0065] Hereinafter, a first embodiment of the present invention will be described based on the drawings.

[0066] 1. Structure of finger-worn controller

[0067] Figure 1 This is an explanatory diagram showing a structural example of a finger-worn controller (ring-shaped) according to the present invention and an example of wearing the controller. Figure 2 This is a schematic cross-sectional view showing a structural example of a finger-worn controller (ring shape) according to the present invention.

[0068] The finger-worn controller 1 of the first embodiment is in the shape of a ring. Figure 1 As shown, it is worn on the user's finger 2 to control external electronic devices. Figure 2 As shown, the finger-worn controller 1 includes a wearing member 4 , a first sensor 5 , a protective layer 6 , a control circuit 7 , a wireless transceiver 8 , and a battery 9 .

[0069] (1) Wearing parts

[0070] The wearing member 4 has a first opening 4a for receiving the user's first finger 21. The first finger 21 may be any one of the four fingers other than the thumb of one hand of the user, but in Figure 1 as well as Figure 2 In the example shown, the first finger 21 is the index finger.

[0071] The inner peripheral surface of the first opening 4 a preferably has an inner diameter and a shape that match the first finger 21 of the user so that the finger-worn controller 1 will not fall off the first finger 21 during use.

[0072] In addition, the outer side surface of the wearing member 4 has a smooth plane or cylindrical surface at least at the location where the first sensor 5 is arranged (see Figure 2 ).

[0073] In addition, if Figure 2 As shown, the wearing component 4 has a space 4c for accommodating the control circuit 7, the wireless transceiver 8 and the battery 9, and has an outlet 4d for wiring from the control circuit 7 accommodated in the space 4c to the first sensor 5 arranged on the outer side.

[0074] As the material of the wearing part 4, for example, general-purpose resins such as polystyrene resins, polyolefin resins, ABS resins, AS resins, and AN resins can be listed. In addition, general-purpose engineering resins such as polyphenylene ether-polystyrene resins, polycarbonate resins, polyacetal resins, polyacrylic resins, polycarbonate-modified polyphenylene ether resins, polybutylene terephthalate resins, polybutylene terephthalate resins, and ultra-high molecular weight polyethylene resins and super engineering resins such as polysulfone resins, polyphenylene sulfide resins, polyphenylene ether resins, polyarylate resins, polyetherimide resins, polyimide resins, liquid crystal polyester resins, and polyallyl-based heat-resistant resins can also be used. The wearing part 4 using these resins can be composed of a single resin molded product, or it can be a resin molded product composed of multiple resin layers. In addition, the wearing part 4 using these resins can also be an assembly of multiple resin molded products.

[0075] In particular, it is preferable to use a polyester, olefin, polyurethane, polyamide or other thermoplastic elastomer resin for the portion forming the inner peripheral surface of the first opening 4 a because of its excellent deformability to conform to the first finger 21 of the user.

[0076] In addition, metal, wood, glass, ceramics, etc. can also be used as the material of the wearing member 4. In addition, a composite product or an assembled product of these and a resin molded product can also be used.

[0077] It should be noted that, when the portion that becomes the inner circumference of the first opening 4a is made of a material that lacks deformability, one that is suitable for the first finger 21 of the user 1 is selected from a combination of two or more finger-worn controllers 1 having different inner diameters or shapes of the first opening 4a. Alternatively, only the portion that becomes the inner circumference of the first opening 4a may be replaced with a portion having a different inner diameter or shape, or a gap adjustment material may be added to the inner circumference of the first opening 4a after the gap adjustment material is purchased.

[0078] (2) First sensor

[0079] The first sensor 5 is a thin-film three-axis force sensor disposed at least partially on the outer side surface of the wearing member 4 .

[0080] A three-axis force sensor is a sensor that simultaneously detects the force (pressure) of the fingertip pressing and the force (friction) of the sliding in its effective area 5a. Since friction can measure not only the direction but also the size, it is also possible to input the size of volume and speed. Compared with other user interfaces (UI) such as joysticks, cross keys or mice, it is possible to input the direction and movement amount simultaneously through small movements of the fingers. As one of the thin-film three-axis force sensors, electrostatic capacitance, piezoelectric, strain gauge, etc. or other known sensors can be used.

[0081] In addition, since the first sensor 5 is in the form of a film, it can also be installed in Figure 2 On the cylinder shown.

[0082] In addition, the first sensor 5 in this embodiment not only detects the force of the three axes in the effective area 5a, but also has a touch sensor function for further detecting the presence or absence of contact or proximity. Therefore, the diversity of the operation information that can be input is further expanded. Here, as examples of having a touch sensor function, there can be cited an example of stacking additional touch sensor electrodes on the outside of a three-axis force sensor, an example of adding touch sensor electrodes in parallel with the electrodes inside a three-axis force sensor, and an example of using a part of the electrodes of a three-axis force sensor as touch sensor electrodes.

[0083] The effective area 5a of the first sensor 5 may be in any shape such as square, rectangle, circle, or ellipse. In addition, the maximum width of the effective area 5a of the first sensor 5 may be about 15 to 20 mm.

[0084] It should be noted that the effective area 5a of the first sensor 5 is located at a position that can be touched by the thumb 22 of the same hand as the first finger 21 wearing the finger-worn controller 1. For example, the effective area 5a of the first sensor 5 is provided on the side of the first finger 21 on the thumb 22 side, or from the side to the fingertip, so that it is easy to operate with the thumb 22. Figure 1 In the example shown, the first finger 21 is provided from the side surface between the first joint and the second joint to the fingertip.

[0085] (3) Protective layer

[0086] like Figure 2 As shown, the first sensor 5 is covered by a protective layer 6 .

[0087] The protective layer 6 protects the first sensor 5 to which force is applied. The upper surface of the protective layer 6 becomes a contact surface with the thumb 22, that is, a pressure-sensitive surface.

[0088] As the material of the protective layer 6, rubber sheets and foam materials made of polyurethane, silicone, epoxy resin, ethylene vinyl acetate copolymer, polyethylene, polypropylene, polystyrene, butadiene, etc. can be listed. In order to improve the dielectric constant, powdered carbon, etc. can be added thereto. The covering of the protective layer 6 is performed by laminating these rubber sheets and foam materials, or by insert molding in which the wearing component 4 to which the first sensor 5 is laminated is set on a molding die and a liquid rubber material is injected to perform molding. The thickness of the protective layer 6 is preferably less than 5 mm at its thickest part. When the thickness exceeds 5 mm, the volume of the finger-worn controller 1 becomes larger, and it becomes an obstacle when the hand wearing it on the first finger 21 performs other operations. In addition, the thickness of the protective layer 6 is preferably more than 0.5 mm at its thinnest part. When the thickness is less than 0.5 mm, the first sensor 5 cannot be fully protected.

[0089] Furthermore, as the protective layer 7, a decorative sheet, leather, rubber, cloth, or the like may be laminated to give the protective layer 7 a design property.

[0090] It should be noted that if Figure 2 As shown, the protective layer 6 of the present embodiment is thick only in the effective area 5a of the first sensor 5 to form a convex portion 6a.

[0091] Since the protective layer 6 has the convex portion 6a, the user can easily recognize the position of the effective area 5a of the first sensor 5 by the touch of the thumb 22 without visually observing the finger-worn controller 1. The height of the convex portion 6a is preferably formed to be 0.5 mm to 2 mm.

[0092] (4) Control circuit

[0093] The control circuit 7 is accommodated in the wearing member 4 and is electrically connected to the first sensor 5 .

[0094] The control circuit 7 is formed of a CPU and other electronic components. The control circuit 7 controls various operations of the finger-worn controller 1 in addition to controlling the first sensor 5 .

[0095] (5) Wireless transceiver

[0096] The wireless transceiver 8 is accommodated in the wearing member 4 , is electrically connected to the control circuit 7 , and is configured to communicate with the external electronic device 3 .

[0097] As the external electronic device 3 for communication, for example, in addition to the head mounted display used in xR (see Figure 3 ) and smart glasses, it can also be a smart TV, a laptop computer, a desktop computer, a tablet computer, a car audio system, an automatic control device for home, work or environment, or any such device or system, but is not limited to this.

[0098] The wireless transceiver 8 communicates with external electronic devices via wireless LAN such as WI-FI (registered trademark), BLUETOOTH (registered trademark), NFC, etc. The wireless transceiver 8 can communicate unidirectionally or bidirectionally. It should be noted that the finger-worn controller 1 can control multiple external electronic devices 3 simultaneously or separately.

[0099] (6)Battery

[0100] The battery 9 is housed in the wearing member 4 , and supplies power to the control circuit 7 .

[0101] As the battery 9, a rechargeable battery such as a lithium battery can be used. In the case of a rechargeable battery, the user can charge it simply by USB or by placing the finger-worn controller 1 on a charging pad. Alternatively, a non-rechargeable battery can be used as the battery 9 and removed from the wearing component 4 for replacement.

[0102] 2. Operation of finger-worn controller

[0103] Figure 3 It is shown Figure 1 An explanatory diagram of an operation example of a finger-worn controller (ring shape) shown.

[0104] like Figure 3 As shown, the finger-worn controller 1 is operated by touching the effective area 5a of the first sensor 5 with the thumb 22. When the contact surface of the effective area 5a is pressed along the Z-axis direction with the thumb 22, the pressure is detected, and when the thumb 22 is slid along the XY direction on the contact surface of the effective area 5a, the friction force is detected, thereby controlling the external electronic device 3.

[0105] An example of the operation is described below.

[0106] As a premise, it is defined that the front, rear, left, and right directions of the operation surface in the effective area 5a of the first sensor 5 are Fig.10 ) corresponds to the up, down, left, and right directions of the GUI (Graphical User Interface) of the external electronic device. In the case of xR use, the external electronic device 3 is a head-mounted display. Based on the friction force detected by the first sensor 5, it is detected which direction of the front, back, left, and right of the operation surface is input.

[0107] (1) Character input by flicking

[0108] Figure 11 to Figure 13 Each of them is a diagram showing an example of hiragana input by flick operation. Fig.11 If you input "あ(a)", Fig.12 If you enter "え(e)", Fig.13This is the case when you input "!".

[0109] When "あ(a)" is input, first, the first sensor 5 detects that the thumb 22 is touching the operation surface, and 3×4=12 partitions 321 (GUI 32) with hiragana and symbols are displayed on the screen 31 of the head mounted display. Initially, the center "な(na)" is highlighted in the screen to indicate to the user that the operation surface of the first sensor 5 is being touched (see Fig.10 Here, the user can change the selected partition by applying force to the front, back, left, and right sides of the operation surface. Fig.10 In the example shown in (b), the partition is changed to "あ(a)" by applying force to the left front of the operation surface. Then, when "あ(a)" is selected, the user lifts the thumb 22 off the operation surface of the first sensor 5 (lifts the finger) to input "あ(a)".

[0110] When "え(e)" is entered, until "あ(a)" is selected, Fig.10 Same (refer to Fig.11 Then, the user presses the operation surface of the first sensor 5 without lifting the thumb 22, and the color and size of the partition "あ(a)" change, and new partitions 322 appear on the top, bottom, left, and right of the display screen (see Fig.11 Here, the user applies force to the right of the operation surface to select the partition "え(e)" (refer to Fig.11 Then, by lifting the finger, the user can input "え(e)".

[0111] When inputting "!", until the initial "な(na)" is highlighted, Fig.10 Same (refer to Fig.12 Then, the user applies force to the right rear of the operation surface to select the partition "ら(ra)" (refer to Fig.12 (b)). In addition, the user applies force to the rear of the operation surface to select the partition of "!?" (refer to Fig.12 Then, by pressing the thumb 22 on the operation surface of the first sensor 5, the color and size of the "!?" partition change, and a new partition 323 appears on the upper left and right sides of the display screen (see Fig.12 Here, the user applies force to the right side of the operation surface to select the partition of "!" (refer to Fig.12 (d)). Then, by lifting the finger, the user can input “!”.

[0112] In this way, using a GUI similar to the flick operation used in a smartphone, characters can be quickly input by operating the finger-worn controller 1 worn on the first finger 21 of the user only with the thumb 22 .

[0113] In addition, Chinese character conversion, character deletion, input mode switching, etc. Fig.14 As shown in the table, it is performed by clicking, double clicking, and clicking & touching using the touch sensor function. Regarding the input mode switching (mode switching of kana input, English input, and numeric input), it is performed as follows: when clicking & touching is detected, a partition in which multiple input modes are arranged is displayed as a GUI, and the mode you want to input is selected.

[0114] It should be noted that the above-described operation example using the thin-film three-axis force sensor can also be applied to existing hand-held remote control type controllers, touch panels, and the like.

[0115] (2) Multi-level item selection via the ring menu

[0116] Furthermore, by detecting the triaxial force using the first sensor 5 formed of a triaxial force sensor, a large number of items involving multiple levels can be selected.

[0117] Fig.16 This is a diagram showing an example of multi-level item selection by a ring menu.

[0118] First, the first sensor 5 detects that the thumb 22 is in contact with the operation surface, and a GUI 33 (ring menu) with eight sections arranged in a ring shape appears on the screen 31 of the head mounted display, and selection items "1" to "8" are displayed clockwise from the top section (see Fig.16 Here, the user can select one of the eight items in the "menu" level (first level 331) by applying force to the front, back, left, right, front right, front left, back right, and back left of the operation surface. Fig.16 In the example shown in (b), the partition "8" is selected by applying force to the front left of the operation surface. It should be noted that the selected partition is changed in size and color to make it eye-catching.

[0119] Then, when "8" is selected in the "Menu" level (first level 331), the user can enter the next level (see Fig.16 (c)). Fig.16In the example shown in (c), the level "8" (second level 332) has a new circular menu centered on the location where item "8" exists, and displays selection items "81" to "88" in a clockwise direction from the top partition. Here, the user can select one of the eight items in the level "8" (second level 332) by applying force to the front, back, left, right, front right, front left, right rear, and left rear of the operating surface, as in the first level 331. Fig.10 In the example shown in (d), the partition "82" is selected by applying force to the front right of the operation surface.

[0120] Next, when "82" is selected in the level "8" (second level 332), the user can enter the next level (see Fig.16 (e)). Fig.16 In the example shown in (e), the level "82" (third level 333) has a newly superimposed circular menu centered on the location where item "82" exists, and displays selection items "821" to "828" in a clockwise direction from the top partition. Here, the user can select one of the eight items in the level "82" (third level 333) by applying force to the front, back, left, right, front left, right rear, and left rear of the operating surface, similarly to the first level and the second levels 331 and 332. Fig.10 In the example shown in (f), the partition "821" is selected by applying force to the front of the operation surface.

[0121] The level of "82" (third level 333) is the final level. When "821" is selected, the user presses the thumb 22 on the operation surface of the first sensor 5 to execute the item "821" (refer to Fig.16 (g)).

[0122] In this way, using the circular menu, a multi-level item selection can be performed by operating the finger-worn controller 1 worn on the first finger 21 of the user only with the thumb 22 .

[0123] In addition, operations such as canceling and switching input modes can be performed as follows Fig.17 As shown in the table, it is performed by tapping, double-clicking, and tapping & touching using the touch sensor function. For example, if you want to cancel the item you just executed, double-click. In addition, if you accidentally enter the wrong level during item selection, you can end the item selection by lifting your finger and then tapping it immediately, and then start again. Regarding input mode switching (display position and display size of the ring menu, other settings), it is performed as follows: when tapping & touching is detected, a partition in which multiple input modes are arranged is displayed as a GUI, and then the partition is selected.

[0124] It should be noted that the above-described operation example using the thin-film three-axis force sensor can also be applied to existing hand-held remote control type controllers, touch panels, and the like.

[0125] 3. Variations

[0126] (Variation 1)

[0127] exist Figure 1 In the example shown, the finger-worn controller 1 is worn between the first joint and the second joint of the first finger 21, but the finger-worn controller 1 of the first embodiment can be worn on any part of any finger. Figure 4 As shown, the finger-worn controller 1 may also be worn at the base of the first finger 21 .

[0128] (Variation 2)

[0129] In terms of operation, it is preferred that the first finger 21 be any one of the four fingers other than the thumb of one hand of the user, but sometimes it is more convenient to use the middle finger as the first finger 21 than the index finger close to the thumb 22 to perform user operations other than input to the finger-worn controller 1. For example, it can be cited that while writing characters and drawing on the touch pad with the index finger, the finger-worn controller 1 worn on the middle finger is used to adjust the shading, blurring and color.

[0130] It should be noted that it is not impossible to use the thumb as the first finger 21. In this case, one or more of the four fingers other than the thumb of the same hand will be used to touch the first sensor 5.

[0131] (Variation 3)

[0132] In addition, if Figure 2 As shown in FIG. 1 , the inner peripheral surface of the first opening 4a of the wearing member 4 in the first embodiment may not completely cover the periphery of the first finger 21. That is, the inner peripheral surface of the first opening 4a may be discontinuous due to the slit 4f. For example, Fig.15 As shown, the portion constituting the inner periphery of the first opening 4a may also have a C-shaped cross section.

[0133] The finger-worn controller configured as above has the wearing member 4 formed of a deformable material, and can be worn regardless of the size of the first finger 21 by inserting the first finger 21 into the first opening 4 a having a small inner diameter.

[0134] (Variation 4)

[0135] In addition, the first sensor 5 described above also has a touch sensor function, but it is not necessarily required to have this function in the present embodiment. The touch sensor function can be omitted depending on the required operation content.

[0136] [Second embodiment]

[0137] Hereinafter, a second embodiment of the present invention will be described based on the drawings.

[0138] Figure 5 This is a schematic cross-sectional view showing another structural example of the finger-worn controller (ring shape) involved in the present invention.

[0139] The finger-worn controller 1 of the present invention may further include a second sensor 10 on the outer surface of the wearing member 4 , and the second sensor 10 may be arranged to face the second finger 23 adjacent to the first finger 21 which is any one of the four fingers other than the thumb 22 .

[0140] The second sensor 10 is configured to detect whether there is a press or a contact between the first finger 21 and the second finger 23. For example, a capacitive touch sensor that measures the electrostatic capacitance of an electrode and detects press or contact based on the change in the capacitance can be used. In addition, other known devices that detect press or contact can be used. Figure 5 In the example shown, the first finger 21 is the index finger and the adjacent second finger 23 is the middle finger.

[0141] The control circuit 7 is also electrically connected to the second sensor 10, and the wearing component 4 has an outlet 4e (see FIG. 4 ) for wiring from the control circuit 7 accommodated in the space 4c to the second sensor 10 arranged on the outer side. Figure 5 ).

[0142] By configuring in this way, the finger-worn controller 1 can control the first sensor 5 so that when the second sensor 10 detects that there is no pressing or contact, the controller 1 is in a state where the power consumption is lower than when there is pressing or contact. Here, the state of lower power consumption refers to, for example, a state where the first sensor 5 is not detecting or a state where the detection interval of the first sensor 5 is extended.

[0143] The other structures are the same as those of the first embodiment, and thus the description thereof will be omitted.

[0144] [Third Embodiment]

[0145] Hereinafter, a third embodiment of the present invention will be described based on the drawings.

[0146] Figure 6 This is a schematic cross-sectional view showing another structural example of the finger-worn controller (ring shape) involved in the present invention.

[0147] In the first embodiment, the ring-shaped wearing component 4 has only the first opening 4a, but the finger-worn controller 1 of the present invention is not limited thereto. For example, the ring-shaped wearing component 4 may have a second opening 4b in addition to the first opening 4a. The second opening 4b is used to receive the thumb 22 of the same hand and any one of the three fingers 2 other than the first finger 21, that is, the second finger 23 adjacent to the first finger 21. Figure 6 In the example shown, the first finger 21 is the index finger and the second finger 23 is the middle finger.

[0148] With such a configuration, when a shear force is applied to the pressure-sensitive surface of the finger-worn controller 1 in the direction around the first finger 21, the second finger 23 inserted into the second opening 4b acts as a stopper to prevent the wearing component 4 from rotating around the first finger 21. When the wearing component 4 rotates around the first finger 21 during input, the effective area 5a of the first sensor 5 moves, making input difficult.

[0149] The other structures are the same as those of the first embodiment, and thus the description thereof will be omitted.

[0150] [Fourth Embodiment]

[0151] Hereinafter, a fourth embodiment of the present invention will be described based on the drawings.

[0152] Figure 7 This is an explanatory diagram showing a configuration example of a finger-worn controller (in the shape of a fingertip) according to the present invention and an operation example thereof.

[0153] In the first embodiment, the finger-worn controller 1 is in the shape of a ring, but the finger-worn controller 1 of the present invention is not limited thereto. For example, the finger-worn controller 1 may also be in the shape of a finger glove. Figure 7 As shown in FIG. 1 , the finger sleeve shape refers to a bag-like shape that covers the finger 2 from the finger tip toward the base of the finger. That is, the shape of the wearing part 4 is different from the ring-shaped finger-worn controller 1. It should be noted that, from the cross-sectional view, the shape of the wearing part 4 is different from that of the first embodiment. Figure 2 The same is true for the embodiment of the present invention, but the first opening 4a of the wearing member 4 is not a through hole.

[0154] In this embodiment, since the wearing member 4 is in the shape of a fingertip, the area of ​​the effective region 5a of the first sensor 5 can be increased compared to the case of a ring shape. As described in the first embodiment, the first sensor 5 can simultaneously input the direction and the amount of movement by a small movement of the thumb 22, but even so, if the effective region 5a can be expanded in the direction from the fingertip toward the base of the finger, the variation of the operation of the thumb 22 will increase.

[0155] Since the wearing member 4 of this embodiment is in the shape of a finger sleeve, a material that is easily deformed to easily bend the joint of the finger 2 can be used. For example, thermoplastic elastomer resins such as polyester, olefin, urethane, and polyamide are preferably used because they are excellent in deformability to adapt to the first finger 21 of the user.

[0156] The other structures are the same as those of the first embodiment, and thus the description thereof will be omitted.

[0157] [Fifth Embodiment]

[0158] Hereinafter, a fifth embodiment of the present invention will be described based on the drawings.

[0159] Figure 8 1 is an explanatory diagram showing another structural example of a finger-worn controller (in the shape of a fingertip) according to the present invention and an example of wearing the controller. Figure 8 Among them, (a) is an example in which the first finger is the index finger, and (b) is an example in which the first finger is the middle finger. Fig. 9 It is shown Figure 8 1 and 2 (b) are diagrams for explaining an operation example of a finger-worn controller (in the shape of a fingertip).

[0160] In the finger-worn controller 1 in the shape of a fingertip of the fourth embodiment, the effective area 5a of the first sensor 5 is located at a position that can be touched by the thumb 22 of the same hand, but the finger-worn controller 1 of the present invention is not limited to this. For example, in the case where the wearing member 4 is in the shape of a fingertip, as shown in FIG. Figure 8 As shown, the effective area 5a of the first sensor 5 may be arranged on the tip of the finger.

[0161] With this structure, input can be performed by pressing the ventral surface of the finger 2 wearing the finger-worn controller 1 on the table or somewhere on the body (such as the thigh, or the back of the hand not wearing the finger-worn controller 1, etc.).

[0162] In this case, since the first sensor 5 is not operated by the thumb 22, any finger 2 including the thumb 22 of the same hand can be used as the first finger 21 for wearing the finger wearable controller 1. Figure 8 In the figure, (a) is an example of wearing the finger-worn controller 1 by inserting the index finger as the first finger 21 into the first opening 4a of the wearing member 4, and (b) is an example of wearing the finger-worn controller 1 by inserting the middle finger as the first finger 21 into the first opening 4a of the wearing member 4. In addition, the controller may be worn on two or more fingers.

[0163] The other structures are the same as those of the first embodiment, and thus the description thereof will be omitted.

[0164] As mentioned above, although one embodiment of the present invention has been described, the present invention is not limited to the embodiment, and various modifications can be made without departing from the gist of the invention.

[0165] Description of Reference Numerals

[0166] 1: finger-worn controller; 2: finger; 21: first finger; 21a: fingertip; 22: thumb; 23: second finger; 3: external electronic device; 31: screen; 32, 33: GUI; 321-323: partition; 331: first level; 332: second level; 333: third level; 4: wearing part; 4a: first opening; 4b: second opening; 4c: space; 4d, 4e: outlet; 4f: slit; 5: first sensor; 5a: effective area; 6: protective layer; 6a: convex part; 7: control circuit; 8: wireless transceiver; 9: battery; 10: second sensor.

Claims

1. A finger-worn controller, worn on a user's finger to control an external electronic device, comprising: a wearing component having a first opening for receiving a first finger of the user; A first thin-film sensor is configured to be at least partially disposed on the outer side of the wearing member and detect triaxial forces in an effective area; a protective layer, covering the first sensor; a control circuit, contained in the wearable component and electrically connected to the first sensor; a wireless transceiver configured to be housed in the wearable component, electrically connected to the control circuit and to communicate with the external electronic device; and A battery is housed in the wearable component and supplies power to the control circuit.

2. The finger-worn controller according to claim 1, wherein: The wearing component is in the shape of a ring.

3. The finger-worn controller according to claim 1, wherein: The wearing component is in the shape of a finger sleeve.

4. The finger-worn controller according to claim 3, wherein: The active area of ​​the first sensor is located at the tip of a first finger of the user.

5. The finger-worn controller according to claim 1, wherein: The first finger is any one of four fingers other than a thumb of one hand of the user, The effective area of ​​the first sensor is located at a position that can be touched by the thumb of the same hand.

6. The finger-worn controller according to claim 5, wherein: The protective layer becomes thicker only on the active area of ​​the first sensor to form a convex portion.

7. The finger-worn controller according to claim 5, wherein: A second sensor is further provided on the outer side of the wearing component, the second sensor being arranged to face a second finger and configured to detect whether there is a press or contact between the first finger and the second finger, the second finger being any one of the four fingers other than the thumb and adjacent to the first finger. The control circuit is electrically connected to the second sensor, and when the second sensor detects that there is no pressure or contact, the control circuit controls the first sensor to achieve a state in which power consumption is lower than when pressure or contact is detected.

8. The finger-worn controller according to claim 7, wherein: The state of low power consumption is a state in which detection by the first sensor is not performed.

9. The finger-worn controller according to claim 7, wherein: The state in which the power consumption is low is a state in which the detection interval of the first sensor is extended.

10. The finger-worn controller according to claim 2, wherein: The first finger is any one of four fingers other than a thumb of one hand of the user, The effective area of ​​the first sensor is located at a position that can be touched by the thumb of the same hand, The wearing member has a second opening for receiving a second finger, the second finger being any one of the thumb and three fingers other than the first finger of the same hand and adjacent to the first finger.

11. The finger-worn controller according to claim 1, wherein: The first sensor also has a touch sensor function for further detecting whether there is contact or proximity.

Images