Input Devices

Abstract

To allow for simple and accurate input by inputting data by movement of cheeks.SOLUTION: An input device (10) includes a cheek movement detecting device (12) and a computer (14). The cheek movement detecting device includes a mask type detecting unit 120. In the mask type detecting unit, two touch detecting units 124 are provided at right and left edges of cloth of a mask 122. Movements of cheeks of a user are detected by the touch detecting unit, and the computer generates operation data based on outputs of the touch detecting unit and inputs the generated data to an outside computer.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an input device, and more particularly to an input device for inputting operation data based on cheek movements, for example, into a computer. [Background technology]

[0002] An example of this type of conventional input device is disclosed in Patent Document 1. The gaze detection device disclosed in Patent Document 1 includes two first cameras for measuring the position of the pupil relative to a coordinate system, a light source for forming a corneal reflection point, and a second camera for acquiring data on the distance between the center of the pupil and the corneal reflection point and a predetermined angle of this distance relative to the coordinate axis of the coordinate system, and includes a calculation means for calculating the gaze direction from information from each camera. In this gaze detection device, in the relational equation determination stage, the subject is made to look at a known point, measurement is performed, and the relational equation is determined. In the gaze determination stage, the subject is measured again, and the gaze is determined using the relational equation. Patent Document 1 also discloses that this gaze detection device can be used as a gaze input means. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4517049 Summary of the Invention [Problem to be solved by the invention]

[0004] In the gaze detection device disclosed in the above Patent Document 1, when determining the gaze, the subject or user needs to focus on a known point to be input, which makes the operation cumbersome and relatively difficult to input accurately. In addition, when confirming the input, the user needs to focus on the known point for a certain amount of time, which makes it difficult to input quickly.

[0005] SUMMARY OF THE PRESENT EMBODIMENT It is therefore a primary object of the present invention to provide a novel input device.

[0006] Another object of the present invention is to provide an input device which is easy to operate and allows accurate and high-speed input. [Means for solving the problem]

[0007] The first invention includes a deformable sheet-like covering part that covers at least a part of the cheek of the user, a covering part that is attached to the side of the covering part that comes into contact with the face of the user, and a mask that covers at least the cheek of the user. left Cheek movement and right cheek movement A detection unit capable of detecting the above, and a detection unit Operation data based on the user's left cheek movement and / or right cheek movement The input device includes a generating unit that generates operation data based on the action of the input device.

[0008] A second invention is according to the first invention, and further comprises a transmission unit which transmits the operation data generated by the generation unit to an external computer.

[0009] A third invention is according to the first or second invention, wherein the detection unit comprises: Two It is a capacitive touch sensor, Two The capacitive touch sensors are arranged on the left and right sides of the covering portion, respectively, and detect the movement of the user's left cheek and / or right cheek.

[0010] A fourth invention is according to the first or second invention, and the detection unit includes four capacitive touch sensors, the four capacitive sensors being arranged on the top, bottom, left and right of the covering unit, respectively, and detecting a movement of at least one of the left cheek, right cheek, philtrum and chin of the user. The generation unit generates at least one of operation data based on the movement of the user's left cheek, operation data based on the movement of the user's right cheek, operation data based on the movement of the user's philtrum, and operation data based on the movement of the user's jaw detected by the four capacitive sensors.

[0011] A fifth invention is according to the third or fourth invention, and includes a capacitive touch sensor comprising a conductive cloth formed by overlapping a first cloth formed by knitting conductive yarn with a second cloth formed by knitting insulating yarn, an insulating sheet having the same size as the first cloth and overlapping and affixed to the first cloth, and a capacitive sensor IC electrically connected to the first cloth.

[0012] A sixth invention is according to the fifth invention, wherein the conductive cloth has elasticity. Effect of the Invention

[0013] According to this invention, a user wearing a mask equipped with a touch detection unit can perform operations similar to those of a computer mouse by moving his / her cheek, which simplifies the operation and enables accurate and high-speed input of characters.

[0014] The above objects, other objects, features and advantages of the present invention will become more apparent from the following detailed description of the embodiments with reference to the drawings. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a block diagram showing the electrical configuration of an input device according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing the electrical configuration of the cheek movement detection device shown in FIG. [Diagram 3] FIG. 3 is a diagram showing the outline of the external configuration of the mask-type detection unit. [Figure 4] FIG. 4 is a diagram for explaining an outline of the configuration of the touch detection unit shown in FIG. [Diagram 5] 5(A) is a partial enlarged view of the conductive surface side of the conductive cloth constituting the touch detection unit shown in FIG. 4, and FIG. 5(B) is a partial enlarged view of the non-conductive surface side of the conductive cloth constituting the touch detection unit shown in FIG. 4. [Figure 6] FIG. 6 is a partial enlarged view of the conductive cloth constituting the touch detection unit shown in FIG. [Figure 7] FIG. 7(A) is a diagram showing an example of a state in which a user is not touching the touch detection unit of the cheek movement detection device shown in FIG. 1, and FIG. 7(B) is a diagram showing an example of a state in which a user is touching the touch detection unit of the cheek movement detection device shown in FIG. 1. [Figure 8] FIG. 8 is a diagram showing an example of a memory map of a RAM built into the computer shown in FIG. [Figure 9] FIG. 9 is a flowchart showing an example of the operation detection and operation data generation processing of the CPU built in the computer shown in FIG. [Figure 10] FIG. 10 is a block diagram showing the electrical configuration of a character input system using the input device shown in FIG. [Figure 11] FIG. 11 is a flowchart showing an example of a character input process of a CPU built into the user terminal shown in FIG. [Figure 12] FIG. 12 is a block diagram showing the electrical configuration of the system according to the second embodiment. [Figure 13] FIG. 13 is a diagram showing a schematic external configuration of a mask-type detection unit included in the cheek movement detection device shown in FIG. [Figure 14] FIG. 14 is a block diagram showing an example of the electrical configuration of the wheelchair shown in FIG. [Figure 15] FIG. 15 is a flowchart showing a part of an example of a wheelchair control process by a CPU built in the computer shown in FIG. [Figure 16] FIG. 16 is a flowchart showing another part of the wheelchair control processing by the CPU built in the computer shown in FIG. 14, which follows FIG. [Figure 17] FIG. 17 is a flow chart showing another part of the wheelchair control processing by the CPU built in the computer shown in FIG. 14, which follows FIG. [Figure 18] FIG. 18 is a flowchart showing an example of mouse operation processing by the CPU built into the user terminal of the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] [First Example] 1, an input device 10 of the first embodiment includes a cheek motion detection device 12, which is communicatively connected to a computer 14. The cheek motion detection device 12 will be described in detail later.

[0017] The computer 14 is a general-purpose server or PC, and includes components such as a CPU 14a, a RAM 14b, and a communication device 14c. The computer 14 also includes other storage units configured with non-volatile memories such as HDDs, flash memories, and EEPROMs, or semiconductor memories such as SSDs.

[0018] The CPU 14a is a processor that controls the overall control of the computer 14. The RAM 14b is a main storage device of the computer 14, and functions as a buffer area and a work area of ​​the CPU 14a. The communication device 14c is a communication module for communicating with the cheek movement detection device 12 or an external computer via a wired or wireless communication method such as Ethernet or Wi-Fi.

[0019] 2 is a block diagram showing the electrical configuration of cheek movement detection device 12. Cheek movement detection device 12 includes a mask type detection section 120 and a controller 130, and a touch detection section 124 (described later) of mask type detection section 120 is electrically connected to controller 130.

[0020] 3 is a diagram showing an outline of the structure of the mask type detection unit 120. The mask type detection unit 120 includes a general-purpose mask 122, and touch detection units 124 are provided on the left and right ends of the mask 122, respectively.

[0021] In addition, in Fig. 3, in order to clearly show the positional relationship between the positions of the left and right cheeks of the user and each of the two touch detection units 124, a part of the user's face covered by the mask 122 is also shown by a solid line. Also, in Fig. 3, in order to clearly show the positions of the two touch detection units 124 arranged on the mask 122, a state in which the user does not hang the strings of the mask 122 from his / her ears is shown. Furthermore, in Fig. 3, the touch detection units 124 are filled in gray. These are the same in Fig. 13 of the second embodiment.

[0022] As an example, the mask 122 is a household mask of gauze type, nonwoven fabric type, or urethane type made of a deformable material, and covers a part of the user's face with a sheet-like covering part. The part of the user's face specifically means all or part of the mouth, nose, chin, and each of the left and right cheeks.

[0023] In the first embodiment, the mask 122 used had a covering portion measuring 9 cm in length and 17 cm in width.

[0024] However, a medical mask (i.e., a surgical mask) may also be used as the mask 122. In addition, the mask 122 does not need to be limited to a household mask or a medical mask, and a dedicated mask may also be created.

[0025] As described later, in the first embodiment, it is sufficient to detect the movement of the user's cheek, so that the mask 122 only needs to cover at least a part of the user's cheek. Also, it is sufficient to detect the movement of the user's cheek, and it is sufficient for the user to visually confirm the content and position of input using the input device 10, so that the mask 122 may cover the entire head except for the eyes.

[0026] The two touch detection units 124 are each formed in a strip shape and, as an example, fixed in a vertically long direction between the outer and inner (i.e., the user side wearing the mask 122) cloths of the layered mask 122 (i.e., the covering portion). However, the touch detection units 124 may be fixed to the surface of the outer or inner cloth of the mask 122. As described later, the touch detection units 124 are made of cloth and therefore can be sewn to the mask 122.

[0027] In addition, in the first embodiment, when viewed from the side of a user wearing the mask-type detection unit 120 (or the mask 122), the touch detection unit 124a is attached to the left end of the fabric of the mask 122, and the touch detection unit 124b is attached to the right end of the fabric of the mask 122.

[0028] Hereinafter, in this specification, when there is no need to particularly distinguish between the touch detection units 124a and 124b, they will simply be referred to as the "touch detection units 124."

[0029] In this first embodiment, the user wears the above-mentioned mask-type detection unit 120 and moves either the left cheek or the right cheek or both, and the movement is detected by the touch detection unit 124a and / or the touch detection unit 124b. The user can inflate the cheek with air or press the cheek from the inside to the outside with the tongue to contact or press the cheek against the touch detection unit 124 (hereinafter, simply referred to as a "pressing movement"). Also, in this specification, the user can perform a clicking movement by performing a pressing movement and then stopping the pressing movement (i.e., moving the cheek away from the mask 122).

[0030] In other words, by moving the cheek, the user can perform an operation similar to pressing down the left and right buttons of a computer mouse, and then pressing and releasing the left and right buttons.

[0031] FIG. 4 is a diagram showing an outline of the structure of the touch detection unit 124 shown in FIG. 3. As shown in FIG. 4, the touch detection unit 124 has a layered structure, and includes a conductive cloth 200 and an insulating tape 220. Furthermore, the conductive cloth 200 is formed by bonding a conductive surface side cloth 200a (corresponding to a "first cloth") and a non-conductive surface side cloth 200b (corresponding to a "second cloth"). The insulating tape 220 is attached to the conductive surface side cloth 200a. Although not shown, the controller 130 shown in FIG. 3 is connected to the conductive surface side cloth 200a of each of the touch detection units 124a and 124b by electric wires.

[0032] FIG. 5(A) is a partial enlarged view of the conductive surface side cloth 200a, and FIG. 5(B) is a partial enlarged view of the non-conductive surface side cloth 200b. Also, FIG. 6 is a partial enlarged view of the conductive cloth 200 constituting the touch detection unit 124 of the cheek motion detection device 12. The conductive surface side cloth 200a, the non-conductive surface side cloth 200b, and the conductive cloth 200 of this first embodiment will be specifically described with reference to FIG. 5(A), FIG. 5(B), and FIG. 6. However, in FIG. 5(A), FIG. 5(B), and FIG. 6, the non-conductive surface side cloth 200b is shown by a hollow line in order to easily show the conductive surface side cloth 200a and the non-conductive surface side cloth 200b. Also, in FIG. 6, the insulating thread 200c is shown by a dotted line.

[0033] The conductive surface side cloth 200a is made by circular knitting conductive yarn. In this first embodiment, the conductive yarn is silver-plated nylon yarn. The non-conductive surface side cloth 200b is made by circular knitting insulating yarn. In this first embodiment, the insulating yarn is polyester yarn. In this way, the conductive surface side cloth 200a and the non-conductive surface side cloth 200b that make up the conductive cloth are both made by circular knitting, and therefore have high elasticity.

[0034] As shown in FIG. 6, the conductive cloth 200 is made by knitting in a bonded jersey stitch. That is, the conductive cloth 200 is knitted by knitting the conductive surface side cloth 200a and the non-conductive surface side cloth 200b with an insulating thread 200c such as polyester thread between them, so that the conductive surface side cloth 200a and the non-conductive surface side cloth 200b are bonded together. Therefore, the conductive cloth 200 has a three-layer structure of the conductive surface side cloth 200a, the non-conductive surface side cloth 200b, and the insulating thread 200c between them. However, in FIG. 4, the layer of insulating thread 200c for bonding the conductive surface side cloth 200a and the non-conductive surface side cloth 200b is omitted.

[0035] In this first embodiment, the conductive cloth 200 is made by bonded jersey knitting, but it is also possible to make two pieces of cloth, the conductive side cloth 200a and the non-conductive side cloth 200b, separately and then attach them together with insulating thread 200c so that their surfaces meet.

[0036] In addition, in the first embodiment, the conductive surface side cloth 200a and the non-conductive surface side cloth 200b are made by circular knitting in order to give the conductive cloth 200 elasticity, but this is not necessary to be limited to this. The conductive surface side cloth 200a and the non-conductive surface side cloth 200b may be made by weft knitting or warp knitting. In such a case, the conductive cloth 200 can also be made elastic.

[0037] The insulating tape 220 is an insulating sheet with an adhesive applied to one side. The insulating sheet is made of nylon. As an example of the insulating tape 220, "Nylon Repair Sheet Seal Type" manufactured by KAWAGUCHI Corporation can be used.

[0038] The controller 130 is also called a capacitance sensor IC, and detects the capacitance generated between the conductive surface side cloth 200a and a conductive object at ground potential. A DC voltage is supplied from a power source to the controller 130, which is used to detect the capacitance. In simple terms, the controller 130 detects the capacitance every predetermined period (for example, 5 seconds), applies a predetermined value of DC voltage to the conductive surface side cloth 200a in the earlier period (for example, 2.5 seconds) of the predetermined period, and calculates the capacitance by detecting the voltage value when the conductive surface side cloth 200a is discharged in the remaining period of the predetermined period. As an example of the controller 130 having the function of calculating the capacitance, a microcontroller (model number: PIC16F1847) manufactured by Microchip Technology Japan Co., Ltd. can be used.

[0039] However, in this first embodiment, the cloth 200a on the conductive surface side of the two touch detection units 124 is connected to different ports of the capacitance sensor IC using electric wires covered with insulating resin such as polyvinyl chloride. Therefore, the capacitance generated between the cloth 200a on the conductive surface side of each touch detection unit 124 and a conductor at ground potential is detected individually.

[0040] The cheek motion detection device 12 configured as above can function as a touch sensor. Fig. 7(A) shows an example of a state where the touch detection unit 124 is not touched, and Fig. 7(B) shows an example of a state where the touch detection unit 124 is touched. However, the controller 130 is omitted in Fig. 7(A) and Fig. 7(B). Also, for convenience of explanation, the user's finger is depicted in Fig. 7(A) and Fig. 7(B), but in reality, the touch detection unit 124 is touched by the user's cheek. Also, for convenience of explanation, the inner layer of the fabric of the mask 122 is omitted in Fig. 7(A) and Fig. 7(B).

[0041] As shown in FIG. 7B, when a user at ground potential touches insulating tape 220 of touch detection unit 124, capacitance C occurs between cloth 200a (touch detection unit 124) on the conductive surface side and the user's finger.

[0042] Therefore, in the first embodiment, the touch detection unit 124 is fixed to the mask 122 such that the insulating tape 220 faces the inside (user side) of the mask 122 and the non-conductive cloth 20b faces the outside.

[0043] The capacitance C can be calculated by the following formula (Formula 1). In the formula, ε is the dielectric constant, which is determined by the material of the insulating tape 220 in the first embodiment. D is the distance between the touch detection unit 124 and the user's hand. S is the area of ​​the touch detection unit 124, which is 1.5 cm×4 cm in the first embodiment.

[0044] [Number 1] C=ε×S / D In this manner, when the capacitance C occurs, it is detected that a conductive body such as a user is touching the touch detection unit 124.

[0045] Therefore, in this first embodiment, the cheek movement of a user wearing the mask-type detection unit 120 is detected by a change in the capacitance C of the touch detection unit 124. However, when the user wears the mask-type detection unit 120, the distance D between the user's cheek and the touch detection unit 124 is about several mm, so that some capacitance C is generated even when the user does not move his / her cheek, i.e., when the user does not contact (touch) the touch detection unit 124. Therefore, the output of the controller 130 is calibrated to be zero or approximately zero when the user wears the mask 122 and the user's cheek is not in contact with the touch detection unit 124 (the cloth inside the mask 122).

[0046] As described above, since the capacitance C occurs even when the user's cheek does not touch the touch detection unit 124, the computer 14 (CPU 14a) is configured to determine that the user's cheek has touched the touch detection unit 124, i.e., a pressing operation, when the output of the controller 130 (hereinafter sometimes referred to as the "sensor value") has changed by a predetermined threshold value or more. When the computer 14 (CPU 14a) determines that a pressing operation has occurred, it generates operation data of the pressing operation.

[0047] In an experiment, when the user's cheek touches the touch detection unit 124, the capacitance changes by about 300 F compared to before the user's cheek touches the touch detection unit 124, so the predetermined threshold is set between 150 F and 250 F.

[0048] Furthermore, when the computer 14 (CPU 14a) detects that the pressing action has stopped, if a pressing action was performed prior to a first predetermined time (100 msec in the first embodiment), it determines that a click action has been performed and generates operation data for the click action.

[0049] When the computer 14 (CPU 14a) generates the operation data, it transmits (or inputs) the generated operation data to an external computer to which the input device 10 is connected.

[0050] In this first embodiment, the length of time that the pressing action is performed is not relevant to determining whether it is a click action, but if the pressing action is relatively long (for example, 1 second or more), it may be determined to be a long press action rather than a click action.

[0051] Fig. 8 shows an example of a memory map 300 of the RAM 14b of the computer 14 shown in Fig. 1. As shown in Fig. 8, the RAM 14b includes a program storage area 302 and a data storage area 304.

[0052] The program storage area 302 stores the program of the input device 10 (that is, the information processing program), and the information processing program includes a communication program 302a, a sensor value detection program 302b, and an operation data generation program 302c.

[0053] The communication program 302a is a program for communicating with the controller 130 and an external computer. The sensor value detection program 302b is a program for detecting a sensor value based on the output of the touch detection unit 124 transmitted from the controller 130. However, the sensor value based on the output of the touch detection unit 124a and the sensor value based on the output of the touch detection unit 124b are made distinguishable from each other.

[0054] The operation data generation program 302c is a program for generating operation data based on the sensor values ​​detected according to the sensor value detection program 302b. However, the operation data generation program 302c generates operation data regarding the left cheek movement based on the sensor value of the touch detection unit 124a, and generates operation data regarding the right cheek movement based on the sensor value of the touch detection unit 124b.

[0055] The data storage area 304 stores sensor value data 304a, operation data 304b, a pressing action flag 304c, a no-action flag 304d, and the like.

[0056] The sensor value data 304a is data on the sensor values ​​transmitted from the controller 130, and is stored so that the sensor value based on the output of the touch detection unit 124a and the sensor value based on the output of the touch detection unit 124b can be distinguished from each other. The sensor value data 304a is stored in chronological order, and is deleted after being used by the CPU 14a for the generation process of the operation data.

[0057] The operation data 304b is generated based on the sensor value data 304a, and is stored so as to be identifiable for each of the touch detection sections 124a and 124b.

[0058] The pressing action flag 304c is a flag for determining whether the action of the user's cheek is a pressing action. The pressing action flag 304c is turned on when a pressing action is detected, and is turned off when no action or a clicking action is detected.

[0059] The no-motion flag 304d is a flag for determining whether the user's cheek motion is no motion or not. The no-motion flag 304d is turned on when no motion is detected, and is turned off when a pressing motion is detected.

[0060] However, the pressing action flag 304c and the no-action flag 304d are provided so as to be distinguishable for each of the left and right cheeks, that is, for each of the touch detection units 124a and 124b.

[0061] Fig. 9 is a flow diagram of the motion detection and operation data generation process of the CPU 14a built in the computer 14. The motion detection and operation data generation process shown in Fig. 9 is executed separately for each of the sensor values ​​based on the output of the left touch detection section 124a and the right touch detection section 124b. That is, the motion of the left cheek is detected, and operation data corresponding to the motion of the left cheek (hereinafter, sometimes referred to as "left operation data") is generated, and the motion of the right cheek is detected, and operation data corresponding to the motion of the right cheek (hereinafter, sometimes referred to as "right operation data") is generated.

[0062] When the CPU 14a receives an instruction from a user or an instruction from an external computer connected for communication, as shown in FIG. 9, it starts a process of detecting motion and generating operation data, and in step S1, it determines whether the sensor value based on the output of the touch detection unit 124 is equal to or greater than a predetermined threshold value (e.g., 150).

[0063] If the answer is "YES" in step S1, that is, if the sensor value is equal to or greater than a predetermined threshold, the pressing action flag 304c is turned on in step S3, operation data for the pressing action is generated in step S5, and the no-action flag 304d is turned off in step S7, and the process returns to step S1.

[0064] However, in step S5, when the operation data is generated, the corresponding operation data 304b is stored in the RAM 14b and input (or transmitted) to an external computer. This also applies to step S17 described later.

[0065] If the pressing flag 304c is already on, the process of step S3 is skipped. Similarly, if the no-action flag 304d is already off, the process of step S7 is skipped. The same applies to the cases where other flags are on or off.

[0066] If step S1 is "NO", that is, if the sensor value is less than the predetermined threshold, step S9 determines whether the pressing flag 304c was on a first predetermined time (for example, 500 msec) before. Although not shown, when the pressing flag 304c is changed from on to off, the CPU 14a starts counting a timer provided in the RAM 14b, and determines whether the count value is equal to or less than the first predetermined time.

[0067] If "NO" in step S9, that is, if the pressing flag 304c before the first predetermined time is off, in a step S11, the no-motion flag 304d is turned on, and in a step S13, the pressing flag 304c is turned off, and the process returns to step S1.

[0068] On the other hand, if "YES" in step S9, that is, if the pressing action flag 304c before the first predetermined time is on, in step S15, operation data of a click action is generated, and then in step S17, the pressing action flag 304c is turned off, and the process returns to step S1.

[0069] The input device 10 of the present invention shown in Fig. 1 can be used as an input device for an external computer. As an example, Fig. 10 is a block diagram showing the electrical configuration of a system 400 in which the input device 10 is applied to an input system using an eye-gaze input device.

[0070] 10, the system 400 includes an input device 10, a user terminal 20, and an eye-gaze input device 22. The user terminal 20 and the eye-gaze input device 22 are connected to a computer 14 so as to be able to communicate with each other.

[0071] The user terminal 20 is a general-purpose desktop PC or a tablet terminal, and includes components such as a CPU 20a, memory (RAM, ROM, HDD), a communication device, and a display.

[0072] The eye-gaze input device 22 captures an image of the user's face with a camera and calculates (or estimates) the user's eye-gaze direction from the captured image. However, the position or area of ​​the display surface of the display relative to the eye-gaze direction can be specified based on the positional relationship between the user's face, the camera, and the display of the user terminal 20.

[0073] The gaze input device 22 may be a gaze direction estimation device disclosed in Japanese Patent Application Laid-Open No. 2014-194617 or Japanese Patent Application Laid-Open No. 2012-216180, which is well known and has been filed by the applicants and has already been published. However, the computer 14 may function as a computer main body included in the gaze direction estimation device.

[0074] When the user terminal 20 is a tablet terminal, the camera of the eye-gaze input device 22 can be a camera provided in the tablet terminal.

[0075] The computer 14 integrates the detection result data (hereinafter referred to as "sensor value") input from the cheek movement detection device 12 and the gaze direction data input from the gaze input device 22, and inputs the integrated data to an external computer (here, the user terminal 20). The computer 14 synchronizes the detection result data with the gaze direction data. For this reason, the gaze input device 22 is connected to the computer 14.

[0076] The user terminal 20 receives the operation data and / or directional input data input from the input device 10 and executes a predetermined process. Here, a case will be described in which the user terminal 20 executes a predetermined application for inputting characters. However, since only the operation data of the click action is used in the character input process shown in FIG. 11, even if the user terminal 20 receives the operation data of the pressing action, it does not use it for the character input process. For this reason, the input device 10 may not transmit the operation data of the pressing action to the user terminal 20.

[0077] Fig. 11 is a flow diagram of character input processing of the CPU 20a of the user terminal 20 shown in Fig. 10. When the cheek movement and gaze-based character input function is executed, the character input processing shown in Fig. 11 is executed. Although not shown in the figure, a predetermined application for entering characters for document creation or e-mail, etc. is also executed at the same time in the user terminal 20.

[0078] 11, when the CPU 20a of the user terminal 20 starts character input processing, in step S31, a software keyboard is displayed on the display of the user terminal 20. In the following step S33, the mouse cursor is moved according to the movement of the line of sight. However, if the line of sight does not move, the mouse cursor does not move either.

[0079] In the next step S35, it is determined whether or not a left click operation has been performed. Here, the CPU 20a determines whether or not operation data of a left cheek click operation, that is, operation data of a click operation based on the output of the touch detection unit 124a, has been input from the computer 14. The same applies when determining whether or not another click operation has been performed.

[0080] If "NO" in step S35, that is, if there has been no left click operation, the process proceeds to step S45. On the other hand, if "YES" in step S35, that is, if there has been a left click operation, in step S37, it is determined whether or not the mouse cursor is pointing to any key on the software keyboard.

[0081] If "NO" in step S37, that is, if the mouse cursor is not pointing to any key on the software keyboard, in step S39, it is determined whether or not the mouse cursor is pointing to the end button of the above-mentioned predetermined application.

[0082] If "NO" in step S39, that is, if the mouse cursor is not pointing to the end button of the above-mentioned predetermined application, the process returns to step S33. On the other hand, if "YES" in step S39, that is, if the mouse cursor is pointing to the end button of the above-mentioned predetermined application, the process instructs the end of the predetermined application in step S41, and ends the character input process.

[0083] Also, if the result in step S37 is "YES", that is, if the mouse cursor is pointing to any key on the software keyboard, then in step S43, the character corresponding to the pointed key is input, and the process returns to step S33. That is, in step S43, the CPU 20a gives an instruction to a specific application to input the character corresponding to the pointed key. Therefore, in the specific application, the pointed character is input at the position where it should be input.

[0084] Also, in step S45, it is determined whether or not a right-side click motion has been performed. Here, the CPU 20a determines whether or not operation data of a right cheek click motion has been input from the computer .

[0085] If "NO" in step S45, that is, if there is no right-side click operation, the process returns to step S33. On the other hand, if "YES" in step S45, that is, if there is a right-side click operation, the previously input character is deleted (one character is deleted) in step S47, and the process returns to step S33.

[0086] According to the first embodiment, the user wearing the mask provided with the touch detection unit can perform the same operation as operating the buttons of a computer mouse by moving his / her cheek. This makes the operation simple and allows characters to be input accurately and quickly. Therefore, the user can shorten the time he / she gazes at the characters to be input, compared to inputting characters only by eye gaze input.

[0087] According to the first embodiment, the touch detection unit is made of conductive cloth and insulating tape, so that the cheek motion detection device, i.e., the sensor, can be easily manufactured. Moreover, the conductive cloth is made of bonded jersey knit, so it is highly durable.

[0088] Furthermore, according to the first embodiment, the mask and the touch detection unit are made of cloth and can be washed, so they can be kept clean even after repeated use.

[0089] In the first embodiment, the case of inputting characters has been described, but when another application is executed, a click action can be used to execute a command or cancel the execution of a command.

[0090] In the first embodiment, the left operation data or the right operation data is received to execute character input and one character deletion processing, but when both the left operation data and the right operation data are received simultaneously, other commands (for example, line feed) may be executed. In this case, the user puffs out both cheeks at the same time and touches the two touch detection sections at the same time.

[0091] Furthermore, in this first embodiment, two touch detection units are provided, but one touch detection unit is sufficient to function as an input device, and three or more touch detection units may be provided if the user can perform the operation intended.

[0092] Furthermore, in the first embodiment, a touch detection unit made of cloth is provided, but other sensors made of sheet-like soft materials can also be used. As an example, a thin tactile sensor (product name "Shock Cube (TM)" manufactured by Touchence Inc. can be used.

[0093] [Second Example] The second embodiment is a system 500 in which the input device 10 of the present invention is used to control an electric wheelchair 30. The system 500 will be described below, but since the input device 10 has been described in the first embodiment, a duplicated description will be omitted.

[0094] 12 is a block diagram showing the electrical configuration of a system 500 according to the second embodiment. As shown in FIG. 12, the system 500 includes an input device 10 and a wheelchair 30, and the wheelchair 30 is electrically connected to a computer 14.

[0095] Moreover, in the input device 10 of the second embodiment, the mask-type detection unit 120 includes four touch detection units 124. In addition to the left touch detection unit 124a and the right touch detection unit 124b described in the first embodiment, an upper touch detection unit 124c and a lower touch detection unit 124d are provided.

[0096] As shown in FIG. 13, the upper touch detection unit 124c is disposed upward from the center of the fabric of the mask 122, and the lower touch detection unit 124d is disposed downward from the center of the fabric of the mask 122.

[0097] The shape and material of the touch detection units 124c and 124d are the same as those of the touch detection units 124a and 124b. Moreover, the touch detection units 124c and 124d are fixed in a landscape orientation between the outer and inner fabrics of the mask 122 having a layered structure.

[0098] The user can bring the philtrum into contact with the touch detection unit 124c by inflating the space between the upper lip and nose with air or pushing it out with the tongue. In other words, the upper touch detection unit 124c detects the pressing and clicking actions on the upper side.

[0099] Also, the user can bring part of the chin into contact with the touch detection unit 124d by inflating the space between the lower lip and the chin with air or by pushing out the space with the tongue. In other words, the lower touch detection unit 124d detects the pressing and clicking actions on the lower side.

[0100] Strictly speaking, movements of the philtrum and parts of the jaw are not cheek movements, but for the purposes of this specification, these movements are also included in cheek movements.

[0101] In addition, hereinafter, in this specification, when there is no need to particularly distinguish between the touch detection units 124a-124d, they will simply be referred to as "touch detection unit 124."

[0102] Figure 14 is a block diagram showing an example of the electrical configuration of wheelchair 30. As shown in Figure 14, wheelchair 30 includes a computer 32, which is provided with an input / output interface (hereinafter simply referred to as "interface") 34, motor drivers 36a, 36b, motors 38a, 38b, and encoders 40a, 40b.

[0103] The computer 32, the interface 34 and the motor drivers 36a, 36b are housed in a box, which is provided under or behind the seat of the wheelchair 30.

[0104] The computer 32 is a general-purpose PC and includes components such as a CPU 32a, memory (RAM, ROM, and HDD), a communication device, etc. The computer 32 is connected to the computer 14 of the input device 10 so as to be able to communicate with it.

[0105] The computer 32 is also connected to an interface 34. The interface 34 is connected to a left motor 38a via a motor driver 36a and to a right motor 38b via a motor driver 36b. The interface 34 is also connected to encoders 40a and 40b.

[0106] Although not shown in the figure, the rotation shaft of the left motor 38a and the rotation shaft of the left rear wheel of the wheelchair 30 are connected using gears, and the rotation shaft of the right motor 38b and the rotation shaft of the right rear wheel of the wheelchair 30 are connected using gears.

[0107] The computer 32 controls the driving of the left motor 38a and the right motor 38b in response to the operation data from the input device 10, thereby controlling the movement of the wheelchair 30. As an example, when an upward click motion is detected by the touch detection unit 124c and operation data corresponding to the upward click motion is input, the computer 32 rotates the left motor 38a and the right motor 38b at a first predetermined speed to move the wheelchair 30 forward. When a downward click motion is detected by the touch detection unit 124d and operation data corresponding to the click motion is input, the computer 32 stops the left motor 38a and the right motor 38b to stop the wheelchair 30.

[0108] Furthermore, when the wheelchair 30 is moving forward, if a left click action is detected by the touch detection unit 124a and operation data corresponding to the click action is input, the computer 32 increases the rotation speed of the right motor 38b from the first predetermined speed to the second predetermined speed, causing the wheelchair 30 to turn left. When the wheelchair 30 is moving forward, if a right click action is detected by the touch detection unit 124b and operation data corresponding to the click action is input, the computer 32 increases the rotation speed of the left motor 38a from the first predetermined speed to the second predetermined speed, causing the wheelchair 30 to turn right.

[0109] Furthermore, when the wheelchair 30 is stopped, if the touch detection unit 124a detects a left click operation and inputs operation data corresponding to the click operation, the computer 32 rotates the right motor 38b at a third predetermined speed while stopping the left motor 38a, thereby turning the wheelchair 30 to the left. However, the third predetermined speed is set to be equal to or lower than the first predetermined speed. Also, when the wheelchair 30 is stopped, if the touch detection unit 124b detects a right click operation and inputs operation data corresponding to the click operation, the computer 32 rotates the left motor 38a at the third predetermined speed while stopping the right motor 38b, thereby turning the wheelchair 30 to the right.

[0110] Furthermore, when a click action on the lower side is detected by the touch detection unit 124d and operation data corresponding to the click action is detected a predetermined number of times within a second predetermined time, the computer 32 ends the control process for the wheelchair 30.

[0111] Specifically, the CPU 32a built into the computer 32 of the wheelchair 30 executes the wheelchair control process shown in Figures 15 to 17. Figures 15 to 17 are flow charts.

[0112] The processing of the input device 10 is the same as that of the first embodiment, and therefore a duplicated description will be omitted. However, in the second embodiment, the mask type detection unit 120 includes four touch detection units 124, and therefore the motion detection and operation data generation processing shown in Fig. 9 is executed for each of the four touch detection units 124, and the operation data based on the detection results of the top, bottom, left, and right touch detection units 124 is input to the computer 32 in an identifiable manner.

[0113] In addition, in the wheelchair control process shown in FIG. 15 to FIG. 17, only the operation data of the click action is used. Therefore, even if the user terminal 20 receives the operation data of the press action, Wheelchair Control Therefore, the input device 10 may be configured not to transmit the operation data of the pressing action to the user terminal 20.

[0114] When the main power supply of the wheelchair 30 is turned on, the CPU 32a starts the wheelchair control process as shown in Fig. 15, and in step S71, it determines whether or not a downward click motion has been performed. Here, the CPU 20a determines whether or not operation data of a click motion with the chin, that is, operation data of a click motion based on the output of the touch detection unit 124d, has been input from the computer 14. The same applies to determining whether or not there is another click motion.

[0115] If "NO" in step S71, that is, if there is no downward click motion, the process proceeds to step S89 shown in Fig. 16. On the other hand, if "YES" in step S71, that is, if there is a downward click motion, in step S73, it is determined whether the number of downward click motions (i.e., the number of clicks) is 0.

[0116] Although not shown, when the wheelchair control process is started, the counter that counts the number of clicks is reset (that is, the count value=0).

[0117] If the result is "YES" in step S73, that is, if the number of clicks on the lower side is 0, in step S75, the rotation speed of the left motor 38a and the right motor 38b is set to 0 (m / sec), in step S77, the number of clicks is incremented by 1 (number of clicks=1), in step S79, the timer is started, and the process returns to step S71.

[0118] However, in step S75, the CPU 32a controls the motor driver 36a and the motor driver 36b via the interface 34 to set (control) the rotation speeds of the left motor 38a and the right motor 38b. The same applies to the case of setting the rotation speeds of the left motor 38a and the right motor 38b.

[0119] On the other hand, if "NO" in step S73, that is, if the number of clicks on the lower side is not 0, it is determined in a step S81 whether the number of clicks is 3 or not. If "NO" in step S81, that is, if the number of clicks is 1 or 2, in step S83, the number of clicks is incremented by 1, and the process returns to step S71.

[0120] On the other hand, if "YES" in step S81, that is, if the number of clicks is 3, then in step S83, it is determined whether or not the count value of the timer has reached a second predetermined time (for example, 1 second).

[0121] If step S83 is "YES", that is, if the timer count has passed the second predetermined time, the counter is reset (i.e., the number of clicks = 0) in step S87, and the process returns to step S71. In other words, if the downward click action is not performed three times within the second predetermined time, the wheelchair control process is not terminated. On the other hand, if step S83 is "NO", that is, if the timer count has not passed the second predetermined time, the wheelchair control process is terminated.

[0122] In step S89 shown in Fig. 16, it is determined whether or not an upward click motion has occurred. If "YES" in step S89, that is, if an upward click motion has occurred, in step S91, the rotation speeds of the left motor 38a and the right motor 38b are set to a first predetermined speed, and the process proceeds to step S95. Therefore, the wheelchair 30 moves forward at a moving speed corresponding to the first predetermined speed.

[0123] On the other hand, if "NO" in step S89, that is, if there is no upward clicking motion, in step S93, the rotation speeds of the left motor 38a and the right motor 38b are set to 0, and the process proceeds to step S95. Therefore, if the wheelchair 30 is stopped, it continues to be stopped, and if it is moving, it decelerates or stops.

[0124] In step S95, it is determined whether or not a left click operation has been performed. If the result in step S95 is "NO," that is, if a left click operation has not been performed, in step S97, the rotation speed of the right motor 38b is set to zero, and the process proceeds to step S105 shown in Fig. 17. However, if the rotation speed of the right motor 38b has already been set to zero, the process in step S97 is skipped.

[0125] On the other hand, if the result in step S95 is "YES", that is, if a left click operation has been performed, then in step S99, it is determined whether the wheelchair 30 is moving forward. Here, the CPU 32a determines whether the left motor 38a and the right motor 38b are rotating. This is also the same as in step S109, which will be described later.

[0126] If step S99 is "YES", that is, if the wheelchair 30 is moving forward, then in step S101, the rotation speed of the right motor 38b is set to a second predetermined speed, and the process proceeds to step S105. Therefore, the wheelchair 30 turns left (i.e., turns left). On the other hand, if step S99 is "NO", that is, if the wheelchair 30 is stopped, then in step S103, the rotation speed of the right motor 38b is set to a third predetermined speed, and the process proceeds to step S105. Therefore, the wheelchair 30 turns left.

[0127] As shown in Fig. 17, in step S105, it is determined whether or not a right-side click operation has been performed. If the result in step S105 is "NO," that is, if a right-side click operation has not been performed, in step S107, the rotation speed of the left motor 38a is set to zero, and the process returns to step S71 shown in Fig. 15. However, if the rotation speed of the left motor 38a has already been set to zero, the process of step S107 is skipped.

[0128] On the other hand, if the answer is "YES" in step S105, that is, if there is a right-side click operation, then in step S109, it is determined whether the wheelchair 30 is moving forward. If the answer is "YES" in step S109, then in step S111, the rotation speed of the left motor 38a is set to a second predetermined speed, and the process returns to step S71. Therefore, the wheelchair 30 turns left (i.e., turns left). On the other hand, if the answer is "NO" in step S109, that is, if the wheelchair 30 is stopped, then in step S113, the rotation speed of the left motor 38a is set to a third predetermined speed, and the process returns to step S71. Therefore, the wheelchair 30 turns right.

[0129] According to the second embodiment, it is possible to obtain the same effects as the first embodiment and also to control the movement of the wheelchair.

[0130] The wheelchair control method shown in the second embodiment is an example and should not be limited to the above. In another example, instead of detecting three lower clicks within the second predetermined time, the wheelchair control process may be terminated when left and right clicks are detected simultaneously, or when upper, left and right clicks are detected simultaneously, or when lower, left and right clicks are detected simultaneously, or when upper, lower, left and right clicks are detected simultaneously.

[0131] [Third Example] The third embodiment is a system in which the input device 10 of the present invention is used to control mouse operations. This system will be described below, but as the input device 10 has been described in the first and second embodiments, a duplicate description will be omitted.

[0132] Although not shown in the drawings, the system of the third embodiment is obtained by deleting the eye-gaze input device 22 from the system 400 of the first embodiment and using the input device 10 of the second embodiment.

[0133] Therefore, the user terminal 20 controls the position, ie, movement, of the mouse cursor based on pressing and clicking actions from the input device 10, and executes commands based on left-clicking and right-clicking actions.

[0134] Specifically, in the third embodiment, the CPU 20a of the user terminal 20 executes the mouse operation process shown in Fig. 18. It is assumed that the software keyboard described in the first embodiment is displayed, but the software keyboard does not have to be displayed. Also, the mouse operation process is executed in parallel with a predetermined application.

[0135] As shown in FIG. 18, when the CPU 20a starts mouse operation, it determines in step S121 whether or not a pressing operation on any of the up, down, left and right directions continues for a third predetermined time period (for example, one second) or more.

[0136] If the result of step S121 is "NO," and if no pressing action of any of the up, down, left, or right directions continues for a third predetermined time or longer, the process proceeds to step S125. However, in step S121, if no pressing action of any of the up, down, left, or right directions is performed, the result is also determined to be "NO."

[0137] On the other hand, if the result is "YES" in step S121, that is, if the pressing motion in any of the up, down, left, or right directions continues for more than the third predetermined time, then in step S123, the mouse cursor is moved in the direction in which the pressing motion continued for more than the third predetermined time, and the process returns to step S121.

[0138] In step S125, the moving speed of the mouse cursor is set to 0. In the next step S127, it is determined whether or not a left click action has been performed. If "NO" in step S127, that is, if there has been no left click action, it is determined in step S129 whether or not a right quick action has been performed.

[0139] If step S129 is "NO", that is, if there is no right-click action, the process returns to step S121. On the other hand, if step S129 is "YES", that is, if there is a right-click action, a right-click command is executed in step S131, and the process returns to step S121. For example, in step S131, if character input is being executed, one character is deleted as described in the first embodiment, or if the mouse cursor is pointing to a button displayed on the execution screen of a specified application, the properties of that button are displayed on the display.

[0140] Also, if "YES" in step S127, that is, if there is a left click action, in step S133, it is determined whether or not the mouse cursor is on the end button of a predetermined application.

[0141] If the result in step S133 is "NO", that is, if the mouse cursor is not on the end button of the predetermined application, a left click command is executed in step S135, and the process returns to step S121. For example, in step S135, characters are input using a software key, or a function assigned to a button provided on the execution screen of the predetermined application is executed.

[0142] On the other hand, if "YES" in step S133, that is, if the mouse cursor is on the end button of the predetermined application, in step S137, an instruction to end the predetermined application is issued, and the processing of the mouse operation is ended.

[0143] According to the third embodiment, it is possible to obtain the same effects as the first embodiment, and also to execute commands by moving the mouse cursor and clicking.

[0144] It should be noted that the specific numerical values ​​and control methods shown in the above embodiments are merely examples and are not limited to these, but can be modified as appropriate depending on the actual product and the environment in which the product is applied. [Explanation of symbols]

[0145] 10. Input device 12 ... Cheek movement detection device 14, 32, … Computer 20...User terminal 22... Eye gaze input device 30...Wheelchair 400, 500 … systems

Claims

1. A deformable sheet-like covering portion that covers at least a portion of the cheek of the user; a detection unit attached to a side of the covering unit that comes into contact with the user's face and capable of detecting at least a left cheek movement and a right cheek movement of the user; and An input device comprising: a generation unit that generates operation data based on a left cheek movement and / or a right cheek movement of the user detected by the detection unit.

2. The input device according to claim 1 , further comprising a transmission unit that transmits the operation data generated by the generation unit to an external computer.

3. the detection unit is two capacitive touch sensors, The input device according to claim 1 , wherein the two capacitive touch sensors are disposed on the left and right sides of the covering portion, respectively, and detect motion of the left cheek and / or the right cheek of the user.

4. the detection unit includes four capacitive touch sensors; The four capacitive touch sensors are arranged on the top, bottom, left and right sides of the covering portion, respectively, and detect at least one movement of the left cheek, right cheek, philtrum and chin of the user; 3. The input device according to claim 1, wherein the generation unit generates at least one of operation data based on the movement of the user's left cheek, operation data based on the movement of the user's right cheek, operation data based on the movement of the user's philtrum, and operation data based on the movement of the user's jaw detected by the four capacitive touch sensors.

5. The capacitive touch sensor includes: A conductive cloth in which a first cloth formed by knitting a conductive thread and a second cloth formed by knitting an insulating thread are overlapped with each other; an insulating sheet having the same size as the first fabric and attached to the first fabric; and The input device according to claim 3 or 4, further comprising a capacitance sensor IC electrically connected to the first cloth.

6. The input device according to claim 5 , wherein the conductive cloth has elasticity.

Images