Operating device, control method therefor, and control program
The operating device uses electromyographic signals to initiate input actions before physical contact, addressing the lag issue in conventional devices, achieving faster response times.
Patent Information
- Application Number
- JP2024095795
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-06-13
- Publication Date
- 2025-12-25
AI Technical Summary
Conventional computer mice and keyboards, particularly those used for gaming, suffer from a time lag between user recognition of an input action and the actual execution of the input due to the need for physical contact detection, limiting response speed.
The operating device utilizes electromyographic signals detected before finger movement to initiate input actions, incorporating electrodes to capture these signals, and a signal processing system to amplify, filter, and convert them into control signals for faster response.
This approach enables a significantly faster response speed compared to conventional devices by utilizing electromyographic signals detected before physical contact, reducing the time lag and enhancing input speed.
Smart Images

Figure 2025187195000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to operation devices such as a mouse and a keyboard for operating a PC (Personal Computer), a game machine, etc., and a control method and a control program for the same. [Background technology]
[0002] 2. Description of the Related Art In recent years, operation devices such as mice and keyboards have come into use to input operations into various devices such as PCs and game consoles. For example, Patent Document 1 discloses a computer mouse in which the cursor displayed on a computer screen can be moved in any direction by moving the mouse body, and a click switch can be operated with a finger while the cursor is positioned at any position to output a click signal for computer control, and the click switch is formed from a touch switch that has an operating touch electrode that is touched by the operating finger and a switch circuit that detects the electromagnetic signal change that occurs when the finger touches the electrode and outputs a click signal. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-126934 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the above-mentioned conventional computer mouse has the following problems. Here, in recent years, operating devices such as mice are not only used as operating devices for operating PCs installed in the workplace or at home, but are also used as operating devices for operating games such as e-Sports, and faster response speeds are required.
[0005] For this reason, the computer mouse disclosed in the above publication is configured to detect the electromagnetic signal change that occurs when a finger touches the operation touch electrode and output a click signal, which results in a time lag between the time the person recognizes it and the time the finger starts to move. For this reason, it has not been possible to obtain a sufficiently high response speed, which is required for recent operating devices. An object of the present invention is to provide an operating device capable of achieving a response speed faster than conventional devices, a control method for the operating device, and a control program for the operating device. [Means for solving the problem]
[0006] The operating device according to a first aspect of the present invention is an operating device for operating various devices, and includes a main body, a detection unit, and an output unit. The detection unit has an electrode unit arranged at a position on the main body where the user's skin comes into contact, and detects myoelectric signals from the skin that touches the electrode unit. The output unit outputs based on the myoelectric signals detected by the detection unit. Here, output control such as ON / OFF is performed using myoelectric signals detected before operation input by the fingers or the like operating the operation device.
[0007] Here, the operating device includes, for example, a game controller, a mouse, a keyboard, and the like. In addition, electromyographic signals are electrical signals emitted from the brain to nerves to move muscles in the fingers, arms, legs, etc., and are detected, for example, by electrodes (sensors) placed in contact with the surface of the skin before the muscles move. An electromyographic signal is an electrical signal that is detected as a change that occurs, for example, when the brain issues a command to move a muscle from a state in which the muscle is not exerting force or is not moving. Conventional physical switches and capacitance sensor switches output an output only after detecting that a finger has touched an operating switch, making it difficult to bridge the time lag between when a person recognizes the touch and when the finger begins to move.
[0008] Therefore, in this operation device, output is performed using myoelectric signals detected before the movement of the fingers that operated the physical switch or the like. This allows for a faster response speed than conventional inputs using physical switches or capacitance switches, by using an electromyographic signal that is detected before the operation signal that is output when a physical switch is operated with a finger.
[0009] An operating device according to a second aspect of the present invention is the operating device according to the first aspect of the present invention, further comprising a first filter section that removes DC (direct current) components from the signal input from the electrode section. This allows the first filter section to remove DC components from the signal detected and input at the electrode section at the most upstream side, thereby increasing the amplification factor of the subsequent stage and thereby improving detection accuracy.
[0010] An operating device according to a third aspect of the present invention is the operating device according to the first or second aspect of the present invention, further comprising a differential amplifier that amplifies the difference in voltage detected at multiple electrodes included in the electrode unit. This makes it possible to detect myoelectric signals by amplifying the difference between voltages detected at a plurality of electrodes arranged along the muscles of the fingers, for example.
[0011] An operating device according to a fourth aspect of the present invention is the operating device according to the third aspect of the present invention, further comprising a signal processing unit that converts the signal amplified in the differential amplifier unit into a DC signal. As a result, myoelectric signals behave like AC (alternating current) signals because pulsed signals are constantly emitted while the muscles are working, so they can be converted into DC signals by a signal processing unit.
[0012] An operating device according to a fifth aspect of the present invention is the operating device according to the fourth aspect of the present invention, further comprising a second filter section that removes noise from the DC signal. This allows the myoelectric signal to be detected with high accuracy by removing noise contained in the myoelectric signal.
[0013] An operating device according to a sixth aspect of the present invention is the operating device according to the fifth aspect of the present invention, further comprising a signal amplifier section that amplifies the signal output from the second filter section. This allows the signal, which has been converted into a DC signal and from which noise has been removed, to be amplified by the signal amplifier.
[0014] An operating device according to a seventh aspect of the present invention is the operating device according to the third aspect of the present invention, wherein the amplification factor of the differential amplifier is set to a value lower than the upper limit of the saturation voltage range. This prevents the output signal from becoming saturated when the surrounding environment changes or when the contact state between the electrode and the skin changes and a larger signal is input.
[0015] An operating device according to an eighth aspect of the present invention is the operating device according to the first or second aspect of the present invention, wherein the output section compares the myoelectric signal with a predetermined threshold value and outputs the result. This makes it possible to output, for example, an ON signal when the detected myoelectric signal is greater than a predetermined threshold, and an OFF signal when the detected myoelectric signal is smaller than a predetermined threshold.
[0016] An operating device according to a ninth aspect of the present invention is the operating device according to the first or second aspect of the present invention, wherein the electrode section is arranged along the muscles of the user's hand when used by the user. This allows the electrical signals transmitted from the user's brain to the muscles to be effectively detected by the electrode portions arranged along the muscles of the hand.
[0017] An operating device according to a tenth aspect of the present invention is the operating device according to the first or second aspect of the present invention, wherein the electrode section includes two electrodes arranged along the muscles of the user's hand and a reference electrode. This allows the myoelectric signal to be detected effectively using the two electrodes in contact with the skin of the user's fingers and the reference electrode.
[0018] An operating device according to an eleventh aspect of the present invention is the operating device according to the first or second aspect of the present invention, wherein the output section performs ON / OFF output based on the myoelectric signal detected by the detection section. This makes it possible to provide an operating device that is capable of ON / OFF output at a higher speed than conventional devices.
[0019] The operating device according to a twelfth aspect of the present invention is the operating device according to the first or second aspect of the present invention, and is operated for a certain period of time, and calibration is performed using the myoelectric signal detected in the electrode unit to adjust the amplification factor of the myoelectric signal. Taking into account the fact that the values of the detected electromyographic signals are likely to vary in magnitude, calibration is performed so that the magnitude of the electromyographic signals detected after a certain period of operation remains approximately constant, thereby suppressing variations in detection accuracy due to individual differences between users operating the device.
[0020] An operating device according to a thirteenth aspect of the present invention is the operating device according to the twelfth aspect of the present invention, wherein calibration is performed when the power is turned on or at any timing. This allows calibration to be performed at a predetermined timing, such as when the power is turned on, so that myoelectric signals, which vary in strength from person to person, can be detected at a substantially constant value.
[0021] An operating device according to a fourteenth aspect of the present invention is the operating device according to the twelfth aspect of the present invention, wherein the amplification factor of the myoelectric signal detected in the electrode unit is set according to the magnitude of the signal obtained as a result of calibration. This allows for setting a large amplification factor when the value of the myoelectric signal detected due to individual differences is small, thereby suppressing variations in the magnitude of the myoelectric signal due to individual differences.
[0022] An operating device according to a fifteenth aspect of the present invention is the operating device according to the twelfth aspect of the present invention, in which a predetermined threshold value for comparison with the myoelectric signal is set according to the magnitude of noise contained in the signal obtained as a result of calibration. This allows output control to be performed so as to prevent malfunctions by determining the noise level and setting an appropriate threshold value during calibration.
[0023] An operating device according to a sixteenth aspect of the present invention is the operating device according to the first or second aspect of the present invention, further comprising a physical switch operated by a user's finger. This allows for a combination of an output based on the detection results of an electromyographic signal with a physical switch operated by the fingers, so that even if the electromyographic signal cannot be detected properly, the physical switch can detect the operational input and output it.
[0024] An operating device according to a seventeenth aspect of the present invention is the operating device according to the first or second aspect of the present invention, further comprising a contact detection sensor that detects a finger of a user. This allows for the output based on the detection results of the electromyographic signal to be combined with a contact detection sensor (e.g., a capacitance sensor or a pressure sensor) operated by the fingers, so that even if the electromyographic signal cannot be detected properly, the contact detection sensor can detect the operation input and output it.
[0025] An operating device according to an eighteenth aspect of the present invention is the operating device according to the first or second aspect of the present invention, wherein the electrode portion has a curved surface shape. This allows the electrode portion, which has a curved surface shape that conforms to the shape of the fingers of the user holding the operating device, to efficiently detect myoelectric signals.
[0026] A control method for an operating device according to a nineteenth aspect of the present invention is a control method for an operating device that operates various devices, and includes a detection step and a control step. In the detection step, a myoelectric signal is detected from skin that touches an electrode unit arranged in a position on the main body of the operating device where the skin of the user comes into contact. In the control step, an output is performed based on the myoelectric signal detected in the detection step. Here, output control such as ON / OFF is performed using myoelectric signals detected before operation input by the fingers or the like operating the operation device.
[0027] Here, the operating device includes, for example, a game controller, a mouse, a keyboard, and the like. In addition, electromyographic signals are electrical signals emitted from the brain to nerves to move muscles in the fingers, arms, legs, etc., and are detected, for example, by electrodes (sensors) placed in contact with the surface of the skin before the muscles move. An electromyographic signal is an electrical signal that is detected as a change that occurs, for example, when the brain issues a command to move a muscle from a state in which the muscle is not exerting force or is not moving.
[0028] Conventional physical switches and capacitance sensor switches output an output only after detecting that a finger has touched an operating switch, making it difficult to bridge the time lag between when a person recognizes the touch and when the finger begins to move. Therefore, in this operation device, output control is performed using myoelectric signals detected before the movement of the fingers that operated the physical switch or the like. This allows for a faster response speed than conventional inputs using physical switches or capacitance switches, by using an electromyographic signal that is detected before the operation signal that is output when a physical switch is operated with a finger.
[0029] A control program for an operating device according to a twentieth aspect of the present invention is a control method for an operating device for operating various devices, and causes a computer to execute the control method for an operating device, the control method including a detection step and a control step. In the detection step, a myoelectric signal is detected from skin that touches an electrode unit arranged at a position on the main body of the operating device where the skin of the user comes into contact. In the control step, output is performed based on the myoelectric signal detected in the detection step.
[0030] Here, output control such as ON / OFF is performed using myoelectric signals detected before operation input by the fingers or the like operating the operation device. Here, the operating device includes, for example, a game controller, a mouse, a keyboard, and the like. In addition, electromyographic signals are electrical signals emitted from the brain to nerves to move muscles in the fingers, arms, legs, etc., and are detected, for example, by electrodes (sensors) placed in contact with the surface of the skin before the muscles move.
[0031] An electromyographic signal is an electrical signal that is detected as a change that occurs, for example, when the brain issues a command to move a muscle from a state in which the muscle is not exerting force or is not moving. Conventional physical switches and capacitance sensor switches output an output only after detecting that a finger has touched an operating switch, making it difficult to bridge the time lag between when a person recognizes the touch and when the finger begins to move. Therefore, in this operation device, output control is performed using myoelectric signals detected before the movement of the fingers that operated the physical switch or the like. This allows for a faster response speed than conventional inputs using physical switches or capacitance switches, by using an electromyographic signal that is detected before the operation signal that is output when a physical switch is operated with a finger. [Effects of the Invention]
[0032] According to the operating device of the present invention, a response speed faster than that of the prior art can be obtained. [Brief explanation of the drawings]
[0033] [Figure 1] 1 is an external view showing a configuration of an operating device according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram showing a state in which the operating device of FIG. 1 is being used by a user. [Figure 3] FIG. 2 is a circuit diagram showing the circuit configuration of the operating device of FIG. 1. [Figure 4] (a) is a diagram explaining the details of the calibration (for a person with a large detected electromyographic signal) performed when the power of the operation device in Figure 1 is turned on, etc. (b) is a diagram explaining the details of the same calibration (for a person with a small detected electromyographic signal). [Figure 5] 4 is a diagram illustrating the relationship between the amplification factor set in the differential amplifier included in the operating device of FIG. 3 and the saturation voltage range. [Figure 6] 3 is a flowchart showing the flow of processing in a control method for the operation device of FIG. 1; DETAILED DESCRIPTION OF THE INVENTION
[0034] An operating device 10 according to one embodiment of the present invention and a control method thereof will be described below with reference to FIGS. In the present embodiment, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.
[0035] Furthermore, the applicant provides the accompanying drawings and the following description to enable those skilled in the art to fully understand the present invention, and they are not intended to limit the subject matter described in the claims. The operating device 10 according to this embodiment is a mouse for operating a PC (Personal Computer), a game device, etc., and as shown in FIG. 1, includes a main body 10a, switches (physical switches) 10b and 10c, electrodes (electrode portions) 11a and 11b, and a reference electrode (electrode portion) 11c.
[0036] 1 indicates the front of the operating device 10, the left and right directions of FIG. 1 indicate the sides of the operating device 10, and the bottom direction of FIG. The main body 10a is a housing having a substantially elliptical shape, and has switches 10b and 10c, electrodes 11a and 11b, and a reference electrode 11c arranged on its outer circumferential surface. The switches (physical switches) 10b and 10c are arranged side by side at the front of the main body 10a, and are pressed by the user's fingers.
[0037] The switch 10b is operated by, for example, the index finger as shown in Fig. 2. The switch 10c is operated by, for example, the middle finger as shown in Fig. 2. In addition, operations on switches 10b and 10c may be input in addition to operations based on electromyographic signals detected by electrodes 11a, 11b, and 1c described later, or may be configured to be input while operations based on electromyographic signals are in the OFF state.
[0038] The electrodes (electrode units) 11a and 11b are dry electrodes for reading electrical signals (electromyographic signals) from the user's skin, and two pairs are provided exposed on the surface of the main body unit 10a along the front-rear direction of the operating device 10. As shown in Fig. 2, the electrodes 11a and 11b are used in a state where they are in contact with the skin of the user's fingers. The electrodes 11a and 11b arranged to the left of the main body 10a are arranged along the muscle that moves the index finger F1, as shown in Fig. 2. The electrodes 11a and 11b arranged to the right of the main body 10a are arranged along the muscle that moves the middle finger F2, as shown in Fig. 2.
[0039] The electrodes 11a and 11b detect commands from the brain to move the index finger F1 and / or the middle finger F2 as electrical signals (electromyographic signals). The reference electrode (electrode unit) 11c is arranged at the rear of the main body 10a, and detects the reference voltage of the myoelectric signal detected by the electrodes 11a and 11b arranged at positions closer to the left and right of the main body 10a, respectively.
[0040] For example, an identification circuit may be configured in which electrodes 11a and 11b arranged along the muscles of the index finger F1 and the muscles of the middle finger F2 are connected, and the finger that performed the operation input may be identified based on the detection results at the electrodes 11a and 11b corresponding to multiple fingers. In this case, if a myoelectric signal is detected at the electrodes 11a, 11b corresponding to one of the fingers, it can be determined that the movement is that of the finger on which the signal was detected, and if a myoelectric signal is detected at both electrodes 11a, 11b, it can be determined that the movement is an undesired movement, such as applying force to the entire hand.
[0041] Here, the size of the electrodes 11a and 11b is preferably such that they are arranged to straddle the muscles that move the user's fingers. For example, as shown in Fig. 2, they are preferably arranged along the muscles that move the index finger F1 and / or middle finger F2 that operate the operating device 10. As a result, even if the detected myoelectric signal is weak, the detection accuracy of the myoelectric signal can be improved by using the electrodes 11a and 11b arranged across a plurality of muscles.
[0042] Furthermore, it is preferable that the electrodes 11a and 11b have a curved shape and a thickness equal to or greater than a predetermined value, which allows the electrodes 11a and 11b to be embedded into the surface of the skin along the tendons of the fingers of the user of the operating device 10, making it easier to detect myoelectric signals. In the operating device 10 of this embodiment, the electrode section arranged on each finger (index finger F1, middle finger F2) to detect myoelectric signals is composed of three points: electrodes 11a, 11b and reference electrode 11c, but the number of electrodes may be four or more, or may be two excluding the reference electrode.
[0043] The electrode parts (electrodes 11a, 11b and reference electrode 11c) are made of silver-silver chloride to prevent corrosion by salt. However, the electrode parts may be made of a metal with low contact resistance, such as aluminum. Alternatively, the electrode parts may be made of a material other than metal, such as resin, with a plated surface. As shown in FIG. 3, the operating device 10 of this embodiment includes a detection unit 11, a high-pass filter (noise processing unit, first filter unit) 12, a differential amplification unit 13, a signal processing unit 14, a filter unit (noise processing unit) 15, a signal amplification unit 16, and an output unit 17.
[0044] The detection unit 11 includes an electrode unit (electrodes 11a, 11b and reference electrode 11c) arranged at a position on the main body 10a where the user's skin comes into contact, and detects myoelectric signals from the skin that comes into contact with the electrode unit. The reference electrode (electrode unit) 11c is connected to GND (ground) as shown in Fig. 3. Therefore, the myoelectric signals are detected at the electrodes 11a and 11b based on the potential of the finger skin detected at the reference electrode 11c.
[0045] As shown in Figure 3, the high-pass filter (noise processing unit, first filter unit) 12 is arranged immediately downstream of the detection unit 11 and removes DC (direct current) components from the signal input from the electrode unit (electrodes 11a, 11b and reference electrode 11c). Here, biosignals such as myoelectric signals are detected as weak voltage values on the order of a few millivolts and are therefore amplified. If even a small offset component is included, the signal may become stuck between the upper and lower limits during amplification, making it impossible to detect.
[0046] Therefore, by removing the DC component at the most upstream side using the high-pass filter 12, the myoelectric signal can be appropriately detected when it is amplified in the subsequent stage. The high-pass filters 12 are adapted to correspond to the electrodes 11a and 11b, respectively. The differential amplifier 13 amplifies the difference between the voltages detected at the plurality of electrodes 11a and 11b of the detector 11. The differential amplifier 13 performs the amplification process with an amplification factor set within the range of 500 to 1000, for example.
[0047] The signal processing unit 14 converts the signal amplified by the differential amplifier 13 into a DC signal. More specifically, as shown in FIG. 3, the signal processing unit 14 has a full-wave rectifier 14a and a peak holder 14b. The full-wave rectifier 14a converts the signal amplified by the differential amplifier 13 into a positive signal.
[0048] The peak holding unit 14b converts the positive signal converted by the full-wave rectifying unit 14a into a DC signal. As a result, since the myoelectric signal is detected as a pulsed signal while the muscle is working and behaves like an AC (alternating current) signal, the myoelectric signal can be converted to a DC signal by converting it to a positive signal in the full-wave rectifier 14a and then converting it to a DC signal.
[0049] In order to remove AC noise (hum noise) from the DC-converted signal, the filter unit (noise processing unit) 15 performs noise processing again following the high-pass filter 12. More specifically, as shown in FIG. 3, the filter unit 15 has a high-pass filter 15a and an offset correction unit 15b. High-pass filter (noise processing section, second filter section) 15a is provided to remove AC noise (hum noise) from the signal converted to DC by signal processing section 14. This makes it possible to remove noise that is constantly applied at a substantially constant voltage.
[0050] The offset corrector 15b performs offset correction on the signal from which the AC noise has been removed. The signal amplifier 16 amplifies the signal output from the filter 15 again, using an amplification factor set within the range of 10-100, for example. The output unit 17 performs output based on the myoelectric signal detected by the detection unit 11. More specifically, the output unit 17 has a comparison circuit 17a as shown in FIG.
[0051] The comparison circuit 17a compares the myoelectric signal amplified by the signal amplifier 16 with a predetermined threshold value, and outputs an ON / OFF signal based on the comparison result. That is, the comparison circuit 17a outputs an ON signal when the myoelectric signal is greater than the predetermined threshold value, and outputs an OFF signal when the myoelectric signal is smaller than the threshold value.
[0052] <Noise removal from electromyographic signals> Here, one of the problems in detecting myoelectric signals is the superposition of AC noise. When the voltage directly below the electrodes 11a and 11b is monitored, AC noise of, for example, several tens of mV may be detected. Since the myoelectric signal is detected as a weak voltage and is superimposed on this AC noise, if the noise component is large, the detection accuracy of the myoelectric signal may be reduced. For this reason, a method is generally used in which a notch filter is used to remove 60 Hz or 50 Hz, which is the frequency band of AC noise (hum noise).
[0053] However, when detecting using dry electrodes, in situations where the myoelectric signal is abnormally small or where there is a lot of superimposed noise, even a slight effect from the notch filter can cause the signal to disappear. That is, since the frequency band in which the EMG signal is strongest is around 60 Hz, attempts to remove AC noise (hum noise) inevitably affect the detection of the EMG signal.
[0054] In the operating device 10 of this embodiment, as described above, the detected myoelectric signal is converted into a DC signal, so that AC noise (hum noise) that continues to be output at 60 Hz (50 Hz) at a constant voltage looks like a DC signal, and can be removed by placing a high-pass filter 15a in the subsequent stage and performing noise processing. On the other hand, myoelectric signals are generated (or appear to be generated) irregularly in multiple frequency bands, and therefore cannot be removed by filtering.
[0055] <Calibration> In the operating device 10 of this embodiment, calibration is performed, for example, when the power is turned on or at predetermined time intervals, taking into consideration the nature of myoelectric signals, in which the detected signal strength changes depending on the individual differences of users, the state of the skin at the time of detection (dry or wet), and the contact state. That is, in the operating device 10 of this embodiment, the amplification factor (100 or 1000) is set so that the output is approximately the same for a user whose myoelectric signal shown in FIG. 4(a) is detected at a relatively high intensity and a user whose myoelectric signal shown in FIG. 4(b) is detected at a relatively low intensity.
[0056] Specifically, the potential at the stage subsequent to the signal amplifier 16 is monitored, and calibration is performed when the power is turned on (or at any timing). Calibration involves having the user apply full force for a set period of time, and then detecting the strength of the user's signal. Alternatively, the user may perform a normal switch pressing action to obtain data on the strength of the myoelectric signal detected during the normal action.
[0057] As a result, as shown in Figures 4(a) and 4(b), the amplification factor of the signal amplifier 16 and the amplification factor of the differential amplifier 13 can be determined to appropriate values so that the signals are of approximately equal magnitude depending on the strength of the detected myoelectric signal. During calibration, the noise level is detected and the threshold value of the final stage comparator circuit 17a is set to a value that will not cause malfunction.
[0058] This allows output control to be performed so that malfunction of the operating device 10 does not occur. Furthermore, the amplification process of the detected myoelectric signal described above is determined by multiplying the respective magnifications of the differential amplifier 13 and the signal amplifier 16 . For example, after performing calibration and obtaining data on the strength of each user's signal, the output voltage of the differential amplifier 13 is monitored, and the amplification factor of the differential amplifier 13 is determined so that it is approximately half the saturation voltage, as shown in Figure 5.
[0059] This makes it possible to prevent the output signal from becoming saturated even when the surrounding environment changes or when a larger signal is input due to a change in the contact state between electrodes 11a, 11b and the skin. Thereafter, the signal at the stage subsequent to the signal amplifier 16 is checked, and the amplification factor of the amplifier in the signal amplifier 16 is adjusted so that the signal at the time of normal input becomes about half the power supply voltage of the amplifier. The threshold value set in the comparison circuit 17a at the final stage is determined taking into consideration the noise level and the like.
[0060] <Control method of the operation device 10> In the operation device 10 of this embodiment, output control is performed according to the flowchart shown in FIG. That is, when the detector 11 (electrodes 11a, 11b) detects a myoelectric signal in step S11, the high-pass filter 12 performs processing to remove DC components from the detected signal in step S12.
[0061] Next, in step S13, the differential amplifier 13 amplifies the difference between the signals detected at the electrodes 11a and 11b. Next, in step S14, the signal processing unit 14 converts the signal amplified in step S13 into a DC signal.
[0062] Next, in step S15, the filter unit 15 removes noise from the signal converted into a DC signal in step S15. Next, in step S16, the signal amplifier 16 amplifies the signal from which noise has been removed in step S15. Next, in step S17, the output unit 17 compares the signal amplified in step S16 with a predetermined threshold value, and outputs an ON signal or an OFF signal according to the result.
[0063] <Major features> The operating device 10 of this embodiment is a device for operating various devices, and as shown in Fig. 3, includes a main body 10a (see Fig. 2, etc.), a detection unit 11, and an output unit 17. The detection unit 11 has electrodes 11a and 11b and a reference electrode 11c arranged at positions on the main body 10a where the user's skin comes into contact, and detects myoelectric signals from the skin that comes into contact with the electrodes 11a and 11b. The output unit 17 outputs based on the myoelectric signals detected by the detection unit 11. This allows for a faster response speed than conventional inputs using physical switches or capacitance switches, by using an electromyographic signal that is detected before the operation signal that is output when a physical switch is operated with a finger.
[0064] [Other embodiments] Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible without departing from the gist of the invention.
[0065] (A) In the above embodiment, the operation device 10 and its control method are described as examples of realizing the present invention, but the present invention is not limited to this. For example, the present invention may be realized as a control program that causes a computer to execute the control method for the operation device 10 described above.
[0066] This control program is stored in a memory (storage unit) installed in the operating device, and a CPU (Central Processing Unit) reads the control program stored in the memory and causes the hardware to execute each step. More specifically, the CPU reads the control program and executes each of the steps described above, thereby achieving the same effects as those described above. The present invention may also be realized as a recording medium storing a control program for an operating device.
[0067] (B) In the above embodiment, an example has been described in which minute myoelectric signals detected by the electrodes 11a and 11b are amplified in two stages for use, but the present invention is not limited to this. For example, if a myoelectric signal with little noise can be detected, the amplification process may be performed in one stage. Alternatively, for example, in order to effectively perform noise processing, the signal may be amplified in three or more stages.
[0068] (C) In the above embodiment, an example was described in which calibration is performed at the start of use, etc., taking into consideration that myoelectric signals differ from user to user. However, the present invention is not limited to this. For example, if the detection accuracy of the myoelectric signal detected by the electrode section is improved, the operation device may be one that can be started to be used without performing calibration.
[0069] (D) In the above embodiment, an example has been described in which myoelectric signals are detected by two sets of two electrodes 11a, 11b arranged along the muscles of the user's fingers on the surface of the main body 10a of the operating device 10 and a single common reference electrode 11c. However, the present invention is not limited to this. For example, two sets of electrode parts each including two electrodes and a reference electrode may be arranged. Furthermore, the number of electrode sections arranged on the surface of the main body of the operating device may be one set, rather than two sets, or three or more sets.
[0070] (E) In the above embodiment, an example has been described in which the present invention is realized as the operating device 10 that outputs an ON / OFF signal, but the present invention is not limited to this. For example, the signal to be output is not limited to an ON / OFF signal, and the operation device may output various other signals.
[0071] (F) In the above embodiment, the operation device 10 that outputs a signal based on a myoelectric signal detected by the detection unit 11 (electrodes 11a, 11b) has been described as an example. However, the present invention is not limited to this.
[0072] For example, the operation device may be one that outputs an electrical signal by combining a physical switch including a pressure sensor and the like in addition to an electrode unit that detects an electromyographic signal. As a result, if the detection strength of the electromyographic signal is weak and does not exceed an arbitrarily set detection threshold, it will not be detected. Therefore, by using an AND circuit consisting of the physical switch and the detection unit 11 that detects the electromyographic signal, it is possible to control it so that even in the worst case scenario, the user can operate it at the speed they would normally use.
[0073] The signals detected by the electrodes 11a and 11b of the detection unit 11 may be processed by a CPU (Central Processing Unit) instead of the electrical circuit shown in FIG. Furthermore, the detector 11 for detecting myoelectric signals may be used as a means for adding an input unit, rather than as a means for replacing a conventional physical switch. For example, the electromyographic signal can be configured to be active only when the fingers are extended greatly, and a physical switch can be used when the fingers are bent, and the electromyographic signal can be detected when the fingers are extended to perform operation, thereby creating an operating device with multiple input means. Furthermore, by providing a plurality of threshold values to be set in the comparison circuit 17a, it is possible to make a determination according to the signal strength, and to distinguish between bending and extension movements, etc.
[0074] (G) In the above embodiment, an example has been described in which noise components are removed from the signal detected by the detection unit 11 using the electric circuit shown in Fig. 3. However, the present invention is not limited to this.
[0075] For example, the removal of noise components contained in the detected signal may be performed using a CPU. Specifically, the CPU may perform frequency filtering to remove noise components from the signal. Furthermore, the detected signal may be subjected to smoothing processing such as moving average, within a range that does not impair the responsiveness of the operating device. It should be noted that the term CPU refers to a microcomputer, a processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like.
[0076] (H) In the above embodiment, an example has been described in which calibration is performed to obtain data on the strength of each user's signal, and then the output voltage of the differential amplifier 13 is monitored and the amplification factor is determined so that it becomes 1 / 2 of the saturation voltage. However, the present invention is not limited to this. For example, the amplification factor is not limited to about half the saturation voltage, but may be set to any value smaller than the saturation voltage.
[0077] (I) In the above embodiment, an example has been described in which myoelectric signals are detected using electrodes 11a and 11b arranged along the muscles of the index finger F1 and middle finger F2, as shown in Fig. 2. However, the present invention is not limited to this. For example, electrodes may be arranged in an array on the muscles corresponding to each finger, and movements such as flexion / extension of the finger muscles may be identified according to the signal strength detected at each electrode.
[0078] (J) In the above embodiment, an example has been described in which the electrodes 11a and 11b for detecting myoelectric signals are arranged along the muscles of the fingers, but the present invention is not limited to this. For example, a configuration may be adopted in which electrodes for a capacitance sensor are arranged in parallel with the electrodes for detecting myoelectric signals, and whether or not electrodes 11a and 11b are being appropriately touched may be determined.
[0079] In this case, if it is detected that at least one of the electrodes of the capacitance sensor is not detecting, it can be determined that the user's fingers are not firmly touching the electrodes, and control can be performed so that detection of myoelectric signals is not performed. In this case, the electrodes for detecting myoelectric signals may also be used as electrodes for the capacitance sensor. Furthermore, the sensor for determining whether or not the electrode is being touched may be other contact detection sensors such as a pressure sensor, in addition to the capacitance sensor.
[0080] (K) In the above embodiment, an example has been described in which the operation device 10 to which the present invention is applied is a mouse for operating a PC, a game device, etc. However, the present invention is not limited to this. For example, the present invention may be applied to an operation device such as a game controller, an operation portion of a PC touchpad, or the like.
[0081] (L) In the above embodiment, an example has been described in which myoelectric signals are detected by electrodes 11a and 11b arranged along the muscles that move the user's fingers, but the present invention is not limited to this. For example, the part from which the myoelectric signal is detected may be other parts such as arm muscles, leg muscles, abdominal muscles, etc., in addition to the fingers.
[0082] <Additional Notes> An operating device according to a first aspect of the present invention comprises: An operating device for operating various devices, a main body; a detection unit having an electrode unit disposed at a position on the main body where the user's skin comes into contact, the detection unit detecting a myoelectric signal from the skin that comes into contact with the electrode unit; an output unit that outputs based on the myoelectric signal detected by the detection unit; It is equipped with:
[0083] An operating device according to a second aspect of the present invention is the operating device according to the first aspect of the present invention, The device further includes a first filter section that removes DC components from the signal input from the electrode section. An operating device according to a third aspect of the present invention is the operating device according to the first or second aspect of the present invention, The device further includes a differential amplifier that amplifies the difference between voltages detected at the plurality of electrodes included in the electrode unit.
[0084] An operating device according to a fourth aspect of the present invention is the operating device according to the third aspect of the present invention, The digital signal processing device further includes a signal processing unit that converts the signal amplified in the differential amplifier unit into a DC signal. An operating device according to a fifth aspect of the present invention is the operating device according to the fourth aspect of the present invention, The device further includes a second filter section that removes noise from the DC signal.
[0085] An operating device according to a sixth aspect of the present invention is the operating device according to the fifth aspect of the present invention, The digital signal processing device further includes a signal amplifier that amplifies the signal output from the second filter. An operating device according to a seventh aspect of the present invention is the operating device according to the third aspect of the present invention, The amplification factor of the differential amplifier is set to a value lower than the upper limit of the saturation voltage range.
[0086] An operating device according to an eighth aspect of the present invention is the operating device according to any one of the first to seventh aspects of the present invention, The output unit compares the myoelectric signal with a predetermined threshold and outputs the result. An operating device according to a ninth aspect of the present invention is the operating device according to any one of the first to eighth aspects of the present invention, The electrode portion is arranged along the muscles of the user's hand when used by the user.
[0087] An operating device according to a tenth aspect of the present invention is the operating device according to any one of the first to ninth aspects of the present invention, The electrode section includes two electrodes arranged along the muscles of the user's hand and a reference electrode. An operating device according to an eleventh aspect of the present invention is the operating device according to any one of the first to tenth aspects of the present invention, The output unit performs ON / OFF output based on the myoelectric signal detected by the detection unit.
[0088] An operating device according to a twelfth aspect of the present invention is the operating device according to any one of the first to eleventh aspects of the present invention, A calibration is performed to adjust the amplification factor of the myoelectric signal using the myoelectric signal detected by the electrode unit after operation for a certain period of time. An operating device according to a thirteenth aspect of the present invention is the operating device according to the twelfth aspect of the present invention, The calibration is performed when the power is turned on or at any other timing.
[0089] An operating device according to a fourteenth aspect of the present invention is the operating device according to the twelfth or thirteenth aspect of the present invention, The amplification factor of the myoelectric signal detected by the electrode unit is set according to the magnitude of the signal obtained as a result of the calibration. An operating device according to a fifteenth aspect of the present invention is the operating device according to any one of the twelfth to fourteenth aspects of the present invention, A predetermined threshold value for comparison with the myoelectric signal is set according to the magnitude of noise contained in the signal obtained as a result of the calibration.
[0090] An operating device according to a sixteenth aspect of the present invention is the operating device according to any one of the first to fifteenth aspects of the present invention, The device further includes a physical switch that is operated by the user's finger. An operating device according to a seventeenth aspect of the present invention is the operating device according to any one of the first to sixteenth aspects of the present invention, The device further includes a contact detection sensor for detecting the user's finger.
[0091] An operating device according to an eighteenth aspect of the present invention is the operating device according to any one of the first to seventeenth aspects of the present invention, The electrode portion has a curved surface. [Industrial Applicability]
[0092] The operating device of the present invention has the effect of being able to achieve a faster response speed than conventional operating devices, and is therefore widely applicable to operating devices that output various signals. [Explanation of symbols]
[0093] 10 Operating device 10a Main body 10b, 10c Switch (physical switch) 11 Detection unit 11a,11b Electrode (electrode part) 11c Reference electrode (electrode part) 12 High-pass filter (noise processing section, first filter section) 13 Differential amplifier section 14 Signal processing section 14a Full wave rectifier 14b Peak holder 15 Filter section (noise processing section) 15a High-pass filter (noise processing section, second filter section) 15b Offset correction section 16 Signal amplifier 17 Output section 17a Comparison circuit F1 index finger F2 middle finger
Claims
1. An operating device for operating various devices, a main body; a detection unit having an electrode unit disposed at a position on the main body where the user's skin comes into contact, the detection unit detecting a myoelectric signal from the skin that comes into contact with the electrode unit; an output unit that outputs based on the myoelectric signal detected by the detection unit; An operating device comprising:
2. The device further includes a first filter unit that removes DC components from the signal input from the electrode unit. The operating device according to claim 1 .
3. The device further includes a differential amplifier that amplifies a difference in voltage detected at the plurality of electrodes included in the electrode unit. The operating device according to claim 1 or 2.
4. The amplifier further includes a signal processing unit that converts the signal amplified in the differential amplifier unit into a DC signal. The operating device according to claim 3 .
5. Further comprising a second filter unit that removes noise from the DC signal. The operating device according to claim 4 .
6. further comprising a signal amplifier unit that amplifies the signal output from the second filter unit; The operating device according to claim 5 .
7. The amplification factor of the differential amplifier is set to be lower than the upper limit of a saturation voltage range. The operating device according to claim 3 .
8. the output unit compares the myoelectric signal with a predetermined threshold and outputs the result. The operating device according to claim 1 or 2.
9. The electrode portion is arranged along the muscles of the user's hand when used by the user. The operating device according to claim 1 or 2.
10. The electrode unit includes two electrodes arranged along the muscles of the user's hand and a reference electrode. The operating device according to claim 1 or 2.
11. The output unit outputs ON / OFF based on the myoelectric signal detected by the detection unit. The operating device according to claim 1 or 2.
12. A calibration is performed to adjust an amplification factor of the myoelectric signal using the myoelectric signal detected by the electrode unit after the operation for a certain period of time. The operating device according to claim 1 or 2.
13. The calibration is performed when the power is turned on or at any other timing. The operating device according to claim 12.
14. an amplification factor of the myoelectric signal detected by the electrode unit is set according to the magnitude of the signal obtained as a result of the calibration; The operating device according to claim 12.
15. a predetermined threshold value to be compared with the myoelectric signal is set according to the magnitude of noise contained in the signal obtained as a result of the calibration; The operating device according to claim 12.
16. Further provided is a physical switch operated by the user's finger. The operating device according to claim 1 or 2.
17. Further provided is a contact detection sensor for detecting the user's fingers. The operating device according to claim 1 or 2.
18. The electrode portion has a curved surface shape. The operating device according to claim 1 or 2.
19. A control method for an operating device that operates various devices, a detection step of detecting a myoelectric signal from the skin that touches an electrode portion that is disposed at a position on the main body of the operating device where the skin of the user comes into contact; a control step of performing an output based on the myoelectric signal detected in the detection step; A control method for an operating device comprising:
20. A control program for an operating device that operates various devices, a detection step of detecting a myoelectric signal from the skin that touches an electrode portion that is disposed at a position on the main body of the operating device where the skin of the user comes into contact; a control step of performing an output based on the myoelectric signal detected in the detection step; A control program that causes a computer to execute a control method for an operating device having the above-mentioned components.
Citation Information
Patent Citations
Mouse for computer
JP2006126934A