Information processing device and motion detection device

Abstract

The present invention provides an information processing device and an action detection device. The information processing device of an embodiment includes: a transmitting terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, wherein the signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals.

Description

Technical Field

[0001] The invention relates to an information processing device and a motion detection device. Background Art

[0002] Electrostatic capacitive sensors are used in touch panels of mobile terminals, etc. For example, the touch sensor described in Patent Document 1 detects a touch position based on changes in electrostatic capacitance at intersections of a plurality of column-direction electrodes and a plurality of row-direction electrodes. Patent Document 1 uses machine learning to identify whether input to the touch sensor is the user's intention.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2016-177343 Summary of the invention

[0006] Problems to be solved by the invention

[0007] In order to perform advanced processing, the touch sensor needs to identify more complex user gestures. However, the touch sensor described in Patent Document 1 takes time to detect the touch position by scanning the column-direction electrodes and the row-direction electrodes in sequence. In addition, the touch sensor described in Patent Document 1 can only follow the key information touched, and if the user's gesture becomes complicated, it cannot reliably identify the action. This problem is not limited to touch sensors, but also applies to other sensors.

[0008] The present invention is proposed in view of the above situation, and an object of the present invention is to provide an information processing device and a motion detection device capable of recognizing more complex gestures of a user.

[0009] Technical solutions to the problem

[0010] (1) A first method provides an information processing device comprising: a transmitting terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, wherein a signal received by one of the plurality of receiving terminals is configured to be able to interact with signals received by other receiving terminals.

[0011] (2) The information processing device of the above-mentioned method may also include a plurality of electrodes, at least one of the plurality of electrodes is the transmitting terminal, and at least two of the plurality of electrodes are the receiving terminals, the transmitting terminal is a driving electrode to which a signal is input, and the receiving terminal is a detection electrode to detect information from the driving electrode, the field generated by each of the plurality of electrodes at least affects the surrounding electrodes, and the plurality of electrodes each at least interact with the surrounding electrodes, and at least two of the plurality of electrodes are connected via a circuit, and the circuit has at least one selected from the group consisting of a resistor, a capacitor and a coil.

[0012] (3) In the information processing device of the above aspect, the circuit may generate a transient phenomenon, and a decay time of the circuit may be at least twice a period of the signal input to the drive electrode.

[0013] (4) In the information processing device of the above aspect, at least two of the plurality of electrodes may be electrically connected via a switching element.

[0014] (5) The information processing device of the above-mentioned embodiment may also include: a signal generator that inputs a signal to the driving electrode; an identifier that identifies the signal from the detection electrode; and a feedback device that transmits a portion of the signal from the detection electrode to the identifier to the signal generator.

[0015] (6) In the information processing device of the above aspect, the feedback device may include: a signal holding unit that temporarily holds the signal from the detection electrode; and a signal sending unit that sends the signal held by the signal holding unit to the signal generator after a certain period of time.

[0016] (7) The information processing device of the above-mentioned method may also include a feedback device, wherein the transmitting terminal outputs the wave as a signal, and the multiple receiving terminals respectively receive the wave as a signal, and the feedback device feeds back the signal received by the first receiving terminal among the multiple receiving terminals to the transmitting terminal or any of the receiving terminals.

[0017] (8) In the information processing device of the above aspect, the feedback device may be connected to the first receiving terminal and the transmitting terminal, and the feedback device may feed back a signal received by the first receiving terminal to the transmitting terminal.

[0018] (9) In the information processing device of the above aspect, the feedback device may be connected to the first receiving terminal and a second receiving terminal different from the first receiving terminal, and the feedback device may feed back a signal received by the first receiving terminal to the second receiving terminal.

[0019] (10) In the information processing device of the above aspect, the feedback device may be connected to the first receiving terminal, and the feedback device may feed back the signal received by the first receiving terminal to the first receiving terminal again.

[0020] (11) The information processing device of the above-mentioned method may also include an external transmission terminal for transmitting an input signal, and the feedback device is connected to the first receiving terminal and the external transmission terminal, and the feedback device feeds back the signal received by the first receiving terminal to the external transmission terminal.

[0021] (12) In the information processing device of the above aspect, the feedback device may include a nonlinear output circuit that performs nonlinear conversion on an input signal and outputs the resultant signal.

[0022] (13) In the information processing device of the above aspect, the feedback device may include a delay circuit that delays an input signal.

[0023] (14) In the information processing device of the above-mentioned method, it can also be a structure as follows: the transmitting terminal or the receiving terminal connected to the feedback device has a diaphragm and a piezoelectric body in contact with the diaphragm, the diaphragm can vibrate by the wave, and the piezoelectric body is connected to the feedback device and inputs a feedback signal.

[0024] (15) In the information processing device of the above-mentioned method, it can also be a structure as follows: the transmitting terminal or the receiving terminal connected to the feedback device has a diaphragm, a coil fixed to the diaphragm and a magnet surrounded by the coil, the diaphragm can vibrate by the wave, and the coil is connected to the feedback device and inputs a feedback signal.

[0025] (16) The information processing device of the above aspect may further include a reflector configured to reflect the wave output from the transmission terminal to each of the plurality of reception terminals.

[0026] (17) A second aspect provides a motion detection device comprising: the information processing device of the above aspect; and an output device that outputs a result calculated by the information processing device to the outside.

[0027] Effects of the Invention

[0028] The information processing device and motion detection device of the above-described embodiment can recognize more complex gestures of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is a schematic diagram of the motion detection device according to the first embodiment.

[0030] Figure 2 It is a schematic diagram of the signal processing unit of the motion detection device according to the first embodiment.

[0031] Figure 3 It is a conceptual diagram of the reserve pool calculation simulated by the information processing device of the first embodiment.

[0032] Figure 4 This is a schematic diagram for explaining the operation of the motion detection device according to the first embodiment.

[0033] Figure 5 It is a schematic diagram of the signal processing unit of the first modified example.

[0034] Figure 6 It is a schematic diagram of a signal processing unit of a second modified example.

[0035] Figure 7 It is a schematic diagram of a signal processing unit of a third modified example.

[0036] Figure 8 It is a schematic diagram of a signal processing unit according to a fourth modified example.

[0037] Fig. 9 It is a schematic diagram of a signal processing unit of a fifth modification example.

[0038] Fig.10 It is a schematic diagram of a signal processing unit of a sixth modification example.

[0039] Fig.11 It is a schematic diagram of the motion detection device according to the second embodiment.

[0040] Fig.12 It is a schematic diagram of the signal processing unit of the seventh modification example.

[0041] Fig.13 It is a schematic diagram of the motion detection device according to the third embodiment.

[0042] Fig.14 This is a schematic diagram of an example of a transmission terminal connected to a feedback device.

[0043] Fig.15 FIG. 1 is a schematic diagram of another example of a transmission terminal connected to a feedback device.

[0044] Fig.16 It is a schematic diagram of a motion detection device according to an eighth variation.

[0045] Fig.17 It is a schematic diagram of a motion detection device according to a ninth variation.

[0046] Fig.18 It is a schematic diagram of a motion detection device according to a tenth variation.

[0047] Fig.19 It is a schematic diagram of a motion detection device according to an eleventh variation.

[0048] Fig. 20 It is a schematic diagram of a motion detection device according to a twelfth variation. DETAILED DESCRIPTION

[0049] Hereinafter, the present embodiment will be described in detail with reference to the drawings as appropriate.

[0050] In order to facilitate understanding of the features of the present invention, the drawings used in the following description sometimes appropriately enlarge the features, and the size ratios of the various components are sometimes different from the actual ones. The materials, dimensions, etc. illustrated in the following description are examples, and the present invention is not limited thereto, and can be appropriately changed and implemented within the scope of achieving the effects of the present invention.

[0051] [First embodiment]

[0052] Figure 1 Schematic diagram of the motion detection device 100 of the first embodiment. The motion detection device 100 includes an information processing device and an output device 50. The motion detection device 100 is, for example, a touch sensor, an ultrasonic sensor, etc. In the first embodiment, an example of a touch sensor is shown. The information processing device projects an input signal in a high dimension and replaces the input signal with another signal including information of the input signal. The details of the action of the information processing device will be described later. The output device 50 outputs the signal processed by the information processing device to the outside.

[0053] The information processing device includes a signal processing unit 10, a signal generator 20, and a recognizer 30. The signal processing unit 10 is connected to the signal generator 20 and the recognizer 30.

[0054] The signal generator 20 supplies a driving signal to the driving electrode Dr of the signal processing unit 10. The identifier 30 identifies the signal detected by the detection electrode Dt of the signal processing unit 10.

[0055] The signal processing unit 10 includes a plurality of electrodes E. The plurality of electrodes E are, for example, located on a substrate. The plurality of electrodes E are, for example, separated and scattered within the same surface. There is no particular limitation on the arrangement of the plurality of electrodes E. The plurality of electrodes E are, for example, arranged in a matrix.

[0056] The plurality of electrodes E include a driving electrode Dr and a detection electrode Dt. The driving electrode Dr is an electrode E connected to the signal generator 20. A driving signal is input to the driving electrode Dr from the signal generator 20. The driving electrode Dr is a transmitting terminal for transmitting information based on the input driving signal. The detection electrode Dt is an electrode E connected to the identifier 30. The detection electrode Dt detects information transmitted from the driving electrode Dr. The detection electrode Dt receives the information output from the driving electrode Dr as a signal. At least one of the plurality of electrodes E is the driving electrode Dr. At least two of the plurality of electrodes E are the detection electrodes Dt.

[0057] The positional relationship between the driving electrode Dr and the detection electrode Dt is arbitrary. For example, the driving electrode Dr is surrounded by a plurality of detection electrodes Dt. In the case of a plurality of driving electrodes Dr, for example, the driving electrode Dr is respectively surrounded by a plurality of detection electrodes Dt. The plurality of detection electrodes Dt can detect information at any position around the driving electrode Dr by surrounding the driving electrode Dr.

[0058] Figure 2 Schematic diagram of the signal processing unit 10 of the motion detection device of the first embodiment. Each of the plurality of electrodes E generates a field. A field is a physical quantity related to each point in space and time where the existence of a substance having a physical quantity affects its surroundings. Examples of a field are an electric field, a magnetic field, a thermal field, a vibration field, and a gravitational field. A field is generated between a plurality of electrodes E separated in space, and a change in the potential of one electrode E is transmitted to another electrode E via an electric field, a magnetic field, heat, vibration, etc., and the potential of the other electrode E changes.

[0059] The field generated by each of the plurality of electrodes E affects at least the surrounding electrodes E. As a result, each of the plurality of electrodes E interacts with at least the surrounding electrodes E. The surrounding electrodes E are electrodes E that initially surround one electrode E, for example, electrodes E that initially contact the radiation that radially extends from one electrode as the center. The field generated by each of the plurality of electrodes E may also affect other electrodes E. That is, each of the plurality of electrodes E may also interact with all other electrodes E.

[0060] For example, when the plurality of electrodes E are grounded, the plurality of electrodes E do not electrically interact with each other because their respective potentials are fixed. For example, when an electromagnetic field shield is provided on each of the plurality of electrodes E, the plurality of electrodes E do not electromagnetically interact with each other.

[0061] For example, a case where the field connecting different electrodes is an electric field will be described as an example. Figure 2The multiple electrodes E shown are capacitively coupled C1 and C2. The capacitive coupling C1 and C2 are couplings via electric fields between different electrodes E. Different electrodes E interact with each other through the capacitive coupling C1 and C2. The capacitive coupling C1 is the capacitive coupling between the driving electrode Dr and the detection electrode Dt, and the capacitive coupling C2 is the capacitive coupling between two detection electrodes Dt.

[0062] The strength of the capacitive coupling C1 and C2 is inversely proportional to the distance between the electrodes E. The distance between the closest electrodes E is, for example, within 1 times the average size of the electrodes E. The strength of the capacitive coupling C2 between the two closest detection electrodes Dt is, for example, 0.25 times or more and 1.75 times or less of the capacitive coupling C1 between the closest drive electrode Dr and the detection electrode Dt, preferably 0.5 times or more and 1.5 times or less, and more preferably 0.75 times or more and 1.25 times or less. In addition, the strength of the capacitive coupling C2 between the detection electrodes Dt surrounding a drive electrode Dr is, for example, 0.25 times or more and 1.75 times or less of the capacitive coupling C1 between a drive electrode Dr and any one of the detection electrodes Dt surrounding the drive electrode Dr, preferably 0.5 times or more and 1.5 times or less, and more preferably 0.75 times or more and 1.25 times or less.

[0063] Next, the operation of the information processing device is described. The information processing device projects the input signal in a high dimension and replaces the input signal with another signal including information of the input signal. The operation in the information processing device is equivalent to the processing in the reservoir calculation.

[0064] Reservoir computing is a means of realizing a neural network that mimics the human brain. Reservoir computing performs recursive processing by causing signals to interact with each other. Reservoir computing, for example, mimics the actions of the cerebellum and performs recursive data processing or data conversion (for example, coordinate conversion). Reservoir computing is a method of recurrent neural networks that can process nonlinear time series data. Nonlinear time series data is data whose value changes over time, and stock prices are one example.

[0065] First, before explaining the operation of the information processing device, the reserve pool calculation will be briefly explained.

[0066] Figure 3 It is a conceptual diagram of the reserve pool calculation RC simulated by the information processing device of the first embodiment. Figure 3 The reservoir calculation RC shown is the input layer L in , storage pool R and output layer L out Input layer L in And the output layer L out Connected to the reservoir R.

[0067] Input layer L inThe signal from the outside is transmitted to the reservoir R. Input layer L in For example, a number of neurons n 1 Neurons are sometimes called nodes. From the outside to the input layer L in Each neuron n 1 The input signal is transmitted to the reservoir R.

[0068] The reserve pool R is used to store the in The input signal is an area where the input signals interact with each other. The reservoir R has a plurality of neurons n randomly connected to each other. 2 In the reservoir R, the signals only interact with each other and do not learn. If the input signals interact with each other, the input signals change nonlinearly. In addition, the input signals change over time by interacting with each other in the reservoir R. For example, sometimes from a neuron n at a certain time t 2 The output signal returns to the original neuron n at a certain time t+1 2 In neurons 2 In the process, the signal at time t and time t+1 can be processed, and the information can be processed recursively.

[0069] Output layer L out Output the signal from the reservoir R. Output layer L out For example, a number of neurons n 3 . Neuron 3 is the output terminal in the neuromorphic device. out When learning is performed, the neurons n of the connected reserve pool R are 2 And the output layer L out The neuron 3 The output layer L out Output the learning results to the outside.

[0070] The information processing device performs the same operation as the reserve pool calculation RC. The operation of the information processing device is described in comparison with the above-mentioned operation of the reserve pool calculation RC.

[0071] First, if Figure 2As shown, as an initial state, a driving signal Sgi is input from the signal generator 20 to the driving electrode Dr. If the driving signal Sgi is input to the driving electrode Dr, the potential of the driving electrode Dr changes, and an electric field is generated between the driving electrode Dr and the detection electrode Dt. The driving electrode Dr and the detection electrode Dt are capacitively coupled C1 through the electric field. The potential of the detection electrode Dt changes due to the capacitive coupling C1. The detection electrode Dt generates an electric field according to the difference in potential with other detection electrodes Dt, and performs capacitive coupling C2. As a result, an initial state in which an electric field is formed above a plurality of electrodes E is generated. Each detection electrode Dt outputs a signal based on its own potential to the identifier 30.

[0072] Next, if Figure 4 As shown in FIG. 1 , the object Ob approaches a certain position above the plurality of electrodes E. As shown in FIG. Figure 4 1 is a schematic diagram for explaining the operation of the information processing device of the first embodiment. The object Ob is, for example, a finger of a user. The proximity of the object Ob and the signal in the reserve pool calculation RC to the input layer L in The input corresponds to .

[0073] For example, Figure 4 As shown, the object Ob approaches between a certain driving electrode DrA and a certain detection electrode DtA. If the object Ob with a different dielectric constant is inserted between the driving electrode DrA and the detection electrode DtA, the strength of the capacitive coupling C3 between the driving electrode DrA and the detection electrode DtA changes from the initial state. If the strength of the capacitive coupling C3 changes, the potential of the detection electrode DtA changes from the initial state. If the potential of the detection electrode DtA changes, the potential of the detection electrode DtB that is capacitively coupled C4 to the detection electrode DtA also changes. Moreover, the potential change of the detection electrode DtB is also propagated to other detection electrodes Dt through the capacitive coupling between the detection electrode DtB and other detection electrodes Dt.

[0074] The change in the potential of each detection electrode Dt corresponds to the signal processing in the reservoir R of the reservoir calculation RC. The reservoir R stores the signal from the input layer L in In the signal processing unit 10, the information on the approach of the object Ob changes nonlinearly due to the interaction between the plurality of electrodes E via capacitive coupling, and is replaced with information on the potential of each detection electrode Dt.

[0075] The potentials of the respective detection electrodes DtA, DtB, and DtC are signals Sgo1, Sgo2, and Sgo3, which arrive at the identifier 30. The signals Sgo1, Sgo2, and Sgo3 arriving at the identifier 30 are different from the initial state. The identifier 30 learns the signal output from the signal processing unit 10 when the object Ob is at a predetermined position. The processing in the identifier 30 and the output layer L of the reserve pool calculation RC out The signal processing corresponds to .

[0076] The identifier 30 learns the relationship between the state of the object Ob and the signal output from the signal processing unit 10. The identifier 30 identifies the state of the object Ob by identifying the signal output from the signal processing unit 10. The state of the object Ob includes, for example, the position, shape, material, size, and motion of the object Ob.

[0077] The identifier 30 includes, for example, a plurality of variable resistors arranged in a matrix, a plurality of first bit lines connected to the variable resistors in the same row, and a plurality of second bit lines connected to the variable resistors in the same column. The variable resistors are, for example, magnetic domain wall moving elements. Weights obtained by learning are assigned to the variable resistors. The resistance values ​​of the variable resistors are different according to the weights assigned to the variable resistors.

[0078] The signal input to the identifier 30 is transmitted through each of the first bit lines and reaches each variable resistor. Each variable resistor has a different resistance value according to the weight assigned, and a product operation is performed by passing the signal through each variable resistor. The result of the product operation performed through each variable resistor is transmitted to the second bit line. The results of the product operation of the variable resistors connected to the same second bit line are collected on the same second bit line and a sum operation is performed.

[0079] The motion detection device 100 of the first embodiment identifies the motion of the object Ob based on the signal reaching the identifier 30. The motion detection device 100 of the first embodiment performs nonlinear conversion on the input signal through the interaction of multiple electrodes E and replaces it with new information. Since the input signal and the output signal are in a nonlinear relationship, the motion detection device 100 of the first embodiment can extract the output signal that only focuses on the required information. In addition, the motion detection device 100 of the first embodiment does not require linear scanning and can read the motion of the object Ob more quickly.

[0080] In the above, the present invention has been described in detail by taking the motion detection device 100 according to the first embodiment as an example, but the structure of the motion detection device 100 is not limited to these embodiments, and various modifications and changes can be made.

[0081] For example, the electrodes are not limited to Figure 1 For example, electrode E1 can also be like Figure 5The electrode E1 shown in FIG. 1 has a plane portion PE and a wall portion WE. The wall portion WE rises from the plane portion PE. Since the wall portions WE in adjacent electrodes E1 face each other, the capacitive coupling between adjacent electrodes E1 is enhanced. Figure 6 As shown, the electrode E2 may also be a columnar body.

[0082] In addition, if Figure 7 As shown, the shape of at least one of the multiple electrodes E3 may be different from that of the other electrodes E3. The shape of each group of the multiple electrodes E3 may also be non-constant. The top view shape of the electrode E3 may be circular, rectangular, or amorphous. In addition, among the multiple electrodes E3, planar electrodes and three-dimensional electrodes may also be mixed together. The shapes of the individual electrodes E3 are different, and the strength of the capacitive coupling between the electrodes is different for each electrode. If the strength of the capacitive coupling is different depending on the location, the motion detection device 100 can further perform nonlinear conversion on the input signal.

[0083] In addition, if Figure 8 As shown, at least two of the plurality of electrodes E may also be electrically connected via the switch element SW. If the switch element SW is connected, the two connected electrodes E become equal in potential. If the potential of the electrode E changes, the strength of the capacitive coupling also changes. If the switch element SW is switched, the electric field formed above the plurality of electrodes E is switched. That is, the initial state of the signal processing unit 10 also becomes one of the parameters that can be changed, and the signal processing unit 10 can read more information from the object Ob.

[0084] In addition, if Fig. 9 As shown, multiple electrodes E may be in layers L1 and L2 of different levels. The electrode group belonging to layer L1 and the electrode group belonging to layer L2 are in different levels. For example, there is a dielectric between the electrode group of layer L1 and the electrode group of layer L2. The electrodes E of layer L1 and the electrodes E of layer L2 may also interact with each other. The electrodes E of layer L1 may all be driving electrodes Dr, and the electrodes E of layer L2 may all be detection electrodes Dt. In addition, the relationship may be the opposite. In addition, the electrode groups of layer L1 and layer L2 may have driving electrodes Dr and detection electrodes Dt, respectively.

[0085] In addition, capacitive coupling has been shown as an example of a medium responsible for the interaction between the plurality of electrodes E, but the medium responsible for the interaction may also be electromagnetic induction. That is, each of the plurality of electrodes E may also interact with other electrodes E via a magnetic field. Fig.10 As shown, by making the electrode E4 into a coil shape, electromagnetic induction occurs between the electrodes E4. In addition, as a medium responsible for the interaction between the plurality of electrodes E, capacitive coupling (electric field) and electromagnetic induction (magnetic field) may be used in combination.

[0086] [Second Embodiment]

[0087] Fig.11 The motion detection device 101 shown includes an information processing device and an output device 50. The information processing device includes a signal processing unit 10, a signal generator 20, an identifier 30, and a feedback device 40. The motion detection device 101 is different from the motion detection device 100 in that it includes a feedback device 40. Hereinafter, the points in the motion detection device 101 that are different from the motion detection device 100 will be described in detail, and the description of the same structure will be omitted.

[0088] The feedback device 40 is located between the detection electrode Dt of the signal processing unit 10 and the identifier 30. The feedback device 40 returns a part of the signal detected by the detection electrode Dt to the signal generator 20.

[0089] The feedback device 40 includes, for example, a signal holding unit and a signal transmitting unit. The signal holding unit temporarily holds the signal from the detection electrode Dt. The signal transmitting unit transmits the signal held by the signal holding unit to the signal generator 20 after a certain period of time.

[0090] The motion detection device 101 returns the signal output at time t to the signal generator 20 for calculation at time t+1. The signal at the past time t includes information on the touch position at the past time t. That is, based on the past user's actions, the current user's actions can be read. As a result, the motion detection device 101 can read more complex user gestures.

[0091] In addition, if Fig.12 As shown, at least two of the plurality of electrodes may also be replaced with the feedback device 40 or connected together with the feedback device 40 via a circuit L. The circuit L has at least one selected from the group consisting of a resistor, a capacitor, and a coil. The circuit L is, for example, an LCR circuit. The circuit L generates a transient phenomenon.

[0092] The decay time of the circuit L is, for example, twice or more the length of time over which the time variation of the signal input to the driving electrode Dr occurs. The decay time of the circuit L is the time until the intensity of the signal input to the circuit L becomes 1 / e.

[0093] If a transient phenomenon occurs in the circuit L, the signal input at time t is held in the circuit L and used for calculation at time t + 1. That is, the current user's actions can be read based on the past user's actions.

[0094] [Third Embodiment]

[0095] Fig.13Schematic diagram of the motion detection device 200 of the third embodiment. The motion detection device 200 includes an information processing device and an output device 50. The motion detection device 200 is, for example, a touch sensor, an ultrasonic sensor, etc. An example of an ultrasonic sensor is shown in the third embodiment. The information processing device projects the input signal in a high dimension and replaces the input signal with another signal including information of the input signal. The details of the action of the information processing device will be described later. The output device 50 outputs the signal processed by the information processing device to the outside.

[0096] The information processing device includes a signal processing unit 12, a signal generator 20, an identifier 30, and a feedback device 40. The specific structure of the information processing device is different from the motion detection device 101 of the second embodiment. The signal generator 20 supplies a signal to the transmission terminal TT of the signal processing unit 12.

[0097] The signal processing unit 12 includes, for example, a transmission terminal TT and a plurality of reception terminals RT. There may be a plurality of transmission terminals TT. The number and arrangement of the transmission terminals TT and the reception terminals RT are arbitrary.

[0098] The transmitting terminal TT outputs the signal input from the signal generator 20 as a wave w. The wave w is, for example, an ultrasonic wave, an electromagnetic wave, etc. The plurality of receiving terminals RT receive the wave w respectively. The state of the wave w received by the plurality of receiving terminals RT changes according to the position, shape, material, size, motion, etc. of the object close to the signal processing unit 12. The motion detection device 200 detects the position, shape, material, size, motion, etc. of the object close to the signal processing unit 12 according to the change in the state of the wave w. The number and arrangement of the transmitting terminals TT and the receiving terminals RT are arbitrary.

[0099] The transmitting terminal TT and the receiving terminal RT each have a diaphragm. The transmitting terminal TT outputs a wave w by vibrating the diaphragm with a signal input from the signal generator 20. The receiving terminal RT converts the movement of the diaphragm vibrated by the wave w into a signal. The receiving terminal RT interacts with other receiving terminals RT via the wave w or wiring.

[0100] The feedback device 40 is connected to the receiving terminal RT and the transmitting terminal TT. The feedback device 40 feeds back the signal received by the receiving terminal RT to the transmitting terminal TT.

[0101] exist Fig.13 , an example is shown in which all the receiving terminals RT are connected to the feedback device 40, but only a part of the receiving terminals RT may be connected to the feedback device 40. The receiving terminals RT connected to the feedback device 40 are referred to as first receiving terminals. When only a part of the receiving terminals RT are connected to the feedback device 40, the other receiving terminals RT are directly connected to the identifier 30.

[0102] Fig.141 is a schematic diagram of an example of a transmission terminal TT connected to the feedback device 40. The transmission terminal TT connected to the feedback device 40 includes, for example, a diaphragm 60 and a piezoelectric body 61. The piezoelectric body 61 is in contact with the diaphragm 60.

[0103] The piezoelectric body 61 is connected to the feedback device 40. The piezoelectric body 61 is input with an electrical signal transmitted from the feedback device 40 and vibrates based on the electrical signal. The diaphragm 60 vibrates based on the signal input from the signal generator 20. The transmission terminal TT superimposes the vibration of the diaphragm 60 and the vibration of the piezoelectric body 61 and outputs the wave w. The vibration of the piezoelectric body 61 is a signal fed back to the signal processing unit 12.

[0104] Fig.15 1 is a schematic diagram of another example of a transmission terminal TT connected to the feedback device 40. The transmission terminal TT connected to the feedback device 40 includes, for example, a diaphragm 60, a coil 62, and a magnet 63. The coil 62 surrounds the convex portion of the magnet 63. When current flows through the coil 62, an electromagnetic force is generated inside the coil 62. The coil 62 is fixed to the diaphragm 60.

[0105] The coil 62 is connected to the feedback device 40. The electrical signal sent from the feedback device 40 flows in the coil 62 as an electric current. The coil 62 modulates the vibration of the diaphragm 60 by the electromagnetic force formed by the electric current. The transmission terminal TT outputs a wave w based on the vibration of the diaphragm 60 modulated by the electric current flowing in the coil 62. In the case where the receiving terminal RT has the diaphragm 60, the coil 62 moves up and down around the magnet 63 as the diaphragm 60 vibrates, and the wave can be converted into a signal.

[0106] In addition, if Fig.13 As shown, the feedback device 40 includes, for example, a nonlinear output circuit 41 and a delay circuit 42 .

[0107] The nonlinear output circuit 41 performs nonlinear conversion on the input signal and outputs it. As described above, the reservoir R performs nonlinear conversion on the input signal by making the input signals interact with each other, and performs recursive data processing or data conversion (for example, coordinate conversion). By inputting the nonlinearly converted signal from the nonlinear output circuit 41 to the signal processing unit 12, more complex signal processing can be performed.

[0108] The delay circuit 42 delays the input signal. The delay circuit 42 has the same function as the signal holding unit in the second embodiment. The delay circuit 42 temporarily holds the input signal and returns it to the signal processing unit 12 after a certain period of time. By inputting past information to the signal processing unit 12 in a time series, the current user's actions based on the past user's actions can be read. As a result, the action detection device 101 can read more complex user gestures.

[0109] The motion detection device 200 of the third embodiment can recognize the position, shape, size, motion, etc. of the object based on the signal reaching the identifier 30. The motion detection device 200 of the third embodiment does not require line scanning and can read the motion of the object more quickly.

[0110] As mentioned above, the present invention has been described in detail by taking the motion detection device 200 according to the third embodiment as an example, but the structure of the motion detection device 200 is not limited to these embodiments, and various modifications and changes can be made.

[0111] For example, the same deformation as that of the first and second embodiments can be added to the motion detection device 200 of the third embodiment. For example, the shapes of the transmission terminal TT and the receiving terminal RT may not be constant. In addition, a propagation body for transmitting vibration may be provided between the transmission terminal TT and the receiving terminal RT and between different receiving terminals RT. In addition, the transmission terminals TT and the receiving terminals RT may be formed over different layers. In addition, a feedback device 40 may be used instead or a circuit L( Fig.12 ).

[0112] Alternatively, for example, Fig.16 The feedback device 40 is connected to two different receiving terminals RT as in the motion detection device 201 shown in FIG. One receiving terminal RT is referred to as a first receiving terminal, and the other receiving terminal RT is referred to as a second receiving terminal. The feedback device 40 feeds back the signal received by the first receiving terminal to the second receiving terminal. In this case, the receiving terminal RT connected to the feedback device 40 becomes Fig.14 or Fig.15 By feeding back a signal to the signal processing unit 12, information of different time series is input to the signal processing unit 12. As a result, the motion detection device 201 can detect complex motions and the like.

[0113] Alternatively, for example, Fig.17 The feedback device 40 is connected to a receiving terminal RT as in the motion detection device 202 shown in FIG. The feedback device 40 feeds back the signal received by the receiving terminal RT to the same receiving terminal RT again. In this case, the receiving terminal RT connected to the feedback device 40 becomes Fig.14 or Fig.15 By feeding back a signal to the signal processing unit 12, information of different time series is input to the signal processing unit 12. As a result, the motion detection device 202 can detect more complex motions, etc.

[0114] In addition, for example, Fig.18The feedback device 40 is connected to the receiving terminal RT and the external transmission terminal TT2 as in the motion detection device 203 shown in the figure. The feedback device 40 transmits the signal received by the receiving terminal RT to the external transmission terminal TT2. The external transmission terminal TT2 outputs a wave w2 based on the transmitted signal. The wave w2 is received by the transmission terminal TT and the receiving terminal RT, and the signal is indirectly fed back to the transmission terminal TT or the receiving terminal RT. The structure of the external transmission terminal TT2 is the same as that of the above-mentioned transmission terminal TT. Even if it is indirect, the signal is fed back to the signal processing unit 12, thereby inputting information of different time series to the signal processing unit 12. As a result, the motion detection device 203 can detect more complex motions, etc.

[0115] Alternatively, for example, Fig.19 As shown in FIG. 2 , the motion detection device 204 is provided with a reflector 70 at a position capable of reflecting the wave w generated by the transmission terminal TT. The reflector 70 reflects the wave generated from the transmission terminal TT toward the reception terminal RT. The reflector 70 is, for example, a reflector. The reflector 70 serves as a substitute for the object. That is, the motion detection device 204 can function as a reserve pool R even in the absence of the object. The motion detection device 204 is not limited to the detection of gestures, etc., but functions as an element for realizing the reserve pool calculation RC.

[0116] Alternatively, for example, Fig. 20 As in the motion detection device 205 shown in FIG. 1 , some of the receiving terminals RT are independently connected to the identifier 30. Alternatively, all the receiving terminals RT may be independently connected to the identifier 30. Furthermore, after a plurality of receiving terminals RT are connected by wiring, even when the terminals are connected to the identifier 30, there is no limit to the number of receiving terminals RT connected to the wiring. Fig. 20 205 is shown as a modified example of the motion detection device 201, but the same is true for other motion detection devices. That is, in any of the motion detection devices 200 to 204, the outputs from all the receiving terminals RT do not need to reach the identifier 30 after being merged by wiring, and some of the receiving terminals RT are independently connected to the identifier 30.

[0117] Explanation of symbols

[0118] 10, 12 Signal processing unit

[0119] 20 Signal Generator

[0120] 30 Identifier

[0121] 40 Feedback device

[0122] 41 Nonlinear Output Circuit

[0123] 42 Delay Circuit

[0124] 50 Output device

[0125] 60 Diaphragm

[0126] 61 Piezoelectric

[0127] 62 Coil

[0128] 60 Magnet

[0129] 70 Reflector

[0130] 100, 101, 200, 201, 202, 203 Motion detection device

[0131] C1, C2, C3, C4 Capacitor coupling

[0132] Dr, DrA driving electrode

[0133] Dt, DtA, DtB, DtC detection electrodes

[0134] E, E1, E2, E3, E4 electrodes

[0135] L Circuit

[0136] L1 and L2 layers

[0137] L in Input Layer

[0138] L out Output Layer

[0139] n1, n2, n3 neurons

[0140] R Reserve

[0141] RC Reserve Pool Calculation

[0142] Ob object

[0143] PE plane part

[0144] RT receiving terminal

[0145] SW Switching Element

[0146] TT Sending terminal

[0147] TT2 external sending terminal

[0148] WE wall surface

Claims

1. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. comprising a plurality of electrodes, At least one of the plurality of electrodes is the transmitting terminal, At least two of the plurality of electrodes are the receiving terminals, The transmitting terminal is a driving electrode to which a signal is input. The receiving terminal is a detection electrode for detecting information from the driving electrode. The fields generated by each of the plurality of electrodes at least affect surrounding electrodes, and each of the plurality of electrodes at least interacts with surrounding electrodes. At least two of the plurality of electrodes are connected via a circuit, The circuit has at least one selected from the group consisting of a resistor, a capacitor, and a coil, The signal generator inputs a signal to the driving electrode, The identifier recognizes the signal from the detection electrode, determines the state of the object approaching the plurality of electrodes based on a learning result of the relationship between the state of the object and the signal output from the signal processing unit, The feedback device transmits a portion of the signal reaching the identifier from the detection electrode to the signal generator, and includes: a signal holding unit that temporarily holds the signal from the detection electrode; and a signal sending unit that sends the signal held by the signal holding unit to the signal generator after a certain period of time.

2. The information processing device according to claim 1, characterized in that The circuit produces a transient phenomenon, The decay time of the circuit is at least twice the period of the signal input to the driving electrode.

3. The information processing device according to claim 1 or 2, characterized in that: At least two of the plurality of electrodes are electrically connected via a switching element.

4. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The feedback device is connected to the first receiving terminal and a second receiving terminal different from the first receiving terminal, The feedback device feeds back the signal received by the first receiving terminal to the second receiving terminal, The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

5. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The feedback device is connected to the first receiving terminal, The feedback device feeds back the signal received by the first receiving terminal to the first receiving terminal again, The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

6. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, feedback device, and external transmission terminal, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The feedback device is connected to the first receiving terminal and the external sending terminal, The feedback device feeds back the signal received by the first receiving terminal to the external sending terminal, The external transmission terminal outputs a wave based on a signal input to the external transmission terminal, The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

7. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The feedback device includes a delay circuit for delaying the input signal. The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

8. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The transmitting terminal or the receiving terminal connected to the feedback device has a diaphragm and a piezoelectric body in contact with the diaphragm, The diaphragm can be vibrated by the wave, The piezoelectric body is connected to the feedback device and a feedback signal is inputted. The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

9. An information processing device, characterized in that: include: signal processing unit, signal generator, identifier, and feedback device, The signal processing unit includes: a transmission terminal for transmitting an input signal; and a plurality of receiving terminals for receiving information output from the transmitting terminal as a signal, The signal received by one of the plurality of receiving terminals is configured to interact with the signals received by other receiving terminals. The transmitting terminal outputs the wave as a signal. The plurality of receiving terminals receive the waves as signals respectively. The feedback device feeds back a signal received by a first receiving terminal among the plurality of receiving terminals to the transmitting terminal or any of the receiving terminals, The transmitting terminal or the receiving terminal connected to the feedback device has a diaphragm, a coil fixed to the diaphragm, and a magnet surrounded by the coil. The diaphragm can be vibrated by the wave, The coil is connected to the feedback device and a feedback signal is inputted. The signal generator inputs a signal to the sending terminal, The identifier is connected to the plurality of receiving terminals, and identifies the state of an object approaching the plurality of receiving terminals based on a learning result of a relationship between the state of the object and a signal output from the signal processing unit.

10. A motion detection device, characterized in that: include: The information processing device according to any one of claims 1 to 9; and An output device outputs the result calculated by the information processing device to the outside.

Images