Abnormal data processing system and abnormal data processing method
The abnormal data processing system addresses unreliable data issues in human measurement systems by combining individual and multi-subject databases for precise abnormality detection, enhancing the accuracy of analysis results.
Patent Information
- Application Number
- JP2023096145
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-10-30
- Filing Date
- 2023-06-12
- Publication Date
- 2025-01-09
- Estimated Expiration
- 2038-10-17
AI Technical Summary
Existing human data measurement systems, such as finger tap analysis systems, face issues with unreliable data when users measure or are assisted by inexperienced individuals, leading to inaccurate analysis results due to improper measurements or misunderstandings, which can falsely indicate brain dysfunction.
An abnormal data processing system that combines individual and multi-subject databases to detect deviations, using composite deviation degrees to accurately identify and process abnormal data, incorporating a control unit, storage unit, and input/output sections to manage and analyze data for precise abnormality detection.
The system enables high-precision automatic processing of abnormal data by compensating for individual and collective database strengths and weaknesses, ensuring accurate analysis results.
Smart Images

Figure 0007611301000001 
Figure 0007611301000002 
Figure 0007611301000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing service technology, and also to a technology for implementing abnormal data processing. [Background technology]
[0002] In fields such as healthcare, medical care, and nursing care, there are an increasing number of systems that measure data on humans. These systems provide value to users by calculating analysis results from the data obtained and feeding them back to the user. One example of such a system is a system (finger tap measurement and analysis system) that simply evaluates cognitive and motor functions by measuring and analyzing the user's finger tapping movements (e.g., Patent Document 1). Here, the finger tapping movement is the repeated opening and closing of the thumb and index finger. It is known that the performance of finger tapping movements varies depending on the presence and severity of brain dysfunction such as dementia and Parkinson's disease. It has been pointed out that the results of the analysis of finger tapping movements by the above system may enable early detection of brain dysfunction in users and estimation of its severity. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-140424 A [Patent Document 2] Special Publication No. 2013-535268 [Patent Document 3] JP 2013-039344 A Summary of the Invention [Problem to be solved by the invention]
[0004] When human data measurement services, such as finger tap measurement and analysis systems, become widespread in ordinary households, it is expected that users will measure by themselves or with the assistance of family members who are unfamiliar with measurement. When data is measured without the assistance of an experienced person, there is a possibility that unreliable data (hereinafter referred to as "abnormal data") will be measured due to inappropriate measurement procedures or users not performing expected actions.
[0005] For example, in the case of the finger tapping measurement and analysis system described above, there may be cases where the user stops the finger tapping motion in the middle of the specified measurement time, or where the user misunderstands the instructions and performs the finger tapping motion.
[0006] If such abnormal data is used, it will be impossible to provide the user with reliable analysis results. For example, in the case of the finger tapping measurement and analysis system described above, the finger tapping movement may be deemed to be poorer than it actually is, and an analysis result may be obtained indicating a high possibility of brain dysfunction, even though the possibility is actually low.
[0007] Therefore, a mechanism for automatically processing abnormal data is required. There are two approaches to realizing this mechanism for processing abnormal data: (A) when abnormalities can be detected simply by focusing on the target data, and (B) when abnormalities can only be detected by comparing with a past database (DB). In the case of (A), all that is required is the target data, and so this can be done on a personal computer (PC) terminal (local PC) connected to a local measuring device. In the case of (B), if past DBs are stored on the local PC, this can be done on the local PC, but if past DBs are stored on a cloud server, it must be done on the server.
[0008] The above-mentioned case (B) will be explained in detail. When comparing the target data with a past DB, the past DB can be (i) a DB consisting only of the data of the user (hereinafter referred to as the "individual subject DB"), or (ii) a DB including the data of many other users (hereinafter referred to as the "multiple subject DB"). Since the individual subject DB (i) reflects the individuality of the data of the user, it is desirable to use the individual subject DB (i) in order to accurately detect abnormal data. However, although it is possible to use the individual subject DB (i) if the user has already performed measurements many times, if it is the first time or if the user has performed measurements only a few times, the DB (i) has not been sufficiently accumulated, and it is necessary to use the multiple subject DB (ii).
[0009] The advantage of using the multi-subject DB in (ii) is that it is easy to prepare the DB, since data of users other than the relevant user can be stored in advance. However, the multi-subject DB in (ii) is a collection of data from many users, and does not reflect the individuality of the relevant user's data, so there is a disadvantage that abnormal data detection may be less accurate than when using the individual subject DB in (i).
[0010] In light of the above concerns, it is considered necessary to have a technology that uses both the individual subject DB (i) and the multiple subject DB (ii) in combination, complementing each other's advantages and disadvantages. Examples of prior art related to abnormal data processing include JP2013-535268A (Patent Document 2) and JP2013-039344A (Patent Document 3). However, these two patent documents only describe a method for identifying whether test data is abnormal in a pre-given database, and do not mention a technology for improving the accuracy of abnormal data detection by using both the individual subject DB and the multiple subject DB. Therefore, the present invention proposes a technology for automatically processing abnormal data with high accuracy. [Means for solving the problem]
[0011] One aspect of the present invention is an abnormal data processing system which detects and processes the presence or absence of anomalies in new data, the abnormal data processing system comprising: a memory unit which holds a multiple subject DB in which data of a plurality of subjects is accumulated, and an individual subject DB in which data of an individual subject is accumulated, an individual subject DB deviation calculation unit which calculates an individual subject DB deviation degree which is the degree to which new data deviates from the individual subject DB, a multiple subject DB deviation calculation unit which calculates a multiple subject DB deviation degree which is the degree to which new data deviates from the multiple subject DB, and a composite deviation calculation unit which uses the number of data in the individual subject DB to determine a composite deviation degree by combining the individual subject DB deviation degree and the multiple subject DB deviation degree, and the abnormal data processing system judges the new data to be abnormal based on the composite deviation degree.
[0012] This is an abnormal data processing method that uses an input unit, an output unit, a control unit, and a memory unit to detect and process the presence or absence of anomalies in new data acquired from the input unit, in which the memory unit holds a multiple subject DB in which data of a plurality of subjects is accumulated, and an individual subject DB in which data of an individual subject is accumulated, calculates an individual subject DB deviation degree which is the degree to which new data deviates from the individual subject DB, calculates a multiple subject DB deviation degree which is the degree to which new data deviates from the multiple subject DB, determines a composite deviation degree using the individual subject DB deviation degree and the multiple subject DB deviation degree based on the number of data in the individual subject DB, and judges the new data to be abnormal based on the composite deviation degree. Effect of the Invention
[0013] It is possible to realize technology that automatically processes abnormal data with high accuracy. [Brief description of the drawings]
[0014] [Figure 1] 1 is a block diagram showing a configuration of an abnormality data processing system according to a first embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a configuration of an abnormality data processing system in a first embodiment. [Diagram 3] 1 is a block diagram showing a configuration of a measurement device in a first embodiment. [Figure 4] FIG. 2 is a block diagram showing a configuration of a terminal device in the first embodiment. [Diagram 5] 1 is a perspective view showing a motion sensor attached to a finger in the first embodiment. FIG. [Figure 6] FIG. 2 is a block diagram showing the configuration of a motion sensor control unit and the like of the measurement device in the first embodiment. [Figure 7] 4 is a flowchart showing a processing flow of the abnormality data processing system of the first embodiment. [Figure 8] FIG. 4 is a waveform diagram showing an example of a waveform signal of a feature amount in the first embodiment. [Figure 9] FIG. 4 is a table showing an example of the configuration of a feature amount list in the first embodiment. [Figure 10] 10 is a waveform diagram showing an example of DB unused abnormal data detection in the first embodiment. FIG. [Figure 11] FIG. 2 is a conceptual diagram showing abnormal data detection using an individual subject DB and abnormal data detection using a multiple subject DB in the first embodiment. [Figure 12] FIG. 4 is a conceptual diagram showing a method for calculating a composite deviation in the first embodiment. [Figure 13] FIG. 4 is a conceptual diagram showing a method of calculating a deviation degree taking into account a time series in the first embodiment. [Figure 14] 4 is a table diagram showing an example of the configuration of an abnormality detection reason / processing correspondence table in the first embodiment. FIG. [Figure 15] FIG. 2 is a plan view showing a menu screen as an example of a display screen in the first embodiment. [Figure 16] FIG. 2 is a plan view showing a task measurement screen as an example of a display screen in the first embodiment. [Figure 17] FIG. 4 is a plan view showing an evaluation result screen as an example of a display screen in the first embodiment. [Figure 18] FIG. 2 is a plan view showing a first abnormal data detection / processing screen as an example of a display screen in the first embodiment. [Figure 19] 13 is a plan view showing a second abnormal data detection / processing screen as an example of a display screen in the first embodiment. FIG. [Figure 20]FIG. 11 is a block diagram showing a configuration of an abnormality data processing system according to a second embodiment of the present invention. [Figure 21] FIG. 11 is a plan view showing finger tapping on a screen as an example of exercise in the second embodiment. [Figure 22] FIG. 11 is a waveform diagram showing a waveform of the distance between two fingers tapping on a screen in the second embodiment. [Figure 23] FIG. 11 is a plan view showing reaching as an example of motion in the second embodiment. [Figure 24] FIG. 11 is a plan view showing continuous touch as an example of a movement in the second embodiment. [Diagram 25] FIG. 11 is a plan view showing tapping in accordance with stimulation as an example of exercise in the second embodiment. [Figure 26] FIG. 11 is a plan view showing five-finger tapping as an example of exercise in the second embodiment. [Figure 27] FIG. 11 is a block diagram showing a configuration of an abnormality data processing system according to a third embodiment of the present invention. [Figure 28] FIG. 11 is a block diagram showing a configuration of a server which is an abnormality data processing system according to a third embodiment. [Figure 29] FIG. 11 is a table showing an example of the configuration of user information, which is management information of a server, in the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In addition, in all the drawings for explaining the embodiment, the same parts are basically given the same reference numerals, and the repeated description will be omitted.
[0016] The embodiments will be described in detail with reference to the drawings. However, the present invention should not be interpreted as being limited to the description of the embodiments shown below. It will be easily understood by those skilled in the art that the specific configuration can be changed without departing from the concept or purpose of the present invention.
[0017] When there are multiple elements having the same or similar functions, they may be described by using the same reference numerals with different subscripts. However, when there is no need to distinguish between multiple elements, the subscripts may be omitted.
[0018] The designations "first," "second," "third," and the like in this specification are given to identify components, and do not necessarily limit the number, order, or content. Furthermore, numbers for identifying components are used in different contexts, and a number used in one context does not necessarily indicate the same configuration in another context. Furthermore, a component identified by a certain number does not prevent the component from also having the function of a component identified by another number.
[0019] In order to facilitate understanding of the invention, the position, size, shape, range, etc. of each component shown in the drawings, etc. may not represent the actual position, size, shape, range, etc. Therefore, the present invention is not necessarily limited to the position, size, shape, range, etc. disclosed in the drawings, etc.
[0020] In this embodiment, a technology for automatically processing abnormal data is proposed. In abnormal data processing, there are (A) cases where an abnormality can be detected simply by focusing on the target data, and (B) cases where an abnormality can only be detected by comparing with past DBs. In this embodiment, particularly for (B), a technology for detecting abnormal data is proposed that uses a combination of (i) a DB consisting only of the data of the user (individual subject DB) and (ii) a DB including data of many other users (multiple subject DB). According to a representative embodiment, (i) the decrease in accuracy due to a lack of data when using a DB consisting only of the data of the user, and (ii) the decrease in accuracy due to an inability to reflect individual differences when using a DB including data of many other users, can be realized by mutually compensating for each other to achieve highly accurate detection of abnormal data. Embodiment 1
[0021] The abnormal data processing system according to the first embodiment of the present invention will be described with reference to Figures 1 to 19. The abnormal data processing system according to the first embodiment has a function of detecting an abnormality in data measured from a user and generating processing content when an abnormality is detected. These functions enable detection and processing of abnormal data with high accuracy.
[0022] [Human data measurement system (1)] FIG. 1 shows the configuration of a human data measurement system including an abnormality data processing system according to a first embodiment. In the first embodiment, the human data measurement system is provided in facilities such as hospitals and elderly care facilities, in users' homes, etc. The human data measurement system has an abnormality data processing system 1 and a measurement system 2 which is a magnetic sensor type finger tapping exercise system, which are connected via a communication line. The measurement system has a measurement device 3 and a terminal device 4, which are connected via a communication line. A plurality of measurement systems 2 may be provided within a facility.
[0023] The measurement system 2 is a system that measures finger movements using a magnetic sensor type motion sensor. The motion sensor is connected to a measurement device 3. The motion sensor is attached to the user's fingers. The measurement device 3 measures the finger movements through the motion sensor and obtains measurement data including a time series waveform signal.
[0024] The terminal device 4 displays various information for abnormal data processing, including the abnormal data detection result, the abnormal data detection reason, and the abnormal data processing content, on a display screen, and accepts operation inputs by a user. In the first embodiment, the terminal device 4 is a PC.
[0025] The abnormal data processing system 1 has a function of providing an abnormal data processing service as a service based on information processing. The abnormal data processing system 1 has, as its functions, an abnormal data detection function, an abnormal data processing decision function, etc. The abnormal data detection function is a function that detects the presence or absence of an abnormality in the measurement data measured by the measurement system 2. The abnormal data processing decision function is a function that decides the processing for data in which an abnormality has been detected by the abnormal data detection function.
[0026] The abnormal data processing system 1 inputs, for example, instructions to a user, measurement data, etc. as input data from the measurement system 2. The abnormal data processing system 1 outputs, for example, an abnormal data detection result, abnormal data processing details, etc. as output data to the measurement system 2. The abnormal data detection result includes the presence or absence of an abnormality in the measurement data, as well as the reason for the abnormal data detection.
[0027] The human data measurement system of the first embodiment is not limited to facilities such as hospitals and elderly care facilities and their subjects, but can be widely applied to general facilities and people. The measurement device 3 and the terminal device 4 may be configured as an integrated measurement system. The measurement system 2 and the abnormal data processing system 1 may be configured as an integrated device. The terminal device 4 and the abnormal data processing system 1 may be configured as an integrated device. The measurement device 3 and the abnormal data processing system 1 may be configured as an integrated device.
[0028] [Abnormal Data Processing System] 2 shows the configuration of the abnormal data processing system 1 of the first embodiment. The abnormal data processing system 1 has a control unit 101, a storage unit 102, an input unit 103, an output unit 104, a communication unit 105, etc., which are connected via a bus. The input unit 103 is a unit that performs operation input by an administrator or the like of the abnormal data processing system 1. The output unit 104 is a unit that performs screen display or the like for the administrator or the like of the abnormal data processing system 1. The communication unit 105 has a communication interface and is a unit that performs communication processing with the measuring device 3 and the terminal device 4.
[0029] The control unit 101 controls the entire abnormal data processing system, and is composed of a Central Processing Unit (CPU), a Read Only Memory (ROM), a Random Access Memory (RAM), etc., and realizes a data processing unit that detects abnormal data and determines how to process the abnormal data based on software program processing. The data processing unit of the control unit 101 has a user information management unit 11, a task processing unit 12, an analysis evaluation unit 13, an abnormal data detection unit 14, an abnormal data processing determination unit 15, an abnormal data processing execution unit 16, and a result output unit 17. The control unit 101 realizes functions such as inputting measurement data from the measurement device 3, processing and analyzing the measurement data, outputting control instructions to the measurement device 3 and the terminal device 4, and outputting display data to the terminal device 4.
[0030] The user information management unit 11 performs processes such as registering and managing user information input by a user in user information 41 in DB 40, and checking the user information 41 in DB 40 when the user uses a service. The user information 41 includes attribute values, usage history information, user setting information, etc. for each individual user. Attribute values include gender, age, etc. Usage history information is information that manages the history of a user's use of services provided by this system. User setting information is setting information set by the user regarding the functions of this service.
[0031] The task processing unit 12 is a part that performs processing related to tasks for analyzing and evaluating motor functions, etc. In other words, a task is a predetermined finger movement. The task processing unit 12 outputs a task on the screen of the terminal device 4 based on task data 42A in the DB 40. The task processing unit 12 also acquires measurement data of the task measured by the measurement device 3 and stores it in the DB 40 as measurement data 42B.
[0032] The analysis evaluation unit 13 is a part that calculates a feature quantity that represents the property of the measurement data based on the user's measurement data 42 B. The analysis evaluation unit 13 stores in the DB 40 analysis evaluation data 43 that is the result of the analysis evaluation process.
[0033] The abnormal data detection unit 14 performs a process of detecting abnormal data and a process of outputting the abnormal data detection result 44 to the screen of the terminal device 4 based on information in the user analysis evaluation data 43, the individual subject DB 45A, the multiple subject DB 45B, and the abnormality detection reason-processing correspondence table 50B in the management table 50. The abnormal data detection unit 14 stores the result of detecting an abnormality as the abnormal data detection result 44 in the DB 40. The abnormal data detection result 44 includes the presence or absence of an abnormality in the measurement data, as well as the reason for detecting the abnormal data. The abnormal data detection unit 14 transmits the abnormal data detection result 44 in the DB 40 to the terminal device 4 to output it on the screen. The abnormal data detection unit 14 is composed of a non-DB-using abnormal data detection unit 14A that detects abnormal data without using a DB, and a DB-using abnormal data detection unit 14B that detects abnormal data using a DB. The DB usage abnormal data detection unit 14B is composed of an individual subject DB deviation calculation unit 14Ba, a multiple subject DB deviation calculation unit 14Bb, and a composite deviation calculation unit 14Bc.
[0034] The abnormal data processing decision unit 15 performs processing such as creating abnormal data processing details 46 based on the abnormal data detection result 44 and the abnormality detection reason / processing correspondence table 50B in the management table 50 and storing the details in the DB 40.
[0035] The abnormal data processing execution unit 16 performs processing to execute the abnormal data processing content based on the abnormal data processing content 46. At this time, depending on the abnormal data processing content 46, the measurement data 42B may or may not be stored in the individual subject DB 45A or the multiple subject DB 45B.
[0036] Here, the individual subject DB45A is a DB consisting of only the data of a specific user, and the multiple subject DB45B is a DB combining the data of multiple users. In general, the data of the individual subject DB45A is a subset of the multiple subject DB45B, but the multiple subject DB45B does not necessarily need to include the data of the individual subject DB45A. In addition, the individual subject DB45A and the multiple subject DB45B may be separated as databases. However, by adding information that identifies a user to the data of the multiple subject DB45B and making it possible to extract the data of a specific user, the multiple subject DB45B can also function as the individual subject DB45A.
[0037] The result output unit 17 performs processing to output the user's analysis and evaluation data 43, the abnormal data detection result 44, and the abnormal data processing content 46 to the screen of the terminal device 4. The analysis and evaluation unit 13, the abnormal data detection unit 14, the abnormal data processing decision unit 15, and the abnormal data processing execution unit 16 cooperate with the result output unit 17 to perform screen output processing.
[0038] The data and information stored in DB 40 of storage unit 102 include user information 41, task data 42A, measurement data 42B, analysis and evaluation data 43, abnormal data detection results 44, individual subject DB 45A, multiple subject DB 45B, abnormal data processing details 46, and management table 50. Control unit 101 holds and manages management table 50 in storage unit 102. An administrator can set the contents of management table 50. Management table 50 stores feature amount list 50A for setting feature amounts, an abnormality detection reason / processing correspondence table 50B for setting the abnormality detection reason and the corresponding processing, and the like.
[0039] [Measuring equipment] FIG. 3 shows the configuration of the measuring device 3 of the first embodiment. The measuring device 3 includes the motion sensor 20, a storage unit 301, a measuring unit 302, a communication unit 303, and the like. The storage unit 301 includes a motion sensor interface unit 311 to which the motion sensor 20 is connected, and a motion sensor control unit 312 to control the motion sensor 20. The measuring unit 302 measures a waveform signal through the motion sensor 20 and the storage unit 301, and outputs it as measurement data. The measuring unit 302 includes a task measuring unit 321 that obtains the measurement data. The communication unit 303 includes a communication interface, and communicates with the abnormality data processing system 1 to transmit the measurement data to the abnormality data processing system 1. The motion sensor interface unit 311 includes an analog-to-digital conversion circuit, and converts the analog waveform signal detected by the motion sensor 20 into a digital waveform signal by sampling. The digital waveform signal is input to the motion sensor control unit 312.
[0040] Note that the measuring device 3 may store each measurement data in a storage means, or the measuring device 3 may not store each measurement data, and only the abnormality data processing system 1 may store the measurement data.
[0041] [Terminal Device] FIG. 4 shows the configuration of the terminal device 4 of the first embodiment. The terminal device 4 has a control unit 401, a storage unit 402, a communication unit 403, an input device 404, and a display device 405. The control unit 401 performs control processing based on software program processing, such as displaying the abnormal data detection result, displaying the abnormal data processing content, and executing the abnormal data processing content. The storage unit 402 stores user information, task data, measurement data, analysis evaluation data, abnormal data detection result, abnormal data processing content, and the like obtained from the abnormal data processing system 1. The communication unit 403 has a communication interface, communicates with the abnormal data processing system 1 to receive various data from the abnormal data processing system 1, and transmits user instruction input information and the like to the abnormal data processing system 1. The input device 404 includes a keyboard, a mouse, and the like. The display device 405 displays various information on a display screen 406. The display device 405 may be a touch panel.
[0042] [Hand, motion sensor, finger tap measurement] FIG. 5 shows a state in which a magnetic sensor, which is a motion sensor 20, is attached to the fingers of a user. The motion sensor 20 has a pair of coil sections, a transmitter coil section 21 and a receiver coil section 22, which are connected through a signal line 23 connected to the measurement device 3. The transmitter coil section 21 generates a magnetic field, and the receiver coil section 22 detects the magnetic field. In the example of FIG. 5, on the user's right hand, the transmitter coil section 21 is attached near the nail of the thumb, and the receiver coil section 22 is attached near the nail of the index finger. The fingers on which the sensors are attached can be changed. The location of attachment is not limited to near the nail.
[0043] As shown in FIG. 5, the motion sensor 20 is attached to the target fingers of a user, for example, the thumb and index finger of the left hand. In this state, the user performs finger tapping, which is a motion of repeatedly opening and closing the two fingers. In finger tapping, a motion is performed that transitions between a state in which the two fingers are closed, i.e., a state in which the fingertips of the two fingers are in contact, and a state in which the two fingers are open, i.e., a state in which the fingertips of the two fingers are open. With this motion, the distance between the coil parts of the transmitter coil unit 21 and the receiver coil unit 22, which corresponds to the distance between the fingertips of the two fingers, changes. The measuring device 3 measures a waveform signal corresponding to the change in the magnetic field between the transmitter coil unit 21 and the receiver coil unit 22 of the motion sensor 20.
[0044] Specifically, finger tapping includes the following types of tasks. Examples of such exercises include one-handed free run, one-handed metronome, both-handed simultaneous free run, alternating both-handed free run, both-handed simultaneous metronome, and alternating both-handed metronome. One-handed free run refers to finger tapping as many times as possible as quickly as possible with two fingers of one hand. One-handed metronome refers to finger tapping with two fingers of one hand in time with a constant pace of stimulation. Both-handed simultaneous free run refers to finger tapping with two fingers of the left hand and two fingers of the right hand at the same timing. Both-handed alternating free run refers to finger tapping with two fingers of the left hand and two fingers of the right hand at alternating timing.
[0045] [Motion sensor control unit and finger tap measurement] FIG. 6 shows a detailed configuration example of the motion sensor control unit 312 of the measuring device 3. In the motion sensor 20, the distance D between the transmission coil unit 21 and the receiving coil unit 22 is shown. The motion sensor control unit 312 has an AC generating circuit 312a, a current generating amplifier circuit 312b, a preamplifier circuit 312c, a detection circuit 312d, an LPF circuit 312e, a phase adjustment circuit 312f, an amplifier circuit 312g, and an output signal terminal 312h. The current generating amplifier circuit 312b and the phase adjustment circuit 312f are connected to the AC generating circuit 312a. The transmission coil unit 21 is connected to the current generating amplifier circuit 312b through a signal line 23. The receiving coil unit 22 is connected to the preamplifier circuit 312c through a signal line 23. The detection circuit 312d, the LPF circuit 312e, the amplifier circuit 312g, and the output signal terminal 312h are connected to the rear stage of the preamplifier circuit 312c, in this order. The phase adjustment circuit 312f is connected to a detection circuit 312d.
[0046] The AC generating circuit 312a generates an AC voltage signal of a predetermined frequency. The current generating amplifier circuit 312b converts the AC voltage signal into an AC current of a predetermined frequency and outputs it to the transmitting coil section 21. The transmitting coil section 21 generates a magnetic field by the AC current. The magnetic field generates an induced electromotive force in the receiving coil section 22. The receiving coil section 22 outputs the AC current generated by the induced electromotive force. The AC current has the same frequency as the predetermined frequency of the AC voltage signal generated by the AC generating circuit 312a.
[0047] The preamplifier circuit 312c amplifies the detected AC current. The detector circuit 312d detects the amplified signal based on a reference signal 312i from a phase adjuster circuit 312f. The phase adjuster circuit 312f adjusts the phase of an AC voltage signal of a predetermined frequency or double the frequency from the AC generator circuit 312a, and outputs it as a reference signal 312i. The LPF circuit 312e limits the band of the detected signal and outputs it, and the amplifier circuit 312g amplifies the signal to a predetermined voltage. An output signal corresponding to the measured waveform signal is output from an output signal terminal 312h.
[0048] The output signal, that is, the waveform signal, is a signal having a voltage value representing the distance D between the two fingers. The distance D and the voltage value can be converted based on a predetermined calculation formula. The calculation formula can also be obtained by calibration. In the calibration, for example, a user measures a block of a predetermined length held by two fingers of the target hand. From a data set of the voltage value and the distance value in the measured value, a predetermined calculation formula is obtained as an approximation curve that minimizes the error. In addition, the size of the user's hand may be grasped by calibration and used for normalization of the feature amount, etc. In the first embodiment, the above-mentioned magnetic sensor is used as the motion sensor 20, and a measuring means corresponding to the magnetic sensor is used. Not limited to this, other detection means and measuring means such as an acceleration sensor, a strain gauge, and a high-speed camera can be applied.
[0049] [Processing flow] Fig. 7 shows the flow of the entire process mainly performed by the abnormal data processing system 1 in the human data measurement system of the embodiment 1. Fig. 7 has steps S1 to S10. The steps will be explained below in order.
[0050] (S1) A user operates the measurement system 2. The terminal device 4 displays an initial screen on the display screen. The user selects a desired operation item on the initial screen. For example, an operation item for performing abnormal data detection and processing is selected. The terminal device 4 transmits instruction input information corresponding to the selection to the abnormal data processing system 1. The user can also input and register user information such as gender and age on the initial screen. In this case, the terminal device 4 transmits the input user information to the abnormal data processing system 1. The user information management unit 11 of the abnormal data processing system 1 registers the user information in the user information 41.
[0051] (S2) The task processing unit 12 of the abnormal data processing system transmits task data for the user to the terminal device 4 based on the instruction input information of S1 and the finger tap task data 42A. The task data includes information on one or more types of tasks related to finger movement, such as one-handed free run, both hands simultaneous free run, and both hands alternate free run. The terminal device 4 displays the finger movement task information on the display screen based on the received task data. The user performs the finger movement task according to the task information on the display screen. The measurement device 3 measures the task and transmits it to the abnormal data processing system 1 as measurement data. The abnormal data processing system 1 stores the measurement data in measurement data 42B.
[0052] (S3) The analysis evaluation unit 13 of the abnormal data processing system performs analysis and evaluation processing of the user's motor function, etc., based on the measurement data 42B of S2, creates analysis and evaluation data 43 of the user, and stores it in the DB 40. In the analysis and evaluation processing, the analysis evaluation unit 13 extracts features based on the waveform signal of the user's measurement data 42B. These features are recorded in a feature list 50A, and include features calculated from a distance waveform, which will be described later, and features calculated from a speed waveform, etc. The analysis evaluation unit 13 may correct the extracted features based on attribute values of the user, such as the age, and may use the corrected features for evaluation.
[0053] (S4) The result output unit 17 of the abnormal data processing system 1 outputs analysis evaluation result information to the display screen of the terminal device 4 based on the analysis evaluation data 43 of S3. The user can check the analysis evaluation result information showing the state of his / her own motor function, etc., on the display screen. Step S4 may be omitted.
[0054] (S5) The non-DB-used abnormal data detection unit 14A in the abnormal data detection unit 14 of the abnormal data processing system 1 detects abnormal data without using a DB based on the analysis and evaluation data 43 of S3. In other words, it detects abnormalities that can be detected only from the measurement data, without referring to the individual subject DB 45A or the multiple subject DB 45B accumulated in the past. The detailed detection method will be described later. The abnormality detection reason / processing correspondence table 50B records a list of abnormality detection reasons to be detected. Abnormal data is detected based on these abnormality detection reasons. This result is stored in the abnormal data detection result 44 in the memory unit 40. Note that step S5 may be omitted and only step S6 may be performed.
[0055] (S6) The DB-using abnormal data detection unit 14B of the abnormal data detection unit 14 of the abnormal data processing system 1 performs abnormal data detection using the DB, using the analysis and evaluation data 43 of S3, the individual subject DB 45A, and the multiple subject DB 45B. In other words, abnormalities that can only be detected by comparing the measurement data with past DBs of individual subjects and multiple subjects are detected. A detailed detection method will be described later. The abnormality detection reason / processing correspondence table 50B records a list of abnormality detection items to be detected. Abnormal data is detected based on these abnormality detection items. This result is stored in the abnormal data detection result 44 in the storage unit 40. Note that step S6 may be omitted and only step S5 may be performed.
[0056] (S7) The abnormal data processing decision unit 15 of the abnormal data processing system 1 decides on the abnormal data processing content 46 based on the abnormal data detection result 44 generated in steps S5 and S6. The detailed decision method will be described later. The abnormality detection reason / processing correspondence table 50B records a correspondence table between the abnormal data detection result 44 and the abnormal data processing content 46. The abnormal data processing decision unit 15 decides on the processing content of the abnormal data based on this correspondence table, and stores it in the abnormal data processing content 46.
[0057] (S8) The abnormal data processing system 1 displays the abnormal data detection results 44 generated in S5 and S6, and the abnormal data processing details 46 generated in S7 on the display screen by the analysis and evaluation unit 13. The user can check the current abnormal data detection results and the processing details on the display screen.
[0058] (S9) The abnormal data processing system 1 processes the abnormal data based on the abnormal data processing content 46. As an example, if no abnormality is detected, the abnormal data is stored in the individual subject DB 45A and the multi-subject DB 45B, but if an abnormality is detected, the abnormal data is not stored. As another example, the abnormal data processing content 46 is output to the terminal device 4 via the communication unit 105 to request remeasurement. A detailed execution method will be described later.
[0059] (S10) If the abnormality data processing system 1 requests remeasurement from the terminal device 4 in S9, the process returns to S2 and is repeated in the same manner. If remeasurement is not requested, the flow ends.
[0060] [Features] FIG. 8 shows an example of a waveform signal of a feature. FIG. 8(a) shows a waveform signal of the distance D between two fingers, (b) shows a waveform signal of the speed of the two fingers, and (c) shows a waveform signal of the acceleration of the two fingers. The speed of (b) is obtained by time differentiation of the waveform signal of the distance of (a). The acceleration of (c) is obtained by time differentiation of the waveform signal of the speed of (b). The analysis evaluation unit 13 obtains a waveform signal of a predetermined feature as in this example from the waveform signal of the measurement data 42B based on calculations such as differentiation and integration. The analysis evaluation unit 13 also obtains a value from the feature by a predetermined calculation.
[0061] FIG. 8(d) is an enlargement of (a) and shows an example of feature quantities. It shows the maximum value Dmax of the finger tap distance D, the tap interval TI, etc. The horizontal dashed line shows the average value Dav of the distance D over the entire measurement time. The maximum value Dmax shows the maximum value of the distance D over the entire measurement time. The tap interval TI is the time corresponding to the period TC of one finger tap, and in particular shows the time from the minimum point Pmin to the next minimum point Pmin. In addition, it shows the maximum point Pmax and the minimum point Pmin within one period of the distance D, the time T1 of the opening operation and the time T2 of the closing operation described below.
[0062] Further detailed examples of the feature amounts are shown below. In the first embodiment, a plurality of feature amounts obtained from the waveforms of the distance, speed, and acceleration are used. In other embodiments, only some of the plurality of feature amounts may be used, or other feature amounts may be used, and the details of the definition of the feature amount are not limited.
[0063] FIG. 9 shows the feature quantity [distance] portion of the features of finger taps recorded in feature quantity list 50A. This association setting is one example and can be changed. Feature quantity list 50A in FIG. 9 has columns of feature quantity classification, identification number, and feature quantity parameter. The feature quantity classification has [distance], [velocity], [acceleration], [tap interval], [phase difference], and [marker tracking]. For example, the feature quantity [distance] has multiple feature quantity parameters identified by identification numbers (1) to (7). The number in brackets [ ] for the feature quantity parameter indicates the unit.
[0064] (1) "Maximum distance amplitude" [mm] is the difference between the maximum and minimum amplitude values in the distance waveform (Figure 8 (a)). (2) "Total travel distance" [mm] is the sum of the absolute values of the distance change during the entire measurement time of one measurement. (3) "Average of distance maximum points" [mm] is the average value of the maximum amplitude points in each cycle. (4) "Standard deviation of distance maximum points" [mm] is the standard deviation of the above values.
[0065] (5) "Slope of the approximation curve of the maximum distance points (attenuation rate)" [mm / sec] is the slope of the curve approximating the maximum amplitude points. This parameter mainly represents the change in amplitude due to fatigue during the measurement time. (6) "Coefficient of variation of the maximum distance points" is the coefficient of variation of the maximum amplitude points, and its unit is a dimensionless quantity (indicated by [-]). This parameter is a value obtained by normalizing the standard deviation by the mean value, and therefore, individual differences in finger length can be eliminated. (7) "Standard deviation of local maximum distance points" [mm] is the standard deviation of three adjacent maximum amplitude points. This parameter is used to evaluate the degree of localized amplitude variation over a short period of time.
[0066] Hereinafter, each of the feature parameters will be described without illustrating the figures. The feature [velocity] has feature parameters indicated by the following identification numbers (8) to (22). (8) "Maximum amplitude of velocity" [m / sec] is the difference between the maximum value and the minimum value of the velocity in the velocity waveform ((b) of FIG. 8). (9) "Average of the local maximum points of the opening velocity" [m / sec] is the average value of the maximum value of the velocity during the opening motion of each finger tap waveform. The opening motion is the motion of moving two fingers from a closed state to a maximum open state ((d) of FIG. 8). (10) "Average of the local maximum points of the closing velocity" [m / sec] is the average value of the maximum value of the velocity during the closing motion. The closing motion is the motion of moving two fingers from a maximum open state to a closed state. (11) "Standard deviation of the local maximum points of the opening velocity" [m / sec] is the standard deviation of the maximum value of the velocity during the above-mentioned opening motion. (12) "Average of maximum closing speed points" [m / sec] is the standard deviation of the maximum speed during the closing motion.
[0067] (13) "Energy balance" [-] is the ratio of the sum of squares of the velocity during the opening movement to the sum of squares of the velocity during the closing movement. (14) "Total energy" [m2 / sec2] is the sum of squares of the velocity during the entire measurement time. (15) "Coefficient of variation of the opening velocity maximum point" [-] is the coefficient of variation of the maximum velocity during the opening movement, which is the standard deviation normalized by the mean. (16) "Average of the closing velocity maximum points" [m / sec] is the coefficient of variation of the minimum velocity during the closing movement.
[0068] (17) "Number of tremors" [-] is the number of times the velocity waveform changes from positive to negative minus the number of times finger taps are made for large opening and closing movements. (18) "Average distance ratio at peak opening velocity" [-] is the average value of the ratio when the amplitude of finger taps is set to 1.0 for the distance at the maximum velocity during the opening movement. (19) "Average distance ratio at peak closing velocity" [-] is the average value of the same ratio when the amplitude of finger taps is set to 1.0 for the distance at the minimum velocity during the closing movement. (20) "Ratio of distance ratio at peak velocity" [-] is the ratio between the value of (18) and the value of (19). (21) "Standard deviation of distance ratio at peak opening velocity" [-] is the standard deviation of the ratio when the amplitude of finger taps is set to 1.0 for the distance at the maximum velocity during the opening movement. (22) "Standard deviation of distance ratio at peak closing velocity" [-] is the standard deviation of the same ratio when the amplitude of finger taps is set to 1.0 for the distance at the minimum velocity during the closing movement.
[0069] The feature [acceleration] has the feature parameters indicated by the following identification numbers (23) to (32). (23) "Maximum amplitude of acceleration" [m / sec2] is the difference between the maximum and minimum values of acceleration in the acceleration waveform (FIG. 8(c)). (24) "Average of opening acceleration maximum points" [m / sec2] is the average of the maximum values of acceleration during the opening motion, and is the first of four extreme values that appear during one cycle of finger tapping. (25) "Average of opening acceleration minimum points" [m / sec2] is the average of the minimum values of acceleration during the opening motion, and is the second of four extreme values. (26) "Average of closing acceleration maximum points" [m / sec2] is the average of the maximum values of acceleration during the closing motion, and is the third of four extreme values. (27) “Average of closing acceleration minima” [m / s2] is the average of the minimum values of acceleration during the closing motion, the fourth of the four extremes.
[0070] (28) "Average contact time" [seconds] is the average value of the contact time when two fingers are closed. (29) "Standard deviation of contact time" [seconds] is the standard deviation of the above contact times. (30) "Coefficient of variation of contact time" [-] is the coefficient of variation of the above contact times. (31) "Number of zero crossings of acceleration" [-] is the average number of times that the acceleration changes from positive to negative during one cycle of finger tapping. Ideally, this value should be 2. (32) "Number of freezings" [-] is the value obtained by subtracting the number of finger taps with large opening and closing from the number of times that the acceleration changes from positive to negative during one cycle of finger tapping.
[0071] The feature [tap interval] has feature parameters indicated by the following identification numbers (33) to (41). (33) "Number of taps" [-] is the number of finger taps during the entire measurement time of one measurement. (34) "Tap interval average" [sec] is the average value for the above-mentioned tap interval ((d) in FIG. 8) in the distance waveform. (35) "Tap frequency" [Hz] is the frequency at which the spectrum is maximum when the distance waveform is Fourier transformed. (36) "Tap interval standard deviation" [sec] is the standard deviation for the tap interval.
[0072] (37) "Tap interval variation coefficient" [-] is the variation coefficient for the tap interval, which is the value obtained by normalizing the standard deviation by the mean. (38) "Tap interval variation" [mm2] is the integrated value for frequencies from 0.2 to 2.0 Hz when the tap interval is subjected to spectrum analysis. (39) "Skewness of tap interval distribution" [-] is the skewness in the frequency distribution of the tap interval, which indicates the degree to which the frequency distribution is skewed compared to a normal distribution. (40) "Local standard deviation of tap interval" [sec] is the standard deviation for three adjacent tap intervals. (41) "Slope of tap interval approximation curve (decay rate)" [-] is the slope of the curve approximating the tap interval. This slope mainly indicates the change in tap interval due to fatigue during the measurement time.
[0073] The feature [phase difference] has the feature parameters indicated by the following identification numbers (42) to (45). (42) "Average phase difference" [degrees] is the average value of the phase difference in the waveforms of both hands. The phase difference is an index value that expresses the deviation of the finger tap of the left hand relative to the right hand as an angle, assuming that one cycle of the finger tap of the right hand is 360 degrees. When there is no deviation, it is set to 0 degrees. The larger the value of (42) or (43), the larger the deviation between the two hands and the more unstable it is. (43) "Standard deviation of phase difference" [degrees] is the standard deviation of the above phase difference. (44) "Similarity between both hands" [-] is a value that represents the correlation when the time deviation is 0 when the cross-correlation function is applied to the waveforms of the left hand and the right hand. (45) "Time deviation at which the similarity between both hands is maximum" [seconds] is a value that represents the time deviation at which the correlation of (44) is maximum.
[0074] The feature [marker tracking] has the feature parameters indicated by the following identification numbers (46) to (47). (46) "Average delay time from marker" [seconds] is the average value of the delay time of finger tapping with respect to the time indicated by the periodic marker. The marker corresponds to stimuli such as visual stimuli, auditory stimuli, and tactile stimuli. This parameter value is based on the time when the two fingers are closed. (47) "Standard deviation of delay time from marker" [seconds] is the standard deviation of the delay time.
[0075] [DB not used abnormal data detected] The following describes the non-DB-used abnormal data detection unit 14A performed by the abnormal data detection unit 14 of the abnormal data processing system 1. The non-DB-used abnormal data detection unit 14A judges whether or not there is an abnormality only from the measurement data, without referring to the individual subject DB 45A and the multiple subject DB 45B. Specifically, the following abnormality detection items can be mentioned. The abnormal data detection unit 14 detects the acquired data as abnormal data when there is a mismatch between the characteristics of the data that are originally expected and the characteristics of the acquired data. For the detection, the acquired measurement data itself or the above-mentioned various feature quantities obtained from the measurement data can be used. The abnormal data detection unit 14, which detects abnormal data corresponding to an abnormality detection item, performs processing corresponding to the detected abnormal data.
[0076] FIG. 10 shows an example of a signal waveform obtained when abnormal data is detected. (E1) When a user mistakenly measures the same task repeatedly When multiple data corresponding to the same task are input, it is detected as abnormal data. As a corresponding process, the user is asked on the screen of the terminal device 4 whether to use the first or second data, and the data is selected. Alternatively, it may be decided that the first data, which does not include the practice effect, will always be used, assuming that the second data will have a practice effect due to repeated measurement. Also, it may be decided that the second data will always be used, assuming that the first data may have failed due to inexperience with measurement. Also, it may be decided to use the better data by referring to the feature amounts stored in the analysis evaluation data 43.
[0077] (E2) When measuring finger taps of one hand, finger taps of both hands were selected by mistake This is the case where the user exercises with the intention of measuring finger taps of one hand, but in reality, finger taps of both hands are selected in the system and the measurement data is recorded. The time during which no movement is performed (hereinafter referred to as "non-exercise time") is calculated for the measurement data of each hand. The non-exercise time is found using the above-mentioned feature quantity. For example, it is defined as the time period during which (2) "total movement distance" per unit time is equal to or less than a predetermined value TDc. In addition to this definition, (14) "total energy" and (33) "number of taps" may be equal to or less than a predetermined value. If the non-exercise time of only one hand exceeds a predetermined value Tc, it is determined that a task of only one hand was performed by mistake, even though it was a task of both hands, and the data is detected as abnormal. Tc can be determined in advance as, for example, two-thirds of the measurement time. In this case, if the measurement time is 15 seconds, abnormal data is detected when the non-exercise time is 10 seconds or more. If abnormal data is detected in this way, the data of the hand that had the non-exercise time is ignored and treated as measurement data of a one-hand task consisting of data of only the other hand. Instead of automatic processing, the user or administrator may be asked for confirmation on the screen of the terminal device 4.
[0078] (E3) When measuring finger taps of both hands, if you mistakenly select finger taps of one hand This is the case where the user exercises with the intention of measuring finger taps of both hands, but in reality, finger taps of one hand are selected in the system and measurement data is recorded. As described later, on the task measurement screen in FIG. 12, when finger taps of one hand are performed, only the waveform of one hand is presented to the user, but since the measurement device 3 acquires measurement data of both hands, the measurement data of both hands is saved in the background. For each hand in the measurement data of both hands, the non-exercise time is calculated as in the previous section. If the non-exercise time of both hands is less than a predetermined value Tc, it can be determined that the user performed a two-handed task. Then, the data of the hand that was not presented to the user is also used and treated as the measurement data of the two-handed task. Note that instead of processing automatically, it is also possible to confirm by asking the user or the administrator on the screen.
[0079] (E4) When measuring simultaneous free run of both hands, the alternate free run of both hands was selected by mistake. This is a case where the user exercises with the intention of measuring both hands simultaneous free run, but the measurement system 2 instructs the user to do both hands alternate free run. To detect this abnormality, among the features stored in the analysis evaluation data 43, a feature that evaluates the coordination of both hands is used. For example, (42) "average phase difference" is 0° in an ideal both hands simultaneous free run where both hands are moved in perfect unison, whereas it is 180° in an ideal both hands alternate free run where both hands are moved perfectly alternately. From this, if (42) "average phase difference" is less than a predetermined value (e.g., 90°), it can be considered that the user exercised with the intention of both hands simultaneous free run, even if both hands alternate free run was selected. In other words, it is considered that both hands alternate free run was selected by mistake when measuring both hands simultaneous free run, and the task data 42A is changed after measurement to indicate that the measurement data is both hands simultaneous free run. In this case, it is possible to confirm by asking the user on the screen without automatically processing. As an example of using other features, if (44) "similarity of both hands" is equal to or greater than a predetermined value (e.g., 0), it may be deemed that both hands are free-running simultaneously, or if the absolute value of (45) "time difference at which the similarity of both hands is maximum" is less than a predetermined value (e.g., (34) "average tap interval" × 0.25), it may be deemed that both hands are free-running simultaneously. Note that there are cases where the user intends to perform a free-running with both hands simultaneously, but is unable to move both hands together, resulting in measurement data that is close to alternating free-running with both hands. In this case, the data may not be automatically treated as abnormal, but the user or administrator may be asked on the screen to confirm.
[0080] (E5) When measuring alternate free run of both hands, simultaneous free run of both hands was selected by mistake This is the opposite of the previous section, and is a case where the user exercises with the intention of measuring alternating hands free run, but the measurement system 2 instructs the user to free run both hands simultaneously. As in the previous section, this can be determined based on the feature value of the finger tap. (42) If the "average phase difference" is equal to or greater than a predetermined value (for example, 90°, which is the intermediate value between the ideal value of 0° for simultaneous free run of both hands and the ideal value of 180° for alternating hands free run), even if simultaneous free run of both hands was selected, there is a possibility that the user exercised with the intention of alternating hands free run. In other words, it is assumed that simultaneous free run of both hands was mistakenly selected when measuring alternating hands free run, and the task data 42A is changed to simultaneous free run of both hands after measurement. As an example of using other features, if (44) "similarity of both hands" falls below a predetermined value (e.g., 0), it may be deemed that both hands are free-running simultaneously, or if (45) "time difference at which the similarity of both hands is maximum" exceeds a predetermined value (e.g., (34) "average tap interval" × 0.25), it may be deemed that both hands are free-running simultaneously. Note that although the user intends to perform alternate free-running with both hands, there are cases in which both hands move in unison, resulting in measurement data close to both hands being free-running simultaneously. In this case, instead of automatically processing it as abnormal data, it may be possible to ask the user or administrator on the screen to confirm.
[0081] (E6) When two fingers are crossed during measurement This is a case where the distance between the two fingers becomes an abnormal value due to the crossing of the thumb and index finger during measurement of the finger tapping motion. When a magnetic sensor is used for the motion sensor 20, due to its nature, the distance between the two fingers may be estimated to be a very large value during the time period when the two fingers cross as shown in FIG. 10(a). To detect this abnormality, a feature quantity representing the waveform amplitude is used among the feature quantities stored in the analysis evaluation data 43. For example, if (1) the "maximum amplitude of the distance" is a predetermined value (for example, 20 cm as a value larger than the distance between the two fingers of most people) or is larger than the maximum value of the distance between the two fingers measured before measurement, it can be considered that an abnormality of the two fingers crossing has occurred. In addition, the time period when the abnormality has occurred can be specified by extracting the time period when the distance between the two fingers is larger than the maximum value in the measurement data 42B (raw waveform data) before the feature quantity is calculated. Note that the phenomenon of the two fingers crossing is also part of the nature of the finger tapping motion, so it may be better not to exclude it as abnormal data. In this case, instead of automatically processing the data as abnormal, the user or administrator may be asked for confirmation on the screen.
[0082] (E7) If the motion sensor comes off the finger during measurement This is a case where the distance between two fingers becomes an abnormal value due to the motion sensor coming off the finger during measurement. When the motion sensor comes off, the distance between two fingers is estimated to be a very large value as shown in FIG. 10(b). As in the previous section, if (1) a feature value representing the waveform amplitude such as the "maximum amplitude of the distance" is larger than a predetermined value or the maximum value of the distance between two fingers, and if this continues until the end of the measurement, it can be determined that the motion sensor has come off the finger. Whether this state continues until the end of the measurement can be determined by extracting a time period in the measurement data where the distance between two fingers is larger than the maximum value, as in the previous section. Note that even if the predetermined measurement time has not ended, when it is determined that the motion sensor has come off the finger, the measurement may be immediately terminated in real time to prompt the user to measure again.
[0083] (E8) If you start exercising in the middle of the measurement time This is the case where the user does not correctly understand the signal to start the measurement and starts exercising in the middle of the measurement time. As shown in Figure 10(c), if there is a non-exercise time at the beginning of the measurement, it can be determined that this abnormality has occurred. The presence or absence of a non-exercise time can be determined by the method described above. In addition, the measurement time is divided into a predetermined number (e.g., 5) of segments, and the feature value of finger taps is calculated for each segment. When the feature values are compared between the segments, it can be determined that this abnormality has occurred if there is a segment whose feature value is clearly different from that of the other segments. For example, if a 15-second measurement time is divided into 5 segments, each segment is 3 seconds long. When the "tap count" (33) is calculated for each of these segments, the values obtained from the first segment are 0, 5, 5, 5, and 4. In this case, if the presence or absence of a segment that is more than N standard deviations (e.g., N=2) away from the average value of these five feature values in the direction in which the magnitude of the movement decreases, the 0 tap count for the first segment corresponds to this. In this way, it is also possible to determine the presence or absence of a non-exercise time.
[0084] (E9) If you stop exercising during the measurement time This is the case when the user mistakenly ends the exercise before the measurement is completed. As shown in Figure 10(d), this abnormality can be detected when there is a period of no exercise at the end of the measurement. The presence or absence of a period of no exercise can be determined by the method described above. It can also be achieved by the method described in the previous section, in which the measurement time is divided into N segments to determine the period of no exercise. Note that even if the specified measurement time has not ended, if it is determined that the exercise has ended during the measurement time, the measurement may be immediately ended in real time and the user may be prompted to measure again.
[0085] (E10) If you temporarily stop exercising during the measurement This is the case when exercise is temporarily interrupted due to reasons such as the cable becoming tangled during measurement. As shown in Figure 10(e), if there is a period of no exercise during measurement, it can be detected that this abnormality has occurred. The determination of whether or not there was a period of no exercise can be realized by the method described above. It can also be realized by the method of dividing the measurement time into N segments and determining the period of no exercise as described in the previous section. Note that even if the specified measurement time has not ended, if it is determined that exercise was interrupted during the measurement time, the measurement may be immediately ended in real time and a re-measurement may be prompted.
[0086] [DB usage abnormal data detected] The following describes the DB usage abnormal data detection unit 14B performed in the abnormal data detection unit 14 of the abnormal data processing system 1. When new data of user X is acquired, for example, the DB usage abnormal data detection unit 14B judges whether the new data is abnormal or not by referring to the individual subject DB 45A and the multiple subject DB 45B that store the past data of user X. Specifically, the following abnormality detection items are listed.
[0087] (E11) When the nature of the movement changes due to the user's intention This is the case where the user intentionally exercises in a non-serious manner or misunderstands the task instructions, resulting in poor exercise performance. This can be detected when the degree of deviation from the user's own past DB (individual subject DB) or the past DBs of many subjects (multiple subject DB) is large. The method for calculating the degree of deviation will be described later.
[0088] (E12) When the nature of the exercise changes due to a change in the user's physical condition This includes cases where exercise performance deteriorates due to a decline in brain or motor function or extreme fatigue, and cases where exercise performance improves due to the effects of medication or rehabilitation. These can be detected when the degree of deviation from the user's own past DB (individual subject DB) is large. The method for calculating the degree of deviation will be described later.
[0089] (E13) If another person impersonates the user This is the case where the nature of the exercise appears to have changed due to another person impersonating the user. In this case, too, it can be detected if there is a large degree of deviation from the user's own past DB (individual subject DB). The method for calculating the degree of deviation will be described later.
[0090] <Calculation of deviation> The method of calculating the above-mentioned deviations will be described below. The deviations are calculated by the individual subject DB deviation calculation section 14Ba, the multiple subject DB deviation calculation section 14Bb, and the composite deviation calculation section 14Bc.
[0091] First, a method of calculating the deviation common to the individual subject DB deviation calculation unit 14Ba and the multiple subject DB deviation calculation unit 14Bb will be described. N (N≧1) feature quantities of finger tapping motion are selected, and a data distribution in an N-dimensional space is generated for the DB (individual subject DB 45A or multiple subject DB 45B). The mean of this data distribution is M (=[m1, m2, , mN]), and the standard deviation is Σ (=[σ1, σ2, , σN]). The data to be detected as abnormal data is A (=[a1, a2, , aN]). In this case, the deviation d is calculated as |(AM) / Σ|. Here, || indicates the absolute value of the vector (square root of the sum of squares). If d is larger than a predetermined value dc, it is determined that there is a sufficient deviation from the DB. For example, if dc=1, the measurement data in question deviates from 68.3% of the data close to the average in the DB. Similarly, if dc=2, the data deviates from 95.5%, and if dc=3, the data deviates from 99.7%. In other words, if you want to strictly detect abnormal data, set dc to a small value, and if you want to detect abnormal data more gently, set dc to a large value. Note that the definition of deviation can be other than the above, as long as it is an indicator that means it is far from the DB.
[0092] In the above calculation of the deviation, the feature values of the finger tapping motion were used as they were, but the feature values may be processed to create a new index. For example, principal component analysis may be applied to all feature values, and N principal components with high contribution rates may be used.
[0093] By observing the changes in the features of the finger tapping movement, it is possible to determine whether the performance of the movement has worsened or improved. For example, if (2) "total distance traveled," (14) "total energy," or (33) "number of taps" are smaller than the averages in the individual subject DB, it is clear that the performance of the movement has deteriorated. Conversely, if these features are larger than the averages in the individual subject DB, it is clear that the performance of the movement has improved.
[0094] In addition, in order to identify the cause of changes in athletic performance, a screen may be provided in which the user can input information before measurement regarding the presence or absence of decline in brain function or athletic function, the presence or absence of fatigue, and the presence or absence of treatment such as medication or rehabilitation. In this case, the input contents may be referenced as the reason for abnormality detection (described later in the explanation of FIG. 15) when the athletic performance deteriorates or improves in comparison with the individual subject DB45A. By doing so, the reason for abnormal data detection can be made more persuasive to the user.
[0095] <<Synthesis of deviations>> In the above-mentioned method, the individual subject DB deviation calculation unit 14Ba and the multiple subject DB deviation calculation unit 14Bb can calculate the deviation of the measurement data from the individual subject DB 45A or multiple subject DB 45B. In this regard, since the individual subject DB 45A can detect abnormal data that reflects the individuality of the data of the user, it is desirable to use the individual subject DB 45A for accurate detection of abnormal data. Specifically, as shown in FIG. 11(a), data 1 and data 2 indicated by * have the same deviation from the individual subject DB 45A of user A, and both are correctly detected as abnormal data. However, although it is possible to use the individual subject DB 45A when the user has already performed measurements many times, if it is the first time or if the user has performed measurements only a few times, the individual subject DB 45A has not been sufficiently accumulated, and it is necessary to use the multiple subject DB 45B. In Figures 11 to 13, the DB and abnormal data are shown diagrammatically as a two-dimensional space consisting of two features, but the feature may be one or three or more, and the space is considered to be multidimensional according to the number of features used.
[0096] The advantage of using the multi-subject DB 45B is that it is easy to prepare the DB, since data of users other than the relevant user can be stored in advance. However, the multi-subject DB 45B is a collection of data of many users, and does not reflect the characteristics of the relevant user's data, so there is a disadvantage that abnormal data detection may be less accurate than when the individual subject DB 45A is used. Specifically, as shown in FIG. 11(b), data 1 and data 2 marked with stars have different degrees of deviation from the multi-subject DB 45B, and data 2 is correctly detected as abnormal data, but data 1 is not detected as abnormal data. In light of the above issues, it is considered that a technology is needed to use both the individual subject DB 45A and the multi-subject DB 45B in combination, complementing each other's strengths and weaknesses.
[0097] Therefore, instead of selecting and using either the deviation degree of the individual subject DB45A or the deviation degree of the multiple subjects DB45B, the two are combined to calculate a new deviation degree (composite deviation degree).By using the composite deviation degree, it is considered possible to detect abnormal data by compensating for the advantages and disadvantages of using either the individual subject DB45A or the multiple subjects DB45B.
[0098] The composite discrepancy is calculated by the composite discrepancy calculation unit 14Bc. The composite discrepancy ds is calculated using the individual subject DB reliability coefficient c, the individual subject DB discrepancy d1, and the multiple subject DB discrepancy d2, as shown in FIG. 12(a). The individual subject DB reliability coefficient c is an index showing the degree to which the individual subject DB 45A can be trusted, and has a value between 0.0 and 1.0, as shown in FIG. 12(b). When the number of data in the individual subject DB 45A is 0, it is 0.0, and as the amount of data increases, it gradually approaches 1.0. The formula expressing the relationship between the individual subject DB reliability coefficient c and the number of data k may be any formula as long as c increases as the number of data increases. For example, as shown in FIG. 12(b), a sigmoid function can be used to set c=1 / (1+exp(-α(k-β)))+γ (for example, α=0.1, β=50). Here, if the individual subject DB is to be trusted when the number of data is small, α should be set to a large value, and if the number of data is large, α should be set to a small value. β and γ should be adjusted so that c=0 when k=0. Using c defined in this way, the composite discrepancy ds is defined as ds=d1×c+d2×(1.0-c). If ds is larger than a predetermined value dc, it is determined that it is sufficiently deviated from DB. In other words, the individual subject DB reliability coefficient c is the weight of the individual subject DB discrepancy d1, and increases as the number of data in the individual subject DB 45A increases. Note that the time-dependent decay discrepancy explained next may be used for the individual subject DB discrepancy d1 and the multiple subject DB discrepancy d2.
[0099] <Calculation of deviation taking into account time series> When calculating the deviation degree from the individual subject DB 45A in the individual subject DB deviation degree calculation unit 14Ba, a method for obtaining a deviation degree (hereinafter referred to as the time-dependent attenuation deviation degree) calculated in consideration of the time-series relationship of the data in the DB will be described. The data in the individual subject DB 45A is accumulated over time by the user's regular measurement. However, the health status of the user changes daily due to aging, cognitive function decline, motor function decline, etc. Therefore, when detecting abnormal data, it is considered that the reliability of the most recent data is higher and the reliability becomes lower as it goes back in the past. Specifically, as shown in Fig. 13(a), when the data in the individual subject DB 45A changes over time as 1⇒2⇒3, the deviation degrees of 4a and 4b from the average of the DB are the same, but 4a is far from the most recent data 3, so it should be determined as abnormal, while 4b is close to the most recent data 3, so it should not be determined as abnormal.
[0100] Therefore, as shown in Fig. 13(b), the individual subject DB deviation degree d1 is calculated using the time-dependent attenuation deviation degree in which the most recent data is weighted more and the data going back in the past is weighted less. Specifically, taking the data in the individual subject DB 45A as Bi(=[bi1,bi2,···,biN], i = 1~k (the number of data in the individual subject DB 45A)), the past data reliability qi = pti is defined according to the time ti going back from the acquisition time of the new data (0.0 < p < 1.0). And the average of the data distribution in the individual subject DB 45A is defined as M = q1B1 + q2B2 + ··· + qkBk. Defining M in this way means that the most recent data is trusted more and the data going back in the past is trusted less. Furthermore, using this M, the standard deviation Σ of the data distribution in the DB can be defined as Σ = ((q1B1 - M)2 + (q2B2 - M)2 + ··· + (qkBk - M)2) / k. The individual subject DB deviation degree d1 is obtained as d = |(A - M) / Σ| using these M and Σ as described above.
[0101] The above-mentioned deviation degree taking into account the time series has been explained with the individual subject DB 45A in mind, but the same calculation can be performed for the multiple subject DB 45B. In other words, the multiple subject DB deviation degree d2 may be calculated by calculating the deviation degree taking into account the time series for each subject in the multiple subject DB 45B and calculating the average of these.
[0102] [Abnormal data processing decision] The abnormal data processing decision unit 15 processes the abnormal data detected by the DB non-use abnormal data detection unit 14A and the DB use abnormal data detection unit 14B of the abnormal data processing system 1. The abnormality detection reason / processing correspondence table 50B in the management table 50 shown in FIG. 14 stores abnormal items of the DB non-use abnormal data detection unit 14A and the DB use abnormal data detection unit 14B performed by the abnormal data detection unit 14 of the abnormal data processing system 1 in a table format. This may be given in advance when the abnormal data processing system 1 is constructed, or may be set by the administrator of the abnormal data processing system 1. Although a plurality of processes are described in the processing column, in practice, one of these is selected and set. The abnormal data processing decision unit 15 performs processing corresponding to the abnormal detection items detected by the DB non-use abnormal data detection unit 14A and the DB use abnormal data detection unit 14B based on the abnormality detection reason / processing correspondence table 50B.
[0103] [Perform abnormal data processing] The abnormal data processing execution unit 16 executes the abnormal data processing content 46 determined by the abnormal data processing determination unit 15. When the measurement data is not to be used, the data is not to be registered in the individual subject DB 45A and the multiple subject DB 45B. When remeasurement is to be performed, the abnormal data processing content 46 of remeasurement is transmitted to the terminal device 4 via the communication unit 105. The terminal device 4 receives this and performs remeasurement in cooperation with the measurement device 3. When inquiring of the user regarding the handling of the data, the inquiry content is transmitted to the terminal device 4 via the communication unit 105. The terminal device 4 displays the inquiry content on the screen, and the user answers by looking at the screen. The user's answer is transmitted to the abnormal data processing system via the communication unit 105. The abnormal data processing execution unit 16 executes processing based on the user's answer content.
[0104] [Display screen (1) - Menu] 15 shows an example of a menu screen, which is an initial screen of the service, as an example of a display screen of the terminal device 4. This menu screen has a user information column 1501, an operation menu column 1502, a setting column 1503, and the like.
[0105] In the user information field 1501, the user can input and register user information. If user information has already been input in an electronic medical record or the like, the system may link with that user information. Examples of user information that can be input include user ID, name, date of birth or age, sex, dominant hand, disease / symptoms, and notes. Dominant hand can be selected and input from right hand, left hand, both hands, unknown, and the like. Disease / symptoms can be selected and input from options in a list box, for example, or can be input as arbitrary text. When this system is used in a hospital or the like, a doctor or the like may input information on behalf of the user instead of the user. This abnormality data processing system is also applicable when user information is not registered.
[0106] The operation menu field 1502 displays operation items for the functions provided by the service. The operation items include "calibration," "measurement of finger motion," "abnormal data detection and processing," and "end." When "calibration" is selected, the above-mentioned calibration, that is, processing related to adjustment of the motion sensor 20 to the user's fingers, is performed. The status of whether or not adjustment has been completed is also displayed. When "measurement of finger motion" is selected, the screen transitions to a task measurement screen for measuring finger motion tasks such as finger tapping. When "abnormal data detection and processing" is selected, the screen transitions to a screen where an abnormality is detected in the measured data, the abnormal data detection results are displayed, and the detected abnormal data is processed. When "end" is selected, the service is terminated.
[0107] In the setting field 1503, user settings are possible. For example, if there is a type of abnormality detection item that the user, measurer, or administrator wishes to detect, the abnormality detection item can be selected from the options and set. It is also possible to select processing corresponding to each abnormality detection item. It is also possible to set the threshold value for abnormal data detection, etc. These setting contents are sent to the abnormal data processing system 1 via the communication unit 105, and the abnormal data processing system 1 detects and processes abnormal data by referring to the settings specified here.
[0108] [Display screen (2)-Task measurement] FIG. 16 shows a task measurement screen as another example. This screen displays task information. For example, a graph 1600 is displayed for each of the left and right hands, with time on the horizontal axis and the distance between two fingers on the vertical axis. Other instruction information for explaining the task content may be output to the screen. For example, a video area may be provided for explaining the task content with video and audio. The screen has operation buttons such as "Start measurement", "Retry measurement", "End measurement", and "Save (register)", which can be selected by the user. The user selects "Start measurement" according to the task information on the screen and performs the task exercise. The measurement device 3 measures the task exercise and obtains a waveform signal. The terminal device 4 displays a measured waveform 1602 corresponding to the waveform signal being measured on the graph 1600 in real time. After the exercise, the user selects "End measurement", and if confirmed, selects "Save (register)". The measurement device 3 transmits the measurement data to the abnormality data processing system 1.
[0109] [Display screen (3) - Evaluation results] FIG. 17 shows an evaluation result screen as another example. In this screen, analysis and evaluation result information of the task is displayed. After the analysis and evaluation of the task, this screen is automatically displayed. In this example, the feature quantities of the five finger tapping movements A to E are displayed in a radar chart format. A solid frame 1701 indicates the analysis and evaluation result after the current task measurement. The feature quantities are not limited to being displayed in a radar chart format, but may be displayed in a graph of a predetermined format. The feature quantities may be converted and displayed in a format such as a performance score (for example, a maximum score of 100 points). In addition to the graph of the feature quantities, evaluation comments on the analysis and evaluation results may be displayed. The analysis and evaluation unit 13 creates the evaluation comments. For example, a message such as "(B) and (E) are good" is displayed. The screen has operation buttons such as "Overwrite past results", "Proceed to abnormal data detection and processing", and "Exit". When "Proceed to abnormal data detection and processing" is selected, the abnormal data processing system transitions to the abnormal data detection and processing screen, and when "Exit" is selected, the system transitions to the initial screen.
[0110] [Display screen (3) - Abnormal data detection and processing] FIG. 18 shows an abnormal data detection and processing screen as another example. In this screen, the abnormal data detection result 44 sent from the abnormal data processing system 1 and the abnormal data processing content 46 are displayed. After the "Abnormal data detection and processing" button in FIG. 11 or the "Proceed to abnormal data detection and processing" button in FIG. 18 is pressed, this screen is displayed. In this screen, basic information such as user information and measurement data information is displayed, and then the abnormal data detection result is displayed. If an abnormality is detected in the measurement data, "abnormal" is displayed, and if no abnormality is detected, "no abnormality" is displayed. Furthermore, if it is determined to be "abnormal", the reason for the abnormal data detection is displayed. The reason for the abnormal data detection is included in the abnormal data detection result 44 sent from the abnormal data processing system 1. In this figure, as an example of DB non-use abnormal data detection 14A, an example of "Because no exercise was performed during the measurement time of 0 to 3 seconds" is displayed. Below that, the waveform of the finger tapping movement is presented to visually explain the reason for the abnormal data detection in an easy-to-understand manner. Further below that, a recommended action corresponding to the reason for the abnormal data detection is shown. In this figure, "remeasure" is shown as an example. This correspondence table between the reason for abnormal data detection and the action is recorded in abnormality detection reason / action correspondence table 50B in management table 50. If the user, measurer, or administrator wishes to execute the recommended action shown in this figure, he / she selects the "Execute recommended action" button, and if he / she does not wish to execute the action, he / she selects the "Do not execute recommended action" button. Note that abnormal data processing system 1 may automatically execute the action and notify the user, measurer, or administrator of the results afterwards, without allowing the user, measurer, or administrator to choose whether or not to execute the action.
[0111] Fig. 19 shows another example of the abnormal data detection and processing screen. In this figure, as an example of DB usage abnormal data detection 14B, the reason for abnormal data detection is "deviated from past personal DB." And, as a recommended process corresponding to this abnormal data detection reason, "do not register data in DB" is shown as an example. [Effects, etc.] According to the abnormal data processing system 1 of the first embodiment, by using both the individual subject DB 45A and the multiple subject DB 45B, highly accurate abnormal data processing can be realized. This is because the decrease in accuracy when the number of data in the individual subject DB 45A is insufficient can be compensated for by increasing the weighting of the multiple subject DB 45B, and the decrease in accuracy caused by the inability to reflect individual differences when the multiple subject DB 45B is used can be compensated for by increasing the weighting of the individual subject DB 45A.
[0112] An abnormality data processing system according to a second embodiment of the present invention will be described with reference to Figures 20 to 26. The basic configuration of the second embodiment is the same as that of the first embodiment, and the following describes the differences between the configuration of the second embodiment and the configuration of the first embodiment.
[0113] [System (2)] FIG. 20 shows a human data measurement system including the abnormal data processing system of the second embodiment. This human data measurement system is installed in hospitals, elderly care facilities, users' homes, etc. The abnormal data processing system of the second embodiment uses a measurement system that is a tablet-type finger tapping motion measurement system. This measurement system is composed of a terminal device 5 that is a tablet terminal. In the second embodiment, motion measurement and information display are performed using a touch panel provided in the terminal device 5. The second embodiment corresponds to a form in which the measurement function of the measurement device 3 of the first embodiment and the display function of the terminal device 4 are integrated into one terminal device 5. The terminal device 5 may be a device installed in a facility, or may be a device owned by a user.
[0114] The terminal device 5 has a control unit 501, a storage unit 502, a communication unit 505, a touch panel 510, etc., which are connected via a bus. The touch panel 510 has a display unit 511 and a touch sensor 512. The display unit 511 is, for example, a liquid crystal display unit or an organic EL display unit, and has a display screen. The touch sensor 512 is, for example, a capacitance type, and is arranged in an area corresponding to the display screen. The touch sensor 512 detects a change in capacitance according to the proximity or contact state of a finger on the display screen as an electric signal, and outputs the detection signal to the touch detection unit 521.
[0115] The control unit 501 controls the entire terminal device 5, and is configured with a CPU, a ROM, a RAM, etc., to realize a data processing unit 500 that performs abnormal data processing and the like based on software program processing. The configuration of the data processing unit 500 is roughly the same as that of the first embodiment. The control unit 501 further has a touch detection unit 521 and a measurement processing unit 522. The control unit 501 realizes a function of obtaining measurement data through the touch panel 510, a function of processing and analyzing the measurement data, a function of outputting information to the display screen of the display unit 511 of the touch panel 510, and the like. The touch detection unit 521 performs processing to detect the proximity and contact state of the user's finger on the display screen and the state of the finger's movement as touch position coordinates and a time-series signal based on a detection signal from the touch sensor 512. The measurement processing unit 522 uses the detection information of the touch detection unit 521 to measure the position and movement of the finger on the display screen as a waveform signal and obtains it as measurement data. This measurement data corresponds to the measurement data 42B. The data processing unit 500 performs abnormal data detection and abnormal data processing decision based on the measurement data by the same processing as in the first embodiment, and displays it on the display screen of the display unit 511. The data processing unit 500 also creates analysis evaluation data, etc., and displays an evaluation screen, etc. on the display screen of the display unit 511. The data processing unit 500 has the same functions as the data processing unit in FIG. 2, such as the user information management unit 11 and the abnormal data detection unit 14 consisting of the DB non-use abnormal data detection unit 14A and the DB use abnormal data detection unit 14B. The storage unit 502 has the same functions as the storage unit 102 in FIG. 2, such as the user information 41, task data 42A, measurement data 42B, analysis evaluation data 43, abnormal data detection result 44, individual subject DB 45A, multiple subject DB 45B, management table 50, and abnormal data processing content 46.
[0116] [Example of exercise display screen (1)] FIG. 21 shows a method of performing finger tapping exercise on the display screen 210 of the terminal device 5. The terminal device 5 may provide a task using this method. In this method, the control unit 501 displays an area 211 for placing two target fingers of both hands on the background area of the display screen 210. The target two fingers are, for example, a thumb as the first finger and an index finger as the second finger. The user places the two fingers of each hand in contact or close to the area 211. Although it depends on the touch sensor 512 and the like, in this example, the state in which the fingers are touching the area 211 of the display screen is basically maintained during this exercise. The user performs finger tapping by opening and closing the two fingers in the area 211. The terminal device 5 measures the finger tapping exercise through the touch sensor 512 and the like, and obtains measurement data such as a waveform signal in the same manner as in the first embodiment. The movement 212 of the first finger and the movement 213 of the second finger on the area 211 are indicated by arrows. The distance L between the fingertips of two fingers is shown as L1 on the left hand side and L2 on the right hand side.
[0117] FIG. 22 shows a waveform signal of two fingers at a distance L as an example of measurement data corresponding to the finger tapping motion of FIG. 21. The horizontal axis shows elapsed time t [seconds], and the vertical axis shows distance L(t) [mm] for each elapsed time t. Note that part 221 of the waveform shows the part when the finger is somewhat removed from area 211. When the waveform is interrupted in this way, a continuous waveform can be obtained by interpolating the waveform when the finger is on area 211. In the same manner as in embodiment 1, terminal device 5 extracts features based on the measurement data, detects abnormal data, decides to process the abnormal data, and executes the abnormal data process, and displays the results.
[0118] [Example of exercise display screen (2)] FIG. 23 shows the reaching method as an example of another finger tapping motion and display screen. The terminal device 5 may provide a task using the reaching method. (a) of FIG. 23 shows a cross reaching. First, a figure 231 at an initial position is displayed on the display screen 210 of the terminal device 5, and measurement is started with a target finger, for example, an index finger, placed on the figure 231 at the initial position. After the start, a target figure 232, for example, a cross, corresponding to the marker is displayed on the display screen 210. The control unit 501 displays the figure 232 at different positions, for example, at a predetermined cycle. The user performs a finger tap by extending the finger to follow the position of the figure 232. In this example, a state where a finger tap is performed at a position 233 having a deviation from the center position of the figure 232 is shown. Between the center position of the target figure 232 and the tap or touch position 233, there is a distance E corresponding to the deviation. The terminal device 5 calculates the distance E, the delay time TD, etc. as one of the feature quantities based on the measurement data. The delay time TD is the time from when the target graphic 232 is displayed in a standby state where a finger is placed on the graphic 231 at the initial position to when the finger touches the target graphic 232.
[0119] 23(b) shows circular reaching. A circular area is displayed as a target graphic 234. The user similarly performs a finger tap within the circular area of graphic 234. As a feature amount, for example, the distance between the center position of graphic 234 and the tap position is extracted.
[0120] [Example of exercise display screen (3)] FIG. 24 shows the continuous touch method as an example of another finger tapping motion and display screen. The terminal device 5 may provide a task or practice using the continuous touch method. FIG. 24(a) shows one-handed continuous touch. A figure 241 for touching the thumb of the left hand, for example a circular area, is displayed at one location on the display screen 210, for example near the lower left. The user touches the displayed figure 241 with his / her finger and continues to touch it continuously. When the figure 241 becomes hidden, the user removes his / her finger from the figure 241. The control unit 501 controls the display of the figure 241. For example, the display and non-display of the figure 241 are switched at a predetermined cycle, and the figure 241 is displayed a predetermined number of times. In addition, together with the display of the figure 241, an auditory stimulus or the like may be given as teaching information. For example, the number of touches of the figure 241, the touch interval, the touch delay time, etc. are extracted as feature amounts.
[0121] FIG. 24(b) shows simultaneous continuous touching with both hands. Graphics 242 indicating touch positions of target fingers of the left and right hands are displayed in two places on the display screen 210. The user touches the displayed graphics 242 continuously with both hands at the same time and at the same timing. Similarly, alternating continuous touching with both hands is also possible. In this case, the control unit 501 switches to alternately displaying the left and right graphics 242. The user touches the graphics 242 with the left and right hands at alternating timing. As the feature amount, for example, the phase difference between the touches of the left and right graphics 242 is extracted.
[0122] As another example of exercise, instead of displaying a figure, an auditory stimulus or the like may be output as instruction information. For example, two types of sounds may be output at a predetermined cycle for times when the user should touch and times when the user should not touch.
[0123] [Example of exercise display screen (4)] FIG. 25 shows a tapping method in accordance with light as an example of another finger tapping motion and display screen. The terminal device 5 may provide a task using this method. FIG. 25(a) shows one-handed tapping. On the display screen 210, a figure 251 for tapping the target finger of the left hand and a figure 252 that is a light of visual stimulation to indicate the timing of tapping the figure 251 are displayed. The control unit 501 causes the figure 252 to blink so as to switch between display and non-display. The user taps the figure 251 for tapping at the timing when the figure 252 is displayed. As another example of the motion, sound may be output as an auditory stimulation instead of the visual stimulation figure 252, or a method of performing continuous touching may be used. As a feature amount, for example, there is a time lag between the time of tapping or touching with respect to the time of occurrence of a periodic stimulation. This time lag corresponds to a delay time from the time when the figure 252 is displayed to the time when the figure 251 is tapped. FIG. 25(b) similarly shows the case of simultaneous tapping with both hands. Two tapping figures 251 are provided on the left and right, and two visual stimulation figures 252 are displayed on the left and right, blinking at the same timing. Similarly, in the case of alternating tapping with both hands, the control unit 501 causes the two left and right figures 252 to blink at alternating timing.
[0124] [Example of exercise display screen (5)] FIG. 26 shows a five-finger tapping method as an example of another finger tapping movement and display screen. The terminal device 5 may provide a task using the five-finger tapping method. In this method, the five fingers of the target hand are used. The terminal device 5 displays a graphic 261 for tapping the five fingers of each hand, a total of ten fingers, on the background area of the display screen 210. The user first places the five fingers on the display screen 210 so as to touch it. The terminal device 5 automatically adjusts and sets the display position of the graphic 261 based on the detection of the touch position. The terminal device 5 controls the display of the graphic 261 at each position. The terminal device 5 sets the graphic 261 at the position to be tapped to a specific display state (for example, indicated by a black circle), and sets the other graphic 261 at the position not to be tapped to a different display state. The terminal device 5 controls the switching of the display state of the graphic 261. The user taps the finger on the graphic 261 to be tapped in accordance with the display of the graphic 261.
[0125] [Features] Examples of features specific to the second embodiment are given below. The following are feature parameters related to the reaching method. (2-1) "Average value of delay time from target display" [seconds] is the average value related to the delay time. (2-2) "Standard deviation of delay time from target display" [seconds] is the standard deviation related to the delay time. (2-3) "Average value of position error from target" [mm] is the average value related to the distance E. (2-4) "Standard deviation of position error from target" [mm] is the standard deviation related to the distance E.
[0126] The feature parameters related to the one-handed continuous touch method are as follows: (2-5) "number of taps" [-], (2-6) "average tap interval" [seconds], (2-7) "tap frequency" [Hz], (2-8) "standard deviation of tap interval" [seconds], (2-9) "coefficient of tap interval variation" [-], (2-10) "tap interval variation" [mm2], (2-11) "skewness of tap interval distribution" [-], (2-12) "local standard deviation of tap interval" [seconds], (2-13) "tap interval decay rate", etc. The definitions of each feature are the same as in the first embodiment.
[0127] The following are feature parameters related to the two-handed consecutive touch method. (2-14) "Average phase difference" [degrees] is the average value of the phase difference of the touch of both hands, etc. (2-15) "Standard deviation of phase difference" [degrees] is the standard deviation of the above phase difference.
[0128] The following are feature parameters related to the method of touching or tapping in accordance with light or sound stimuli. (2-16) "Average value of time delay from stimulus" [seconds] is the average value of the time delay. (2-17) "Standard deviation of time delay from stimulus" [degrees] is the standard deviation of the time delay.
[0129] [DB not used abnormal data detected] The following describes the DB non-use abnormal data detection unit 14A performed by the abnormal data detection unit 14 in the data processing unit 500. As in the first embodiment, the DB non-use abnormal data detection unit 14A judges whether or not there is an abnormality only from the measurement data, without referring to the DB. Basically, the same abnormality detection items as in the first embodiment are listed, but only the items specific to this embodiment are described below. Of the abnormality items described in the first embodiment, (E2) cannot occur in this embodiment in the case of a task using both hands, because the places to touch with both hands are visually indicated. Also, (E6) is a phenomenon specific to magnetic sensors, so it does not need to be considered in this embodiment in which the screen is touched.
[0130] (E4) When measuring simultaneous tapping with both hands, you have mistakenly selected alternating tapping with both hands. This is the case where the user performs an exercise with the intention of measuring simultaneous tapping of both hands, but the system actually selects alternating tapping of both hands and records the measurement data. To detect this abnormality, a feature that evaluates the coordination of both hands is used among the features stored in the analysis evaluation data 43. For example, (2-14) "average phase difference" is 0° in ideal simultaneous tapping of both hands, where both hands are moved in perfect unison, whereas it is 180° in ideal alternating tapping of both hands, where both hands are moved perfectly alternately. From this, if (2-14) "average phase difference" is less than a predetermined value (e.g., 90°), it can be considered that the user performed the exercise with the intention of tapping of both hands simultaneously, even if alternating tapping of both hands was selected. In other words, it is considered that alternating tapping of both hands was selected by mistake when measuring simultaneous tapping of both hands, and the task data 42A is changed after measurement to indicate measurement data of simultaneous tapping of both hands.
[0131] (E5) When measuring alternating tapping with both hands, if simultaneous tapping with both hands is selected by mistake This is the opposite of the previous section, and is the case when the user makes an exercise with the intention of measuring alternating tapping of both hands, but in reality the system selects simultaneous tapping of both hands and records the measurement data. As in the previous section, this can be determined based on the features of the finger taps. (2-14) If the "average phase difference" is equal to or greater than a specified value (e.g., 90°), it can be deemed that the user intended to make an exercise with alternating tapping of both hands, even if simultaneous tapping of both hands was selected. In other words, it is assumed that simultaneous tapping of both hands was selected by mistake when measuring alternating tapping of both hands, and task data 42A is changed after measurement to indicate that the measurement data is simultaneous tapping of both hands.
[0132] (E7) If your finger moves out of place during measurement This is the case where the finger touches a place other than the specified place on the screen during measurement. If there is a certain period of time during which no movement is performed, it can be determined that this abnormality has occurred. Specifically, for example, the non-movement time can be evaluated as the time when (2-5) "number of taps" is 0. In addition, even before the specified measurement time ends, the measurement may be terminated in real time to prompt the user to measure again. In addition, by detecting touches around the specified place without detecting it as abnormal data, the user may be visually or audibly guided to return to the correct specified place when the touch place is outside the specified place. The non-movement time in (E8), (E9), and (E10) may be evaluated as the time when (2-5) "number of taps" is 0, just like this abnormality detection item.
[0133] [Effects, etc.] According to the abnormal data processing system of the second embodiment, similarly to the first embodiment, by using both the individual subject DB 45A and the multiple subject DB 45B in combination, highly accurate detection of abnormal data can be realized. In particular, in the second embodiment, there is no need to provide a motion sensor 20, which is an advantage in that it saves the user the trouble of making measurements.
[0134] An abnormality data processing system according to a third embodiment of the present invention will be described with reference to Figures 27 to 29. The basic configuration of the third embodiment is the same as that of the first embodiment, and the following describes the differences between the configuration of the third embodiment and the configuration of the first embodiment.
[0135] [System (3)] Fig. 27 shows an abnormality data processing system according to the third embodiment. The abnormality data processing system has a server 6 of a service provider and systems 7 of multiple facilities, which are connected via a communication network 8. The communication network 8 and the server 6 may include a cloud computing system. The abnormality data processing system according to the third embodiment is configured such that the terminal device 4 and the server 6 of the system 7 share roles. The division of roles will be described later.
[0136] The facility can be various, such as a hospital, a health checkup center, a public facility, an entertainment facility, or a user's home. The facility is provided with a system 7. Examples of the system 7 of the facility include a system 7A of a hospital H1 and a system 7B of a hospital H2. For example, the systems 7A and 7B of each hospital have a measuring device 3 and a terminal device 4 that constitute the measurement system 2 similar to that of the first embodiment. The configurations of the systems 7 may be the same or different. The system 7 of the facility may include an electronic medical record management system of the hospital, etc. The measuring device of the system 7 may be a dedicated terminal.
[0137] The server 6 is a device under the jurisdiction of a service provider. The server 6 has a function of providing facilities and users with an abnormal data processing service similar to that of the abnormal data processing system 1 of the first embodiment as a service by information processing. The server 6 provides service processing to the measurement system in a client-server manner. In addition to such functions, the server 6 has a user management function and the like. The user management function is a function of registering, accumulating, and managing user information of a group of users, measurement data, analysis evaluation data, and the like obtained through the system 7 of multiple facilities in a DB. Note that the terminal device 5 of the third embodiment does not need a function of processing abnormal data by itself, and has a measurement function using a touch panel and a display function of displaying the abnormal data detection results and the like generated by the server 6.
[0138] [server] 28 shows the configuration of the server 6. The server 6 has a control unit 601, a storage unit 602, an input unit 603, an output unit 604, and a communication unit 605, which are connected via a bus. The input unit 603 is a unit that performs operation input by an administrator of the server 6 or the like. The output unit 604 is a unit that performs screen display and the like for the administrator of the server 6 or the like. The communication unit 605 has a communication interface and is a unit that performs communication processing with the communication network 8. The storage unit 602 stores a DB 640. The DB 640 may be managed by a DB server or the like separate from the server 6.
[0139] The control unit 601 controls the entire server 6, and is composed of a CPU, ROM, RAM, etc., to realize a data processing unit 600 that performs abnormal data detection, abnormal data processing decision, etc. based on software program processing. The data processing unit 600 has a user information management unit 11, a task processing unit 12, an analysis evaluation unit 13, an abnormal data detection unit 14, an abnormal data processing decision unit 15, an abnormal data processing execution unit 16, and a result output unit 17. Unlike the first embodiment, the abnormal data detection unit 14 does not include a DB non-use abnormal data detection unit 14A, but only includes a DB use abnormal data detection unit 14B.
[0140] The user information management unit 11 registers and manages user information relating to a group of users of the system 7 in multiple facilities as user information 41 in the DB 640. The user information 41 includes attribute values for each individual user, usage history information, user setting information, etc. The usage history information includes performance information on past use of the abnormal data processing service by each user.
[0141] [Server management information] FIG. 29 shows an example of the data configuration of the user information 41 managed in the DB 640 by the server 6. The table of the user information 41 includes a user ID, a facility ID, a facility user ID, a sex, an age, a disease, a severity score, symptoms, history information, and the like. The user ID is unique identification information of the user in this system. The facility ID is identification information of the facility where the system 7 is installed. In addition, the communication address of the measuring device of each system 7 is also managed. The facility user ID is user identification information when there is user identification information managed in the facility or the system 7. That is, the user ID and the facility user ID are managed in association with each other. The disease item and the symptom item are stored with values representing the disease or symptoms selected and input by the user, or values diagnosed by a doctor or the like at a hospital. The severity score is a value representing the degree of the disease.
[0142] The history information item is information for managing the user's past service usage and abnormal data processing results, and stores information such as the date and time of each usage in chronological order. The history information item also stores each piece of data when a practice was performed, that is, the aforementioned measurement data, analysis and evaluation data, abnormal data detection results, abnormal data processing details, etc. The history information item may also store information on the address where each piece of data is stored.
[0143] [Dividing the burden of detecting abnormal data between local and server] In the first embodiment, the abnormal data detection unit 14 is configured to execute both the DB non-use abnormal data detection unit 14A and the DB use abnormal data detection unit 14B. In contrast, in this embodiment, the DB non-use abnormal data detection unit 14A is executed in the terminal device 4 of the local system 7, and the DB use abnormal data detection unit 14B is executed in the server 6. The reason for this division of labor is that the server 6 is suitable for abnormal data detection using a DB because the individual subject DB 45A and the multi-subject DB 45B are constructed from data aggregated from a plurality of systems 7 (7A, 7B, . . .). On the other hand, it is better to execute abnormal data detection that does not require these DBs in the local terminal device 4 in order to perform it as quickly as possible. By detecting abnormal data in the local terminal device 4, abnormal data detection can be performed in real time when an abnormality occurs during measurement, and instructions for remeasurement, etc. can be issued immediately. In addition, if the network with the server is not constantly connected, it is possible to prevent the loss of time spent sending data to the server and waiting for the abnormal data detection result.
[0144] Although the method of dividing the abnormal data detection function between the terminal device 4 and the server 6 based on whether or not to use the DB as described above has been described, other division methods are also possible. For example, if many users visit hospital H1 and a large-scale DB can be constructed, the DB use abnormal data detection unit 14B may also be performed by the terminal device 4. Furthermore, if the system administrator is given the authority to collectively change the settings of the abnormality detection reason / processing correspondence table 50B in the management table 50, the DB non-use abnormal data detection unit 14A may also be performed by the server 6.
[0145] [Effects, etc.] According to the abnormal data processing system of the third embodiment, similarly to the first embodiment, both the individual subject DB 45A and the multiple subject DB 45B are used in combination, thereby enabling highly accurate detection of abnormal data. Furthermore, by managing the individual subject DB 45A and the multiple subject DB 45B on a server, data from many facilities can be aggregated to build a large-scale DB, which is considered to enable more accurate detection of abnormal data. Furthermore, by sharing the abnormal data detection function between the local terminal device 4 and the server 6, abnormal data can be detected without time loss.
[0146] Although the present invention has been specifically described based on the embodiment, the present invention is not limited to the above embodiment and can be modified in various ways without departing from the gist of the present invention.
[0147] The present invention is not limited to the above-described embodiment, and includes various modified examples. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is also possible to add, delete, or replace a part of the configuration of each embodiment with the configuration of another embodiment. [Explanation of symbols]
[0148] 1...abnormal data processing system, 2...measurement system, 3...measurement equipment, 4...terminal equipment.
Claims
1. An abnormal data processing system that detects and processes the presence or absence of an abnormality in new data, A storage unit for holding a multiple subject DB in which data including information identifying users of multiple subjects is stored; a multiple-subject DB deviation degree calculation unit that calculates a multiple-subject DB deviation degree, which is a degree to which the new data deviates from the multiple-subject DB; an individual subject data deviation degree calculation unit that calculates an individual subject data deviation degree, which is a degree of deviation of the new data from data of an individual subject extracted from data of the multiple subject DB; a composite discrepancy calculation unit that calculates a composite discrepancy by using the multiple subject DB discrepancy and the individual subject data discrepancy based on the number of data of the individual subjects extracted from the multiple subject DB, determining that the new data is abnormal based on the composite deviation; a non-DB-used abnormal data detection unit that determines that the new data is abnormal based on the new data itself or a feature amount obtained from the new data, without using data of individual subjects extracted from the multiple-subject DB; The new data is finger movement data, The DB unused abnormal data detection unit At least one of a waveform amplitude, a movement non-execution time, and a bimanual coordination calculated from the finger movement data is set as the feature quantity, and it is detected whether the feature quantity deviates from a predetermined numerical range. Anomaly data processing system.
2. In the synthetic deviation calculation unit, Using an individual subject DB reliability coefficient that increases as the number of data of individual subjects extracted from the multiple subject DB increases, the individual subject data discrepancy is weighted with the individual subject DB reliability coefficient to obtain the composite discrepancy.
2. The anomaly data processing system according to claim 1.
3. an abnormal data processing decision unit that decides a process to be performed when the new data is determined to be abnormal; An abnormal data processing execution unit that executes the processing, 2. The anomaly data processing system according to claim 1.
4. In the individual subject data deviation calculation unit, Calculating the difference in measurement time between the new data and each data of the individual subject data; a time decay deviation calculation function for calculating a past data reliability that decays as the difference in the measurement times increases, and calculating the individual subject data deviation from each of the data and the past data reliability; 2. The anomaly data processing system according to claim 1.
Citation Information
Patent Citations
Action analyzing apparatus and utilization of the same
JP2005152053A
Living body information monitoring system
JP2005304996A
Exercise supporting device, exercise supporting method, exercise supporting system, exercise supporting control program and recording medium
JP2009142333A
Mental and physical health condition management system
JP2011238215A
Apparatus and method for medical image processing and program for detecting abnormality
JP2013039344A