Operating status monitoring system

Abstract

To provide a motion state monitoring system capable of monitoring a motion state of a subject accurately, and to provide a control method and a control program thereof.SOLUTION: A motion state monitoring system which monitors a designated motion to be monitored by two or more sensors selected from a plurality of sensors associated with each of a plurality of regions of a subject's body includes: an arrangement mechanism in which two or more sensors are arranged in a known direction; a calibration execution unit for performing calibration of the two or more sensors arranged in the known direction by the arrangement mechanism; and a monitoring result generation unit for generating a monitoring result for the subject's motion to be monitored on the basis of a result of the detection by the two or more sensors attached to the subject after the calibration is completed.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an operation state monitoring system, a control method thereof, and a control program.

Background Art

[0002] Patent Document 1 discloses an operation state monitoring system that monitors the operation state of a subject based on detection results by a plurality of sensors attached to each of a plurality of parts of the subject's body. Patent Document 1 also discloses calibration of a plurality of sensors.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In an operation state monitoring system for monitoring the operation state of a subject as in related art, in order to accurately monitor the monitoring target operation of the subject, it is required to accurately calibrate a plurality of sensors used to monitor the monitoring target operation of the subject.

[0005] The present disclosure has been made in view of the above background, and an object thereof is to provide an operation state monitoring system, a control method thereof, and a control program capable of accurately monitoring the operation state of a subject.

Means for Solving the Problems

[0006] The motion state monitoring system according to this disclosure is a motion state monitoring system that monitors a designated target motion using two or more sensors selected from a plurality of sensors associated with each of a plurality of parts of a subject's body, and comprises: an arrangement mechanism in which the two or more sensors are arranged in a known orientation; a calibration execution unit that performs calibration of the two or more sensors arranged in the known orientation by the arrangement mechanism; and a monitoring result generation unit that generates monitoring results of the subject's target motion based on detection results from the two or more sensors attached to the subject after the calibration is completed. This motion state monitoring system allows for relative calibration between multiple sensors by performing calibration of the plurality of sensors while the plurality of sensors used to monitor the subject's target motion are arranged in a known orientation by an arrangement mechanism such as a charging case, thereby enabling the orientation of the plurality of sensors to be defined by a common coordinate system. As a result, this motion state monitoring system can accurately monitor the subject's target motion. Furthermore, this motion state monitoring system can more accurately calculate whether the motion state of the subject's target motion is good or not by performing calculations using a trained model.

[0007] In the arrangement mechanism described above, the two or more sensors may be arranged so that they all face the first direction.

[0008] The arrangement mechanism may be a case in which the two or more sensors are housed so that they all face the first direction.

[0009] The case may be a charging case configured to charge the two or more sensors.

[0010] The system may further include a registration unit that associates at least two or more sensors with two or more parts of the subject's body.

[0011] The system further includes a determination unit that determines whether or not the two or more sensors attached to the subject have been calibrated, and the monitoring result generation unit may not generate monitoring results of the subject's monitored actions using the two or more sensors that have not been calibrated.

[0012] The system may further include a notification unit that notifies the user of an error if the determination unit determines that the two or more sensors attached to the subject have not been calibrated.

[0013] Each of the two or more sensors may have a magnetic adsorption portion as the arrangement mechanism, and the two or more sensors may be arranged to face the first direction by being attracted to each other by their respective magnetic adsorption portions.

[0014] The arrangement mechanism may include a identifying unit that identifies the orientation of the two or more sensors as the known orientation by analyzing an identifier assigned to each of the two or more sensors and identifiable from its appearance, and the identifier assigned to each of the two or more sensors included in an image taken of the two or more sensors.

[0015] The control method for the motion state monitoring system according to this disclosure is a control method for a motion state monitoring system in which a specified target motion is monitored by two or more selected sensors from among a plurality of sensors associated with each of a plurality of parts of a subject's body, and the two or more sensors are calibrated by a placement mechanism which is arranged in a known orientation, and after the calibration is completed, a monitoring result of the subject's target motion is generated based on the detection results from the two or more sensors attached to the subject. In this control method for the motion state monitoring system, the orientation of the plurality of sensors can be defined by a common coordinate system by performing calibration of the plurality of sensors which are arranged by a placement mechanism such as a charging case which is arranged in a known orientation, so relative calibration can be performed between the plurality of sensors. As a result, this control method for the motion state monitoring system can accurately monitor the target motion of a subject.

[0016] The control program according to this disclosure is a control program that causes a computer to execute control processing in an motion state monitoring system in which a specified monitored motion is monitored by two or more selected sensors from among a plurality of sensors associated with each of a plurality of parts of a subject's body, and causes the computer to execute a process of calibrating the two or more sensors which are arranged in a known orientation by a placement mechanism, and a process of generating monitoring results of the subject's monitored motion based on the detection results from the two or more sensors attached to the subject after the calibration is completed. This control program allows relative calibration between the plurality of sensors to be performed by calibrating the plurality of sensors which are arranged in a known orientation by a placement mechanism such as a charging case, while the plurality of sensors used to monitor the subject's monitored motion are arranged in a known orientation by a placement mechanism such as a charging case. As a result, this motion state monitoring system can accurately monitor the subject's monitored motion. [Effects of the Invention]

[0017] According to the present disclosure, it is possible to provide an operation state monitoring system capable of accurately monitoring the operation state of a subject, a control method thereof, and a control program.

Brief Description of the Drawings

[0018] [Figure 1] It is a block diagram showing a configuration example of an operation state monitoring system according to Embodiment 1. [Figure 2] It is a diagram showing an example of an attachment target site of a measuring instrument attached to a subject. [Figure 3] It is a diagram showing a configuration example of a measuring instrument provided in the operation state monitoring system according to Embodiment 1. [Figure 4] It is a diagram showing an example of how to attach the measuring instrument shown in FIG. 3 to a subject. [Figure 5] It is a schematic diagram showing the appearance of a charging case provided in the operation state monitoring system according to Embodiment 1. [Figure 6] It is a schematic diagram showing another example of an arrangement mechanism in which a plurality of sensors to be calibrated are arranged in a known orientation. [Figure 7] It is a schematic diagram showing another example of an arrangement mechanism in which a plurality of sensors to be calibrated are arranged in a known orientation. [Figure 8] It is a flowchart showing the operation of an operation state monitoring device provided in the operation state monitoring system according to Embodiment 1. [Figure 9] It is a diagram showing an example of the display content of a monitor. [Figure 10] It is a diagram showing an example of the display content of a monitor. [Figure 11] It is a diagram showing an example of the display content of a monitor.

Modes for Carrying Out the Invention

[0019] The present invention will be described below through embodiments of the invention, but the invention claimed is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential as means of solving the problem. For clarity of explanation, the following descriptions and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are denoted by the same reference numerals, and redundant explanations have been omitted where necessary.

[0020] <Embodiment 1> Figure 1 is a block diagram showing an example configuration of the operation state monitoring system 1 according to Embodiment 1. The operation state monitoring system 1 is a system that monitors the operation state of a subject. Based on the monitoring results, a user, such as a caregiver, can, for example, provide support to bring the subject's movements closer to desired movements. A detailed explanation follows below.

[0021] As shown in Figure 1, the operating status monitoring system 1 comprises a plurality of measuring instruments 11, an operating status monitoring device 12, an operation terminal 13, and a charging case 14. The operating status monitoring device 12 can also be considered an operating status monitoring system on its own. The operating status monitoring device 12, the plurality of measuring instruments 11, and the operation terminal 13 are configured to communicate with each other via a wired or wireless network. In this embodiment, the case in which 11 measuring instruments 11 are provided will be described as an example. Hereafter, each of the 11 measuring instruments 11 will be distinguished and referred to as measuring instrument 11_1 to 11_11.

[0022] The operating terminal 13 is a communication-capable terminal owned by the user or temporarily assigned to the user, such as a PC (Personal Computer) terminal, a mobile terminal such as a smartphone or tablet terminal, or a dedicated communication terminal provided for this system. In this embodiment, the case in which the operating terminal 13 and the operating status monitoring device 12 are provided separately is described as an example, but the system is not limited to this, and the operating terminal 13 and the operating status monitoring device 12 may be formed as a single unit.

[0023] For example, the user inputs information about the subject and monitoring results to be displayed on the monitor 131 into the operating terminal 13 by touching the monitor 131 of the operating terminal 13 with a stylus or finger, or by operating the mouse or keyboard of the operating terminal 13. The operating terminal 13 receives this information and transmits it to the operating status monitoring device 12 via the network. When the user inputs information, the monitor 131 displays an input screen for information about the subject and a selection screen for monitoring results to be displayed on the monitor 131. After the operating status monitoring device 12 has monitored the subject's operating status, the monitor 131 displays the monitoring results received from the operating status monitoring device 12.

[0024] Each measuring instrument 11_1 to 11_11 is attached to one of the body parts 20_1 to 20_11 of subject P, and uses motion sensors (hereinafter simply referred to as sensors) 111_1 to 111_11, consisting of a gyro sensor and an accelerometer, to detect the movement of the body parts 20_1 to 20_11. Each measuring instrument 11_1 to 11_11 is associated with one of the body parts 20_1 to 20_11 through a pairing process performed with the motion state monitoring device 12.

[0025] Figure 2 shows an example of the attachment sites for measuring devices 11_1 to 11_11 on subject P's body. In the example in Figure 2, the attachment sites 20_1 to 20_11 for measuring devices 11_1 to 11_11 are the upper right arm, right forearm, head, chest (trunk), waist (pelvis), left upper arm, left forearm, right thigh, right lower leg, left thigh, and left lower leg, respectively. Note that it is not necessary for all measuring devices 11_1 to 11_11 to be attached to subject P's body. Only the measuring devices 11_1 to 11_11 that are necessary for measuring the target movements (including body part movements) that the user wants to monitor should be attached to subject P's body.

[0026] (Example configuration of measuring instruments 11_1 to 11_11) Figure 3 shows an example of the configuration of measuring instrument 11_1. Note that the configurations of measuring instruments 11_2 to 11_11 are the same as those of measuring instrument 11_1, so their explanation is omitted.

[0027] As shown in Figure 3, the measuring instrument 11_1 includes a sensor 111_1, a mounting pad 112_1, and a belt 113_1. The belt 113_1 is formed to be wrapped around the area of ​​the subject P whose movement is to be detected. The sensor 111_1 is incorporated into, for example, the mounting pad 112_1. The mounting pad 112_1, into which the sensor 111_1 is incorporated, is formed to be detachably attached to the belt 113_1.

[0028] Figure 4 shows an example of how the measuring instrument 11_1 is attached to subject P. In the example in Figure 4, the belt 113_1 is wrapped around subject P's upper right arm, which is one of the body parts targeted for motion detection. The sensor 111_1 is attached to the belt 113_1 via the mounting pad 112_1 after pairing and calibration are completed.

[0029] In Figure 1, the operating state monitoring device 12 outputs a calculation result representing the operating state of subject P based on the detection results (sensing values) of sensors 111_1 to 111_11.

[0030] Specifically, the operating state monitoring device 12 includes a receiving unit 121, a calibration execution unit 122, a determination unit 123, an arithmetic processing unit 124, an output unit 125, and a control unit 126. The operating state monitoring device 12 may further include a registration unit that associates sensors 111_1 to 111_11 with multiple body parts of subject P through a pairing process and registers them.

[0031] The receiving unit 121 receives detection results from sensors 111_1 to 111_11, receives information entered by the user into the operation terminal 13, and receives position and orientation information of sensors 111_1 to 111_11 during calibration. do.

[0032] The calibration execution unit 122 performs calibration of sensors 111_1 to 111_11. However, the calibration execution unit 122 is not limited to performing calibration of all sensors 111_1 to 111_11, but may be configured to perform calibration only on the sensors among sensors 111_1 to 111_11 that are attached to the body of subject P.

[0033] Calibration is the process of measuring the output value (error component) of a sensor used to measure the operation of a monitored object while it is stationary, and subtracting that error component from the measured value. Here, it is assumed that the sensor's output value stabilizes after a predetermined period (approximately 20 seconds) has elapsed since the sensor was stationary. In this case, it is desirable that the output value of the sensor after the predetermined period has elapsed since the sensor was stationary be used as the error component in calibration. Therefore, in this example, the output value of the sensor after the predetermined period has elapsed since the user gave the instruction to start calibration after the sensor was stationary is used as the error component. Furthermore, "during calibration" refers to the processing period until the error component is determined, and "calibration complete" means that the output value (error component) of the sensor in a stationary state has been determined.

[0034] In relative calibration between multiple sensors (i.e., the process of subtracting error components of relative position and relative angle between multiple sensors from measured values), the orientations of the multiple sensors must be defined by a common coordinate system. Therefore, in relative calibration between multiple sensors, the orientations of the multiple sensors must be known.

[0035] Therefore, the calibration execution unit 122 performs calibration of sensors 111_1 to 111_11 when the sensors 111_1 to 111_11 are arranged in a known orientation by a predetermined arrangement mechanism.

[0036] An arrangement mechanism for positioning multiple sensors to be calibrated in known orientations is provided, for example, in the charging case 14. Figure 5 is a schematic diagram showing the external appearance of the charging case 14. In the example in Figure 5, sensors 111_1 to 111_4 are shown as the multiple sensors to be calibrated.

[0037] As shown in Figure 5, the charging case 14 includes a housing 141, a plurality of storage pockets 142 formed on the side of the housing 141, a switch 143, and a charging cable 144. The plurality of storage pockets 142 are arranged in a vertical direction (z-axis direction) and are formed to accommodate sensors 111_1 to 111_11 with their respective top surfaces facing a predetermined direction (x-axis direction). In the example in Figure 5, sensors 111_1 to 111_4 are stored in each of the four storage pockets 142 of the charging case 14. As a result, the orientation of sensors 111_1 to 111_4 is the same, i.e., it is a known state. When the user presses the switch 143, the calibration execution unit 122 determines that sensors 111_1 to 111_4 are arranged in a known orientation and starts the calibration of sensors 111_1 to 111_4. At the same time, the sensors 111_1 to 111_4 stored in each of the four storage pockets 142 of the charging case 14 are charged via the charging cable 144.

[0038] In this embodiment, the case in which a configuration mechanism for arranging multiple sensors to be calibrated in known orientations is provided in the charging case 14 has been described as an example, but the embodiment is not limited to this. The configuration mechanism may be provided in a case that does not have a charging function instead of the charging case 14.

[0039] Furthermore, the arrangement mechanism for positioning multiple sensors to be calibrated in known orientations may be provided in a location other than the case, such as a charging case. This will be explained below with reference to Figures 6 and 7.

[0040] Figure 6 is a schematic diagram showing another example of an arrangement mechanism in which multiple sensors to be calibrated are arranged in a known orientation. In the example in Figure 6, a pair of magnetic adsorption parts Q are attached to both ends of each sensor 111_1 to 111_4. In other words, each sensor 111_1 to 111_4 has a pair of magnetic adsorption parts Q as part of the arrangement mechanism. Sensors 111_1 to 111_4 are attracted to each other by their respective magnetic adsorption parts Q, so that their upper surfaces face the same direction. That is, the orientation of sensors 111_1 to 111_4 becomes known.

[0041] Figure 7 is a schematic diagram showing another example of an arrangement mechanism in which multiple sensors to be calibrated are arranged in known orientations. In the example in Figure 7, each sensor 111_1 to 111_4 is assigned a marker M as an example of an identifier that can be identified by appearance. In this case, the operating state monitoring device 12 has an identification unit that identifies the orientation of each sensor 111_1 to 111_4 as a known orientation by taking a picture of the sensors 111_1 to 111_4, for example, randomly placed on a desk, with a camera and analyzing the marker M assigned to each of the sensors 111_1 to 111_4 included in the captured image. In other words, in the example in Figure 7, the arrangement mechanism (arrangement mechanism) in which multiple sensors to be calibrated are arranged in known orientations is realized by an identifier such as a marker assigned to each sensor and the identification unit described above. Note that the identifier that can be identified by appearance is not limited to marker M, but may also be a pattern, a QR code (registered trademark), etc.

[0042] The determination unit 123 determines whether the calibration of the sensor attached to subject P was performed before it was attached to subject P. For example, the determination unit 123 determines that calibration has been performed when it receives a completion notification from the calibration execution unit 122. Then, the determination unit 123 determines whether the calibration of the sensor attached to subject P was performed before it was attached to subject P by comparing the time when the sensor calibration was completed with the time when the sensor was attached to subject P.

[0043] The arithmetic processing unit 124 performs calculations based on the detection results of each of the calibrated sensors 111_1 to 111_11 to generate calculation results that represent the operational state of the monitored movements of subject P. Therefore, the arithmetic processing unit 124 can also be called a monitoring result generation unit that generates monitoring results of the monitored movements of subject P. The monitored movements include, for example, movements such as right shoulder flexion and extension, right shoulder abduction and adduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and supination, head flexion and extension, head rotation, thoracolumbar flexion and extension, thoracolumbar rotation, thoracolumbar lateral flexion, left shoulder flexion and extension, left shoulder abduction and adduction, left shoulder internal and external rotation, left elbow flexion and extension, and left forearm pronation and supination. The monitored movements also include the movement of the body parts to which the sensors are attached. For example, the monitored movements include the angles of the joints of subject P's body measured based on the detection results of multiple sensors, and the angles of the joints in an arbitrary coordinate system measured based on the detection results of any of the sensors. In the following, the generation of calculation results representing the operating state of the monitored operation will also be referred to as the measurement of the monitored operation.

[0044] For example, the arithmetic processing unit 124 performs calculations based on the detection results of sensor 111_1 attached to subject P's upper right arm (part 20_1) and sensor 111_2 attached to his right forearm (part 20_2), among the sensors 111_1 to 111_11, to generate calculation results that represent the motion state of subject P's right elbow flexion and extension movement.

[0045] Alternatively, the arithmetic processing unit 124 performs calculations based on the detection results of sensor 111_5 attached to the lower back (part 20_5) and sensor 111_8 attached to the right thigh (part 20_8) of subject P, from among sensors 111_1 to 111_11, to generate calculation results that represent the motion state of the lateral flexion movement of the right side of subject P's lower back.

[0046] Furthermore, the arithmetic processing unit 124 may be configured not to generate a calculation result representing the operating state of the monitored operation of subject P if the determination unit 123 determines that the calibration of the sensor attached to subject P was not performed before it was attached to subject P. Alternatively, the arithmetic processing unit 124 may be configured to notify an error if the determination unit 123 determines that the calibration of the sensor attached to subject P was not performed before it was attached to subject P.

[0047] Furthermore, the arithmetic processing unit 124 may perform calculations using a trained model generated by machine learning using past sensor detection results. By performing calculations using this trained model, the arithmetic processing unit 124 can more accurately calculate whether the operating state of the monitored operation of subject P is good or not.

[0048] The output unit 125 outputs the calculation results from the calculation processing unit 124. The information output from the output unit 125 (calculation results, error information) is transferred to the operation terminal 13 via the network, visualized in graphs, etc., and displayed on the monitor 131 of the operation terminal 13. This allows the user to know the operating status of the monitored action of subject P, which can be used, for example, to assist subject P.

[0049] The control unit 126 displays an icon display area S1 and display setting areas A1 to A3 on the monitor 131 screen to allow the user to select the measurement results of the monitored operation to be displayed on the monitor 131. Note that the number of display setting areas is not limited to three, but can be one or more. The control unit 126 also displays a measurement result icon in the icon display area S1 that indicates the measurement result of the monitored operation that can be displayed on the monitor 131. In other words, the control unit 126 displays a measurement result icon that indicates the measurement result of the monitored operation that can be obtained from the sensor attached to the subject P. The user can select a measurement result icon from among the measurement result icons displayed in the icon display area S1 that corresponds to the measurement result of the monitored operation that they want to display on the monitor 131.

[0050] The receiver 121 receives a user setting operation to one of the display setting areas A1 to A3 for setting the area to display the details of the measurement result for the measurement result icon displayed in the icon display area S1. For example, the user moves the measurement result icon displayed in the icon display area S1 to the display setting area A1. Specifically, the user drags and drops the measurement result icon displayed in the icon display area S1 to the display setting area A1 using mouse or touch operation. As a result, the receiver 121 receives a user setting operation to set the area to display the details of the measurement result for the measurement result icon to the display setting area A1. Consequently, the details of the selected measurement result (for example, a graphed measurement result) are displayed in the display setting area A1.

[0051] In this embodiment, the receiving unit 121 has been described as accepting a user setting operation to set an area for displaying details of a measurement result for one measurement result icon displayed in the icon display area S1 in the display setting area A1, but it is not limited to this. The receiving unit 121 may further accept a user setting operation to set an area for displaying details of a measurement result for another measurement result icon displayed in the icon display area S1 in either the display setting area A2 or A3. In this case, for example, the user moves one measurement result icon displayed in the icon display area S1 to the display setting area A1, and moves another measurement result icon displayed in the icon display area S1 to either the display setting area A2 or A3. As a result, the receiving unit 121 accepts a user setting operation to set an area for displaying details of a measurement result for one measurement result icon to the display setting area A1, and also accepts a user setting operation to set an area for displaying details of a measurement result for another measurement result icon to either the display setting area A2 or A3. As a result, the details of one selected measurement result are displayed in display setting area A1, while the details of another selected measurement result are displayed in either display setting area A2 or A3.

[0052] Furthermore, although this embodiment has described an example in which the receiving unit 121 accepts a user setting operation to the display setting area A1 for setting an area to display the details of a measurement result for a certain measurement result icon displayed in the icon display area S1, it is not limited to this. The receiving unit 121 may also accept a user setting operation to the display setting area A1 for setting an area to display the details of a measurement result for another measurement result icon displayed in the icon display area S1. In this case, for example, the user moves the two measurement result icons displayed in the icon display area S1 to the display setting area A1. As a result, the receiving unit 121 accepts a user setting operation to the common display setting area A1 for setting an area to display the details of the measurement results for the two measurement result icons. As a result, the details of the two selected measurement results are displayed in the display setting area A1. For example, two graphed measurement results are displayed superimposed in the display setting area A1.

[0053] Furthermore, the receiving unit 121 may also accept a change operation, for example, when a user moves a measurement result icon from display setting area A1 to either display setting area A2 or A3 (by drag and drop), and change the area where the measurement result corresponding to that measurement result icon is displayed from display setting area A1 to either display setting area A2 or A3. In addition, a measurement result icon set in display setting area A1 can also be set in either or both of display setting areas A2 or A3 at the same time.

[0054] (Operation of the operational status monitoring device 12) Next, we will explain the operation of the operating status monitoring device 12 using Figure 8. Figure 8 is a flowchart showing the operation of the operating status monitoring device 12.

[0055] First, the operating state monitoring device 12 performs a pairing process between the operating state monitoring device 12 and the measuring instruments 11_1 to 11_11 to establish a correspondence between the measuring instruments 11_1 to 11_11 and the body parts 20_1 to 20_11 of subject P (step S101).

[0056] Subsequently, the operating state monitoring device 12 performs calibration of sensors 111_1 to 111_11 (step S102). During calibration, sensors 111_1 to 111_11 are positioned in a known orientation, for example, by being housed in the charging case 14. This allows the operating state monitoring device 12 to define the orientation of sensors 111_1 to 111_11 using a common coordinate system, thereby enabling relative calibration between sensors 111_1 to 111_11.

[0057] During calibration, the monitor 131 displays a message such as, "Calibration in progress. Please place the sensor on the desk and do not move it." Once calibration is complete, the monitor 131 displays a message such as, "Calibration complete. Please attach the sensor." Note that the status of calibration and the completion of calibration are not limited to being displayed on the monitor 131; notifications may also be made by other means, such as voice notification. Furthermore, the order of the calibration process and the pairing process may be reversed.

[0058] After calibration is complete, the sensors are attached to subject P (step S103). In this example, of sensors 111_1 to 111_11, sensors 111_1, 111_2, 111_5, and 111_8 are attached to subject P's upper right arm (area 20_1), right forearm (area 20_2), waist (area 20_5), and right thigh (area 20_8), respectively.

[0059] Subsequently, the operating state monitoring device 12 measures the monitoring target operations that can be measured using the sensors attached to subject P, out of the multiple monitoring target operations (step S104).

[0060] Subsequently, the operating state monitoring device 12 outputs the measurement result (a calculation result representing the operating state of the monitored operation of subject P) (step S105).

[0061] Specifically, the operation status monitoring device 12 first displays an icon display area S1 and display setting areas A1 to A3 on the screen of the monitor 131. Note that the number of display setting areas is not limited to three, but can be one or more. The operation status monitoring device 12 also displays a measurement result icon in the icon display area S1 that indicates the measurement result of a monitored operation that can be displayed on the monitor 131. In other words, the operation status monitoring device 12 displays a measurement result icon in the icon display area S1 that indicates the measurement result of a monitored operation that can be obtained from a sensor attached to the subject P. The user can select a measurement result icon from among the measurement result icons displayed in the icon display area S1 that corresponds to the measurement result of the monitored operation that they want to display on the monitor 131.

[0062] In the example shown in Figure 9, the icon display area S1 is displayed on the left side of the monitor 131 screen, and the display setting areas A1 to A3 are displayed on the right side. The icon display area S1 also displays measurement result icons T1, which represent the measurement result of "right shoulder abduction / adduction movement" obtained from sensor 111_1; measurement result icon T2, which represents the measurement result of "right elbow flexion / extension movement" obtained from sensors 111_1 and 111_2; and measurement result icon T3, which represents "right lumbar lateral flexion movement" obtained from sensors 111_5 and 111_8. In other words, in the example shown in Figure 9, the user can select the measurement result icon from the three measurement result icons T1 to T3 displayed in the icon display area S1 that corresponds to the measurement result of the monitored movement that they want to display on the monitor 131.

[0063] Subsequently, the operating status monitoring device 12 accepts a user setting operation to one of the display setting areas A1 to A3 for setting an area to display details of the measurement results for the measurement result icons T1 to T3 displayed in the icon display area S1.

[0064] In the example shown in Figure 10, the user drags and drops measurement result icon T1 from among the measurement result icons T1 to T3 displayed in the icon display area S1 to the display setting area A1 using mouse or touch operation. As a result, the operation status monitoring device 12 receives the user's setting operation to the display setting area A1 for setting the area to display the details of the measurement result for measurement result icon T1. As a result, as shown in the example in Figure 11, the display setting area A1 displays the details of the measurement result corresponding to measurement result icon T1 (for example, the graphed measurement result). Note that even when measurement result icon T1 is displayed in the display setting area A1 by drag and drop, it continues to be displayed in the icon display area S1, but it may be deleted from the icon display area S1 as a result of being displayed in the display setting area A1 by drag and drop.

[0065] Thus, in this embodiment, the operation state monitoring system 1 performs calibration of the multiple sensors used to monitor the monitored operation while they are arranged in a known orientation by being housed in a charging case 14 or the like. As a result, the operation state monitoring system 1 in this embodiment can define the orientation of the multiple sensors using a common coordinate system, and thus perform relative calibration between the multiple sensors. As a result, the operation state monitoring system 1 in this embodiment can accurately monitor the monitored operation of the subject.

[0066] Furthermore, this disclosure can be implemented by having a CPU (Central Processing Unit) execute a computer program to perform part or all of the processing of the operating status monitoring system 1.

[0067] The program described above includes, when loaded into a computer, a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include RAM (Random-Access Memory), ROM (Read-Only Memory), flash memory, SSD (Solid-State Drive), or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically, or otherwise propagating signals. [Explanation of symbols]

[0068] 1. Operating Status Monitoring System 11 Measuring Instruments 11_1~11_11 Measuring Instruments 12. Operating status monitoring device 13 Operating terminal 14 Charging Case 20_1~20_11 Part 111_1~111_11 Sensor 112_1 Pad 113_1 Belt 121 Receiving Unit 122 Calibration Execution Unit 123 Judgment section 124 Arithmetic Processing Unit 125 Output section 126 Control Unit 131 Monitors 141 cabinets 142 storage pockets 143 switches 144 Charging Cable A1~A3 Display setting area M Marker P Subject S1 Icon display area T1~T3 Measurement Result Icons

Claims

1. A motion state monitoring system that monitors a specified target motion using two or more sensors selected from among multiple sensors associated with each of multiple parts of a subject's body, An arrangement mechanism in which the two or more sensors are arranged in a known orientation, A calibration execution unit that performs calibration of the two or more sensors arranged in known orientations by the arrangement mechanism, A monitoring result generation unit generates monitoring results of the subject's monitored actions based on the detection results from the two or more sensors attached to the subject after the calibration is completed, Equipped with, Each of the two or more sensors has a magnetic adsorption part as the arrangement mechanism, The two or more sensors are arranged so that they all face the first direction, by being attracted to each other by their respective magnetic adsorption parts. Operating status monitoring system.

2. A motion state monitoring system that monitors a specified target motion using two or more sensors selected from among multiple sensors associated with each of multiple parts of a subject's body, An arrangement mechanism in which the two or more sensors are arranged in a known orientation, A calibration execution unit that performs calibration of the two or more sensors arranged in known orientations by the arrangement mechanism, A monitoring result generation unit generates monitoring results of the subject's monitored actions based on the detection results from the two or more sensors attached to the subject after the calibration is completed, Equipped with, The aforementioned arrangement mechanism is Each of the two or more sensors is assigned an identifier that can be identified by its appearance, An identification unit that identifies the orientation of the two or more sensors as the known orientation by analyzing the identifiers assigned to each of the two or more sensors included in the image captured by the two or more sensors, Having, Operating status monitoring system.

Images