Motion state monitoring system, control method thereof, and control program

Abstract

To provide a motion state monitoring system capable of monitoring a motion state of a subject accurately, and to provide a control method and a control program thereof.SOLUTION: A motion state monitoring system which monitors a designated motion to be monitored by two or more sensors selected from a plurality of sensors associated with each of a plurality of regions of a subject's body includes: an arrangement mechanism in which two or more sensors are arranged in a known direction; a calibration execution unit for performing calibration of the two or more sensors arranged in the known direction by the arrangement mechanism; and a monitoring result generation unit for generating a monitoring result for the subject's motion to be monitored on the basis of a result of the detection by the two or more sensors attached to the subject after the calibration is completed.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an operation status monitoring system, a control method thereof, and a control program thereof. [Background technology]

[0002] Patent Document 1 discloses a motion status monitoring system that monitors the motion status of a subject based on the detection results of a plurality of sensors attached to a plurality of parts of the subject's body. Patent Document 1 also discloses calibration of the plurality of sensors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-34448 Summary of the Invention [Problem to be solved by the invention]

[0004] In a motion status monitoring system that monitors the motion status of a subject, such as in the related art, it is required to accurately calibrate multiple sensors used to monitor the subject's monitored motions in order to accurately monitor the subject's monitored motions.

[0005] The present disclosure has been made in consideration of the above background, and aims to provide a motion status monitoring system capable of accurately monitoring the motion status of a subject, a control method thereof, and a control program thereof. [Means for solving the problem]

[0006] The motion state monitoring system according to the present disclosure is a motion state monitoring system that monitors a specified motion to be monitored by two or more selected sensors among a plurality of sensors associated with each of a plurality of parts of the body of a subject, and includes an arrangement mechanism for arranging the two or more sensors in a known orientation, a calibration execution unit that calibrates the two or more sensors arranged in a known orientation by the arrangement mechanism, and a monitoring result generation unit that generates a monitoring result of the motion to be monitored of the subject based on a detection result by the two or more sensors attached to the subject after the calibration is completed. This motion state monitoring system calibrates the plurality of sensors used to monitor the motion to be monitored of the subject in a state in which the plurality of sensors are arranged in a known orientation by an arrangement mechanism such as a charging case, thereby making it possible to define the orientation of the plurality of sensors by a common coordinate system, and therefore it is possible to perform relative calibration between the plurality of sensors. As a result, this motion state monitoring system can monitor the motion to be monitored of the subject with high accuracy. In addition, this motion state monitoring system can more accurately calculate whether the motion state of the motion to be monitored of the subject is good by performing a calculation process using a learned model.

[0007] In the arrangement mechanism, the two or more sensors may be arranged so as to face a first direction.

[0008] The positioning mechanism may be a case in which the two or more sensors are stored so as to all face the first direction.

[0009] The case may be a charging case configured to be capable of charging the two or more sensors.

[0010] The device may further include a registration unit that registers at least the two or more sensors in association with two or more parts of a plurality of parts of the subject's body.

[0011] The device may further include a determination unit that determines whether or not the two or more sensors attached to the subject have been calibrated, and the monitoring result generation unit may not generate monitoring results of the subject's monitored actions using the two or more sensors that have not been calibrated.

[0012] The device may further include a notification unit that notifies an error when the determination unit determines that the two or more sensors attached to the subject have not been calibrated.

[0013] Each of the two or more sensors may have a magnetically attracted portion as the positioning mechanism, and the two or more sensors may be arranged so as to face the first direction by being attracted to each other by the respective magnetically attracted portions.

[0014] The placement mechanism may have an identifier assigned to each of the two or more sensors and identifiable from its appearance, and an identification unit that identifies the orientation of the two or more sensors as the known orientation by analyzing the identifier assigned to each of the two or more sensors contained in an image captured of the two or more sensors.

[0015] The control method of the motion state monitoring system according to the present disclosure is a control method of the motion state monitoring system that monitors a specified motion to be monitored by two or more selected sensors among a plurality of sensors associated with each of a plurality of parts of the body of a subject, and performs calibration of the two or more sensors arranged in a known orientation by an arrangement mechanism, and generates a monitoring result of the motion to be monitored of the subject based on the detection result of the two or more sensors attached to the subject after the calibration is completed. In this control method of the motion state monitoring system, the plurality of sensors used to monitor the motion to be monitored of the subject are calibrated in a state in which the plurality of sensors are arranged in a known orientation by an arrangement mechanism such as a charging case, and the orientation of the plurality of sensors can be defined by a common coordinate system, so that relative calibration between the plurality of sensors can be performed. As a result, this control method of the motion state monitoring system can monitor the motion to be monitored of the subject with high accuracy.

[0016] The control program according to the present disclosure is a control program that causes a computer to execute a control process in a motion monitoring system that monitors a specified motion to be monitored by two or more selected sensors among a plurality of sensors associated with each of a plurality of body parts of a subject, and causes the computer to execute a process of calibrating the two or more sensors that are arranged in a known orientation by an arrangement mechanism, and a process of generating a monitoring result of the motion to be monitored by the subject based on the detection result by the two or more sensors attached to the subject after the calibration is completed. This control program calibrates the multiple sensors used to monitor the motion to be monitored by the subject in a state in which the multiple sensors are arranged in a known orientation by an arrangement mechanism such as a charging case, thereby making it possible to define the orientation of the multiple sensors by a common coordinate system, and thus making it possible to perform relative calibration between the multiple sensors. As a result, this motion monitoring system can monitor the motion to be monitored by the subject with high accuracy. Effect of the Invention

[0017] The present disclosure makes it possible to provide a motion status monitoring system capable of monitoring the motion status of a subject with high accuracy, a control method thereof, and a control program thereof. [Brief description of the drawings]

[0018] [Figure 1] 1 is a block diagram showing a configuration example of an operation state monitoring system according to a first embodiment; [Diagram 2] FIG. 2 is a diagram showing an example of a target attachment portion of a measuring device attached to a subject; [Diagram 3] FIG. 2 is a diagram illustrating a configuration example of a measuring instrument provided in the operation status monitoring system according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of how the measuring device shown in FIG. 3 is attached to a subject. [Diagram 5] 2 is a schematic diagram showing the appearance of a charging case provided in the operation state monitoring system according to the first embodiment. FIG. [Figure 6] 13 is a schematic diagram showing another example of an arrangement mechanism in which multiple sensors to be calibrated are arranged in known orientations. FIG. [Figure 7] 13 is a schematic diagram showing another example of an arrangement mechanism in which multiple sensors to be calibrated are arranged in known orientations. FIG. [Figure 8] 4 is a flowchart showing an operation of an operation status monitoring device provided in the operation status monitoring system according to the first embodiment. [Figure 9] FIG. 4 is a diagram showing an example of the display content of a monitor. [Figure 10] FIG. 4 is a diagram showing an example of the display content of a monitor. [Figure 11] FIG. 4 is a diagram showing an example of the display content of a monitor. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] The present invention will be described below through embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. In addition, not all of the configurations described in the embodiments are necessarily essential as means for solving the problems. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and repeated explanations are omitted as necessary.

[0020] <Embodiment 1> Fig. 1 is a block diagram showing a configuration example of a motion state monitoring system 1 according to the first embodiment. The motion state monitoring system 1 is a system that monitors the motion state of a subject. Based on the monitoring results, a user such as a caregiver can provide support to bring the motion of the subject closer to a desired motion. A specific description will be given below.

[0021] As shown in Fig. 1, the operation state monitoring system 1 includes a plurality of measuring instruments 11, an operation state monitoring device 12, an operation terminal 13, and a charging case 14. The operation state monitoring device 12 can be referred to as an operation state monitoring system by itself. The operation state monitoring device 12, the plurality of measuring instruments 11, and the operation terminal 13 are configured to be able to communicate with each other via a wired or wireless network. In this embodiment, an example will be described in which eleven measuring instruments 11 are provided. Hereinafter, the eleven measuring instruments 11 are also referred to as measuring instruments 11_1 to 11_11 to distinguish each other.

[0022] The operation terminal 13 is a communication-enabled terminal owned by a user or temporarily assigned to a user, and is, for example, a PC (Personal Computer) terminal, a mobile terminal such as a smartphone or a tablet terminal, or a dedicated communication terminal prepared for this system. Note that, in this embodiment, a case where the operation terminal 13 and the operation state monitoring device 12 are provided separately will be described as an example, but the present invention is not limited thereto, and the operation terminal 13 and the operation state monitoring device 12 may be formed integrally.

[0023] For example, a user operates the monitor 131 of the operation terminal 13 by touching it with a touch pen or a finger, or by operating the mouse, keyboard, etc. of the operation terminal 13, thereby inputting information about the subject, monitoring results to be displayed on the monitor 131, etc., to the operation terminal 13. The operation terminal 13 accepts this information and transmits it to the operation state monitoring device 12 via the network. When accepting an operation by the user, the monitor 131 displays an input screen for information about the subject, a selection screen for monitoring results to be displayed on the monitor 131, etc., and after the operation state monitoring device 12 monitors the operation state of the subject, the monitor 131 displays the monitoring results received from the operation state monitoring device 12.

[0024] The measuring instruments 11_1-11_11 are attached to the parts 20_1-20_11, which are motion detection targets among various parts of the body of the subject P, respectively, and detect the motion of the parts 20_1-20_11 using motion sensors (hereinafter simply referred to as sensors) 111_1-111_11 including a gyro sensor, an acceleration sensor, etc. The measuring instruments 11_1-11_11 are associated with the parts 20_1-20_11, respectively, by a pairing process performed with the motion state monitoring device 12.

[0025] FIG. 2 is a diagram showing an example of target parts of the measuring devices 11_1 to 11_11 attached to the body of the subject P. In the example of FIG. 2, target parts 20_1 to 20_11 of the measuring devices 11_1 to 11_11 are the right upper arm, the right forearm, the head, the chest (trunk), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right lower leg, the left thigh, and the left lower leg, respectively. It is not necessary to attach all of the measuring devices 11_1 to 11_11 to the body of the subject P. It is sufficient that only the measuring devices necessary to measure the monitoring target motion (including the movement of the body part) that the user wants to monitor are attached to the body of the subject P among the measuring devices 11_1 to 11_11.

[0026] (Example of configuration of measuring instruments 11_1 to 11_11) 3 is a diagram showing an example of the configuration of measuring instrument 11_1. Note that the configurations of measuring instruments 11_2 to 11_11 are similar to that of measuring instrument 11_1, and therefore the description thereof will be omitted.

[0027] 3, the measuring device 11_1 has a sensor 111_1, an attachment pad 112_1, and a belt 113_1. The belt 113_1 is formed so as to be able to be wrapped around a motion detection target part of the subject P. The sensor 111_1 is incorporated in, for example, the attachment pad 112_1. The attachment pad 112_1 in which the sensor 111_1 is incorporated is formed so as to be able to be attached to and detached from the belt 113_1.

[0028] Fig. 4 is a diagram showing an example of how to attach the measuring device 11_1 to the subject P. In the example of Fig. 4, a belt 113_1 is wrapped around the right upper arm, which is one of the motion detection target parts of the subject P. After pairing, calibration, etc. are completed, the sensor 111_1 is attached to the belt 113_1 via the attachment pad 112_1.

[0029] In FIG. 1, the motion state monitoring device 12 outputs a calculation result indicating the motion state of the subject P based on the detection results (sensing values) of the sensors 111_1 to 111_11.

[0030] Specifically, the operation state monitoring device 12 includes a receiving unit 121, a calibration execution unit 122, a determination unit 123, a calculation processing unit 124, an output unit 125, and a control unit 126. The operation state monitoring device 12 may further include a registration unit that associates the sensors 111_1 to 111_11 with a plurality of body parts of the subject P by a pairing process and registers them.

[0031] The receiving unit 121 receives detection results of the sensors 111_1 to 111_11, receives information input to the operation terminal 13 by a user, and receives information on the positions and orientations of the sensors 111_1 to 111_11 during calibration. do.

[0032] The calibration execution unit 122 executes calibration of the sensors 111_1 to 111_11. However, the calibration execution unit 122 is not limited to the case of executing calibration of all the sensors 111_1 to 111_11, and may be configured to execute calibration only for the sensors attached to the body of the subject P among the sensors 111_1 to 111_11.

[0033] Calibration is, for example, a process of measuring an output value (error component) of a sensor used to measure a monitored operation in a stationary state and subtracting the error component from an actual measurement value. Here, the output value of the sensor is assumed to stabilize after a predetermined period (about 20 seconds) has elapsed since the sensor was made stationary. In this case, it is desirable that the output value of the sensor after the predetermined period has elapsed since the sensor was made stationary is used as the error component in the calibration. Therefore, in this example, the output value of the sensor after the predetermined period has elapsed since the user gave an instruction to start calibration after the sensor was stationary is used as the error component. In addition, "during calibration" refers to a processing period until the error component is determined, and "completed calibration" refers to the output value (error component) of the sensor in a stationary state being determined.

[0034] Here, in relative calibration between multiple sensors (i.e., a process of subtracting error components of the relative positions and relative angles between multiple sensors from actual measurements), the orientations of the multiple sensors need to be defined by a common coordinate system. Therefore, in relative calibration between multiple sensors, the orientations of the multiple sensors need to be known.

[0035] Therefore, the calibration execution unit 122 executes calibration of the sensors 111_1 to 111_11 in a state in which the sensors 111_1 to 111_11 are arranged in a known orientation by a predetermined arrangement mechanism.

[0036] An arrangement mechanism for arranging the multiple sensors to be calibrated in known orientations is provided, for example, in charging case 14. Fig. 5 is a schematic diagram showing the appearance of charging case 14. Note that in the example of Fig. 5, sensors 111_1 to 111_4 are shown as the multiple sensors to be calibrated.

[0037] As shown in FIG. 5, the charging case 14 has a housing 141, a plurality of storage pockets 142 formed on a side surface of the housing 141, a switch 143, and a charging cable 144. The plurality of storage pockets 142 are arranged in a line along the vertical direction (z-axis direction), and are formed to be able to store the sensors 111_1 to 111_11 with their respective upper surfaces facing a predetermined direction (x-axis direction). In the example of FIG. 5, the sensors 111_1 to 111_4 are stored in the four storage pockets 142 of the charging case 14, respectively. As a result, the orientations of the sensors 111_1 to 111_4 are the same, that is, in a known state. When the switch 143 is pressed by the user, the calibration execution unit 122 determines that the sensors 111_1 to 111_4 are arranged in a known orientation, and starts calibration of the sensors 111_1 to 111_4. At this time, the sensors 111_1 to 111_4 stored in the four storage pockets 142 of the charging case 14 are charged via the charging cables 144.

[0038] In the present embodiment, a case has been described in which a positioning mechanism for positioning a plurality of sensors to be calibrated in a known orientation is provided in charging case 14, but the present invention is not limited to this. The positioning mechanism may be provided in a case that does not have a charging function, instead of charging case 14.

[0039] Further, the arrangement mechanism for arranging the multiple sensors to be calibrated in a known orientation may be provided in a location other than the case such as the charging case, etc. Hereinafter, the description will be given with reference to Figs. 6 and 7.

[0040] Fig. 6 is a schematic diagram showing another example of an arrangement mechanism in which a plurality of sensors to be calibrated are arranged in a known orientation. In the example of Fig. 6, a pair of magnetically attracted parts Q is attached to both ends of each of the sensors 111_1 to 111_4. In other words, each of the sensors 111_1 to 111_4 has a pair of magnetically attracted parts Q as the arrangement mechanism. The sensors 111_1 to 111_4 are attracted to each other by their respective magnetically attracted parts Q, and are arranged so that their upper surfaces face the same direction. In other words, the orientations of the sensors 111_1 to 111_4 are in a known state.

[0041] FIG. 7 is a schematic diagram showing another example of an arrangement mechanism in which a plurality of sensors to be calibrated are arranged in a known direction. In the example of FIG. 7, a marker M is attached to each of the sensors 111_1 to 111_4 as an example of an identifier identifiable from the appearance. In this case, the operation state monitoring device 12 has a specification unit that captures the sensors 111_1 to 111_4 randomly arranged on a desk, for example, with a camera, and analyzes the marker M attached to each of the sensors 111_1 to 111_4 included in the captured image to specify the orientation of each of the sensors 111_1 to 111_4 as a known orientation. That is, in the example of FIG. 7, the arrangement mechanism (arrangement mechanism) in which a plurality of sensors to be calibrated are arranged in a known direction is realized by an identifier such as a marker assigned to each sensor and the above-mentioned specification unit. Note that the identifier identifiable from the appearance is not limited to the marker M, and may be a pattern, a QR code (registered trademark), or the like.

[0042] The determination unit 123 determines whether or not the calibration of the sensor attached to the subject P has been performed before the sensor is attached to the subject P. For example, the determination unit 123 determines that the calibration has been performed by receiving a notification of the completion of the calibration from the calibration execution unit 122. Then, the determination unit 123 determines whether or not the calibration of the sensor attached to the subject P has been performed before the sensor is attached to the subject P by comparing the time when the calibration of the sensor is completed with the time when the sensor is attached to the subject P.

[0043] The arithmetic processing unit 124 performs arithmetic processing based on the detection results of the respective sensors 111_1 to 111_11 that have been calibrated, and generates arithmetic results that indicate the motion state of the motion to be monitored of the subject P. Therefore, the arithmetic processing unit 124 can also be called a monitoring result generating unit that generates the monitoring results of the motion to be monitored of the subject P. The motion to be monitored includes, for example, right shoulder flexion and extension, right shoulder abduction and inward rotation, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and outward rotation, head flexion and extension, head rotation, thoracic and lumbar flexion and extension, thoracic and lumbar rotation, thoracic and lumbar lateral bending, left shoulder flexion and extension, left shoulder abduction and inward rotation, left elbow flexion and extension, left forearm pronation and outward rotation, and the like. The motion to be monitored also includes the movement of the part itself to which the sensor is attached. For example, the motion to be monitored includes the angle of the joints of the body of the subject P measured based on the detection results of multiple sensors, and the angle of the joints in an arbitrary coordinate system measured based on the detection results of any one of the sensors. Hereinafter, the generation of a calculation result representing the operation state of the monitored operation is also referred to as measurement of the monitored operation.

[0044] For example, the calculation processing unit 124 performs calculation processing based on the detection results of each of the sensors 111_1 to 111_11, that is, the sensor 111_1 attached to the right upper arm (part 20_1) and the sensor 111_2 attached to the right forearm (part 20_2), to generate a calculation result representing the movement state of the right elbow flexion and extension movement of the subject P.

[0045] Alternatively, the calculation processing unit 124 performs calculation processing based on the detection results of each of the sensors 111_1 to 111_11, that is, the sensor 111_5 attached to the waist (part 20_5) of the subject P and the sensor 111_8 attached to the right thigh (part 20_8), to generate a calculation result representing the movement state of the right side waist lateral bending movement of the subject P.

[0046] The arithmetic processing unit 124 may be configured not to generate a calculation result representing the motion state of the monitored motion of the subject P when the determination unit 123 determines that the calibration of the sensor attached to the subject P has not been performed before the sensor is attached to the subject P. Alternatively, the arithmetic processing unit 124 may be configured to notify an error when the determination unit 123 determines that the calibration of the sensor attached to the subject P has not been performed before the sensor is attached to the subject P.

[0047] The arithmetic processing unit 124 may perform arithmetic processing using a trained model generated by machine learning using past detection results of the sensor. By performing arithmetic processing using this trained model, the arithmetic processing unit 124 can more accurately calculate whether the motion state of the monitored motion of the subject P is good or not.

[0048] The output unit 125 outputs the calculation result by the calculation processing unit 124. The information (calculation result, error information) output from the output unit 125 is transferred to the operation terminal 13 via the network, visualized as a graph or the like, and then displayed on the monitor 131 of the operation terminal 13. This allows the user to know the motion state of the monitored motion of the subject P, which can be useful for, for example, assisting the subject P.

[0049] The control unit 126 displays an icon display area S1 and display setting areas A1 to A3 on the screen of the monitor 131 to allow the user to select the measurement result of the monitored action to be displayed on the monitor 131. The number of display setting areas is not limited to three, and may be one or more. The control unit 126 also displays, in the icon display area S1, measurement result icons representing the measurement result of the monitored action that can be displayed on the monitor 131. In other words, the control unit 126 displays measurement result icons representing the measurement result of the monitored action that can be obtained from a sensor attached to the subject P. The user can select a measurement result icon corresponding to the measurement result of the monitored action to be displayed on the monitor 131 from the measurement result icons displayed in the icon display area S1.

[0050] The receiving unit 121 accepts a setting operation by the user in any one of the display setting areas A1 to A3 for setting an area for displaying details of the measurement result for the measurement result icon displayed in the icon display area S1. For example, the user moves the measurement result icon displayed in the icon display area S1 to the display setting area A1. Specifically, the user drags and drops the measurement result icon displayed in the icon display area S1 into the display setting area A1 by a mouse operation, a touch operation, or the like. This causes the receiving unit 121 to accept a setting operation by the user in the display setting area A1 for setting an area for displaying details of the measurement result for the measurement result icon. As a result, details of the selected measurement result (for example, a graphed measurement result, etc.) are displayed in the display setting area A1.

[0051] In the present embodiment, the receiving unit 121 accepts a user's setting operation in the display setting area A1 for setting an area for displaying the details of a measurement result for one measurement result icon displayed in the icon display area S1, but is not limited thereto. The receiving unit 121 may further accept a user's setting operation in either of the display setting areas A2 and A3 for setting an area for displaying the details of a measurement result for another measurement result icon displayed in the icon display area S1. In this case, for example, the user moves one measurement result icon displayed in the icon display area S1 to the display setting area A1, and moves another measurement result icon displayed in the icon display area S1 to one of the display setting areas A2 and A3. As a result, the receiving unit 121 accepts a user's setting operation in the display setting area A1 for setting an area for displaying the details of a measurement result for one measurement result icon, and accepts a user's setting operation in either of the display setting areas A2 and A3 for setting an area for displaying the details of a measurement result for another measurement result icon. As a result, details of one selected measurement result are displayed in the display setting area A1, and details of another selected measurement result are displayed in either the display setting area A2 or A3.

[0052] In the present embodiment, the receiving unit 121 accepts a setting operation by the user in the display setting area A1 for setting an area for displaying details of a measurement result for one measurement result icon displayed in the icon display area S1, but is not limited thereto. The receiving unit 121 may accept a setting operation by the user in the display setting area A1 for setting an area for displaying details of a measurement result for another measurement result icon displayed in the icon display area S1. In this case, for example, the user moves two measurement result icons displayed in the icon display area S1 to the display setting area A1. Thereby, the receiving unit 121 accepts a setting operation by the user in the common display setting area A1 for setting an area for displaying details of the measurement result for the two measurement result icons. As a result, details of the two selected measurement results are displayed in the display setting area A1. For example, two graphed measurement results are superimposed and displayed in the display setting area A1.

[0053] Furthermore, the receiving unit 121 may accept a change operation to change the area displaying the measurement result corresponding to the measurement result icon from the display setting area A1 to either the display setting area A2 or A3 in response to, for example, the user moving (dragging and dropping) the measurement result icon from the display setting area A1 to either the display setting area A2 or A3. Furthermore, the measurement result icon set in the display setting area A1 can also be set simultaneously in either or both of the display setting areas A2 and A3.

[0054] (Operation of the operation status monitor 12) Next, the operation of the operation state monitoring device 12 will be described with reference to Fig. 8. Fig. 8 is a flow chart showing the operation of the operation state monitoring device 12.

[0055] First, the operation state monitoring device 12 performs a pairing process between the operation state monitoring device 12 and the measuring devices 11_1 to 11_11, thereby associating the measuring devices 11_1 to 11_11 with the parts 20_1 to 20_11 of the subject P (step S101).

[0056] Thereafter, the operational state monitoring device 12 calibrates the sensors 111_1 to 111_11 (step S102). During the calibration, the sensors 111_1 to 111_11 are arranged in known orientations, for example, by being stored in the charging case 14. This allows the operational state monitoring device 12 to define the orientations of the sensors 111_1 to 111_11 by a common coordinate system, and thus allows the sensors 111_1 to 111_11 to be calibrated relative to each other.

[0057] During calibration, the monitor 131 displays, for example, "Calibration in progress. Place the sensor on the desk and do not move it." When the calibration is completed, the monitor 131 displays, for example, "Calibration is complete. Please attach the sensor." Note that the fact that calibration is in progress or that calibration has been completed does not necessarily have to be displayed on the monitor 131, and may be notified by other notification methods, such as by audio. Also, the order of the calibration process and the pairing process may be reversed.

[0058] After the calibration is completed, the sensors are attached to the subject P (step S103). In this example, among the sensors 111_1 to 111_11, the sensors 111_1, 111_2, 111_5, and 111_8 are attached to the right upper arm (site 20_1), the right forearm (site 20_2), the waist (site 20_5), and the right thigh (site 20_8) of the subject P, respectively.

[0059] Thereafter, the motion state monitoring device 12 measures the motions to be monitored that can be measured using the sensor attached to the subject P, among the plurality of motions to be monitored (step S104).

[0060] Thereafter, the motion state monitoring device 12 outputs the measurement result (the calculation result indicating the motion state of the monitored motion of the subject P) (step S105).

[0061] Specifically, first, the operation state monitoring device 12 displays an icon display area S1 and display setting areas A1 to A3 on the screen of the monitor 131. The number of display setting areas is not limited to three, and may be one or more. In addition, the operation state monitoring device 12 displays a measurement result icon representing a measurement result of a monitored action that can be displayed on the monitor 131 in the icon display area S1. In other words, the operation state monitoring device 12 displays a measurement result icon representing a measurement result of a monitored action that can be obtained from a sensor attached to the subject P in the icon display area S1. The user can select a measurement result icon corresponding to the measurement result of a monitored action that the user wants to display on the monitor 131 from the measurement result icons displayed in the icon display area S1.

[0062] In the example of Fig. 9, an icon display area S1 is displayed on the left side of the screen of the monitor 131, and display setting areas A1 to A3 are displayed on the right side. In addition, in the icon display area S1, a measurement result icon T1 indicating the measurement result of "right shoulder abduction movement" obtainable from the sensor 111_1, a measurement result icon T2 indicating the measurement result of "right elbow flexion movement" obtainable from the sensors 111_1 and 111_2, and a measurement result icon T3 indicating "right waist lateral bending movement" obtainable from the sensors 111_5 and 111_8 are displayed. That is, in the example of Fig. 9, the user can select a measurement result icon corresponding to the measurement result of the monitoring target movement that the user wants to display on the monitor 131 from the three measurement result icons T1 to T3 displayed in the icon display area S1.

[0063] Thereafter, the operating status monitoring device 12 accepts a user's setting operation to one of the display setting areas A1 to A3 for setting an area for displaying details of the measurement results for the measurement result icons T1 to T3 displayed in the icon display area S1.

[0064] In the example of FIG. 10, the user drags and drops the measurement result icon T1, among the measurement result icons T1 to T3 displayed in the icon display area S1, into the display setting area A1 by a mouse operation, a touch operation, or the like. This causes the operation state monitoring device 12 to accept a setting operation by the user in the display setting area A1 for setting an area for displaying the details of the measurement result for the measurement result icon T1. As a result, as shown in the example of FIG. 11, the display setting area A1 displays the details of the measurement result corresponding to the measurement result icon T1 (for example, the measurement result in the form of a graph). Note that even if the measurement result icon T1 is displayed in the display setting area A1 by dragging and dropping, it continues to be displayed in the icon display area S1, but may be deleted from the icon display area S1 when it is displayed in the display setting area A1 by dragging and dropping.

[0065] In this manner, the motion state monitoring system 1 according to the present embodiment calibrates the multiple sensors used to monitor the monitored motions in a state in which the multiple sensors are arranged in a known orientation by being stored in the charging case 14 or the like. This allows the motion state monitoring system 1 according to the present embodiment to define the orientations of the multiple sensors using a common coordinate system, and therefore allows relative calibration between the multiple sensors. This allows the motion state monitoring system 1 according to the present embodiment to monitor the monitored motions of the subject with high accuracy.

[0066] Furthermore, in the present disclosure, a part or all of the processing of the operational state monitoring system 1 can be realized by causing a CPU (Central Processing Unit) to execute a computer program.

[0067] The above-mentioned program includes a set of instructions (or software code) for making the computer perform one or more functions described in the embodiment when the program is loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or the tangible storage medium includes a random-access memory (RAM), a read-only memory (ROM), a flash memory, a solid-state drive (SSD) or other memory technology, a CD-ROM, a digital versatile disc (DVD), a Blu-ray® disk or other optical disk storage, a magnetic cassette, a magnetic tape, a magnetic disk storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or the communication medium includes an electrical, optical, acoustic, or other form of propagating signal. [Explanation of symbols]

[0068] 1 Operation status monitoring system 11 Measuring Instruments 11_1~11_11 Measuring Instruments 12 Operation status monitoring device 13 Operation terminal 14 Charging case 20_1~20_11 Part 111_1~111_11 Sensor 112_1 Pad 113_1 Belt 121 Receiving unit 122 Calibration execution unit 123 Judgment section 124 Processing unit 125 Output section 126 Control Unit 131 Monitor 141 Case 142 Storage Pocket 143 Switch 144 Charging Cable A1~A3 Display setting area M Marker P Subject S1 Icon display area T1~T3 measurement result icon

Claims

1. A motion status monitoring system that monitors a designated monitoring target motion by two or more selected sensors from among a plurality of sensors associated with a plurality of body parts of a subject, a positioning mechanism for positioning the two or more sensors in a known orientation; a calibration execution unit that calibrates the two or more sensors that are arranged in a known orientation by the arrangement mechanism; a monitoring result generating unit that generates a monitoring result of the subject's monitored action based on a detection result by the two or more sensors attached to the subject after the calibration is completed; An operating condition monitoring system comprising:

2. In the arrangement mechanism, the two or more sensors are arranged so as to face a first direction. The operating condition monitoring system according to claim 1 .

3. the positioning mechanism is provided in a case in which the two or more sensors are stored so as to face the first direction; The operating condition monitoring system according to claim 2 .

4. The case is a charging case configured to be capable of charging the two or more sensors. The operating condition monitoring system according to claim 3 .

5. The apparatus further includes a registration unit that registers at least the two or more sensors in association with two or more parts of a plurality of parts of the subject's body. The operating condition monitoring system according to claim 1 .

6. A determination unit that determines whether or not the two or more sensors attached to the subject have been calibrated, the monitoring result generation unit does not generate a monitoring result of the subject's monitored action by the two or more sensors that have not been calibrated. The operating condition monitoring system according to claim 1 .

7. The apparatus further includes a notification unit that notifies an error when the determination unit determines that the calibration of the two or more sensors attached to the subject has not been performed. The operating condition monitoring system according to claim 6.

8. Each of the two or more sensors has a magnetic attraction portion as the arrangement mechanism, The two or more sensors are arranged so as to face the first direction by being attracted to each other by the respective magnetic attraction portions. The operating condition monitoring system according to claim 2 .

9. The arrangement mechanism includes: An identifier assigned to each of the two or more sensors and identifiable from appearance; An identification unit that identifies the orientation of the two or more sensors as the known orientation by analyzing an identifier assigned to each of the two or more sensors included in an image captured by the two or more sensors; having The operating condition monitoring system according to claim 1 .

10. A control method for a motion status monitoring system that monitors a designated monitoring target motion by two or more selected sensors from among a plurality of sensors associated with a plurality of body parts of a subject, comprising: calibrating the two or more sensors positioned at known orientations by a positioning mechanism; generating a monitoring result of the monitored motion of the subject based on detection results by the two or more sensors attached to the subject after the calibration is completed; A method for controlling an operational status monitoring system.

11. A control program for causing a computer to execute a control process in a motion monitoring system for monitoring a designated monitoring target motion by two or more selected sensors among a plurality of sensors associated with a plurality of body parts of a subject, the control program comprising: calibrating the two or more sensors positioned at known orientations by a positioning mechanism; generating a monitoring result of the monitored motion of the subject based on detection results by the two or more sensors attached to the subject after the calibration is completed; A control program that causes a computer to execute the above.

Images