Operation state monitoring system, control method therefor, and control program product

Abstract

The invention provides an operation state monitoring system, a control method therefor, and a control program product. A motion state monitoring system according to the present disclosure monitors a specified motion of a subject to be monitored by means of two or more selected sensors among a plurality of sensors associated with each of a plurality of parts of the body of a subject, and is provided with: an arrangement mechanism that arranges the two or more sensors in a known orientation; a calibration execution unit that executes calibration of two or more sensors arranged in a known orientation by the arrangement mechanism; and a monitoring result generation unit that generates a monitoring result of the motion of the object to be monitored by the subject on the basis of the detection results of the two or more sensors worn on the subject after the calibration has been completed.

Description

Technical Field

[0001] The present invention relates to an action state monitoring system, a control method and a control program thereof. Background Art

[0002] Patent Document 1 discloses an operation state monitoring system that monitors the operation state of a subject based on detection results of a plurality of sensors respectively worn at a plurality of locations on the subject's body. Patent Document 1 also discloses calibration of the plurality of sensors.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2022-34448 Summary of the invention

[0004] In an action state monitoring system that monitors the action state of a subject as in the related art, in order to monitor the subject's monitoring target action with high accuracy, it is required to calibrate a plurality of sensors for monitoring the subject's monitoring target action with high accuracy.

[0005] The present disclosure has been made in view of the above background, and an object of the present disclosure is to provide an operation state monitoring system, a control method thereof, and a control program that can monitor the operation state of a subject with high accuracy.

[0006] The motion state monitoring system involved in the present disclosure monitors the specified monitoring object motion by selecting two or more sensors from among a plurality of sensors that respectively establish correspondences with a plurality of parts of the body of the subject, and comprises: a configuration mechanism that configures the two or more sensors in a known orientation; a calibration execution unit that performs calibration of the two or more sensors configured in a known orientation by the configuration mechanism; and a monitoring result generation unit that generates a monitoring result of the monitoring object motion of the subject based on the detection results of the two or more sensors worn on the subject after the calibration is completed. The motion state monitoring system performs calibration of the plurality of sensors used to monitor the monitoring object motion of the subject in a state where the plurality of sensors used to monitor the monitoring object motion of the subject are configured in a known orientation by a configuration mechanism such as a charging box, so that the orientations of the plurality of sensors can be specified by a common coordinate system, and therefore, relative calibration between the plurality of sensors can be performed. Thus, the motion state monitoring system can monitor the monitoring object motion of the subject with high precision. In addition, the motion state monitoring system can perform calculation processing using a learned model, so as to more accurately calculate whether the motion state of the monitoring object motion of the subject is good.

[0007] The following manner may also be adopted, that is, in the configuration mechanism, the two or more sensors are configured to face the first direction.

[0008] The following embodiment may also be adopted, that is, the configuration mechanism is a box that accommodates the two or more sensors in a manner that they are all oriented toward the first direction.

[0009] The following aspect may also be adopted, that is, the box is a charging box configured to be able to charge the two or more sensors.

[0010] The following aspect may be adopted, that is, further comprising a registration unit that registers the two or more sensors in correspondence with at least two or more sites among the plurality of sites of the subject's body.

[0011] The following method can also be adopted, that is, there is also a judgment unit, which judges whether calibration of the two or more sensors worn on the subject has been performed, and the monitoring result generating unit does not generate monitoring results of the monitored object action of the subject based on the two or more sensors for which the calibration has not been performed.

[0012] The present invention may further include a notification unit configured to notify an error when the determination unit determines that the calibration of the two or more sensors worn by the subject has not been performed.

[0013] The following manner may also be adopted, that is, the two or more sensors each have a magnetic adsorption portion as the configuration mechanism, and the two or more sensors are mutually adsorbed by the respective magnetic adsorption portions, so as to be configured to face the first direction.

[0014] The following method can also be adopted, namely, the configuration mechanism has: an identifier, which is assigned to each of the two or more sensors and can be identified from the appearance; and a determination unit, which determines the orientation of the two or more sensors as the known orientation by parsing the identifiers respectively assigned to the two or more sensors contained in the images obtained by shooting the two or more sensors.

[0015] The control method of the motion state monitoring system involved in the present disclosure is a control method of the motion state monitoring system that monitors the specified monitoring object movement by selecting two or more sensors from a plurality of sensors that respectively establish correspondences with a plurality of parts of the body of the subject, wherein calibration of the two or more sensors configured in a known orientation by a configuration mechanism is performed, and a monitoring result of the monitoring object movement of the subject is generated based on the detection results of the two or more sensors worn on the subject after the calibration is completed. The control method of the motion state monitoring system performs calibration of the plurality of sensors used to monitor the monitoring object movement of the subject in a state where the plurality of sensors are configured in a known orientation by a configuration mechanism such as a charging box, so that the orientations of the plurality of sensors can be specified by a common coordinate system, and therefore, relative calibration between the plurality of sensors can be performed. As a result, the control method of the motion state monitoring system can monitor the monitoring object movement of the subject with high precision.

[0016] The control program involved in the present disclosure enables a computer to perform control processing in an action state monitoring system, wherein the action state monitoring system monitors the specified monitoring object action through two or more sensors selected from multiple sensors that have established corresponding relationships with multiple parts of the subject's body, wherein the control program enables the computer to perform the following processing, namely: performing calibration processing of the two or more sensors configured in a known orientation by a configuration mechanism; and generating a monitoring result of the monitoring object action of the subject based on the detection results of the two or more sensors worn on the subject after the calibration. The control program performs calibration of the multiple sensors used to monitor the monitoring object action of the subject in a state where the multiple sensors are configured in a known orientation by a configuration mechanism such as a charging box, so that the orientation of the multiple sensors can be specified by a common coordinate system, and therefore, relative calibration between the multiple sensors can be performed. As a result, the action state monitoring system can monitor the monitoring object action of the subject with high accuracy.

[0017] According to the present disclosure, it is possible to provide an action state monitoring system capable of monitoring the action state of a subject with high accuracy, a control method thereof, and a control program.

[0018] The above and other objects, features and advantages of the present disclosure will be more fully understood from the detailed description and accompanying drawings given below. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a block diagram showing a configuration example of the operation state monitoring system according to the first embodiment.

[0020] Figure 2This is a diagram showing an example of a wearing target part of a measuring instrument worn by a subject.

[0021] Figure 3 It is a diagram showing a configuration example of a measuring instrument provided in the operation state monitoring system according to the first embodiment.

[0022] Figure 4 To express Figure 3 The diagram shows an example of how the measuring instrument is worn by a subject.

[0023] Figure 5 It is a schematic diagram showing the appearance of a charging box provided in the operation status monitoring system according to the first embodiment.

[0024] Figure 6 This is a schematic diagram showing another example of a configuration mechanism for configuring a plurality of sensors of a calibration object in a known orientation.

[0025] Figure 7 This is a schematic diagram showing another example of a configuration mechanism for configuring a plurality of sensors of a calibration object in a known orientation.

[0026] Figure 8 This is a flowchart showing the operation of the operation state monitoring device provided in the operation state monitoring system according to the first embodiment.

[0027] Fig. 9 A diagram showing an example of display content of a monitor.

[0028] Fig.10 A diagram showing an example of display content of a monitor.

[0029] Fig.11 A diagram showing an example of display content of a monitor. DETAILED DESCRIPTION

[0030] The present invention is described below by way of the embodiments, but the present invention is not limited to the following embodiments. In addition, the structures described in the embodiments are not all necessary technical means for solving the problems. For the purpose of clear description, the following description and the accompanying drawings are appropriately omitted and simplified. In each of the accompanying drawings, the same symbols are marked for the same elements, and repeated descriptions are omitted as needed.

[0031] <Implementation method 1>

[0032] Figure 1The block diagram shows a structural example of the motion state monitoring system 1 involved in the first embodiment. The motion state monitoring system 1 is a system for monitoring the motion state of the subject. Based on the monitoring result, a user such as a caregiver can implement support for making the motion of the subject closer to the desired motion. The following is a specific description.

[0033] like Figure 1 As shown, the operation status monitoring system 1 includes a plurality of measuring instruments 11, an operation status monitoring device 12, an operation terminal 13, and a charging box 14. The operation status monitoring device 12 can also be referred to as an operation status monitoring system as a single unit. The operation status monitoring device 12, the plurality of measuring instruments 11, and the operation terminal 13 are configured to be able to communicate with each other via a wired or wireless network. In addition, in this embodiment, the case where 11 measuring instruments 11 are set is described as an example. In the following, the 11 measuring instruments 11 are distinguished, and are also referred to as measuring instruments 11_1 to 11_11.

[0034] The operation terminal 13 is a communicative terminal owned by a user or temporarily allocated to a user, such as a PC (Personal Computer) terminal, a portable terminal such as a smart phone or a tablet terminal, or a dedicated communication terminal prepared for this system, etc. In addition, although in this embodiment, the operation terminal 13 and the operation status monitoring device 12 are separately provided as an example for explanation, it is not limited to this, and the operation terminal 13 and the operation status monitoring device 12 can also be formed integrally.

[0035] For example, the user operates the monitor 131 of the operation terminal 13 by touching with a touch pen or a finger, or operates the mouse or keyboard of the operation terminal 13, thereby inputting information related to the subject, monitoring results to be displayed on the monitor 131, etc. to the operation terminal 13. The operation terminal 13 receives this information and sends it to the action state monitoring device 12 via the network. When receiving the user's operation, the monitor 131 displays an input screen for information related to the subject, a selection screen for monitoring results to be displayed on the monitor 131, etc., or, after the action state monitoring device 12 monitors the action state of the subject, it displays the monitoring results received from the action state monitoring device 12.

[0036] The measuring instruments 11_1 to 11_11 are respectively worn at the parts 20_1 to 20_11 of the motion detection target among various parts of the body of the subject P, and the motion of the parts 20_1 to 20_11 is detected using motion sensors (hereinafter referred to as sensors) 111_1 to 111_11 composed of gyro sensors and acceleration sensors. In addition, the measuring instruments 11_1 to 11_11 are respectively associated with the parts 20_1 to 20_11 by pairing processing performed between the measuring instruments 11_1 to 11_11 and the motion state monitoring device 12.

[0037] Figure 2 FIG. 1 is a diagram showing an example of the wearing target parts of the measuring instruments 11_1 to 11_11 worn on the body of the subject P. Figure 2 In the example of FIG. 1 , the wearing object parts 20_1 to 20_11 of the measuring instruments 11_1 to 11_11 are respectively the right upper arm, the right forearm, the head, the chest (trunk), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right calf, the left thigh, and the left calf. In addition, it is not necessary to wear all the measuring instruments 11_1 to 11_11 on the body of the subject P. Only the measuring instruments required for measuring the monitoring object action (including the movement of the part) that the user wants to monitor among the measuring instruments 11_1 to 11_11 are worn on the body of the subject P.

[0038] (Configuration Example of Measuring Instruments 11_1 to 11_11)

[0039] Figure 3 1 is a diagram showing a configuration example of the measuring device 11_1. Since the configurations of the measuring devices 11_2 to 11_11 are the same as those of the measuring device 11_1, the description thereof will be omitted.

[0040] like Figure 3 As shown, the measuring instrument 11_1 includes a sensor 111_1, a wearing pad 112_1, and a belt 113_1. The belt 113_1 is formed so as to be able to be wrapped around the motion detection target part of the subject P. The sensor 111_1 is assembled to the wearing pad 112_1, for example. The wearing pad 112_1 assembled with the sensor 111_1 is formed on the belt 113_1 in a detachable manner.

[0041] Figure 4 FIG. 1 is a diagram showing an example of a method of wearing the measuring instrument 11_1 on the subject P. Figure 4 In the example of FIG. 1 , the band 113_1 is wrapped around the right upper arm, which is one of the target parts for motion detection of the subject P. After pairing and calibration, etc., the sensor 111_1 is attached to the band 113_1 via the wearing pad 112_1 .

[0042] exist Figure 1In the embodiment, the motion state monitoring device 12 outputs a calculation result indicating the motion state of the subject P based on the detection results (detection values) of the sensors 111_1 to 111_11.

[0043] Specifically, the motion state monitoring device 12 includes a receiving unit 121, a calibration execution unit 122, a determination unit 123, a calculation processing unit 124, an output unit 125, and a control unit 126. The motion state monitoring device 12 may further include a registration unit that registers the sensors 111_1 to 111_11 with a plurality of parts of the body of the subject P by pairing processing.

[0044] The receiving unit 121 receives detection results of the sensors 111_1 to 111_11 , or receives information inputted into the operation terminal 13 by a user, or receives information on the positions and orientations of the sensors 111_1 to 111_11 during calibration.

[0045] The calibration execution unit 122 executes calibration of the sensors 111_1 to 111_11. However, the calibration execution unit 122 is not limited to executing calibration of all the sensors 111_1 to 111_11, and may be configured to execute calibration only for the sensors 111_1 to 111_11 that are worn on the body of the subject P.

[0046] Calibration refers to, for example, measuring the output value (error component) of a sensor in a stationary state used in the measurement of the movement of the monitored object, and subtracting the error component from the measured value. Here, the output value of the sensor is set to be stable after a predetermined period (about 20 seconds) has passed since the sensor was stationary. In this case, it is preferred that, in calibration, the output value of the sensor after a predetermined period has passed since the sensor was stationary is used as the error component. Therefore, in this example, the output value of the sensor after a predetermined period has passed since the user gave an instruction to start calibration after the sensor was stationary is used as the error component. In addition, calibration refers to the processing period until the error component is determined, and calibration completion refers to the situation where the output value (error component) of the sensor in a stationary state has been determined.

[0047] Here, in the relative calibration between multiple sensors (i.e., the process of subtracting the error components of the relative positions or relative angles between multiple sensors from the measured values), the orientations of the multiple sensors need to be specified by a common coordinate system. Therefore, in the relative calibration between multiple sensors, the orientations of the multiple sensors need to be known.

[0048] Therefore, the calibration execution unit 122 executes the calibration of the sensors 111_1 to 111_11 in a state where the sensors 111_1 to 111_11 are arranged in a known orientation by a predetermined arrangement mechanism.

[0049] An arrangement mechanism for arranging the plurality of sensors of the calibration object in a known orientation is provided on the charging box 14 , for example. Figure 5 1 is a schematic diagram showing the appearance of the charging box 14. Figure 5 In the example of FIG. 1 , sensors 111_1 to 111_4 are shown as a plurality of sensors to be calibrated.

[0050] like Figure 5 As shown, the charging box 14 has a shell 141, a plurality of storage bags 142 formed on the side of the shell 141, a switch 143, and a charging cable 144. The plurality of storage bags 142 are arranged in a vertical direction (z-axis direction) and are formed to be able to store the sensors 111_1 to 111_11 with their respective upper surfaces facing a predetermined direction (x-axis direction). Figure 5 In the example, sensors 111_1 to 111_4 are respectively stored in the four storage bags 142 of the charging box 14. As a result, the orientations of the sensors 111_1 to 111_4 are the same, that is, they are in a known state. When the user presses the switch 143, the calibration execution unit 122 determines that the sensors 111_1 to 111_4 are configured in a known orientation and starts the calibration of the sensors 111_1 to 111_4. In addition, at this time, the sensors 111_1 to 111_4 respectively stored in the four storage bags 142 of the charging box 14 are charged via the charging cable 144.

[0051] In this embodiment, the arrangement mechanism for arranging the plurality of sensors to be calibrated in a known orientation is provided on the charging box 14 , but the present invention is not limited thereto. The arrangement mechanism may be provided on a box without a charging function instead of the charging box 14 .

[0052] In addition, the configuration mechanism for arranging the multiple sensors of the calibration object in a known orientation may also be provided outside the box such as the charging box. Figure 6 as well as Figure 7 , for explanation.

[0053] Figure 6 Schematic diagram showing another example of a configuration mechanism for configuring a plurality of sensors of a calibration object in a known orientation. Figure 6 In the example, a pair of magnetic adsorption parts Q are installed at both ends of each sensor 111_1 to 111_4. In other words, each sensor 111_1 to 111_4 has a pair of magnetic adsorption parts Q as the configuration mechanism. The sensors 111_1 to 111_4 are mutually adsorbed by their respective magnetic adsorption parts Q, so that their upper surfaces are configured to face the same direction. In other words, the orientation of the sensors 111_1 to 111_4 becomes known.

[0054] Figure 7 Schematic diagram showing another example of a configuration mechanism for configuring a plurality of sensors of a calibration object in a known orientation. Figure 7 In the example, a mark M as an example of an identifier that can be identified from the appearance is attached to each sensor 111_1 to 111_4. In this case, the action state monitoring device 12 has a determination unit, which, for example, uses a camera to photograph the sensors 111_1 to 111_4 randomly arranged on the table, and analyzes the marks M attached to each sensor 111_1 to 111_4 contained in the photographed image, thereby determining the orientation of each sensor 111_1 to 111_4 as a known orientation. That is, in Figure 7 In the example, the configuration mechanism (configuration mechanism) for configuring the multiple sensors of the calibration object in a known orientation is implemented by an identifier such as a mark assigned to each sensor and the above-mentioned determination unit. In addition, the identifier that can be recognized from the appearance is not limited to the mark M, and can also be a pattern or a QR code (QRCode, a registered trademark) and the like.

[0055] The judgment unit 123 judges whether the calibration of the sensor worn by the subject P has been completed before the subject P wears the sensor. For example, the judgment unit 123 judges that the calibration has been completed by receiving the completion notification from the calibration execution unit 122. Then, the judgment unit 123 compares the time when the calibration of the sensor is completed and the time when the sensor is worn on the subject P, and judges whether the calibration of the sensor worn on the subject P has been completed before the subject P wears the sensor.

[0056] The calculation processing unit 124 performs calculation processing based on the detection results of each of the sensors 111_1 to 111_11 that have been calibrated, and generates a calculation result representing the motion state of the monitored motion of the subject P. Therefore, the calculation processing unit 124 can also be called a monitoring result generating unit that generates the monitoring result of the monitored motion of the subject P. The monitored motion includes, for example, right shoulder flexion and extension, right shoulder adduction and abduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and supination, head flexion and extension, head rotation, thoracolumbar flexion and extension, thoracolumbar rotation, thoracolumbar lateral flexion, left shoulder flexion and extension, left shoulder adduction and abduction, left shoulder internal and external rotation, left elbow flexion and extension, left forearm pronation and supination, and the like. In addition, the monitored motion also includes the movement of the part where the sensor is worn. For example, the monitored motion also includes the angles of the joints of the body of the subject P measured based on the detection results of multiple sensors, the angles of the joints in an arbitrary coordinate system measured based on the detection results of an arbitrary sensor, and the like. Hereinafter, generation of a calculation result indicating the operation state of the monitored operation is also referred to as measurement of the monitored operation.

[0057] For example, the calculation processing unit 124 performs calculation processing based on the detection results of sensor 111_1 worn on the right upper arm (part 20_1) of the subject P and sensor 111_2 worn on the right forearm (part 20_2) among the sensors 111_1 to 111_11, and generates a calculation result representing the action state of the right elbow flexion and extension movement of the subject P.

[0058] Alternatively, the calculation processing unit 124 performs calculation processing based on the detection results of sensor 111_5 worn at the waist (part 20_5) of the subject P and sensor 111_8 worn at the right thigh (part 20_8) among the sensors 111_1 to 111_11, and generates a calculation result representing the movement state of the right side lumbar lateral flexion movement of the subject P.

[0059] In addition, the calculation processing unit 124 may be configured not to generate a calculation result indicating the motion state of the monitored motion of the subject P, when the determination unit 123 determines that the calibration of the sensor worn by the subject P has not been performed before the subject P wears the sensor. Alternatively, the calculation processing unit 124 may be configured to notify an error, when the determination unit 123 determines that the calibration of the sensor worn by the subject P has not been performed before the subject P wears the sensor.

[0060] In addition, the calculation processing unit 124 may also perform calculation processing using a learned model generated by machine learning using past sensor detection results. The calculation processing unit 124 can perform calculation processing using the learned model to more accurately calculate whether the movement state of the monitored movement of the subject P is good.

[0061] The output unit 125 outputs the calculation result calculated by the calculation processing unit 124. The information (calculation result, error information) output from the output unit 125 is transmitted to the operation terminal 13 via the network, and is displayed on the monitor 131 of the operation terminal 13 after being visualized in the form of a graph or the like. Thus, the user can understand the motion state of the monitored motion of the subject P, and can contribute to the care of the subject P, for example.

[0062] In order to allow the user to select the measurement result of the monitored action that the monitor 131 wants to display, the control unit 126 causes the screen of the monitor 131 to display the icon display area S1 and the display setting areas A1 to A3. In addition, the number of display setting areas is not limited to three, as long as it is one or more. In addition, the control unit 126 causes the icon display area S1 to display the measurement result icon indicating the measurement result of the monitored action that can be displayed on the monitor 131. In other words, the control unit 126 causes the measurement result icon indicating the measurement result of the monitored action that can be obtained from the sensor worn on the subject P to be displayed. The user can select the measurement result icon corresponding to the measurement result of the monitored action that the monitor 131 wants to display from the measurement result icons displayed on the icon display area S1.

[0063] The receiving unit 121 receives a setting action performed by the user on any one of the display setting areas A1 to A3 for setting an area for displaying details of the measurement result, with respect to the measurement result icon displayed on the icon display area S1. For example, the user moves the measurement result icon displayed on the icon display area S1 to the display setting area A1. Specifically, the user drags and drops the measurement result icon displayed on the icon display area S1 to the display setting area A1 by a mouse operation or a touch operation. Thus, the receiving unit 121 receives the following setting action performed by the user, that is, setting the measurement result icon to the display setting area A1 in order to set the area for displaying details of the measurement result. As a result, the details of the selected measurement result (for example, a graphical measurement result, etc.) are displayed on the display setting area A1.

[0064] In addition, in the present embodiment, the case where the receiving unit 121 receives the setting action of the user to set the area for displaying the details of the measurement result to the display setting area A1 for one of the measurement result icons displayed on the icon display area S1 is described as an example, but the present invention is not limited to this. The receiving unit 121 may further receive the following setting action performed by the user, that is, to set the area for displaying the details of the measurement result to any one of the display setting areas A2 and A3 for another measurement result icon displayed on the icon display area S1. In this case, for example, the user moves one of the measurement result icons displayed on the icon display area S1 to the display setting area A1, and moves another measurement result icon displayed on the icon display area S1 to any one of the display setting areas A2 and A3. Thus, the receiving unit 121 receives the following setting operation performed by the user, that is, for a certain measurement result icon, the area for setting the display details of the measurement result is set to the display setting area A1, and for another measurement result icon, the area for setting the display details of the measurement result is set to any one of the display setting areas A2 and A3. As a result, the details of the selected measurement result are displayed in the display setting area A1, and the details of the selected other measurement result are displayed in any one of the display setting areas A2 and A3.

[0065] In addition, in the present embodiment, the case where the receiving unit 121 receives a setting action of the user setting a certain measurement result icon displayed on the icon display area S1 to the display setting area A1 in order to set the area for displaying the details of the measurement result, is described as an example, but the present invention is not limited to this. The receiving unit 121 may also receive a setting action of the user setting another measurement result icon displayed on the icon display area S1 to the display setting area A1 in order to set the area for displaying the details of the measurement result. In this case, for example, the user moves two measurement result icons displayed on the icon display area S1 to the display setting area A1. Thus, the receiving unit 121 receives the following setting action performed by the user, that is, for the two measurement result icons, the areas are set to the common display setting area A1 in order to set the areas for displaying the details of the measurement results. As a result, the details of the two selected measurement results are displayed on the display setting area A1. For example, two graphical measurement results are displayed overlappingly on the display setting area A1.

[0066] Furthermore, the receiving unit 121 may also receive a change action such as changing the area displaying the measurement result corresponding to the measurement result icon from the display setting area A1 to any one of the display setting areas A2 and A3 in response to, for example, the user moving (dragging and dropping) the measurement result icon from the display setting area A1 to any one of the display setting areas A2 and A3. Furthermore, the measurement result icon set to the display setting area A1 may also be set to any one of the display setting areas A2 and A3 or both at the same time.

[0067] (Operation of the Operation Status Monitoring Device 12)

[0068] Next, use Figure 8 , the operation of the operation status monitoring device 12 is explained. Figure 8 1 is a flowchart showing the operation of the operation state monitoring device 12.

[0069] First, the operation state monitoring device 12 performs pairing processing between the operation state monitoring device 12 and the measuring devices 11_1 to 11_11, thereby establishing a correspondence relationship between the measuring devices 11_1 to 11_11 and the parts 20_1 to 20_11 of the subject P (step S101).

[0070] Thereafter, the operation status monitoring device 12 performs calibration of the sensors 111_1 to 111_11 (step S102). Here, during calibration, the sensors 111_1 to 111_11 are arranged in a known orientation by, for example, being stored in the charging box 14. Thus, the operation status monitoring device 12 can define the orientation of the sensors 111_1 to 111_11 by a common coordinate system, and thus can perform relative calibration between the sensors 111_1 to 111_11.

[0071] During calibration, for example, "Calibrating. Please place the sensor on the table without moving." is displayed on the monitor 131. When calibration is completed, "Calibration completed. Please wear the sensor." is displayed on the monitor 131. In addition, the situation of calibration being in progress and the situation of calibration completion are not limited to the situation of being displayed on the monitor 131, and other notification methods such as voice notification can also be used to notify. In addition, the order of the calibration process and the pairing process can also be reversed.

[0072] After the calibration is completed, the sensor is worn on the subject P (step S103). In this example, sensors 111_1, 111_2, 111_5, and 111_8 of sensors 111_1 to 111_11 are worn on the right upper arm (part 20_1), right forearm (part 20_2), waist (part 20_5), and right thigh (part 20_8) of the subject P, respectively.

[0073] Thereafter, the motion state monitoring device 12 performs measurement of the monitoring target motion that can be measured using the sensor worn by the subject P among the plurality of monitoring target motions (step S104 ).

[0074] Thereafter, the motion state monitoring device 12 outputs the measurement result (the calculation result indicating the motion state of the monitored motion of the subject P) (step S105).

[0075] Specifically, first, the action state monitoring device 12 causes the screen of the monitor 131 to display the icon display area S1 and the display setting areas A1 to A3. In addition, the number of display setting areas is not limited to three, and it only needs to be one or more. In addition, the action state monitoring device 12 causes the icon display area S1 to display a measurement result icon indicating the measurement result of the monitored action that can be displayed on the monitor 131. In other words, the action state monitoring device 12 causes the icon display area S1 to display a measurement result icon indicating the measurement result of the monitored action that can be obtained from the sensor worn by the subject P. The user can select a measurement result icon corresponding to the measurement result of the monitored action that he wants to be displayed on the monitor 131 from the measurement result icons displayed on the icon display area S1.

[0076] exist Fig. 9 In the example, an icon display area S1 is displayed on the left side of the screen of the monitor 131, and display setting areas A1 to A3 are displayed on the right side. In addition, the icon display area S1 displays: a measurement result icon T1 indicating the measurement result of the "right shoulder adduction and abduction movement" that can be obtained from the sensor 111_1; a measurement result icon T2 indicating the measurement result of the "right elbow flexion and extension movement" that can be obtained from the sensors 111_1 and 111_2; and a measurement result icon T3 indicating the "right side waist lateral flexion movement" that can be obtained from the sensors 111_5 and 111_8. That is, in the Fig. 9 In the example of , the user can select a measurement result icon corresponding to the measurement result of the monitoring target action that the user wants to display on the monitor 131 , among the three measurement result icons T1 to T3 displayed in the icon display area S1 .

[0077] Thereafter, the operating state monitoring device 12 accepts a setting operation by the user on any one of the display setting areas A1 to A3 for setting an area for displaying details of the measurement result, with respect to the measurement result icons T1 to T3 displayed on the icon display area S1 .

[0078] exist Fig.10In the example of , the user drags and drops the measurement result icon T2 among the measurement result icons T1 to T3 displayed on the icon display area S1 to the display setting area A1 by mouse operation or touch operation. Thus, the operation state monitoring device 12 accepts the user's setting operation for setting the measurement result icon T2 to the display setting area A1 in order to set the area for displaying the details of the measurement result. As a result, Fig.11 As shown in the example of , the details of the measurement result corresponding to the measurement result icon T2 (for example, a graphical measurement result) are displayed on the display setting area A1. In addition, although the measurement result icon T2 continues to be displayed on the icon display area S1 even when it is displayed on the display setting area A1 by dragging and dropping, it can also be set to be deleted from the icon display area S1 as it is displayed on the display setting area A1 by dragging and dropping.

[0079] In this way, the motion state monitoring system 1 according to the present embodiment performs calibration of the plurality of sensors when the plurality of sensors for monitoring the motion of the monitored object are arranged in a known orientation by being stored in the charging box 14 or the like. Thus, the motion state monitoring system 1 according to the present embodiment can define the orientations of the plurality of sensors by a common coordinate system, and thus can perform relative calibration between the plurality of sensors. Thus, the motion state monitoring system 1 according to the present embodiment can monitor the motion of the monitored object of the subject with high precision.

[0080] In addition, the present disclosure can realize a part or all of the processing of the operation state monitoring system 1 by causing a CPU (Central Processing Unit) to execute a computer program.

[0081] The above-mentioned program is included in the command group (or software code) for making the computer perform one or more functions described in the embodiment when being read by the computer. The program can also be stored in a non-temporary computer-readable medium or a tangible storage medium. As a non-limiting example, the computer-readable medium or the tangible storage medium includes a random access memory (random-access memory (RAM)), a read-only memory (read-only memory (ROM)), a flash memory, a solid-state drive (solid-state drive (SSD)) or other memory technology, a read-only compact disk (CD-ROM), a digital versatile disc (digital versatile disc (DVD)), a Blu-ray (Blu-ray (registered trademark)) optical disk or other optical storage, a cassette, a magnetic tape, a magnetic disk storage or other magnetic storage device. The program can also be sent on a temporary computer-readable medium or a communication medium. As a non-limiting example, a temporary computer-readable medium or a communication medium includes an electrical, optical, acoustic or other form of transmission signal.

[0082] According to the disclosure described in this way, it is obvious that the embodiments of the present disclosure can be changed in many ways. Such changes should not be regarded as departing from the spirit and scope of the present disclosure, and, for those skilled in the art, all such modifications are obvious and are included in the scope of the technical solution.

Claims

1. A motion state monitoring system, which monitors a designated monitoring target motion by using two or more sensors selected from a plurality of sensors corresponding to a plurality of parts of a subject's body, and comprises: a configuration mechanism for configuring the two or more sensors into a known orientation; a calibration execution unit that executes calibration of the two or more sensors arranged in a known orientation by the arrangement mechanism; A monitoring result generating unit generates a monitoring result of the monitored action of the subject based on the detection results of the two or more sensors worn on the subject after the calibration is completed.

2. The operating status monitoring system according to claim 1, wherein: In the configuration mechanism, the two or more sensors are configured to face a first direction.

3. The operating state monitoring system according to claim 2, wherein: The configuration mechanism is provided on a box that accommodates the two or more sensors so that they are all oriented in the first direction.

4. The operating state monitoring system according to claim 3, wherein: The box is a charging box configured to be able to charge the two or more sensors.

5. The operating status monitoring system according to claim 1, wherein: The apparatus further includes a registration unit that registers the two or more sensors in correspondence with at least two or more sites among the plurality of sites of the subject's body.

6. The operating state monitoring system according to claim 1, wherein: The apparatus further comprises a determination unit configured to determine whether calibration of the two or more sensors worn by the subject has been performed. The monitoring result generating unit does not generate a monitoring result of the monitored action of the subject based on the two or more sensors for which the calibration has not been performed.

7. The operating status monitoring system according to claim 6, wherein: The apparatus further includes a notification unit configured to notify an error when the determination unit determines that the calibration of the two or more sensors worn on the subject has not been performed.

8. The operating status monitoring system according to claim 2, wherein: The two or more sensors each have a magnetic adsorption portion as the configuration mechanism, The two or more sensors are attracted to each other by the respective magnetic attraction parts, and are arranged to face the first direction.

9. The operating state monitoring system according to claim 1, wherein: The configuration mechanism has: an identifier which is assigned to each of the two or more sensors and can be identified from the appearance; The specifying unit specifies the orientations of the two or more sensors as the known orientations by analyzing identifiers respectively assigned to the two or more sensors and included in images obtained by imaging the two or more sensors.

10. A control method for an action status monitoring system, wherein: The motion state monitoring system monitors the designated monitoring object motion by selecting two or more sensors from among a plurality of sensors that respectively establish correspondences with a plurality of parts of the subject's body. In the control method, performing calibration of the two or more sensors arranged in a known orientation by the arrangement mechanism, Based on the detection results of the two or more sensors worn on the subject after the calibration is completed, a monitoring result of the monitored action of the subject is generated.

11. A control program product that causes a computer to execute control processing in an action state monitoring system, wherein the action state monitoring system monitors a designated monitoring object action by selecting two or more sensors from among a plurality of sensors that respectively establish corresponding relationships with a plurality of parts of a subject's body, wherein: The control program product enables the computer to execute the following processing, namely: executing a process of calibrating the two or more sensors arranged in a known orientation by the arrangement mechanism; A process of generating a monitoring result of the monitored action of the subject based on the detection results of the two or more sensors worn on the subject after the calibration is completed.

Images