Operating state monitoring system, control method and program

Abstract

To easily identify a sensor corresponding to an operating state monitoring device when a plurality of operating state monitoring devices share sensors.SOLUTION: An operating state monitoring system comprises: a plurality of sensors respectively attached to a plurality of subjects' body parts; and a plurality of operating state monitoring devices for respectively monitoring each of the subjects by the attached sensors. The plurality of operating state monitoring devices comprise: an icon display part for displaying a plurality of sensor icons respectively corresponding to a plurality of sensors; a display control part for displaying a sensor, out of the plurality of sensors, which is within a prescribed distance of the operating state monitoring device, on the icon display part; a reception part for receiving a setting operation relative to the sensor icon displayed on the icon display part; a processing part for associating the sensor corresponding to the sensor icon with an attachment object part of the subject according to the setting operation; and a control part for changing a display mode of the corresponding sensor icon according to an input from the sensor.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an operation status monitoring system, a control method, and a program. [Background technology]

[0002] Patent Document 1 discloses a motion status monitoring system including a plurality of sensors associated with a plurality of body parts of a subject, and a motion status monitoring device. The plurality of sensors are associated with the respective body parts by a pairing process performed with the motion status monitoring device. In this motion status monitoring system, a sensor is selected based on the motion to be monitored, and the motion status of the subject is monitored based on the detection result by the selected sensor. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-034449 Summary of the Invention [Problem to be solved by the invention]

[0004] When monitoring the movements of multiple subjects, a set of multiple sensors, each with a set of target attachment parts, is prepared for each subject, and each set is used by a different motion status monitoring device. In this way, the multiple sensors in each set have a target attachment part set for each subject, so if a sensor in one set breaks down, the sensor in the other set cannot be used. In addition, in order to use a sensor in another set, it is necessary to change the target attachment part associated with the sensor, which is troublesome and time-consuming.

[0005] For this reason, there is a demand for a sensor to be easily shared among a plurality of operational state monitoring devices so that the sensor can be reused among a plurality of operational state monitoring devices. However, if a sensor is shared among a plurality of operational state monitoring devices and sensors used by different subjects are mixed, there is a problem that it is not possible to know which sensor corresponds to which operational state monitoring device. It is also assumed that the operational state of a subject using such an operational state monitoring device can be inferred using a learning model generated by machine learning or the like, for example.

[0006] The present invention has been made in consideration of the above background, and aims to provide an operation status monitoring system, a control method, and a program that can easily identify the sensor corresponding to an operation status monitoring device when multiple sensors are shared by multiple operation status monitoring devices. [Means for solving the problem]

[0007] According to one embodiment, the operating state monitoring system includes a plurality of sensors attached to body parts of a plurality of subjects, and a plurality of operating state monitoring devices that monitor each of the subjects using the attached sensors. Each of the operating state monitoring devices includes an icon display unit that displays a plurality of sensor icons corresponding to the plurality of sensors, a display control unit that causes the icon display unit to display, among the plurality of sensors, sensors that are within a predetermined distance from the operating state monitoring device, a reception unit that receives a setting operation for the sensor icon displayed on the icon display unit, a processing unit that associates the sensor corresponding to the sensor icon with an attachment target body part of the subject in response to the setting operation, and a control unit that changes a display mode of the corresponding sensor icon in response to an input from the sensor.

[0008] A control method according to one embodiment is a control method for an operational status monitoring system including a plurality of sensors attached to parts of the body of a plurality of subjects, and a plurality of operational status monitoring devices that monitor each subject using the attached sensors, wherein each of the plurality of operational status monitoring devices performs the following processes: displaying, on an icon display unit, a plurality of sensor icons each corresponding to a sensor among the plurality of sensors that is within a predetermined distance from the operational status monitoring device; accepting a setting operation for the sensor icons displayed on the icon display unit; associating, in accordance with the setting operation, the sensor corresponding to the sensor icon with the target attachment part of the subject; and changing the display mode of the corresponding sensor icon in accordance with input from the sensor.

[0009] A program according to one embodiment is a program for controlling an operational status monitoring system including a plurality of sensors attached to respective parts of the body of a plurality of subjects, and a plurality of operational status monitoring devices that monitor each of the subjects using the attached sensors, and causes each of the operational status monitoring devices to perform the following processes: displaying, on an icon display unit, a plurality of sensor icons each corresponding to a sensor among the plurality of sensors that is within a predetermined distance from the operational status monitoring device; accepting a setting operation for the sensor icons displayed on the icon display unit; associating, in accordance with the setting operation, the sensor corresponding to the sensor icon with the target part of the subject to be attached; and changing the display mode of the corresponding sensor icon in accordance with input from the sensor. Effect of the Invention

[0010] According to the present invention, when a plurality of operational status monitoring devices share a plurality of sensors, it becomes possible to easily identify the sensor corresponding to the operational status monitoring device. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of the configuration of a training assistance system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a target portion for mounting a measuring instrument; [Diagram 3] 2 is a diagram showing an example of the configuration of a measuring device provided in the training support system shown in FIG. 1. [Figure 4] FIG. 4 is a diagram showing an example of how to attach the measuring device shown in FIG. 3. [Diagram 5] FIG. 4 is a diagram showing an example of a display screen. [Figure 6] FIG. 4 is a diagram showing an example of a display screen. [Figure 7] 4 is a flowchart showing the operation of one of the motion status monitoring devices in the training assistance system shown in FIG. 1. [Figure 8] 4 is a flowchart showing the operation of the other motion state monitoring device in the training support system shown in FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In addition, in each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary. In the following embodiments, when the number, quantity, amount, range, etc. of each element is mentioned, it is not limited to the mentioned number, unless it is specifically stated or clearly specified in principle. In addition, the structures, etc. described in the following embodiments are not necessarily essential to the technical idea of ​​the present disclosure, unless it is specifically stated or clearly specified in principle.

[0013] 1 is a block diagram showing an example of the configuration of a training support system 1 according to an embodiment. The training support system 1 is a system for monitoring a motion of a subject and providing support for bringing the motion of the subject closer to a desired motion based on the monitoring result. The training support system 1 is used by a user such as a caregiver, for example.

[0014] As shown in FIG. 1, the training support system 1 includes a plurality of motion state monitoring devices 10 and a plurality of measuring devices 20. In this embodiment, an example will be described in which eleven measuring devices 20 are shared between two motion state monitoring devices 10. The training support system 1 can monitor a plurality of subjects P. The plurality of motion state monitoring devices 10 respectively monitor the plurality of subjects P. In the training support system 1 of this embodiment, the two motion state monitoring devices 10 can monitor two subjects P.

[0015] Hereinafter, the two operating state monitoring devices 10 are also referred to as operating state monitoring devices 10_1 and 10_2 to distinguish between them. The operating state monitoring device 10_1 monitors the operating state of the subject P1, and the operating state monitoring device 10_2 monitors the operating state of the subject P2. In addition, the eleven measuring devices 20 are also referred to as measuring devices 20_1 to 20_11 to distinguish between them.

[0016] At least one of the eleven shared measuring devices is used in one motion state monitoring device 10_1, and at least one of the remaining measuring devices is used in the other motion state monitoring device 10_2. The measuring devices 20_1 to 20_11 are attached to any of the motion detection target parts p1 to p11 among various parts of the body of a plurality of subjects P. Hereinafter, the attachment target parts p1 to p11 are collectively referred to as parts p.

[0017] The measuring instruments 20_1-20_11 are associated with any of the parts p1-p11 of the two subjects P1, P2 by a matching process performed with either one of the motion state monitoring devices 10_1, 10_2. The measuring instruments 20_1-20_11 detect the motion of the attached parts p1-p11 using motion sensors (hereinafter simply referred to as sensors) 21_1-21_11 such as gyro sensors. The motion state monitoring devices 10_1, 10_2 monitor the motion states of the subjects P1, P2, respectively, based on the detection results from the sensors of the measuring instruments 20 attached to the subjects P1, P2. Hereinafter, the sensors 21_1-21_11 are also collectively referred to as sensors 21.

[0018] Fig. 2 is a diagram showing an example of a part p to which the measuring device 20 is attached. In the example of Fig. 2, the parts p1 to p11 to which the measuring device 20 is attached are the right upper arm, right forearm, head, back (trunk), waist (pelvis), left upper arm, left forearm, right thigh, right lower leg, left thigh, and left lower leg, respectively. In this example, the back and waist are assumed to be located on the rear side of the subject P. The measuring device 20 is attached to at least one attachment part of a plurality of subjects P.

[0019] The monitored motions include, for example, right shoulder flexion and extension, right shoulder abduction and abduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and external rotation, head flexion and extension, head rotation, thoracic and lumbar flexion and extension, thoracic and lumbar rotation, thoracic and lumbar lateral bending, left shoulder flexion and extension, left shoulder abduction and abduction, left shoulder internal and external rotation, left elbow flexion and extension, left forearm pronation and external rotation, etc. The monitored motions also include the movement of the part itself to which the sensor is attached.

[0020] For example, the monitored motions include angles of joints in the body of the subject P measured based on the detection results of multiple sensors, and angles of joints in an arbitrary coordinate system measured based on the detection result of any one of the sensors. The monitored motions can be specified by a user such as a caregiver.

[0021] Here, as an example, the right elbow flexion and extension motion of two subjects P1 and P2 is monitored. The right elbow flexion and extension motion can be measured based on the detection results of sensors attached to the right upper arm (site p1) and the right forearm (site p2). In this case, for example, two measuring devices are attached to the right upper arm (site p1) and the right forearm (site p2) of one subject P1, and two different measuring devices are attached to the right upper arm (site p1) and the right forearm (site p2) of the other subject P2. Here, as an example, it is assumed that a measuring device 20_1 is attached to the right upper arm (site p1) of the subject P1 and a measuring device 20_2 is attached to the right forearm (site p2). It is also assumed that a measuring device 20_3 is attached to the right upper arm (site p1) of the subject P2 and a measuring device 20_4 is attached to the right forearm (site p2) of the subject P2.

[0022] The user may simultaneously select a plurality of different monitoring target motion items. For example, the user may select "right elbow flexion / extension" and "right shoulder internal / external rotation" in the motion state monitoring device 10_1, and select "left elbow flexion / extension" and "left shoulder internal / external rotation" in the motion state monitoring device 10_2.

[0023] The right elbow flexion and extension movement can be measured based on the detection results of the sensors attached to the right upper arm (part p1) and the right forearm (part p2). Similarly, the right shoulder internal and external rotation movement can be measured based on the detection results of the sensors attached to the right upper arm (part p1) and the right forearm (part p2). Furthermore, the left elbow flexion and extension movement can be measured based on the detection results of the sensors attached to the left upper arm (part p6) and the left forearm (part p7). Similarly, the left shoulder internal and external rotation movement can be measured based on the detection results of the sensors attached to the left upper arm (part p6) and the left forearm (part p7).

[0024] (Example of configuration of measuring instruments 20_1 to 20_11) 3 is a diagram showing an example of the configuration of the measuring instrument 20_1. Note that the measuring instruments 20_2 to 20_11 are similar to the measuring instrument 20_1, and therefore the description thereof will be omitted.

[0025] 3, the measuring device 20_1 has a sensor 21_1, an attachment pad 22_1, and a belt 23_1. The belt 23_1 is configured to be wrapped around a motion detection target part of the subject P. The sensor 21_1 is incorporated in, for example, the attachment pad 22_1. In addition, the attachment pad 22_1 is configured to be detachable from the belt 23_1.

[0026] Fig. 4 is a diagram showing an example of how to attach the measuring device 20_1. In the example of Fig. 4, a belt 23_1 is wrapped around the right upper arm (part p1), which is one of the motion detection target parts of the subject P. After the matching process, calibration, etc. are completed, the sensor 21_1 is attached to the belt 23_1 via the attachment pad 22_1.

[0027] (Example of configuration of operation status monitoring device 10) The motion state monitoring device 10 is a device that outputs a calculation result indicating the motion state of the subject P based on the detection results (sensing values) of the sensors 21_1 to 21_11. The motion state monitoring device 10 may be, for example, a PC (Personal Computer), a mobile phone terminal, a smartphone, or a tablet terminal. The motion state monitoring device 10 is configured to be able to communicate with the sensors 21_1 to 21_11 via a network (not shown). The motion state monitoring device 10 can also be called a motion state monitoring system.

[0028] Incidentally, since the operation state monitoring device 10_2 has the same configuration as the operation state monitoring device 10_1, the detailed configuration of the operation state monitoring device 10_2 is omitted in Fig. 1. The configuration of the operation state monitoring device 10_1 will be described below.

[0029] As shown in FIG. 1, the operating state monitoring device 10_1 includes a display unit 11, a display control unit 12, a reception unit 13, a processing unit 14, a wireless communication unit 15, a control unit 16, a calculation processing unit 17, and an operation unit 18. The display unit 11 is, for example, a display device, and displays a plurality of sensor icons corresponding to a plurality of sensors 21_1 to 21_11, respectively. FIG. 5 shows an example of a display screen S displayed on the display unit 11. An area of ​​the display screen S that displays the sensor icons is defined as a sensor icon display area S1. Furthermore, when accepting an operation from a user, the display unit 11 displays an input screen for information about the subject, a selection screen for the monitoring results to be displayed on the display unit 11, and the like, and displays the monitoring results generated after monitoring the operating state of the subject.

[0030] As described below, the display screen including the sensor icon display area S includes a human body schematic diagram S2 showing the part to which the sensor is to be attached. This human body schematic diagram S2 serves as a part to which the sensor is to be attached display section showing the part to which the sensor is to be attached on a diagram imitating the human body. The display screen S shown in Fig. 5 is displayed when performing a process of associating one of the multiple sensors 21 with one of the parts p of the subject P to which the sensor is to be attached on a one-to-one basis.

[0031] In the example shown in Fig. 5, the front side and the back side of the human body are displayed separately. The parts p1 to p11 of the attachment target of the subject P in Fig. 2 correspond to p_1 to p_11 in the human body schematic diagram S2 in Fig. 5, respectively. Hereinafter, p_1 to p_11 in the human body schematic diagram S2 will be referred to as the right upper arm, right forearm, head, back (trunk), waist (pelvis), left upper arm, left forearm, right thigh, right lower leg, left thigh, and left lower leg, respectively, as necessary. In addition, the display unit 11 can display, for example, a graph of the calculation result based on the detection result of each of one or more sensors.

[0032] The display control unit 12 causes the display unit 11 to display, among the multiple sensors 21, sensors that are located within a predetermined distance from the operation state monitoring device 10_1. For example, the wireless communication unit 15 can receive identification information from each of the multiple sensors 21 located within a predetermined distance by short-range wireless communication. The display control unit 12 causes the display unit 11 to display a different sensor icon for each sensor based on the received identification information. That is, the display unit 11 displays a list of sensor icons corresponding to each of the available sensors that are not associated with an attachment target portion.

[0033] Here, the wireless communication unit 15 performs data communication conforming to the Bluetooth (registered trademark) standard as short-distance wireless communication. The operation status monitoring device 10 is paired with the sensor 21 present within the communication range by exchanging identification information such as Bluetooth addresses and performing mutual authentication, and is then connected to the sensor 21. Once pairing is completed, necessary information is stored in each device, and thereafter, when the sensor 21 is located within a predetermined distance from the operation status monitoring device 10, connection is made without the need for pairing.

[0034] The wireless communication unit 15 can also perform short-distance wireless communication in accordance with NFC (Near field communication), UWB (Ultra Wideband), WiFi (registered trademark), etc. The above-mentioned predetermined distance can vary depending on the type of short-distance wireless communication used.

[0035] The operational state monitoring device 10_1 may have a distance measuring sensor (not shown) such as LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) that uses pulsed laser light as a measurement signal. The distance measuring sensor is capable of measuring the distance to sensors present around the operational state monitoring device 10. The display control unit 12 is also capable of causing the display unit 11 to display sensors that are within a predetermined distance from the operational state monitoring device 10_1 based on the measurement result of the distance measuring sensor.

[0036] These multiple sensor icons are selected by the user to associate the sensor 21 with the site p to which the sensor 21 is to be attached. The operation unit 18 may include an input device such as a mouse or a keyboard. The operation unit 18 may be a touch panel in which a display device and an input device are integrated. For example, the user can select multiple sensor icons by operating the mouse, keyboard, etc. of the operation unit 18, or by touching the touch panel of the operation unit 18 with a touch pen or a finger.

[0037] The reception unit 13 receives a setting operation for the sensor icon displayed on the display unit 11. The setting operation is an input operation for the sensor icon for associating the sensor corresponding to the sensor icon with any one of the body parts p to be attached. For example, the user operates the operation unit 18 to move the sensor icon i21_1 displayed in the sensor icon display area S1 to the right upper arm part p_1 on the human body schematic diagram S2. Specifically, the user drags and drops the sensor icon i21_1 displayed in the sensor icon display area S1 to the right upper arm part p_1 on the human body schematic diagram S2 by a mouse operation, a touch operation, or the like. This setting operation is indicated by a dotted line in FIG. 5. In this way, the reception unit 13 receives the setting operation for the sensor icon by the user.

[0038] The sensors 21 may each include a light-emitting unit capable of changing the color of light emitted. For example, a full-color LED may be used as the light-emitting unit. As an example, the light-emitting unit may have a configuration in which a red LED chip, a green LED chip, and a blue LED chip are sealed with a light-transmitting resin. The light-emitting unit can realize a variety of light-emitting colors by controlling the brightness of three types of LED chips.

[0039] The operating state monitoring device 10_1 may further include a color control unit that executes a process of making the display color of the multiple sensor icons the same as the light emission color of the light emitting units of the multiple sensors. The user can select a sensor having the same light emission color as the display color of the sensor icon, check the human body schematic diagram S2, and actually attach the sensor to the target part p of the subject P. This makes it possible to prevent the sensor from being attached incorrectly.

[0040] The processing unit 14 associates the sensor corresponding to the sensor icon with the subject's attachment site in response to the setting operation. This association process is performed by pairing the motion status monitoring device 10 and the sensor 21 in advance, and associating the identification information of the attachment site p with the identification information of the sensor 21 on the application of the motion status monitoring device 10.

[0041] In this way, according to the present disclosure, a user can freely and easily set, in any one of the operation state monitoring devices 10, a correspondence between the sensor 21 located within a predetermined distance from the plurality of operation state monitoring devices 10 and the part p to which the sensor 21 is to be attached. This allows the sensor 21 to be shared by the plurality of operation state monitoring devices 10, thereby realizing a highly convenient system.

[0042] The calculation processing unit 17 performs calculation processing based on the detection results of the sensors 21_1 to 21_11, and generates a calculation result representing the motion state of the subject P's motion to be monitored. The calculation processing unit 17 may perform calculation processing using a trained model generated by machine learning using past sensor detection results. By performing calculation processing using this trained model, the calculation processing unit 17 can more accurately calculate whether the motion state of the subject P's motion to be monitored is good or not. The calculation processing unit 17 transmits the calculation result to the display control unit 12.

[0043] The display control unit 12 visualizes the information (calculation results) received from the calculation processing unit 17 in a graph or the like and displays it on the display unit 11. This allows the user to know the motion state of the subject P's monitored motion, which can be useful for, for example, assisting the subject P.

[0044] The setting operation is not limited to drag and drop. The reception unit 13 may receive the setting operation by the user clicking the sensor icon displayed in the sensor icon display area S1 and the target attachment part in the human body schematic diagram S2 within a predetermined time.

[0045] Alternatively, the reception unit 13 may receive a setting operation by the user clicking on a target site on the human body schematic diagram S2. The processing unit 14 may automatically associate any one of the sensors corresponding to the plurality of sensor icons displayed on the display unit 11 with the target site p of the subject P in response to the setting operation. For example, the processing unit 14 may pair the sensors, among the plurality of sensors not associated with any of the target sites p of the subject P, in ascending order of distance from the operation state monitoring device 10_1, and associate the sensors with any of the target sites p of the subject P.

[0046] In addition, a sensor icon corresponding to the same sensor may be displayed in a plurality of operation state monitoring devices 10_1 and 10_2. In this way, when the operation state monitoring devices 10_1 and 10_2 simultaneously detect the same sensor, it is possible to know that the operation state monitoring devices 10_1 and 10_2 detect the same sensor at the same location. For example, a sensor icon i21_1 corresponding to the same sensor 21_1 is displayed on the display units of the operation state monitoring devices 10_1 and 10_2. In this case, when the sensor 21_1 is associated with the part p1 to which the subject P1 is attached first in one operation state monitoring device 10_1, the display control unit 12 in the other operation state monitoring device 10_2 performs a process of deleting the sensor icon i21_1 corresponding to the associated sensor 21_1.

[0047] That is, the sensor icon i21_1 is not displayed on the display unit 11 of the operational state monitoring device 10_2. In other words, only the sensor icons i21-2 to i21_11 corresponding to the available sensors remain on the display unit 11 of the operational state monitoring device 10_2. When the same sensor icon is displayed in the two operational state monitoring devices 10, the user may delete the sensor icon in one of the operational state monitoring devices 10 so as not to simultaneously perform setting operations for the same sensor in each operational state monitoring device 10. For example, the user can delete the sensor icon by dragging and dropping the sensor icon onto a trash can icon.

[0048] Alternatively, in the operation state monitoring device 10_2, the display control unit 12 may disable the sensor icon i21_1 so that the user cannot perform a setting operation on the sensor icon i21_1. That is, on the display unit 11 of the operation state monitoring device 10_2, only the sensor icons i21-2 to i21_11 corresponding to the available sensors are in a state in which a setting operation can be input. This makes it possible to prevent one sensor from being set in multiple operation state monitoring devices 10 in a duplicated manner.

[0049] It is also assumed that the sensor 21_1 associated with the right upper arm (site p1) of the subject P1 in the motion state monitoring device 10_1 breaks down during use and becomes inoperable. In this case, the user can perform a resetting operation on the sensor icon that corresponds to a usable sensor that is not associated and is displayed in the sensor icon display area S1. This allows the receiving unit 13 to receive the resetting operation on the sensor icon by the user.

[0050] Specifically, among the sensors 21_1 to 21_11, the sensors 21_1 and 21_2 for which the association process has been performed by the operational state monitoring device 10_1, and the sensors 21_3 and 21_4 for which the association process has been performed by the operational state monitoring device 10_2, other than the sensors 21_5 to 21_11, are usable.

[0051] For example, the user drags and drops the sensor icon i21_5, which is one of the sensor icons i21_5 to i21_11 corresponding to the sensors 21_5 to 21_11, onto the right upper arm part p_1 of the human body schematic diagram S2. This causes the reception unit 13 to receive a reset operation for the sensor icon i21_5 by the user. The processing unit 14 can associate the sensor 21_5 corresponding to the sensor icon i21_5 with the right upper arm (part p1) of the subject P1, instead of the sensor 21_1 which is in an inoperable state.

[0052] This allows the user to change the association between the sensor and the attachment target part by a simple operation. Note that, before performing the association process between another sensor 21_5 and the right upper arm p1 of the subject, the user may perform an input operation to cancel the association between the originally associated sensor 21_1 and the right upper arm (part p1) of the subject.

[0053] As described above, when multiple sensors 21 are shared among multiple operation state monitoring devices 10, it is assumed that sensors used by different subjects will be mixed. In this case, there is a problem that it becomes unclear which sensor corresponds to which operation state monitoring device. To address this, the operation state monitoring device 10_1 has a control unit 16. The control unit 16 changes the display mode of the corresponding sensor icon in response to an input from the sensor 21.

[0054] The control unit 16 can change the display mode so that the corresponding sensor icon i21_1 takes a movement corresponding to the movement of one sensor 21_1 among the multiple sensors 21. For example, the control unit 16 can change the target sensor icon displayed on the screen of the display unit 11 over time in conjunction with the movement of the sensor 21.

[0055] For example, as shown in Fig. 6, the control unit 16 can rotate the target sensor icon i21_1 around a predetermined axis as the rotation axis in response to the rotation operation of the sensor 21_1. As an example, the control unit 16 can display on the display unit 11 an image in which the target sensor icon i21_1 rotates around an axis passing through the center of gravity of the target sensor icon i21_1 as indicated by a dotted arrow in Fig. 6.

[0056] Furthermore, the control unit 16 may, for example, change the display color of the target sensor icon to a color different from the display colors of the other sensor icons and display it on the display unit 11. The control unit 16 may also cause the target sensor icon to flash.

[0057] The sensor 21 may include an acceleration sensor. The control unit 16 may change the display mode of the target sensor icon based on a tap input to the sensor 21 collected by the acceleration sensor. The sensor 21 may also include a switch. The control unit 16 may change the display mode of the target sensor icon based on a pressed state of the switch.

[0058] In this way, by changing the display mode of the sensor icon in response to input from the sensor 21, even if a sensor icon corresponding to the same sensor is displayed in multiple operation status monitoring devices 10_1, 10_2, it is possible to easily identify which operation status monitoring device 10_1, 10_2 the sensor icon corresponds to.

[0059] Furthermore, the control unit 16 can delete from the display unit 11, among the multiple sensor icons displayed on the display unit 11, sensor icons whose display mode does not change in response to an input from the sensor 21. For example, when a sensor icon i21_1 corresponding to the same sensor 21_1 is displayed in the operation state monitoring devices 10_1 and 10_2, it is assumed that the display mode of the target sensor icon i21_1 displayed on the display unit 11 of the operation state monitoring device 10_1 has changed in response to an input from the sensor 21_1.

[0060] In this case, in the operation state monitoring device 10_2, since the display mode of the sensor icon i21_1 does not change, the sensor icon i21_1 can be deleted from the display unit 11. Note that in the operation state monitoring device 10_2, the control unit 16 may delete a sensor icon whose display mode does not change for a predetermined time from the display unit 11. As a result, only the sensor icons i21_3 and i21_4 of the sensors 21_3 and 21_4 associated with the operation state monitoring device 10_2 remain on the display unit 11 of the operation state monitoring device 10_2.

[0061] In this way, the sensors 21_1, 21_2, 21_5 to 21_11 corresponding to the deleted sensor icons i21_1, i21_2, i21_5 to i21_11 are disconnected from the operation state monitoring device 10_2. As a result, the disconnected sensors can be used by connecting and associating them with another operation state monitoring device 10. Note that the user may delete a sensor icon whose display mode does not change in response to an input from the sensor 21 by dragging and dropping the sensor icon onto a trash can icon.

[0062] (Operation of training support system 1) 7 and 8 are flowcharts showing the operation of the training support system 1. As described above, the right elbow flexion and extension movements of the subjects P1 and P2 are monitored by the motion state monitoring devices 10_1 and 10_2, respectively. That is, a sensor is attached to the right upper arm (site p1) and right forearm (site p2) of the subject P1, and a sensor is attached to the right upper arm (site p1) and right forearm (site p2) of the subject P2. Therefore, the motion state monitoring device 10_1 uses two sensors (sensors 21_1 and 21_2), and the motion state monitoring device 10_2 uses two other sensors (sensors 21_3 and 21_4).

[0063] In the following example, it is assumed that the operation state monitoring device 10_1 first performs a process of associating the sensor with the attachment target portion, and then the operation state monitoring device 10_2 performs a process of associating the sensor with the attachment target portion. Fig. 7 shows the operation of the operation state monitoring device 10_1. Fig. 8 shows the operation of the operation state monitoring device 10_2. Note that the same processes are denoted by the same reference numerals in Figs. 7 and 8.

[0064] 7 and 8, first, the operation state monitoring devices 10_1 and 10_2 display sensor icons i21_1 to i21_11 corresponding to a plurality of sensors located within a predetermined distance on the display unit 11 (S11). At this time, the operation state monitoring devices 10_1 and 10_2 do not display a plurality of sensor icons corresponding to all sensors, and there may be sensor icons that are not displayed depending on the distance from the operation state monitoring devices 10_1 and 10_2.

[0065] Here, as an example, it is assumed that all the sensors 21_1 to 21_11 are located within a predetermined distance from both the operation state monitoring devices 10_1 and 10_2. Therefore, it is assumed that sensor icons i21_1 to i21_1 corresponding to all the sensors 21_1 to 21_11, respectively, are displayed in both the operation state monitoring devices 10_1 and 10_2.

[0066] The display unit 11 displays a display screen including a sensor icon display area S1 in which sensor icons corresponding to sensors located within a predetermined distance from the operation status monitoring device 10 are displayed, and a human body schematic diagram S2 in which the target attachment area is displayed, as shown in FIG. 5.

[0067] When the user specifies the motion of the subject P to be monitored, the display unit 11 may display the part to which the sensor used to measure the specified motion to be monitored is attached. The display units 11 of the motion state monitoring devices 10_1 and 10_2 may highlight the right upper arm p_1 and the right forearm p2 in the human body schematic diagram S2 in a display mode (color, blinking, shading, etc.) different from the other parts p3 to p11. That is, in the human body schematic diagram S2 of FIG. 5, the right upper arm p_1 and the right forearm p2 may be displayed in a display mode different from the other parts p3 to p11.

[0068] The operation of the operation state monitoring device 10_1 will be described with reference to Fig. 7. Then, in the operation state monitoring device 10_1, the user drags and drops one sensor icon i21_1 from among the sensor icons i21_1 to i21_11 displayed in the sensor icon display area S1 onto the right upper arm p_1 of the human body schematic diagram S2. This causes the accepting unit 13 to accept the setting operation (S12).

[0069] Thereafter, the motion state monitoring device 10_1 links the identification information of the sensor 21_1 corresponding to the sensor icon i21_1 with the identification information of the right upper arm (site p1) of the subject P1 to which the sensor is to be attached, in accordance with the setting operation. As a result, a process of associating the sensor 21_1 with the right upper arm (site p1) of the subject P1 is performed (S13). Note that similarly, for another attachment target site (right forearm (site p2)), the sensor icon i21_2 is dragged and dropped, and the process of associating the sensor 21_2 with the right forearm (site p2) of the subject P1 is performed. That is, S12 and S13 in FIG. 7 can be repeated the number of times corresponding to the number of attachment target sites of the subject P1.

[0070] After the sensor 21_1 and the attachment target part p1, and the sensor 21_2 and the attachment target part p2 are associated with each other, the sensors 21_1 and 21_2 used to measure the monitored motion are calibrated (S14). The calibration is, for example, a process of measuring an output value (error component) of the sensor used to measure the monitored motion in a stationary state and subtracting the error component from an actual measurement value. In this example, calibration is performed on at least the sensors 21_1 and 21_2. However, the calibration is not limited to the case where it is performed on the sensor used to measure the monitored motion, and may be performed on all the sensors 21_1 to 21_11, for example, before a process of displaying a sensor icon corresponding to a paired sensor.

[0071] After the calibration is completed, the sensor 21 can be identified before actually attaching the measuring device 20 including the sensor 21 to the subject P1 (S15). The sensor 21 can be identified by moving the sensor 21 to change the display mode of the sensor icon. As an example, by rotating the sensor 21_1, the sensor icon i21_1 rotates as shown in FIG. 5. In this way, when multiple sensors 21 are shared between multiple operation state monitoring devices 10, even if sensors used by different subjects are mixed, it is possible to easily identify which operation state monitoring device 10 the sensor 21 corresponds to.

[0072] Furthermore, the control unit 16 can delete from the display unit 11, among the multiple sensor icons displayed on the display unit 11, sensor icons whose display state does not change in response to input from the sensors 21. The sensors 21_1, 21_2, 21_5 to 21_11 corresponding to the deleted sensor icons i21_1, i21_2, i21_5 to i21_11 can be disconnected from the operation status monitoring device 10_2. Thereby, the disconnected sensors can be used by connecting and associating them with another operation status monitoring device 10.

[0073] The sensors 21_1 and 21_2 are attached to the subject P1 (S16). Thereafter, the motion to be monitored is measured based on the detection results of the sensors 21_1 and 21_2 (S17).

[0074] The calculation result showing the motion state of "right elbow flexion and extension" can be calculated by the difference between the detection result of the sensor 21_1 attached to the right upper arm (site p1) of the subject P1 and the detection result of the sensor 21_2 attached to the right forearm (site p2). The motion state monitoring device 10_1 generates a calculation result showing the motion state of "right elbow flexion and extension" based on the detection results of the sensors 21_1 and 21_2. The display unit 11 displays details of the measurement result (e.g., the measurement result in the form of a graph).

[0075] Next, the operation of the operation state monitoring device 10_2 will be described with reference to Fig. 8. After the association process between the sensors 21_1, 21_2 and the attachment target parts in the operation state monitoring device 10_1 is completed, the operation state monitoring device 10_2 performs a deletion process of the sensor icons i21_1, i21_2 corresponding to the sensors 21_1, 21_2 set in the operation state monitoring device 10_1 among the sensor icons i21_1 to i21_11 displayed on the display unit 11 (S20). As a result, the sensor icon display area S1 of the display unit 11 of the operation state monitoring device 10_2 will be left with the available sensor icons i21_3 to i21_11 except for the sensor icons i21_1, i21_2. As described above, the sensor icons i21_1, i21_2 may be invalidated.

[0076] Then, in the motion state monitoring device 10_2, the user drags and drops one sensor icon i21_3 from among the sensor icons i21_3 to i21_11 displayed in the sensor icon display area S1 onto the right upper arm p_1 of the human body schematic diagram S2, for example, causing the accepting unit 13 to accept the setting operation (S12).

[0077] Thereafter, the motion state monitoring device 10_2 links the identification information of the sensor 21_3 corresponding to the sensor icon i21_3 with the identification information of the right upper arm (site p1) of the subject P2 to which the sensor is to be attached, according to the setting operation. As a result, a process of associating the sensor 21_3 with the right upper arm (site p1) of the subject P2 is performed (S13). Note that similarly, for the other attachment target site (right forearm (site p2)), the sensor icon i21_4 is dragged and dropped, and the process of associating the sensor 21_4 with the right forearm (site p2) of the subject P2 is performed. That is, S12 and S13 in FIG. 8 can be repeated as many times as the number of attachment target sites of the subject P2. As described below in FIG. 7, the motion state monitoring device 10_2 also performs the processes of S14 to S17.

[0078] In this way, the training support system 1 according to the present embodiment has a plurality of motion status monitoring devices 10 that display a plurality of sensor icons corresponding to a plurality of sensors within a predetermined distance. Then, each motion status monitoring device 10 associates a sensor corresponding to the displayed sensor icon with a target attachment part of the subject in accordance with a setting operation for the sensor icon. In this way, the training support system 1 can share a plurality of sensors 21_1 to 21_11 among the plurality of motion status monitoring devices 10, thereby realizing a highly convenient system.

[0079] In addition, when a sensor is associated with a target attachment part of a subject in one operation state monitoring device, the other operation state monitoring devices delete the sensor icon corresponding to the associated sensor or disable the sensor icon so that the setting operation cannot be performed. This makes it possible to prevent one sensor from being set in multiple operation state monitoring devices 10.

[0080] The order of processing of the training support system 1 is not limited to the order of processing shown in Figs. 7 and 8. For example, calibration may be performed before the display process of the sensor icon corresponding to the paired sensor. In addition, after the sensor 21 is attached to the subject P, it may be confirmed which operation state monitoring device 10 the sensor 21 corresponds to.

[0081] Furthermore, in the above embodiment, the present disclosure has been described as a hardware configuration, but the present disclosure is not limited to this. The present disclosure can be realized by causing a CPU (Central Processing Unit) to execute a computer program to control the operation status monitoring device.

[0082] The above-mentioned program can be stored and supplied to a computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. The non-transitory computer readable media includes, for example, a magnetic recording medium, a magneto-optical recording medium, a CD-ROM (Read Only Memory), a CD-R, a CD-R / W, and a semiconductor memory. The magnetic recording medium is, for example, a flexible disk, a magnetic tape, a hard disk drive, etc. The magneto-optical recording medium is, for example, a magneto-optical disk, etc. The semiconductor memory is, for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, a RAM (Random Access Memory), etc. The program may also be supplied to a computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include an electric signal, an optical signal, and an electromagnetic wave. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or via a wireless communication path. [Explanation of symbols]

[0083] 1. Training Support System 10. Operation status monitoring device 10_1, 10_2 Operation status monitoring device 11 Display section 12 Display control section 13 Reception 14 Processing section 15 Wireless Communication Section 16 Control section 17 Processing section 18 Control section 20 Measuring Instruments 20_1~20_11 Measuring Instruments 21 Sensors 21_1~21_11 Sensor 22_1 Pad 23_1 Belt P Subject p1~p11 site S display screen S1 Sensor icon display area S2 Human body schematic diagram

Claims

1. A plurality of sensors attached to body parts of a plurality of subjects, respectively; a plurality of motion status monitors each of the subjects by the attached sensors; An operating status monitoring system comprising: Each of the plurality of operation status monitoring devices an icon display unit that displays a plurality of sensor icons corresponding to the plurality of sensors; a display control unit that displays, on the icon display unit, sensors that are located within a predetermined distance from the operation status monitoring device, among the plurality of sensors; a reception unit that receives a setting operation for the sensor icon displayed in the icon display unit; a processing unit that associates a sensor corresponding to the sensor icon with a target part of the subject in response to the setting operation; A control unit that changes a display mode of a corresponding sensor icon in response to an input from the sensor; Equipped with Operational status monitoring system.

2. the control unit deletes from the icon display unit a sensor icon whose display state does not change in response to an input from the sensor, among the plurality of sensor icons displayed on the icon display unit, and disconnects the sensor corresponding to the sensor icon from the operation status monitoring device. The operating condition monitoring system according to claim 1 .

3. the control unit deletes a sensor icon whose display mode has not changed for a predetermined period of time from the icon display unit, and disconnects the sensor corresponding to the sensor icon from the operation status monitoring device. The operating condition monitoring system according to claim 2 .

4. The control unit changes a display state of the corresponding sensor icon so as to perform a movement corresponding to a movement of one of the plurality of sensors. The operating condition monitoring system according to claim 1 .

5. the sensor includes an acceleration sensor; The control unit changes a display mode based on a tap input to the sensor collected by the acceleration sensor. The operating condition monitoring system according to claim 1 .

6. The sensor includes a switch. The control unit changes the display mode based on the pressing state of the switch. The operating condition monitoring system according to claim 1 .

7. A plurality of sensors attached to body parts of a plurality of subjects, respectively; a plurality of motion status monitors each of the subjects by the attached sensors; A control method for an operating status monitoring system, comprising: Each of the plurality of operation status monitoring devices includes a process of displaying, on an icon display unit, a plurality of sensor icons each corresponding to a sensor that is located within a predetermined distance from the operation status monitoring device, among the plurality of sensors; A process of receiving a setting operation for the sensor icon displayed in the icon display unit; A process of associating a sensor corresponding to the sensor icon with a target attachment part of the subject in response to the setting operation; A process of changing a display mode of a corresponding sensor icon in response to an input from the sensor; Execute the Control methods.

8. A plurality of sensors attached to body parts of a plurality of subjects, respectively; a plurality of motion status monitors each of the subjects by the attached sensors; A program for controlling an operation status monitoring system including: Each of the plurality of operation status monitoring devices includes a process of displaying, on an icon display unit, a plurality of sensor icons each corresponding to a sensor that is located within a predetermined distance from the operation status monitoring device, among the plurality of sensors; A process of receiving a setting operation for the sensor icon displayed in the icon display unit; A process of associating a sensor corresponding to the sensor icon with a target attachment part of the subject in response to the setting operation; A process of changing a display mode of a corresponding sensor icon in response to an input from the sensor; Execute the program.

Images