Operation state monitoring system, control method, and program product

Abstract

The invention provides an operation state monitoring system, a control method, and a program product. A motion state monitoring system according to an embodiment of the present invention comprises: a plurality of sensors which are respectively worn on parts of the body of a plurality of subjects; and a plurality of motion state monitoring devices which respectively monitor the subjects by means of the worn sensors. Each of the plurality of operation state monitoring devices is provided with: an icon display unit that displays a plurality of sensor icons corresponding to each of the plurality of sensors; a display control unit that causes the icon display unit to display, among the plurality of sensors, a sensor having a distance within a predetermined distance from the operation state monitoring device; a receiving unit that receives a setting operation on the sensor icon displayed on the icon display unit; and a processing unit that associates the sensor corresponding to the sensor icon with the wearing target part of the subject on the basis of a set operation.

Description

Technical Field

[0001] The present invention relates to an action state monitoring system, a control method and a program product. Background Art

[0002] Japanese Patent Application Laid-Open No. 2022-034449 discloses an operation state monitoring system including a plurality of sensors corresponding to a plurality of parts of a subject's body and an operation state monitoring device. The plurality of sensors are paired with the operation state monitoring device to establish a correspondence with each part.

[0003] In this motion state monitoring system, a sensor is selected based on the motion to be monitored, and the motion state of the subject is monitored based on the detection result detected by the selected sensor. Summary of the invention

[0004] In the case of monitoring the movements of multiple subjects, a component consisting of multiple sensors with respective wearing target parts set is prepared for each subject, and each component is used by a different action state monitoring device. In this way, the multiple sensors of each component are set with the wearing target parts for each subject, so if a sensor in one component fails, the sensors of other components cannot be used. In addition, in order to continue to use the sensors of other components, it is necessary to perform the operation of changing the wearing target parts associated with the sensors, which is time-consuming and troublesome.

[0005] Therefore, there is a demand for easily sharing sensors among multiple motion state monitoring devices so that the sensors can be used between the multiple motion state monitoring devices. For example, it is also conceivable to use a learning model generated based on machine learning to infer the motion state of a subject using such a motion state monitoring system.

[0006] The present invention has been made in view of the above background, and an object of the present invention is to provide an operation state monitoring system, a control method, and a program product that can easily share a plurality of sensors among a plurality of operation state monitoring devices.

[0007] An action status monitoring system involved in one embodiment includes multiple sensors respectively worn at parts of the bodies of multiple subjects and multiple action status monitoring devices that monitor each subject respectively through the sensors worn, and the multiple action status monitoring devices respectively include: an icon display unit that displays multiple sensor icons corresponding to the multiple sensors; a display control unit that causes the icon display unit to display sensors among the multiple sensors that are within a predetermined distance from the action status monitoring device; an acceptance unit that accepts a setting action for the sensor icon displayed on the icon display unit; and a processing unit that establishes a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the setting action.

[0008] A control method involved in one embodiment is a control method for a motion state monitoring system including a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of motion state monitoring devices for respectively monitoring each subject through the sensors worn, wherein the plurality of motion state monitoring devices respectively perform the following processing, namely: processing for causing an icon display unit to display a plurality of sensor icons respectively corresponding to sensors among the plurality of sensors that are within a predetermined distance from the motion state monitoring device; processing for accepting a setting action for a sensor icon displayed on the icon display unit; and processing for establishing a correspondence between a sensor corresponding to the sensor icon and a wearing object part of the subject according to the setting action.

[0009] A program product involved in one method controls a motion status monitoring system, which includes a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of motion status monitoring devices respectively monitoring each subject through the sensors worn, wherein the program product causes the plurality of motion status monitoring devices to respectively perform the following processing, namely: causing an icon display unit to display a plurality of sensor icons respectively corresponding to sensors among the plurality of sensors that are within a predetermined distance from the motion status monitoring device; accepting a setting action for a sensor icon displayed on the icon display unit; and establishing a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the setting action.

[0010] According to the present invention, a plurality of sensors can be easily shared among a plurality of operation state monitoring devices.

[0011] The above and other objects, features and advantages of the present disclosure will be more fully understood from the detailed description and accompanying drawings given below, which are given by way of illustration only and thus should not be construed as limiting the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a block diagram showing a configuration example of a training support system according to an embodiment.

[0013] Figure 2 A diagram showing an example of a part where a measuring instrument is worn.

[0014] Figure 3 To indicate that the setting Figure 1 FIG. 2 is a diagram showing an example of the configuration of a measuring instrument in a training support system shown in FIG.

[0015] Figure 4 To express Figure 3 A diagram showing an example of how to wear the measuring instrument shown.

[0016] Figure 5 A diagram showing an example of a display screen.

[0017] Figure 6 To express Figure 1 A flowchart of the operation of an action state monitoring device in the training assistance system shown.

[0018] Figure 7 To express Figure 1 A flowchart of the operation of another motion state monitoring device in the training assistance system is shown. DETAILED DESCRIPTION

[0019] Hereinafter, the embodiments of the present disclosure will be described with reference to the accompanying drawings. For the purpose of clear description, the following description and the accompanying drawings are appropriately omitted and simplified. In addition, in each of the accompanying drawings, the same symbols are marked for the same elements, and repeated descriptions are omitted as needed. In the following embodiments, when the numbers such as the number, quantity, amount, range, etc. of each element are mentioned, they are not limited to the mentioned numbers except for the cases that are specifically stated and the cases that are clearly determined as the numbers in principle. In addition, the structures described in the embodiments shown below are not necessarily the structures necessary for the technical ideas involved in the present disclosure except for the cases that are specifically stated and the cases that are clearly determined as the structures in principle.

[0020] Figure 1 The block diagram shows a configuration example of a training support system 1 according to an embodiment. The training support system 1 is a system for monitoring the motion of a subject and providing support for bringing the subject's motion closer to a desired motion based on the monitoring result. The training support system 1 is used by a user such as a caregiver.

[0021] like Figure 1As shown, the training assistance system 1 includes a plurality of motion state monitoring devices 10 and a plurality of measuring instruments 20. In this embodiment, an example in which 11 measuring instruments 20 are shared between two motion state monitoring devices 10 is described. The training assistance system 1 can monitor a plurality of subjects P. The plurality of motion state monitoring devices 10 monitor the plurality of subjects P respectively. In the training assistance system 1 of this embodiment, two subjects P can be monitored by two motion state monitoring devices 10.

[0022] In the following, the two operation state monitoring devices 10 are respectively distinguished and also referred to as operation state monitoring devices 10_1 and 10_2. It is assumed that the operation state monitoring device 10_1 monitors the operation state of the subject P1, and the operation state monitoring device 10_2 monitors the operation state of the subject P2. In addition, the 11 measuring instruments 20 are respectively distinguished and also referred to as measuring instruments 20_1 to 20_11.

[0023] At least one of the 11 common measuring instruments is used for one motion state monitoring device 10_1, and at least one of the remaining measuring instruments is used for another motion state monitoring device 10_2. The measuring instruments 20_1 to 20_11 are worn at any of the parts p1 to p11 of the motion detection target among various parts of the body of the plurality of subjects P. Hereinafter, the parts p1 to p11 of the wearing target are also collectively referred to as parts p.

[0024] The measuring instruments 20_1 to 20_11 establish a correspondence with any one of the parts p1 to p11 of the two subjects P1 and P2 by executing a correspondence establishment process with any one of the action state monitoring devices 10_1 and 10_2. The measuring instruments 20_1 to 20_11 use motion sensors (hereinafter referred to as sensors) 21_1 to 21_11 such as gyro sensors to detect the movement of the worn parts p1 to p11. The action state monitoring devices 10_1 and 10_2 monitor the action states of the subjects P1 and P2, respectively, based on the detection results from the sensors of the measuring instruments 20 worn on the subjects P1 and P2. Hereinafter, the sensors 21_1 to 21_11 are also collectively referred to as sensors 21.

[0025] Figure 2 FIG. 2 is a diagram showing an example of a part p of a person wearing the measuring instrument 20. Figure 2In the example of , the parts p1 to p11 of the object to be worn of the measuring instrument 20 are respectively the right upper arm, the right forearm, the head, the back (torso), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right calf, the left thigh, and the left calf. In addition, in this example, the back and the waist are arranged on the back side of the subject P. The measuring instrument 20 is worn on at least one of the parts to be worn of the plurality of subjects P.

[0026] The monitored actions include, for example, right shoulder flexion and extension, right shoulder adduction and abduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and supination, head flexion and extension, head rotation, thoracolumbar flexion and extension, thoracolumbar rotation, thoracolumbar lateral flexion, left shoulder flexion and extension, left shoulder adduction and abduction, left shoulder internal and external rotation, left elbow flexion and extension, left forearm pronation and supination, etc. In addition, the monitored actions also include the movement of the part where the sensor is worn.

[0027] For example, the monitoring target action also includes angles of joints of the body of the subject P measured based on the detection results of multiple sensors, angles of joints in an arbitrary coordinate system measured based on the detection results of arbitrary sensors, etc. The monitoring target action can be specified by a user such as a caregiver.

[0028] Here, as an example, it is assumed that the right elbow flexion and extension movements of two subjects P1 and P2 are monitored. The right elbow flexion and extension movement can be measured based on the detection results of the sensors worn on the right upper arm (part p1) and the right forearm (part p2). In this case, for example, two measuring instruments are worn on the right upper arm (part p1) and the right forearm (part p2) of one subject P1, and two different measuring instruments are worn on the right upper arm (part p1) and the right forearm (part p2) of another subject P2.

[0029] In addition, the user can also select different items of multiple monitored object actions at the same time. For example, the user can also select "right elbow flexion and extension" and "right shoulder internal and external rotation" in the action state monitoring device 10_1, and select "left elbow flexion and extension" and "left shoulder internal and external rotation" in the action state monitoring device 10_2.

[0030] The right elbow flexion and extension movement can be measured based on the detection results of the sensors worn at the right upper arm (part p1) and the right forearm (part p2). Similarly, the right shoulder internal and external rotation movement can be measured based on the detection results of the sensors worn at the right upper arm (part p1) and the right forearm (part p2). In addition, the left elbow flexion and extension movement can be measured based on the detection results of the sensors worn at the left upper arm (part p6) and the left forearm (part p7). Similarly, the left shoulder internal and external rotation movement can be measured based on the detection results of the sensors worn at the left upper arm (part p6) and the left forearm (part p7).

[0031] (Configuration Example of Measuring Instruments 20_1 to 20_11)

[0032] Figure 3 20_1 is a diagram showing a configuration example of the measuring device 20_1. Since the measuring devices 20_2 to 20_11 are the same as those of the measuring device 20_1, their description will be omitted.

[0033] like Figure 3 As shown, the measuring device 20_1 includes a sensor 21_1, a wearing pad 22_1, and a belt 23_1. The belt 23_1 is configured to be wrapped around the motion detection target site of the subject P. The sensor 21_1 is, for example, assembled in the wearing pad 22_1. The wearing pad 22_1 is configured to be attachable to and detachable from the belt 23_1.

[0034] Figure 4 FIG. 2 is a diagram showing an example of a method of wearing the measuring instrument 20_1. Figure 4 In the example of FIG. 1 , the belt 23_1 is wrapped around the right upper arm (part p1) of one of the motion detection target parts of the subject P. The sensor 21_1 is attached to the belt 23_1 via the wearing pad 22_1 after the correspondence establishment process and calibration are completed.

[0035] (Configuration Example of Operation Status Monitoring Device 10)

[0036] The motion state monitoring device 10 is a device that outputs a calculation result representing the motion state of the subject P based on the detection results (detection values) of the sensors 21_1 to 21_11. The motion state monitoring device 10 may be, for example, a PC (Personal Computer), a mobile phone terminal, a smart phone, and a tablet terminal. The motion state monitoring device 10 is configured to be able to communicate with the sensors 21_1 to 21_11 via a network not shown. The motion state monitoring device 10 may also be referred to as a motion state monitoring system.

[0037] In addition, since the operation state monitoring device 10_2 has the same structure as the operation state monitoring device 10_1, Figure 1 In the figure, the detailed structure of the operation state monitoring device 10_2 is omitted. The structure of the operation state monitoring device 10_1 will be described below.

[0038] like Figure 1 As shown, the operation state monitoring device 10_1 includes a display unit 11, a display control unit 12, a receiving unit 13, a processing unit 14, a wireless communication unit 15, a calculation processing unit 17, and an operation unit 18. The display unit 11 is, for example, a display device, and displays a plurality of sensor icons corresponding to the plurality of sensors 21_1 to 21_11. Figure 51 shows an example of a display screen S displayed on the display unit 11. The area where the sensor icons are displayed in the display screen S is set as the sensor icon display area S1. In addition, when the display unit 11 receives an operation from the user, it displays an input screen for information related to the subject, a selection screen for monitoring results to be displayed on the display unit 11, etc., or displays monitoring results generated after monitoring the movement state of the subject.

[0039] As described later, a human body schematic diagram S2 showing a sensor wearing target part is included in the display screen including the sensor icon display area S. The human body schematic diagram S2 is a wearing target part display unit showing a sensor wearing target part on a diagram simulating a human body. Figure 5 The display screen S shown is displayed when a process of establishing a one-to-one correspondence relationship between any sensor among the plurality of sensors 21 and any part of the part p of the subject P to be worn is executed.

[0040] exist Figure 5 In the illustrated example, the front side and the back side of the human body are separately displayed. Figure 2 The parts p1 to p11 of the wearing object of the subject P are respectively Figure 5 The p_1 to p_11 of the human body schematic diagram S2 correspond to each other. Hereinafter, as required, the p_1 to p_11 of the human body schematic diagram S2 are referred to as the right upper arm, the right forearm, the head, the back (trunk), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right calf, the left thigh, and the left calf, respectively. In addition, the display unit 11 can display the calculation results based on the detection results of each of the more than one sensors in a graphical form, for example.

[0041] The display control unit 12 causes the display unit 11 to display sensors within a predetermined distance from the action state monitoring device 10_1 among the plurality of sensors 21. For example, the wireless communication unit 15 can receive identification information of each of the plurality of sensors 21 located within a predetermined distance through short-range wireless communication. The display control unit 12 causes the display unit 11 to display a sensor icon that is different for each sensor based on the received identification information. That is, a list of sensor icons corresponding to each of the available sensors that have not been associated with the wearable object parts is displayed on the display unit 11.

[0042] Here, it is assumed that the wireless communication unit 15 performs data communication in accordance with the Bluetooth (registered trademark) standard as short-range wireless communication. The operation status monitoring device 10 and the sensor 21 within the communication range exchange identification information such as Bluetooth addresses and authenticate each other to perform pairing and connect with the sensor 21. Once pairing is completed, the required information is stored in each other's devices, and later, when the sensor 21 is within a predetermined distance from the operation status monitoring device 10, it is connected without pairing.

[0043] The wireless communication unit 15 can also perform short-distance wireless communication in accordance with NFC (Near field communication), UWB (Ultra Wideband), WiFi (registered trademark), etc. The predetermined distance may differ depending on the type of short-distance wireless communication used.

[0044] In addition, the operation state monitoring device 10_1 may also have a distance measuring sensor (not shown) such as LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) that uses a pulsed laser as a measurement signal. The distance measuring sensor can measure the distance to the sensor existing around the operation state monitoring device 10. The display control unit 12 can also cause the display unit 11 to display the sensor within a predetermined distance from the operation state monitoring device 10_1 based on the measurement result of the distance measuring sensor.

[0045] In order to establish a correspondence between the sensor 21 and the part p of the wearer, the user selects the multiple sensor icons. The operation unit 18 may include an input device such as a mouse and a keyboard. The operation unit 18 may also be a touch panel in which a display device and an input device are integrated. For example, the user can select multiple sensor icons by operating a mouse or a keyboard of the operation unit 18, or by touching the touch panel of the operation unit 18 with a touch pen or a finger.

[0046] The receiving unit 13 receives a setting action for the sensor icon displayed on the display unit 11. The setting action refers to an input action for the sensor icon for establishing a correspondence between the sensor corresponding to the sensor icon and any one of the parts p of the wearer. For example, the user operates the operation unit 18 to move the sensor icon i21_1 displayed on the sensor icon display area S1 to the right upper arm p_1 on the human body schematic diagram S2. Specifically, the user drags and drops the sensor icon i21_1 displayed on the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2 by mouse operation or touch operation. The setting action is performed by Figure 5 In this way, the receiving unit 13 receives the user's setting operation for the sensor icon.

[0047] In addition, the plurality of sensors 21 may also include a light emitting unit capable of changing the color of light emitted. As the light emitting unit, for example, a full-color LED may be used. As an example, the light emitting unit may have a structure in which a red LED chip, a green LED chip, and a blue LED chip are sealed by a light-transmitting resin. The light emitting unit can realize a variety of light emission colors by controlling the brightness of the three types of LED chips.

[0048] The action state monitoring device 10_1 may further include a color control unit that performs processing to make the display colors of the plurality of sensor icons the same as the luminous colors of the luminous parts of the plurality of sensors. The user can select a sensor having the same luminous color as the display color of the sensor icon and confirm the human body schematic diagram S2 while actually wearing it at the part of the wearing object of the subject P. Thus, it is possible to prevent the sensor from being worn incorrectly.

[0049] The processing unit 14 establishes a correspondence between the sensor corresponding to the sensor icon and the subject's wearing object part according to the set operation. The correspondence establishment process is performed in the following manner, that is, pairing is performed in advance between the action state monitoring device 10 and the sensor 21, and the identification information of the wearing object part p and the identification information of the sensor 21 are associated with each other on the application of the action state monitoring device 10. In addition, after the wearing object part p and the sensor 21 are established in a correspondence relationship, the user can also perform a process to restore the correspondence relationship.

[0050] Thus, according to the present disclosure, for a sensor 21 located within a predetermined distance from a plurality of motion state monitoring devices 10, a user can set the correspondence between the sensor 21 and the part p of the wearer in any motion state monitoring device 10 through a free and easy operation. Thus, the sensor 21 can be shared among a plurality of motion state monitoring devices 10, and a highly convenient system can be realized.

[0051] The calculation processing unit 17 performs calculation processing based on the detection results of each of the sensors 21_1 to 21_11, and generates a calculation result indicating the motion state of the monitored motion of the subject P. In addition, the calculation processing unit 17 may perform calculation processing using a learned model generated by machine learning using past detection results of the sensors. The calculation processing unit 17 performs calculation processing using the learned model, and can calculate whether the motion state of the monitored motion of the subject P is good with higher accuracy. The calculation processing unit 17 sends the calculation result to the display control unit 12.

[0052] The display control unit 12 displays the information (calculation result) received from the calculation processing unit 17 on the display unit 11 in a visualized form such as a graph. This allows the user to understand the motion state of the monitored motion of the subject P, which can help in caring for the subject P, for example.

[0053] The setting operation is not limited to drag and drop, and the user may click the sensor icon displayed in the sensor icon display area S1 and the wearing target part of the human body diagram S2 within a predetermined time, so that the receiving unit 13 receives the setting operation.

[0054] In addition, the accepting unit 13 may accept the setting action by the user clicking the wearing object part of the human body schematic diagram S2. The processing unit 14 may also automatically establish a correspondence relationship between any one of the sensors corresponding to the multiple sensor icons displayed on the display unit 11 and the wearing object part p of the subject P according to the setting action. For example, the processing unit 14 may perform pairing in order of distance from the operation state monitoring device 10_1 from near to far for multiple sensors that have not established a correspondence relationship with the wearing object part p of the subject P, and establish a correspondence relationship with any one of the wearing object parts p of the subject P.

[0055] In addition, sometimes a sensor icon corresponding to the same sensor is displayed in a plurality of action status monitoring devices 10_1 and 10_2. In this way, when the action status monitoring devices 10_1 and 10_2 detect the same sensor at the same time, it is possible to grasp the situation that the action status monitoring devices 10_1 and 10_2 detect the same sensor at the same time. For example, it is assumed that a sensor icon i21_1 corresponding to the same sensor 21_1 is displayed. In this case, if a correspondence is first established between the sensor 21_1 and the part p1 of the wearing object of the subject P1 in one action status monitoring device 10_1, then in another action status monitoring device 10_2, the display control unit 12 executes a process of deleting the sensor icon i21_1 corresponding to the sensor 21_1 for which the correspondence has been established.

[0056] That is, the sensor icon i21_1 is not displayed on the display unit 11 of the operation status monitoring device 10_2. In other words, only the sensor icons i21-2 to i21_11 corresponding to the usable sensors remain on the display unit 11 of the operation status monitoring device 10_2. In addition, when the same sensor icon is displayed in two operation status monitoring devices 10, the user can also delete the sensor icon in one operation status monitoring device 10 to avoid performing the setting action for the same sensor in each operation status monitoring device 10 at the same time. For example, the user can delete the sensor icon by dragging and dropping the sensor icon onto the icon of the trash can.

[0057] Alternatively, in the operation status monitoring device 10_2, the display control unit 12 may also disable the sensor icon i21_1 so that the user cannot perform the setting operation on the sensor icon i21_1. That is, in the display unit 11 of the operation status monitoring device 10_2, only the sensor icons i21-2 to i21_11 corresponding to the usable sensors are in a state where the setting operation can be input. This can prevent a sensor from being set repeatedly in multiple operation status monitoring devices 10.

[0058] In addition, the following situation is envisioned, that is, in the action state monitoring device 10_1, the sensor 21_1 that has established a corresponding relationship with the right upper arm (part p1) of the subject P1 fails during use, and becomes a state in which the action cannot be performed. In this case, the user can perform a reset action for the sensor icon corresponding to the usable sensor that has not established a corresponding relationship and is displayed in the sensor icon display area S1. Thus, the acceptance unit 13 can accept the user's reset action for the sensor icon.

[0059] Specifically, among the sensors 21_1 to 21_11, sensors 21_1 and 21_2 for which the operation state monitoring device 10_1 has executed the correspondence processing, and sensors 21_5 to 21_11 other than sensors 21_3 and 21_4 for which the operation state monitoring device 10_2 has executed the correspondence processing can be used.

[0060] For example, the user drags and drops one sensor icon i21_5 among the sensor icons i21_5 to i21_11 corresponding to the sensors 21_5 to 21_11 to the right upper arm part p_1 of the human body schematic diagram S2. Thus, the accepting unit 13 accepts the user's resetting action for the sensor icon i21_5. The processing unit 14 can establish a correspondence between the sensor 21_5 corresponding to the sensor icon i21_5 and the right upper arm (part p1) of the subject P1, instead of the sensor 21_1 that is in a state where the action cannot be performed.

[0061] Thus, the correspondence between the sensor and the wearer's part can be changed by a simple operation. In addition, before executing the correspondence establishment process between other sensors 21_5 and the subject's right upper arm p1, the user can also perform an input action to cancel the correspondence between the sensor 21_1 that originally established the correspondence and the subject's right upper arm (part p1).

[0062] (Operation of the training support system 1)

[0063] Figure 6 , Figure 7 Flowchart showing the action of the training assistance system 1. Here, as described above, it is assumed that the right elbow flexion and extension actions of the subjects P1 and P2 are monitored by the action state monitoring devices 10_1 and 10_2, respectively. That is, sensors are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of the subject P1, and sensors are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of the subject P2. Therefore, two sensors are used in the action state monitoring device 10_1, and two different sensors are used in the action state monitoring device 10_2.

[0064] In the following example, it is assumed that the correspondence relationship establishment process between the sensor and the wearing object part is first performed in the action state monitoring device 10_1, and then the correspondence relationship establishment process between the sensor and the wearing object part is performed in the action state monitoring device 10_2. Figure 6 The operation of the operation state monitoring device 10_1 is shown in FIG. Figure 7 The operation of the operation state monitoring device 10_2 is shown in FIG. Figure 6 , Figure 7 In the figures, the same symbols are used to mark the same processing.

[0065] First, the operation state monitoring devices 10_1 and 10_2 display sensor icons i21_1 to i21_11 corresponding to the plurality of sensors located within a predetermined distance on the display unit 11 (S11). At this time, the operation state monitoring devices 10_1 and 10_2 do not display the plurality of sensor icons corresponding to all sensors, and there may be sensor icons that are not displayed depending on the distance from the operation state monitoring devices 10_1 and 10_2.

[0066] Here, as an example, it is assumed that all sensors 21_1 to 21_11 are located within a predetermined distance from both the operation state monitoring devices 10_1 and 10_2. Therefore, it is assumed that the operation state monitoring devices 10_1 and 10_2 display sensor icons i21_1 to i21_1 corresponding to all sensors 21_1 to 21_11, respectively.

[0067] On the display unit 11, the following is displayed: Figure 5 The display screen shown includes: a sensor icon display area S1 displaying sensor icons corresponding to sensors within a predetermined distance from the operation status monitoring device 10; and a human body schematic diagram S2 displaying a wearing object portion.

[0068] In addition, when the user specifies the monitored action of the subject P, the display unit 11 can display the wear target part of the sensor used to measure the specified monitored action. The display unit 11 of each of the action state monitoring devices 10_1 and 10_2 can set the right upper arm p_1 and the right forearm p_2 to be displayed differently from the other parts p_3 to p_11 in the human body schematic diagram S2 and highlight them. That is, Figure 5 In the human body schematic diagram S2, the right upper arm p_1 and the right forearm p_2 can be displayed differently from the other parts p_3 to p_11.

[0069] Then, in the action state monitoring device 10_1, the user drags and drops, for example, one sensor icon i21_1 from the sensor icons i21_1 to i21_11 displayed in the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2. As a result, the accepting unit 13 accepts the setting operation (S12).

[0070] Thereafter, the action status monitoring device 10_1 establishes an association between the identification information of the sensor 21_1 corresponding to the sensor icon i21_1 and the identification information of the right upper arm (part p1) of the wearer of the subject P1 according to the set action. Thus, the correspondence establishment process (S13) between the sensor 21_1 and the right upper arm (part p1) of the subject P1 is implemented. In addition, for other wearer parts (right forearm (part p2)), the dragging and dropping of the sensor icon i21_2 and the correspondence establishment process between the sensor 21_2 and the right forearm (part p2) of the subject P1 are also implemented in the same manner. That is, Figure 6 S12 and S13 in the above steps may be repeatedly performed according to the number of parts of the wearing object of the subject P1.

[0071] After establishing the correspondence between sensor 21_1 and the wearing object part p1, and between sensor 21_2 and the wearing object part p2, respectively, next, calibration of sensors 21_1 and 21_2 for measuring the movement of the monitoring object is performed (S14). Calibration refers to, for example, measuring the output value (error component) of the sensor used in the measurement of the movement of the monitoring object in a stationary state and subtracting the error component from the measured value. In this example, at least calibration of sensors 21_1 and 21_2 is performed. However, calibration is not limited to the case where it is performed on sensors for measuring the movement of the monitoring object, and for example, it can also be performed on all sensors 21_1 to 21_11 before the display processing of the sensor icon corresponding to the paired sensor.

[0072] After the calibration is completed, the sensors 21_1 and 21_2 are worn on the subject P1 (S15). Thereafter, the motion of the monitoring target is measured based on the detection results of the sensors 21_1 and 21_2 (S16).

[0073] The calculation result indicating the action state of "right elbow flexion and extension" can be calculated by the difference between the detection result of the sensor 21_1 worn on the right upper arm (part p1) of the subject P1 and the detection result of the sensor 21_2 worn on the right forearm (part p2). The action state monitoring device 10_1 generates the calculation result indicating the action state of "right elbow flexion and extension" based on the detection results of the sensors 21_1 and 21_2. The display unit 11 displays the details of the measurement result (for example, a graphical measurement result, etc.).

[0074] After the correspondence between the sensors 21_1 and 21_2 in the action state monitoring device 10_1 and the wear object parts is established, the action state monitoring device 10_2 performs a deletion process (S20) of the sensor icons i21_1 to i21_11 displayed on the display unit 11 corresponding to the sensors 21_1 and 21_2 set in the action state monitoring device 10_1. As a result, in the sensor icon display area S1 of the display unit 11 of the action state monitoring device 10_2, usable sensor icons i21_3 to i21_11 other than the sensor icons i21_1 and i21_2 remain. In addition, as described above, the disabling process of the sensor icons i21_1 and i21_2 can also be performed.

[0075] Then, in the action state monitoring device 10_2, the user drags and drops, for example, one sensor icon i21_3 from among the sensor icons i21_3 to i21_11 displayed in the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2. As a result, the accepting unit 13 accepts the setting operation (S12).

[0076] Thereafter, the action status monitoring device 10_2 establishes an association between the identification information of the sensor 21_3 corresponding to the sensor icon i21_3 and the identification information of the right upper arm (part p1) of the wearer of the subject P2 according to the set action. Thus, the correspondence establishment process (S13) between the sensor 21_3 and the right upper arm (part p1) of the subject P2 is implemented. In addition, for other wearer parts (right forearm (part p2)), the dragging and dropping of the sensor icon i21_4 and the correspondence establishment process between the sensor 21_4 and the right forearm (part p2) of the subject P2 are also implemented. That is, Figure 7 S12 and S13 in the above step may be repeatedly performed according to the number of parts of the wearing object of the subject P2. Figure 6 The processing of S14 to S16 is performed as described in .

[0077] In this way, the training assistance system 1 involved in this embodiment has multiple action state monitoring devices 10 that display multiple sensor icons corresponding to multiple sensors located within a predetermined distance. Moreover, each action state monitoring device 10 establishes a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the set action of the displayed sensor icon. As a result, the training assistance system 1 can share multiple sensors 21_1 to 21_11 in multiple action state monitoring devices 10, and can realize a highly convenient system.

[0078] Furthermore, if a correspondence between a sensor and a wearable part of a subject is established in one motion state monitoring device, the sensor icon corresponding to the sensor for which the correspondence has been established is deleted in other motion state monitoring devices, or the sensor icon is disabled in a manner that makes it impossible to perform the setting operation. This can prevent a sensor from being repeatedly set in multiple motion state monitoring devices 10.

[0079] In addition, the order of processing of the training assistance system 1 is not limited to Figure 6 , Figure 7 For example, calibration may be performed before displaying the sensor icon corresponding to the paired sensor.

[0080] Furthermore, although the present disclosure is described as a hardware configuration in the above-mentioned embodiment, the present disclosure is not limited thereto. The present disclosure can realize the control process of the operation state monitoring device by causing a CPU (Central Processing Unit) to execute a computer program.

[0081] In addition, various types of non-transitory computer readable medium can be used to store the above-mentioned program and provide it to the computer. Non-transitory computer readable medium includes various types of tangible recording medium. Non-transitory computer readable medium includes, for example, magnetic recording medium, optical magnetic recording medium, CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memory. Magnetic recording medium is, for example, a floppy disk, a magnetic tape, a hard disk drive, etc. Optical magnetic recording medium is, for example, an optical magnetic disk. Semiconductor memory is, for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, a RAM (Random Access Memory), etc. In addition, various types of transitory computer readable medium can be used to provide the program to the computer. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer readable media can provide the program to the computer via wired communication lines such as wires and optical fibers or wireless communication lines.

[0082] According to the disclosure described in this way, it is obvious that the embodiments of the present disclosure can be changed in many ways. Such changes should not be regarded as departing from the spirit and scope of the present disclosure, and, for those skilled in the art, all such modifications are obvious and are included in the scope of the technical solution.

Claims

1. An action state monitoring system, comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices respectively monitoring each subject through the worn sensors, wherein: The plurality of operation status monitoring devices respectively include: an icon display unit for displaying a plurality of sensor icons corresponding to the plurality of sensors respectively; a display control unit that causes the icon display unit to display sensors that are within a predetermined distance from the operation status monitoring device among the plurality of sensors; an accepting unit that accepts a setting operation for a sensor icon displayed on the icon display unit; A processing unit establishes a correspondence between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation.

2. The operating status monitoring system according to claim 1, wherein: When sensor icons corresponding to the same sensor are displayed in a plurality of operation status monitoring devices, When the correspondence between a sensor and a worn object part of a subject is established in one motion status monitoring device, the display control unit of other motion status monitoring devices will delete the sensor icon corresponding to the sensor for which the correspondence has been established, or disable the sensor icon in such a way that the setting action cannot be performed.

3. The operating status monitoring system according to claim 1, wherein: When the sensor associated with the subject's wearing target part becomes inoperable, The receiving unit receives a reset operation of the sensor icon corresponding to the sensor displayed on the icon display unit except for the sensor associated with the subject's wearing target part. The processing unit associates a sensor corresponding to the sensor icon corresponding to the resetting operation with the wearing target part of the subject instead of the sensor in the inoperable state.

4. The operating state monitoring system according to claim 1, wherein: The device further comprises a wearing target part display unit for displaying a wearing target part of the sensor on a diagram simulating a human body, The receiving unit receives the setting operation by dragging and dropping the sensor icon onto the wearing target part.

5. The operating status monitoring system according to claim 1, wherein: The device further comprises a wearing target part display unit for displaying a wearing target part of the sensor on a diagram simulating a human body, The receiving unit receives the setting operation by clicking the sensor icon and the wearing target part respectively.

6. The operating state monitoring system according to claim 1, wherein: The device further comprises a wearing target part display unit for displaying a wearing target part of the sensor on a diagram simulating a human body, The receiving unit receives the setting action by clicking the wearing target part, The processing unit automatically associates any one of the plurality of sensors displayed on the icon display unit with a wearing target part of the subject according to the setting operation.

7. The operating status monitoring system according to claim 6, wherein: The processing unit establishes a correspondence relationship between a plurality of sensors that are not associated with the subject's wearing target parts and the subject's wearing target parts in order of distance from the operation state monitoring device from near to far.

8. The operating status monitoring system according to claim 1, wherein: The plurality of sensors further include a light emitting unit capable of changing the color of emitted light. The operation status monitoring system further includes a color control unit that performs processing to make the display colors of the plurality of sensor icons the same as the light emission colors of the light emitting units of the respective plurality of sensors.

9. A control method for a motion state monitoring system comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of motion state monitoring devices respectively monitoring each subject through the worn sensors, wherein: The plurality of operation status monitoring devices respectively perform the following processing, namely: a process of causing an icon display unit to display a plurality of sensor icons corresponding to sensors, among the plurality of sensors, that are within a predetermined distance from the operation status monitoring device; receiving a setting operation for a sensor icon displayed on the icon display unit; A process of establishing a correspondence between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation.

10. A program product for controlling an action state monitoring system, the action state monitoring system comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices for respectively monitoring the subjects through the worn sensors, wherein: The program product causes the plurality of operation status monitoring devices to execute the following processing, namely: a process of causing an icon display unit to display a plurality of sensor icons corresponding to sensors, among the plurality of sensors, that are within a predetermined distance from the operation status monitoring device; receiving a setting operation for a sensor icon displayed on the icon display unit; A process of establishing a correspondence between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation.

Images