Operation state monitoring system, control method, and program product

Abstract

The invention provides an operation state monitoring system, a control method, and a program product. A motion state monitoring system according to an embodiment of the present invention comprises: a plurality of sensors which are respectively worn on parts of the body of a plurality of subjects; and a plurality of motion state monitoring devices which respectively monitor the subjects by means of the worn sensors. A plurality of operation state monitoring devices are provided with: an icon display unit that displays a plurality of sensor icons corresponding to each of a plurality of sensors; a display control unit that causes the icon display unit to display, among the plurality of sensors, a sensor having a distance within a predetermined distance from the operation state monitoring device; a receiving unit that receives a setting operation on the sensor icon displayed on the icon display unit; a processing unit that associates a sensor corresponding to the sensor icon with a region to be worn of the subject on the basis of the setting operation; and a control unit that changes the display mode of the corresponding sensor icon in accordance with an input from the sensor.

Description

Technical Field

[0001] The present invention relates to an action state monitoring system, a control method and a program product. Background Art

[0002] Patent document 1 discloses an action state monitoring system having a plurality of sensors and an action state monitoring device that respectively establish a correspondence relationship with a plurality of parts of a subject's body. The plurality of sensors establish a correspondence relationship with each part through a pairing process performed between the plurality of sensors and the action state monitoring device. In the action state monitoring system, a sensor is selected based on the action of the monitored object, and the action state of the subject is monitored based on the detection result detected by the selected sensor.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2022-034449 Summary of the invention

[0004] In the case of monitoring the movements of multiple subjects, a component consisting of multiple sensors with respective wearing target parts set is prepared for each subject, and each component is used by a different action state monitoring device. In this way, the multiple sensors of each component are set with the wearing target parts for each subject, so if a sensor in one component fails, the sensors of other components cannot be used. In addition, in order to continue to use the sensors of other components, it is necessary to perform the operation of changing the wearing target parts associated with the sensors, which is time-consuming and troublesome.

[0005] Therefore, there is a demand to easily share sensors among multiple motion state monitoring devices so that the sensors can be used among the multiple motion state monitoring devices. However, when sharing sensors among multiple motion state monitoring devices, if sensors used by other subjects are mixed in, there is a problem that it is unclear which sensor corresponds to which motion state monitoring device. For example, it is also conceivable to use a learning model generated by machine learning to perform inference on the motion state of a subject using such a motion state monitoring device.

[0006] The present invention is completed in view of the above background, and its purpose is to provide an operation state monitoring system, control method and program product that can easily identify the sensor corresponding to the operation state monitoring device when multiple sensors are shared by multiple operation state monitoring devices.

[0007] An action state monitoring system according to one embodiment includes a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices respectively monitoring each subject through the worn sensors. The plurality of action state monitoring devices respectively include: an icon display unit that displays a plurality of sensor icons respectively corresponding to the plurality of sensors; a display control unit that causes the icon display unit to display sensors within a predetermined distance from the action state monitoring device among the plurality of sensors; an acceptance unit that accepts a setting action for the sensor icon displayed on the icon display unit; a processing unit that establishes a correspondence between the sensor corresponding to the sensor icon and the subject's wearing target part according to the setting action; and a control unit that changes the display mode of the corresponding sensor icon according to input from the sensor.

[0008] A control method involved in one embodiment is a control method for an action state monitoring system including a plurality of sensors respectively worn on parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices for respectively monitoring each subject through the sensors worn, wherein the plurality of action state monitoring devices respectively perform the following processing, namely: processing for causing an icon display unit to display a plurality of sensor icons respectively corresponding to sensors among the plurality of sensors that are within a predetermined distance from the action state monitoring device; processing for accepting a setting action for a sensor icon displayed on the icon display unit; processing for establishing a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the setting action; and processing for changing the display mode of the corresponding sensor icon according to input from the sensor.

[0009] A program product involved in one method controls a motion status monitoring system, which includes a plurality of sensors respectively worn on parts of the bodies of a plurality of subjects and a plurality of motion status monitoring devices respectively monitoring each subject through the sensors worn, wherein the program product causes the plurality of motion status monitoring devices to respectively perform the following processing, namely: causing an icon display unit to display a plurality of sensor icons respectively corresponding to sensors among the plurality of sensors that are within a predetermined distance from the motion status monitoring device; accepting a setting action for a sensor icon displayed on the icon display unit; establishing a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the setting action; and changing the display method of the corresponding sensor icon according to input from the sensor.

[0010] According to the present invention, when a plurality of sensors are shared by a plurality of operation state monitoring devices, it is possible to easily identify a sensor corresponding to an operation state monitoring device.

[0011] The above and other objects, features and advantages of the present disclosure will be more fully understood from the detailed description and accompanying drawings given below. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a block diagram showing a configuration example of a training support system according to an embodiment.

[0013] Figure 2 A diagram showing an example of a part where a measuring instrument is worn.

[0014] Figure 3 To indicate that the setting Figure 1 FIG. 2 is a diagram showing an example of the configuration of a measuring instrument in a training support system shown in FIG.

[0015] Figure 4 To express Figure 3 A diagram showing an example of how to wear the measuring instrument shown.

[0016] Figure 5 A diagram showing an example of a display screen.

[0017] Figure 6 A diagram showing an example of a display screen.

[0018] Figure 7 To express Figure 1 A flowchart of the operation of an action state monitoring device in the training assistance system shown.

[0019] Figure 8 To express Figure 1 A flowchart of the operation of another motion state monitoring device in the training assistance system is shown. DETAILED DESCRIPTION

[0020] Hereinafter, the embodiments of the present disclosure will be described with reference to the accompanying drawings. For the purpose of clear description, the following description and the accompanying drawings are appropriately omitted and simplified. In addition, in each of the accompanying drawings, the same symbols are marked for the same elements, and repeated descriptions are omitted as needed. In the following embodiments, when the numbers such as the number, quantity, amount, range, etc. of each element are mentioned, they are not limited to the mentioned numbers except for the cases that are specifically stated and the cases that are clearly determined as the numbers in principle. In addition, the structures described in the embodiments shown below are not necessarily the structures necessary for the technical ideas involved in the present disclosure except for the cases that are specifically stated and the cases that are clearly determined as the structures in principle.

[0021] Figure 1 The block diagram shows a configuration example of a training support system 1 according to an embodiment. The training support system 1 is a system for monitoring the motion of a subject and providing support for bringing the subject's motion closer to a desired motion based on the monitoring result. The training support system 1 is used by a user such as a caregiver.

[0022] like Figure 1 As shown, the training assistance system 1 includes a plurality of motion state monitoring devices 10 and a plurality of measuring instruments 20. In this embodiment, an example in which 11 measuring instruments 20 are shared between two motion state monitoring devices 10 is described. The training assistance system 1 can monitor a plurality of subjects P. The plurality of motion state monitoring devices 10 monitor the plurality of subjects P respectively. In the training assistance system 1 of this embodiment, two subjects P can be monitored by two motion state monitoring devices 10.

[0023] In the following, the two operation state monitoring devices 10 are respectively distinguished and also referred to as operation state monitoring devices 10_1 and 10_2. It is assumed that the operation state monitoring device 10_1 monitors the operation state of the subject P1, and the operation state monitoring device 10_2 monitors the operation state of the subject P2. In addition, the 11 measuring instruments 20 are respectively distinguished and also referred to as measuring instruments 20_1 to 20_11.

[0024] At least one of the 11 common measuring instruments is used for one motion state monitoring device 10_1, and at least one of the remaining measuring instruments is used for another motion state monitoring device 10_2. The measuring instruments 20_1 to 20_11 are worn at any of the parts p1 to p11 of the motion detection target among various parts of the body of the plurality of subjects P. Hereinafter, the parts p1 to p11 of the wearing target are also collectively referred to as parts p.

[0025] The measuring instruments 20_1 to 20_11 establish a correspondence with any one of the parts p1 to p11 of the two subjects P1 and P2 by executing a correspondence establishment process with any one of the action state monitoring devices 10_1 and 10_2. The measuring instruments 20_1 to 20_11 use motion sensors (hereinafter referred to as sensors) 21_1 to 21_11 such as gyro sensors to detect the movement of the worn parts p1 to p11. The action state monitoring devices 10_1 and 10_2 monitor the action states of the subjects P1 and P2, respectively, based on the detection results from the sensors of the measuring instruments 20 worn on the subjects P1 and P2. Hereinafter, the sensors 21_1 to 21_11 are also collectively referred to as sensors 21.

[0026] Figure 2FIG. 2 is a diagram showing an example of a part p of a person wearing the measuring instrument 20. Figure 2 In the example of , the parts p1 to p11 of the object to be worn of the measuring instrument 20 are respectively the right upper arm, the right forearm, the head, the back (torso), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right calf, the left thigh, and the left calf. In addition, in this example, the back and the waist are arranged on the back side of the subject P. The measuring instrument 20 is worn on at least one of the parts to be worn of the plurality of subjects P.

[0027] The monitored actions include, for example, right shoulder flexion and extension, right shoulder adduction and abduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and supination, head flexion and extension, head rotation, thoracolumbar flexion and extension, thoracolumbar rotation, thoracolumbar lateral flexion, left shoulder flexion and extension, left shoulder adduction and abduction, left shoulder internal and external rotation, left elbow flexion and extension, left forearm pronation and supination, etc. In addition, the monitored actions also include the movement of the part where the sensor is worn.

[0028] For example, the monitoring target action also includes angles of joints of the body of the subject P measured based on the detection results of multiple sensors, angles of joints in an arbitrary coordinate system measured based on the detection results of arbitrary sensors, etc. The monitoring target action can be specified by a user such as a caregiver.

[0029] Here, as an example, it is assumed that the right elbow flexion and extension movements of each of the two subjects P1 and P2 are monitored. The right elbow flexion and extension movement can be measured based on the detection results of the sensors worn on the right upper arm (part p1) and the right forearm (part p2). In this case, for example, two measuring instruments are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of one subject P1, and two different measuring instruments are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of another subject P2. Here, as an example, it is assumed that the measuring instrument 20_1 is worn on the right upper arm (part p1) of the subject P1, and the measuring instrument 20_2 is worn on the right forearm (part p2). In addition, it is assumed that the measuring instrument 20_3 is worn on the right upper arm (part p1) of the subject P2, and the measuring instrument 20_4 is worn on the right forearm (part p2).

[0030] In addition, the user can also select different items of multiple monitored object actions at the same time. For example, the user can also select "right elbow flexion and extension" and "right shoulder internal and external rotation" in the action state monitoring device 10_1, and select "left elbow flexion and extension" and "left shoulder internal and external rotation" in the action state monitoring device 10_2.

[0031] The right elbow flexion and extension movement can be measured based on the detection results of the sensors worn at the right upper arm (part p1) and the right forearm (part p2). Similarly, the right shoulder internal and external rotation movement can be measured based on the detection results of the sensors worn at the right upper arm (part p1) and the right forearm (part p2). In addition, the left elbow flexion and extension movement can be measured based on the detection results of the sensors worn at the left upper arm (part p6) and the left forearm (part p7). Similarly, the left shoulder internal and external rotation movement can be measured based on the detection results of the sensors worn at the left upper arm (part p6) and the left forearm (part p7).

[0032] (Configuration Example of Measuring Instruments 20_1 to 20_11)

[0033] Figure 3 20_1 is a diagram showing a configuration example of the measuring device 20_1. Since the measuring devices 20_2 to 20_11 are the same as those of the measuring device 20_1, their description will be omitted.

[0034] like Figure 3 As shown, the measuring device 20_1 includes a sensor 21_1, a wearing pad 22_1, and a belt 23_1. The belt 23_1 is configured to be wrapped around the motion detection target site of the subject P. The sensor 21_1 is, for example, assembled in the wearing pad 22_1. The wearing pad 22_1 is configured to be attachable to and detachable from the belt 23_1.

[0035] Figure 4 FIG. 2 is a diagram showing an example of a method of wearing the measuring instrument 20_1. Figure 4 In the example of FIG. 1 , the belt 23_1 is wrapped around the right upper arm (part p1) of one of the motion detection target parts of the subject P. The sensor 21_1 is attached to the belt 23_1 via the wearing pad 22_1 after the correspondence establishment process and calibration are completed.

[0036] (Configuration Example of Operation Status Monitoring Device 10)

[0037] The motion state monitoring device 10 is a device that outputs a calculation result representing the motion state of the subject P based on the detection results (detection values) of the sensors 21_1 to 21_11. The motion state monitoring device 10 may be, for example, a PC (Personal Computer), a mobile phone terminal, a smart phone, and a tablet terminal. The motion state monitoring device 10 is configured to be able to communicate with the sensors 21_1 to 21_11 via a network not shown. The motion state monitoring device 10 may also be referred to as a motion state monitoring system.

[0038] In addition, since the operation state monitoring device 10_2 has the same structure as the operation state monitoring device 10_1, Figure 1 In the figure, the detailed structure of the operation state monitoring device 10_2 is omitted. The structure of the operation state monitoring device 10_1 will be described below.

[0039] like Figure 1 As shown, the operation status monitoring device 10_1 includes a display unit 11, a display control unit 12, a receiving unit 13, a processing unit 14, a wireless communication unit 15, a control unit 16, a calculation processing unit 17, and an operation unit 18. The display unit 11 is, for example, a display device, and displays a plurality of sensor icons corresponding to the plurality of sensors 21_1 to 21_11. Figure 5 1 shows an example of a display screen S displayed on the display unit 11. The area where the sensor icons are displayed in the display screen S is set as the sensor icon display area S1. In addition, when the display unit 11 receives an operation from the user, it displays an input screen for information related to the subject, a selection screen for monitoring results to be displayed on the display unit 11, etc., or displays monitoring results generated after monitoring the movement state of the subject.

[0040] As described later, a human body schematic diagram S2 showing a sensor wearing target part is included in the display screen including the sensor icon display area S. The human body schematic diagram S2 is a wearing target part display unit showing a sensor wearing target part on a diagram simulating a human body. Figure 5 The display screen S shown is displayed when a process of establishing a one-to-one correspondence relationship between any sensor among the plurality of sensors 21 and any part of the part p of the subject P to be worn is executed.

[0041] exist Figure 5 In the illustrated example, the front side and the back side of the human body are separately displayed. Figure 2 The parts p1 to p11 of the wearing object of the subject P are respectively Figure 5 The p_1 to p_11 of the human body schematic diagram S2 correspond to each other. Hereinafter, as required, the p_1 to p_11 of the human body schematic diagram S2 are referred to as the right upper arm, the right forearm, the head, the back (trunk), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right calf, the left thigh, and the left calf, respectively. In addition, the display unit 11 can display the calculation results based on the detection results of each of the more than one sensors in a graphical form, for example.

[0042] The display control unit 12 causes the display unit 11 to display sensors within a predetermined distance from the action state monitoring device 10_1 among the plurality of sensors 21. For example, the wireless communication unit 15 can receive identification information of each of the plurality of sensors 21 located within a predetermined distance through short-range wireless communication. The display control unit 12 causes the display unit 11 to display a sensor icon that is different for each sensor based on the received identification information. That is, a list of sensor icons corresponding to each of the available sensors that have not been associated with the wearable object parts is displayed on the display unit 11.

[0043] Here, it is assumed that the wireless communication unit 15 performs data communication in accordance with the Bluetooth (registered trademark) standard as short-range wireless communication. The operation status monitoring device 10 and the sensor 21 within the communication range exchange identification information such as Bluetooth addresses and authenticate each other to perform pairing and connect with the sensor 21. Once pairing is completed, the required information is stored in each other's devices, and later, when the sensor 21 is within a predetermined distance from the operation status monitoring device 10, it is connected without pairing.

[0044] The wireless communication unit 15 can also perform short-distance wireless communication in accordance with NFC (Near field communication), UWB (Ultra Wideband), WiFi (registered trademark), etc. The predetermined distance may differ depending on the type of short-distance wireless communication used.

[0045] In addition, the operation state monitoring device 10_1 may also have a distance measuring sensor (not shown) such as LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) that uses a pulsed laser as a measurement signal. The distance measuring sensor can measure the distance to the sensor existing around the operation state monitoring device 10. The display control unit 12 can also cause the display unit 11 to display the sensor within a predetermined distance from the operation state monitoring device 10_1 based on the measurement result of the distance measuring sensor.

[0046] In order to establish a correspondence between the sensor 21 and the part p of the wearer, the user selects the multiple sensor icons. The operation unit 18 may include an input device such as a mouse and a keyboard. The operation unit 18 may also be a touch panel in which a display device and an input device are integrated. For example, the user can select multiple sensor icons by operating a mouse or a keyboard of the operation unit 18, or by touching the touch panel of the operation unit 18 with a touch pen or a finger.

[0047] The receiving unit 13 receives a setting action for the sensor icon displayed on the display unit 11. The setting action refers to an input action for the sensor icon for establishing a correspondence between the sensor corresponding to the sensor icon and any one of the parts p of the wearer. For example, the user operates the operation unit 18 to move the sensor icon i21_1 displayed on the sensor icon display area S1 to the right upper arm p_1 on the human body schematic diagram S2. Specifically, the user drags and drops the sensor icon i21_1 displayed on the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2 by mouse operation or touch operation. The setting action is performed by Figure 5 In this way, the receiving unit 13 receives the user's setting operation for the sensor icon.

[0048] In addition, the plurality of sensors 21 may also include a light emitting unit capable of changing the color of light emitted. As the light emitting unit, for example, a full-color LED may be used. As an example, the light emitting unit may have a structure in which a red LED chip, a green LED chip, and a blue LED chip are sealed by a light-transmitting resin. The light emitting unit can realize a variety of light emission colors by controlling the brightness of the three types of LED chips.

[0049] The action state monitoring device 10_1 may further include a color control unit that performs processing to make the display colors of the plurality of sensor icons the same as the luminous colors of the luminous parts of the plurality of sensors. The user can select a sensor having the same luminous color as the display color of the sensor icon and confirm the human body schematic diagram S2 while actually wearing it at the part p of the wearing object of the subject P. Thus, it is possible to prevent the sensor from being worn incorrectly.

[0050] The processing unit 14 establishes a correspondence between the sensor corresponding to the sensor icon and the subject's wearing object part according to the set action. The correspondence establishment process is performed in the following manner, that is, pairing is performed between the action state monitoring device 10 and the sensor 21 in advance, and the identification information of the wearing object part p and the identification information of the sensor 21 are associated in the application of the action state monitoring device 10.

[0051] Thus, according to the present disclosure, for a sensor 21 located within a predetermined distance from a plurality of motion state monitoring devices 10, a user can set the correspondence between the sensor 21 and the part p of the wearer in any motion state monitoring device 10 through a free and easy operation. Thus, the sensor 21 can be shared among a plurality of motion state monitoring devices 10, and a highly convenient system can be realized.

[0052] The calculation processing unit 17 performs calculation processing based on the detection results of each of the sensors 21_1 to 21_11, and generates a calculation result indicating the motion state of the monitored motion of the subject P. In addition, the calculation processing unit 17 may perform calculation processing using a learned model generated by machine learning using past detection results of the sensors. The calculation processing unit 17 performs calculation processing using the learned model, and can calculate whether the motion state of the monitored motion of the subject P is good with higher accuracy. The calculation processing unit 17 sends the calculation result to the display control unit 12.

[0053] The display control unit 12 displays the information (calculation result) received from the calculation processing unit 17 on the display unit 11 in a visualized form such as a graph. This allows the user to understand the motion state of the monitored motion of the subject P, which can help in caring for the subject P, for example.

[0054] The setting operation is not limited to drag and drop, and the user may click the sensor icon displayed in the sensor icon display area S1 and the wearing target part of the human body diagram S2 within a predetermined time, so that the receiving unit 13 receives the setting operation.

[0055] In addition, the accepting unit 13 may accept the setting action by the user clicking the wearing object part of the human body schematic diagram S2. The processing unit 14 may also automatically establish a correspondence relationship between any one of the sensors corresponding to the multiple sensor icons displayed on the display unit 11 and the wearing object part p of the subject P according to the setting action. For example, the processing unit 14 may perform pairing in order of distance from the operation state monitoring device 10_1 from near to far for multiple sensors that have not established a correspondence relationship with the wearing object part p of the subject P, and establish a correspondence relationship with any one of the wearing object parts p of the subject P.

[0056] In addition, sometimes a sensor icon corresponding to the same sensor is displayed in a plurality of action status monitoring devices 10_1 and 10_2. In this way, when the action status monitoring devices 10_1 and 10_2 detect the same sensor at the same time, it is possible to grasp the situation that the action status monitoring devices 10_1 and 10_2 detect the same sensor at the same time. For example, it is assumed that the sensor icon i21_1 corresponding to the same sensor 21_1 is displayed on the display units of the action status monitoring devices 10_1 and 10_2 respectively. In this case, if a correspondence is first established between the sensor 21_1 and the part p1 of the wearing object of the subject P1 in one action status monitoring device 10_1, then in the other action status monitoring device 10_2, the display control unit 12 executes a process of deleting the sensor icon i21_1 corresponding to the sensor 21_1 for which the correspondence has been established.

[0057] That is, the sensor icon i21_1 is not displayed on the display unit 11 of the operation status monitoring device 10_2. In other words, only the sensor icons i21-2 to i21_11 corresponding to the usable sensors remain on the display unit 11 of the operation status monitoring device 10_2. In addition, when the same sensor icon is displayed in two operation status monitoring devices 10, the user can also delete the sensor icon in one operation status monitoring device 10 to avoid performing the setting action for the same sensor in each operation status monitoring device 10 at the same time. For example, the user can delete the sensor icon by dragging and dropping the sensor icon onto the icon of the trash can.

[0058] Alternatively, in the operation status monitoring device 10_2, the display control unit 12 may also disable the sensor icon i21_1 so that the user cannot perform the setting operation on the sensor icon i21_1. That is, in the display unit 11 of the operation status monitoring device 10_2, only the sensor icons i21-2 to i21_11 corresponding to the usable sensors are in a state where the setting operation can be input. This can prevent a sensor from being set repeatedly in multiple operation status monitoring devices 10.

[0059] In addition, the following situation is envisioned, that is, in the action state monitoring device 10_1, the sensor 21_1 that has established a corresponding relationship with the right upper arm (part p1) of the subject P1 fails during use, and becomes a state in which the action cannot be performed. In this case, the user can perform a reset action for the sensor icon corresponding to the usable sensor that has not established a corresponding relationship and is displayed in the sensor icon display area S1. Thus, the acceptance unit 13 can accept the user's reset action for the sensor icon.

[0060] Specifically, among the sensors 21_1 to 21_11, sensors 21_1 and 21_2 for which the operation state monitoring device 10_1 has executed the correspondence processing, and sensors 21_5 to 21_11 other than sensors 21_3 and 21_4 for which the operation state monitoring device 10_2 has executed the correspondence processing can be used.

[0061] For example, the user drags and drops one sensor icon i21_5 among the sensor icons i21_5 to i21_11 corresponding to the sensors 21_5 to 21_11 to the right upper arm part p_1 of the human body schematic diagram S2. Thus, the accepting unit 13 accepts the user's resetting action for the sensor icon i21_5. The processing unit 14 can establish a correspondence between the sensor 21_5 corresponding to the sensor icon i21_5 and the right upper arm (part p1) of the subject P1, instead of the sensor 21_1 that is in a state where the action cannot be performed.

[0062] Thus, the correspondence between the sensor and the wearer's part can be changed by a simple operation. In addition, before executing the correspondence establishment process between other sensors 21_5 and the subject's right upper arm p1, the user can also perform an input action to cancel the correspondence between the sensor 21_1 that originally established the correspondence and the subject's right upper arm (part p1).

[0063] As described above, when multiple sensors 21 are shared between multiple action state monitoring devices 10, it is assumed that a sensor used by another subject is mixed in. In this case, there is a problem that it is unclear which sensor corresponds to which action state monitoring device. Therefore, the action state monitoring device 10_1 has a control unit 16. The control unit 16 changes the display method of the corresponding sensor icon according to the input from the sensor 21.

[0064] The control unit 16 can change the display mode so that the corresponding sensor icon i21_1 takes an action corresponding to the action of one sensor 21_1 among the multiple sensors 21. For example, the control unit 16 can change the sensor icon of the object displayed on the screen of the display unit 11 over time in a manner linked to the action of the sensor 21.

[0065] For example, Figure 6 As shown in FIG. 1 , the control unit 16 can rotate the sensor icon i21_1 of the object with a predetermined axis as the rotation axis according to the rotation action of the sensor 21_1. As an example, the control unit 16 can rotate the sensor icon i21_1 of the object as shown in FIG. Figure 6 As indicated by a dotted arrow, an image that rotates about an axis passing through the center of gravity of the sensor icon i21_1 is displayed on the display unit 11 .

[0066] Furthermore, the control unit 16 may change the display color of the target sensor icon to a color different from the display colors of other sensor icons, and display the icon on the display unit 11. The control unit 16 may cause the target sensor icon to blink.

[0067] In addition, the sensor 21 may include an acceleration sensor. The control unit 16 may also change the display mode of the sensor icon of the object based on the tap input collected by the acceleration sensor to the sensor 21. In addition, the sensor 21 may also include a switch. The control unit 16 may also change the display mode of the sensor icon of the object based on the pressed state of the switch.

[0068] In this way, the display method of the sensor icon is changed according to the input from the sensor 21 side, so that even if the sensor icon corresponding to the same sensor is displayed in multiple operation status monitoring devices 10_1 and 10_2, it can be easily determined which operation status monitoring device 10_1 and 10_2 it corresponds to.

[0069] Furthermore, the control unit 16 can delete from the display unit 11 a sensor icon whose display mode does not change in response to the input from the sensor 21 among the plurality of sensor icons displayed on the display unit 11. For example, it is assumed that, when the sensor icon i21_1 corresponding to the same sensor 21_1 is displayed in the operation status monitoring devices 10_1 and 10_2, the display mode of the sensor icon i21_1 of the object displayed on the display unit 11 of the operation status monitoring device 10_1 changes in response to the input from the sensor 21_1.

[0070] In this case, in the operation status monitoring device 10_2, the display mode of the sensor icon i21_1 has not changed, and therefore the sensor icon i21_1 can be deleted from the display unit 11. In addition, in the operation status monitoring device 10_2, the control unit 16 can also delete the sensor icon whose display mode has not changed for a predetermined time from the display unit 11. As a result, on the display unit 11 of the operation status monitoring device 10_2, only the sensor icons i21_3 and i21_4 of the sensors 21_3 and 21_4 that have established a corresponding relationship with the operation status monitoring device 10_2 remain.

[0071] In this way, the sensors 21_1, 21_2, 21_5 to 21_11 corresponding to the deleted sensor icons i21_1, i21_2, i21_5 to i21_11 are disconnected from the operation state monitoring device 10_2. As a result, the disconnected sensors can be used by connecting to other operation state monitoring devices 10 and establishing a corresponding relationship. In addition, the user can also delete the sensor icon by dragging and dropping the sensor icon whose display mode does not change according to the input from the sensor 21 onto the trash can icon.

[0072] (Operation of the training support system 1)

[0073] Figure 7 , Figure 8Flowchart showing the action of the training assistance system 1. Here, as described above, it is assumed that the right elbow flexion and extension action of the subjects P1 and P2 is monitored by the action state monitoring devices 10_1 and 10_2, respectively. That is, sensors are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of the subject P1, and sensors are respectively worn on the right upper arm (part p1) and the right forearm (part p2) of the subject P2. Therefore, two sensors (sensors 21_1 and 21_2) are used in the action state monitoring device 10_1, and two different sensors (sensors 21_3 and 21_4) are used in the action state monitoring device 10_2.

[0074] In the following example, it is assumed that the correspondence relationship establishment process between the sensor and the wearing object part is first performed in the action state monitoring device 10_1, and then the correspondence relationship establishment process between the sensor and the wearing object part is performed in the action state monitoring device 10_2. Figure 7 The operation of the operation state monitoring device 10_1 is shown in FIG. Figure 8 The operation of the operation state monitoring device 10_2 is shown in FIG. Figure 7 , Figure 8 In the figures, the same symbols are used to mark the same processing.

[0075] like Figure 7 , Figure 8 As shown, first, the operation state monitoring devices 10_1 and 10_2 display sensor icons i21_1 to i21_11 corresponding to the plurality of sensors located within a predetermined distance on the display unit 11 (S11). At this time, the operation state monitoring devices 10_1 and 10_2 do not display the plurality of sensor icons corresponding to all sensors, and there may be sensor icons that are not displayed depending on the distance from the operation state monitoring devices 10_1 and 10_2.

[0076] Here, as an example, it is assumed that all sensors 21_1 to 21_11 are located within a predetermined distance from both the operation state monitoring devices 10_1 and 10_2. Therefore, it is assumed that the operation state monitoring devices 10_1 and 10_2 display sensor icons i21_1 to i21_1 corresponding to all sensors 21_1 to 21_11, respectively.

[0077] On the display unit 11, the following is displayed: Figure 5 The display screen shown includes: a sensor icon display area S1 displaying sensor icons corresponding to sensors within a predetermined distance from the operation status monitoring device 10; and a human body schematic diagram S2 displaying a wearing object portion.

[0078] In addition, when the user specifies the monitored action of the subject P, the display unit 11 can display the wear target part of the sensor used to measure the specified monitored action. The display unit 11 of each of the action state monitoring devices 10_1 and 10_2 can set the right upper arm p_1 and the right forearm p_2 to be displayed differently from the other parts p_3 to p_11 in the human body schematic diagram S2 and highlight them. That is, Figure 5 In the human body schematic diagram S2, the right upper arm p_1 and the right forearm p_2 can be displayed differently from the other parts p_3 to p_11.

[0079] Reference Figure 7 , the operation of the operation state monitoring device 10_1 is described. In the operation state monitoring device 10_1, for example, the user drags and drops a sensor icon i21_1 from the sensor icons i21_1 to i21_11 displayed in the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2. Thus, the receiving unit 13 receives the setting operation (S12).

[0080] Thereafter, the action status monitoring device 10_1 establishes an association between the identification information of the sensor 21_1 corresponding to the sensor icon i21_1 and the identification information of the right upper arm (part p1) of the wearer of the subject P1 according to the set action. Thus, the correspondence establishment process (S13) between the sensor 21_1 and the right upper arm (part p1) of the subject P1 is implemented. In addition, for other wearer parts (right forearm (part p2)), the dragging and dropping of the sensor icon i21_2 and the correspondence establishment process between the sensor 21_2 and the right forearm (part p2) of the subject P1 are also implemented in the same manner. That is, Figure 7 S12 and S13 in the above steps may be repeatedly performed according to the number of parts of the wearing object of the subject P1.

[0081] After establishing the correspondence between sensor 21_1 and the wearing object part p1, and between sensor 21_2 and the wearing object part p2, respectively, next, calibration of sensors 21_1 and 21_2 for measuring the movement of the monitoring object is performed (S14). Calibration refers to, for example, measuring the output value (error component) of the sensor used in the measurement of the movement of the monitoring object in a stationary state and subtracting the error component from the measured value. In this example, at least calibration of sensors 21_1 and 21_2 is performed. However, calibration is not limited to the case where it is performed on sensors for measuring the movement of the monitoring object, and for example, it can also be performed on all sensors 21_1 to 21_11 before the display processing of the sensor icon corresponding to the paired sensor.

[0082] After the calibration is completed, before the measuring device 20 including the sensor 21 is actually worn on the subject P1, the sensor 21 can be identified (S15). The sensor 21 can be identified by moving the sensor 21 to change the display mode of the sensor icon. As an example, by rotating the sensor 21_1, as shown in FIG. Figure 5 As shown, the sensor icon i21_1 rotates. Thus, when a plurality of sensors 21 are shared among a plurality of operation state monitoring devices 10, even if a sensor used by another subject is mixed in, it is possible to easily identify which operation state monitoring device 10 the sensor 21 corresponds to.

[0083] In addition, the control unit 16 can delete the sensor icons whose display mode does not change according to the input from the sensor 21 from the display unit 11 among the multiple sensor icons displayed on the display unit 11. The sensors 21_1, 21_2, 21_5 to 21_11 corresponding to the deleted sensor icons i21_1, i21_2, i21_5 to i21_11 can be disconnected from the operation state monitoring device 10_2. As a result, the disconnected sensors can be used by connecting to other operation state monitoring devices 10 to establish a corresponding relationship.

[0084] The sensors 21_1 and 21_2 are worn by the subject P1 (S16). Thereafter, the motion of the monitoring target is measured based on the detection results of the sensors 21_1 and 21_2 (S17).

[0085] The calculation result indicating the action state of "right elbow flexion and extension" can be calculated by the difference between the detection result of the sensor 21_1 worn on the right upper arm (part p1) of the subject P1 and the detection result of the sensor 21_2 worn on the right forearm (part p2). The action state monitoring device 10_1 generates the calculation result indicating the action state of "right elbow flexion and extension" based on the detection results of the sensors 21_1 and 21_2. The display unit 11 displays the details of the measurement result (for example, a graphical measurement result, etc.).

[0086] Next, refer to Figure 8, the operation of the action state monitoring device 10_2 is explained. After the correspondence between the sensors 21_1, 21_2 in the action state monitoring device 10_1 and the wearing object parts is established, in the action state monitoring device 10_2, the sensor icons i21_1, i21_2 corresponding to the sensors 21_1, 21_2 set in the action state monitoring device 10_1 are deleted from the sensor icons i21_1 to i21_11 displayed on the display unit 11 (S20). As a result, in the sensor icon display area S1 of the display unit 11 of the action state monitoring device 10_2, usable sensor icons i21_3 to i21_11 other than the sensor icons i21_1, i21_2 will remain. In addition, as described above, the disabling process of the sensor icons i21_1, i21_2 can also be performed.

[0087] Then, in the action state monitoring device 10_2, the user drags and drops, for example, one sensor icon i21_3 from among the sensor icons i21_3 to i21_11 displayed in the sensor icon display area S1 to the right upper arm p_1 of the human body schematic diagram S2. As a result, the accepting unit 13 accepts the setting operation (S12).

[0088] Thereafter, the action status monitoring device 10_2 establishes an association between the identification information of the sensor 21_3 corresponding to the sensor icon i21_3 and the identification information of the right upper arm (part p1) of the wearer of the subject P2 according to the set action. Thus, the correspondence establishment process (S13) between the sensor 21_3 and the right upper arm (part p1) of the subject P2 is implemented. In addition, for other wearer parts (right forearm (part p2)), the dragging and dropping of the sensor icon i21_4 and the correspondence establishment process between the sensor 21_4 and the right forearm (part p2) of the subject P2 are also implemented. That is, Figure 8 S12 and S13 in the above step may be repeatedly performed according to the number of parts of the wearing object of the subject P2. Figure 7 As described in , the processing of S14 to S17 is also executed in the operation state monitoring device 10_2.

[0089] In this way, the training assistance system 1 involved in this embodiment has multiple action state monitoring devices 10 that display multiple sensor icons corresponding to multiple sensors located within a predetermined distance. Moreover, each action state monitoring device 10 establishes a correspondence between the sensor corresponding to the sensor icon and the wearing object part of the subject according to the set action of the displayed sensor icon. As a result, the training assistance system 1 can share multiple sensors 21_1 to 21_11 in multiple action state monitoring devices 10, and can realize a highly convenient system.

[0090] Furthermore, if a correspondence between a sensor and a wearable part of a subject is established in one motion state monitoring device, the sensor icon corresponding to the sensor for which the correspondence has been established is deleted in other motion state monitoring devices, or the sensor icon is disabled in a manner that makes it impossible to perform the setting operation. This can prevent a sensor from being repeatedly set in multiple motion state monitoring devices 10.

[0091] In addition, the order of processing of the training assistance system 1 is not limited to Figure 7 , Figure 8 For example, calibration may be performed before displaying the sensor icon corresponding to the paired sensor. In addition, after the sensor 21 is worn on the subject P, it may be confirmed which action state monitoring device 10 the sensor 21 corresponds to.

[0092] Furthermore, although the present disclosure is described as a hardware configuration in the above-mentioned embodiment, the present disclosure is not limited thereto. The present disclosure can realize the control process of the operation state monitoring device by causing a CPU (Central Processing Unit) to execute a computer program.

[0093] In addition, various types of non-transitory computer readable medium can be used to store the above-mentioned program and provide it to the computer. Non-transitory computer readable medium includes various types of tangible recording medium. Non-transitory computer readable medium includes, for example, magnetic recording medium, optical magnetic recording medium, CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memory. Magnetic recording medium is, for example, a floppy disk, a magnetic tape, a hard disk drive, etc. Optical magnetic recording medium is, for example, an optical magnetic disk. Semiconductor memory is, for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash ROM, a RAM (Random Access Memory), etc. In addition, various types of transitory computer readable medium can be used to provide the program to the computer. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer readable media can provide the program to the computer via wired communication lines such as wires and optical fibers or wireless communication lines.

[0094] According to the disclosure described in this way, it is obvious that the embodiments of the present disclosure can be changed in many ways. Such changes should not be regarded as departing from the spirit and scope of the present disclosure, and, for those skilled in the art, all such modifications are obvious and are included in the scope of the technical solution.

Claims

1. An action state monitoring system, comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices respectively monitoring each subject through the worn sensors, wherein: The plurality of operation status monitoring devices respectively include: an icon display unit for displaying a plurality of sensor icons corresponding to the plurality of sensors respectively; a display control unit that causes the icon display unit to display sensors that are within a predetermined distance from the operation status monitoring device among the plurality of sensors; an accepting unit that accepts a setting operation for a sensor icon displayed on the icon display unit; a processing unit that establishes a correspondence between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation; A control unit changes the display mode of the corresponding sensor icon according to the input from the sensor.

2. The operating status monitoring system according to claim 1, wherein: The control unit deletes from the icon display unit a sensor icon whose display mode does not change according to an input from the sensor among a plurality of sensor icons displayed on the icon display unit, and disconnects the sensor corresponding to the sensor icon from the operation status monitoring device.

3. The operating state monitoring system according to claim 2, wherein: The control unit deletes a sensor icon whose display mode has not changed for a predetermined period of time from the icon display unit, and disconnects the sensor corresponding to the sensor icon from the operation state monitoring device.

4. The operating state monitoring system according to claim 1, wherein: The control unit changes the display mode so that the corresponding sensor icon takes an action corresponding to an action of one of the plurality of sensors.

5. The operating status monitoring system according to claim 1, wherein: The sensor comprises an acceleration sensor, The control unit changes a display mode based on a tap input to the sensor collected by the acceleration sensor.

6. The operating state monitoring system according to claim 1, wherein: The sensor includes a switch, The control unit changes a display mode based on a pressed state of the switch.

7. A control method for a motion state monitoring system comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of motion state monitoring devices respectively monitoring each subject through the worn sensors, wherein: The plurality of operation status monitoring devices are respectively configured to perform the following processing, namely: a process of causing an icon display unit to display a plurality of sensor icons corresponding to sensors, among the plurality of sensors, that are within a predetermined distance from the operation status monitoring device; receiving a setting operation for a sensor icon displayed on the icon display unit; A process of establishing a correspondence relationship between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation; A process of changing the display mode of the corresponding sensor icon according to the input from the sensor.

8. A program product for controlling an action state monitoring system, the action state monitoring system comprising a plurality of sensors respectively worn at parts of the bodies of a plurality of subjects and a plurality of action state monitoring devices for respectively monitoring the subjects through the worn sensors, wherein: The program product causes the plurality of operation status monitoring devices to respectively perform the following processing, namely: a process of causing an icon display unit to display a plurality of sensor icons corresponding to sensors, among the plurality of sensors, that are within a predetermined distance from the operation status monitoring device; receiving a setting operation for a sensor icon displayed on the icon display unit; A process of establishing a correspondence relationship between the sensor corresponding to the sensor icon and the wearing target part of the subject according to the setting operation; A process of changing the display mode of the corresponding sensor icon according to the input from the sensor.

Images