Operating status monitoring system, control method, and program

Abstract

To easily identify a sensor corresponding to an operating state monitoring device when a plurality of operating state monitoring devices share sensors.SOLUTION: An operating state monitoring system comprises: a plurality of sensors respectively attached to a plurality of subjects' body parts; and a plurality of operating state monitoring devices for respectively monitoring each of the subjects by the attached sensors. The plurality of operating state monitoring devices comprise: an icon display part for displaying a plurality of sensor icons respectively corresponding to a plurality of sensors; a display control part for displaying a sensor, out of the plurality of sensors, which is within a prescribed distance of the operating state monitoring device, on the icon display part; a reception part for receiving a setting operation relative to the sensor icon displayed on the icon display part; a processing part for associating the sensor corresponding to the sensor icon with an attachment object part of the subject according to the setting operation; and a control part for changing a display mode of the corresponding sensor icon according to an input from the sensor.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an operating state monitoring system, a control method, and a program.

Background Art

[0002] Patent Document 1 discloses an operating state monitoring system including a plurality of sensors respectively associated with a plurality of parts of a subject's body and an operating state monitoring device. The plurality of sensors are respectively associated with the parts by pairing processing performed with the operating state monitoring device. In this operating state monitoring system, sensors are selected based on a monitoring target operation, and the operating state of the subject is monitored based on the detection results by the selected sensors.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When monitoring the operations of a plurality of subjects, a set of a plurality of sensors with each attachment target part set is prepared for each subject, and each set is used by a different operating state monitoring device. Thus, since the attachment target part of each sensor in each set is set for each subject, if a sensor in one set fails, the sensors in other sets cannot be used. Further, in order to divert the sensors in other sets, it is necessary to perform an operation of changing the attachment target part linked to the sensor, which is troublesome and time-consuming.

[0005] Therefore, there is a need to easily share sensors among multiple motion state monitoring devices so that the sensors can be reused across them. However, if sensors are shared among multiple motion state monitoring devices and sensors used by different subjects get mixed up, there is a problem in that it becomes impossible to know which sensor corresponds to which motion state monitoring device. It is also conceivable that the motion state of subjects using such motion state monitoring devices could be inferred using, for example, a learned model generated by machine learning.

[0006] The present invention has been made in view of the above background, and aims to provide an operating state monitoring system, control method, and program that can easily identify the sensor corresponding to an operating state monitoring device when multiple sensors are shared by multiple operating state monitoring devices. [Means for solving the problem]

[0007] An operating state monitoring system according to one embodiment includes a plurality of sensors attached to body parts of a plurality of subjects, and a plurality of operating state monitoring devices that monitor each subject using the attached sensors. Each of the plurality of operating state monitoring devices includes an icon display unit that displays a plurality of sensor icons corresponding to the plurality of sensors, a display control unit that causes the icon display unit to display sensors among the plurality of sensors that are within a predetermined distance from the operating state monitoring device, a reception unit that receives setting operations for the sensor icons displayed on the icon display unit, a processing unit that associates the sensor corresponding to the sensor icon with the attachment target area of ​​the subject according to the setting operation, and a control unit that changes the display mode of the corresponding sensor icon according to the input from the sensor.

[0008] A control method according to one embodiment is a control method for an operating state monitoring system including a plurality of sensors attached to body parts of a plurality of subjects, and a plurality of operating state monitoring devices that monitor each subject using the attached sensors, wherein each of the plurality of operating state monitoring devices performs the following processes: displaying a plurality of sensor icons on an icon display unit corresponding to sensors among the plurality of sensors that are within a predetermined distance from the operating state monitoring device; receiving a setting operation for the sensor icons displayed on the icon display unit; associating the sensor corresponding to the sensor icon with the attachment target part of the subject in accordance with the setting operation; and changing the display mode of the corresponding sensor icon in accordance with the input from the sensor.

[0009] A program according to one embodiment is a program for controlling an operating state monitoring system which includes a plurality of sensors attached to body parts of a plurality of subjects, and a plurality of operating state monitoring devices that monitor each subject using the attached sensors, and causes each of the plurality of operating state monitoring devices to perform the following processes: display a plurality of sensor icons on an icon display unit corresponding to sensors among the plurality of sensors that are within a predetermined distance from the operating state monitoring device; accept a setting operation for the sensor icons displayed on the icon display unit; associate the sensor corresponding to the sensor icon with the attachment target part of the subject according to the setting operation; and change the display pattern of the corresponding sensor icon according to the input from the sensor. [Effects of the Invention]

[0010] According to the present invention, when multiple sensors are shared by multiple operating state monitoring devices, it becomes possible to easily identify the sensor corresponding to each operating state monitoring device. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing an example configuration of a training support system according to an embodiment. [Figure 2] This figure shows an example of a mounting location for a measuring device. [Figure 3] This figure shows an example of the configuration of measuring instruments installed in the training support system shown in Figure 1. [Figure 4] Figure 3 shows an example of how to install the measuring instrument. [Figure 5] This figure shows an example of a display screen. [Figure 6] This figure shows an example of a display screen. [Figure 7] Figure 1 is a flowchart showing the operation of one of the operational status monitoring devices in the training support system. [Figure 8] Figure 1 is a flowchart showing the operation of the other operational status monitoring device in the training support system. [Modes for carrying out the invention]

[0012] Embodiments of this disclosure will be described below with reference to the drawings. For clarity of explanation, the following descriptions and drawings have been omitted and simplified as appropriate. In addition, the same elements are denoted by the same reference numerals in each drawing, and redundant explanations are omitted where necessary. In the following embodiments, when numbers such as the number of elements, quantities, amounts, or ranges are mentioned, the number is not limited to the number mentioned unless it is specifically stated or clearly defined in principle. Furthermore, structures, etc., described in the embodiments shown below are not necessarily essential to the technical concept of this disclosure unless they are specifically stated or clearly defined in principle.

[0013] Figure 1 is a block diagram showing an example configuration of the training support system 1 according to an embodiment. The training support system 1 is a system for monitoring the movements of a subject and, based on the monitoring results, providing support to bring the subject's movements closer to desired movements. The training support system 1 is used by a user, such as a caregiver.

[0014] As shown in FIG. 1, the training support system 1 includes a plurality of operation state monitoring devices 10 and a plurality of measuring devices 20. In this embodiment, an example in which 11 measuring devices 20 are shared between two operation state monitoring devices 10 will be described. The training support system 1 can monitor a plurality of subjects P. The plurality of operation state monitoring devices 10 respectively monitor the plurality of subjects P. In the training support system 1 of this embodiment, two operation state monitoring devices 10 can monitor two subjects P.

[0015] Hereinafter, each of the two operation state monitoring devices 10 will also be referred to as operation state monitoring devices 10_1 and 10_2 for distinction. It is assumed that the operation state monitoring device 10_1 monitors the operation state of the subject P1, and the operation state monitoring device 10_2 monitors the operation state of the subject P_. Also, each of the 11 measuring devices 20 will also be referred to as measuring devices 20_1 to 20_11 for distinction.

[0016] At least one of the 11 shared measuring devices is used by one of the operation state monitoring devices 10_1, and at least one of the remaining measuring devices is used by the other operation state monitoring device 10_2. The measuring devices 20_1 to 20_11 are attached to any one of the parts p1 to p11 of the operation detection target among various parts of the bodies of the plurality of subjects P. Hereinafter, the attachment target parts p1 to p11 will also be collectively referred to as part p.

[0017] The measuring devices 20_1 to 20_11 are associated with any one of the parts p1 to p11 of the two subjects P1 and P respectively by an association process performed between any one of the operation state monitoring devices 10_1 and 10_2. The measuring devices 20_1 to 20_11 detect the movement of the parts p1 to p11 to which they are attached using motion sensors (hereinafter simply referred to as sensors) 21_1 to 21_11 such as gyro sensors. The operation state monitoring devices 10_1 and 10_2 monitor the operation states of the subjects P1 and P respectively based on the detection results from the sensors of the measuring devices 20 attached to the subjects P1 and P2. Hereinafter, the sensors 21_1 to 21_11 will also be collectively referred to as sensor 21.

[0018] FIG. 2 is a diagram showing an example of a site p to which the measuring device 20 is to be attached. In the example of FIG. 2, the sites p1 to p11 to which the measuring device 20 is to be attached are the right upper arm, the right forearm, the head, the back (trunk), the waist (pelvis), the left upper arm, the left forearm, the right thigh, the right lower leg, the left thigh, and the left lower leg, respectively. In this example, the back and the waist are assumed to be arranged on the back side of the subject P. The measuring device 20 is attached to at least one attachment target site of a plurality of subjects P.

[0019] The monitored actions include, for example, actions such as right shoulder flexion and extension, right shoulder abduction and adduction, right shoulder internal and external rotation, right elbow flexion and extension, right forearm pronation and supination, head flexion and extension, head rotation, thoracolumbar flexion and extension, thoracolumbar rotation, thoracolumbar lateral flexion, left shoulder flexion and extension, left shoulder abduction and adduction, left shoulder internal and external rotation, left elbow flexion and extension, left forearm pronation and supination, etc. Also, the monitored actions include the movement of the site itself to which the sensor is attached.

[0020] For example, the monitored actions include the angles of the joints of the body of the subject P measured based on the detection results of a plurality of sensors, and the angles of the joints in an arbitrary coordinate system measured based on the detection result of any one of the sensors. The monitored actions can be specified by a user such as an assistant.

[0021] Here, as an example, it is assumed that the right elbow flexion and extension movements of two subjects P1 and P2 are monitored. The right elbow flexion and extension movement can be measured based on the respective detection results of the sensors attached to the right upper arm (site p1) and the right forearm (site p2). In this case, for example, two measuring devices are respectively attached to the right upper arm (site p1) and the right forearm (site p2) of one subject P1, and two different measuring devices are respectively attached to the right upper arm (site p1) and the right forearm (site p2) of the other subject P2. Here, as an example, it is assumed that the measuring device 20_1 is attached to the right upper arm (site p1) of the subject P1, and the measuring device 20_2 is attached to the right forearm (site p2). Also, it is assumed that the measuring device 20_3 is attached to the right upper arm (site p1) of the subject P2, and the measuring device 20_4 is attached to the right forearm (site p2).

[0022] Furthermore, the user may select multiple different monitored motion items simultaneously. For example, the user may select "right elbow flexion and extension" and "right shoulder internal and external rotation" in motion status monitoring device 10_1, and "left elbow flexion and extension" and "left shoulder internal and external rotation" in motion status monitoring device 10_2.

[0023] Right elbow flexion and extension can be measured based on the detection results of sensors attached to the right upper arm (part p1) and right forearm (part p2). Similarly, right shoulder internal and external rotation can be measured based on the detection results of sensors attached to the right upper arm (part p1) and right forearm (part p2). In addition, left elbow flexion and extension can be measured based on the detection results of sensors attached to the left upper arm (part p6) and left forearm (part p7). Similarly, left shoulder internal and external rotation can be measured based on the detection results of sensors attached to the left upper arm (part p6) and left forearm (part p7).

[0024] (Example configurations for measuring instruments 20_1 to 20_11) Figure 3 shows an example of the configuration of measuring instrument 20_1. Note that measuring instruments 20_2 to 20_11 are the same as those for measuring instrument 20_1, so their explanation is omitted.

[0025] As shown in Figure 3, the measuring device 20_1 includes a sensor 21_1, a mounting pad 22_1, and a belt 23_1. The belt 23_1 is configured to be wrapped around the area of ​​the subject P whose movement is to be detected. The sensor 21_1 is, for example, incorporated into the mounting pad 22_1. The mounting pad 22_1 is also configured to be detachable from the belt 23_1.

[0026] Figure 4 shows an example of how the measuring device 20_1 is attached. In the example in Figure 4, the belt 23_1 is wrapped around the upper right arm (part p1), which is one of the body parts to be detected for motion detection of subject P. The sensor 21_1 is attached to the belt 23_1 via the mounting pad 22_1 after the correspondence process and calibration are completed.

[0027] (Example configuration of the operating status monitoring device 10) The operating state monitoring device 10 is a device that outputs a calculation result representing the operating state of subject P based on the detection results (sensing values) of sensors 21_1 to 21_11. The operating state monitoring device 10 may be, for example, a PC (Personal Computer), a mobile phone terminal, a smartphone, or a tablet terminal. The operating state monitoring device 10 is configured to communicate with sensors 21_1 to 21_11 via a network (not shown). The operating state monitoring device 10 can also be called an operating state monitoring system.

[0028] Since the operating status monitoring device 10_2 has the same configuration as the operating status monitoring device 10_1, the detailed configuration of the operating status monitoring device 10_2 is omitted in Figure 1. The configuration of the operating status monitoring device 10_1 will be described below.

[0029] As shown in Figure 1, the operating status monitoring device 10_1 includes a display unit 11, a display control unit 12, a reception unit 13, a processing unit 14, a wireless communication unit 15, a control unit 16, an arithmetic processing unit 17, and an operation unit 18. The display unit 11 is, for example, a display device that displays multiple sensor icons corresponding to multiple sensors 21_1 to 21_11. Figure 5 shows an example of a display screen S displayed on the display unit 11. The area of ​​the display screen S that displays the sensor icons is called the sensor icon display area S1. The display unit 11 also displays an input screen for information about the subject, a selection screen for monitoring results to be displayed on the display unit 11, and monitor results generated after monitoring the subject's operating status when receiving operations from the user.

[0030] Furthermore, the display screen, which includes the sensor icon display area S, also includes a schematic diagram of the human body S2, which shows the parts of the human body to which the sensors are to be attached, as will be described later. This schematic diagram of the human body S2 is a display area for the parts of the human body to which the sensors are to be attached, showing the parts of the human body to which the sensors are to be attached. The display screen S shown in Figure 5 is displayed when a process is performed to associate one of the multiple sensors 21 with one of the parts of the subject P to which the sensors are to be attached.

[0031] In the example shown in Figure 5, the front and back sides of the human body are displayed separately. The attachment points p1 to p11 of subject P in Figure 2 correspond to p_1 to p_11 in the schematic human body diagram S2 in Figure 5, respectively. Hereafter, as needed, p_1 to p_11 in the schematic human body diagram S2 will be referred to as the right upper arm, right forearm, head, back (trunk), waist (pelvis), left upper arm, left forearm, right thigh, right lower leg, left thigh, and left lower leg, respectively. The display unit 11 can also display the calculation results based on the detection results of one or more sensors, for example, in a graph.

[0032] The display control unit 12 displays on the display unit 11 the sensors among the multiple sensors 21 that are within a predetermined distance from the operating status monitoring device 10_1. For example, the wireless communication unit 15 can receive identification information from multiple sensors 21 located within a predetermined distance via short-range wireless communication. Based on the received identification information, the display control unit 12 displays a different sensor icon for each sensor on the display unit 11. That is, the display unit 11 displays a list of sensor icons corresponding to each of the usable sensors that are not associated with a mounting target area.

[0033] Here, the wireless communication unit 15 performs data communication compliant with the Bluetooth® standard as short-range wireless communication. The operating status monitoring device 10 pairs with the sensor 21, which is within communication range, by exchanging identification information such as Bluetooth addresses and performing mutual authentication, and connects to the sensor 21. Once pairing is complete, the necessary information is stored in both devices, and thereafter, if the sensor 21 is within a predetermined distance from the operating status monitoring device 10, pairing is not required and a connection is established.

[0034] Furthermore, the wireless communication unit 15 can also perform short-range wireless communication compliant with NFC (Near Field Communication), UWB (Ultra Wideband), WiFi (registered trademark), etc. Note that the predetermined distance mentioned above may vary depending on the type of short-range wireless communication adopted.

[0035] The operating status monitoring device 10_1 may also have a distance measuring sensor (not shown) such as LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) that uses pulsed laser light as a measurement signal. The distance measuring sensor is capable of measuring the distance to sensors located around the operating status monitoring device 10. The display control unit 12 can also display on the display unit 11 sensors that are within a predetermined distance from the operating status monitoring device 10_1 based on the measurement results of the distance measuring sensor.

[0036] These multiple sensor icons are selected by the user to associate the sensor 21 with the mounting location p. The operation unit 18 may include an input device such as a mouse or keyboard. The operation unit 18 may also be a touch panel that integrates a display device and an input device. For example, the user can select multiple sensor icons by operating the mouse or keyboard on the operation unit 18, or by touching the touch panel of the operation unit 18 with a stylus or finger.

[0037] The reception unit 13 receives setting operations for the sensor icons displayed on the display unit 11. Setting operations are input operations for the sensor icons to associate the sensor corresponding to the sensor icon with one of the mounting parts p. For example, the user operates the operation unit 18 to move the sensor icon i21_1 displayed in the sensor icon display area S1 to the upper right arm p_1 on the human body diagram S2. Specifically, the user drags and drops the sensor icon i21_1 displayed in the sensor icon display area S1 to the upper right arm p_1 on the human body diagram S2 using mouse operation or touch operation. This setting operation is shown by the dotted line in Figure 5. In this way, the reception unit 13 receives the setting operation for the sensor icon by the user.

[0038] Furthermore, multiple sensors 21 may be equipped with light-emitting units capable of changing the color of the emitted light. For example, a full-color LED can be used as the light-emitting unit. As an example, the light-emitting unit may have a configuration in which a red LED chip, a green LED chip, and a blue LED chip are sealed with a light-transmitting resin. By controlling the brightness of the three types of LED chips, the light-emitting unit can achieve a variety of emitted colors.

[0039] The operating status monitoring device 10_1 may further include a color control unit that performs a process to make the display color of multiple sensor icons the same as the emission color of the respective light-emitting parts of the multiple sensors. The user can select a sensor with the same emission color as the display color of the sensor icon, check the human body diagram S2, and actually attach it to the target part p of the subject P. This makes it possible to prevent incorrect sensor attachment.

[0040] The processing unit 14 associates the sensor corresponding to the sensor icon with the target mounting area of ​​the subject, according to the set operation. This association process is performed by pairing the operating state monitoring device 10 and the sensor 21 in advance, and by linking the identification information of the mounting area p with the identification information of the sensor 21 on the application of the operating state monitoring device 10.

[0041] Thus, according to this disclosure, a sensor 21 located within a predetermined distance from multiple operating status monitoring devices 10 can be linked to a mounting location p in any of the operating status monitoring devices 10 with a simple and easy operation. This allows the sensor 21 to be shared among multiple operating status monitoring devices 10, resulting in a highly convenient system.

[0042] The arithmetic processing unit 17 performs calculations based on the detection results of each of the sensors 21_1 to 21_11 to generate calculation results representing the operational state of the monitored operation of subject P. The arithmetic processing unit 17 may also perform calculations using a trained model generated by machine learning using past sensor detection results. By performing calculations using this trained model, the arithmetic processing unit 17 can calculate with greater accuracy whether the operational state of the monitored operation of subject P is good or not. The arithmetic processing unit 17 transmits the calculation results to the display control unit 12.

[0043] The display control unit 12 visualizes the information (calculation results) received from the calculation processing unit 17 in a graph or the like, and then displays it on the display unit 11. This allows the user to know the operating status of the monitored action of subject P, which can be used, for example, to assist subject P.

[0044] Note that the setting operation is not limited to drag and drop. The reception unit 13 may accept the setting operation by having the user click the sensor icon displayed in the sensor icon display area S1 and the mounting target area on the human body schematic diagram S2 within a predetermined time.

[0045] Alternatively, the user may click on the mounting area in the human body diagram S2, which may trigger the reception unit 13 to accept the setting operation. The processing unit 14 can also automatically associate one of the sensors corresponding to the multiple sensor icons displayed on the display unit 11 with the mounting area p of the subject P, in response to the setting operation. For example, the processing unit 14 can pair multiple sensors that are not yet associated with any of the mounting areas p of the subject P, starting with those closest to the operating state monitoring device 10_1, and associate them with one of the mounting areas p of the subject P.

[0046] Furthermore, in multiple operating status monitoring devices 10_1 and 10_2, the same sensor icon may be displayed. In this way, when operating status monitoring devices 10_1 and 10_2 simultaneously detect the same sensor, they can understand that they are both detecting the same sensor at the same location. For example, suppose that the sensor icon i21_1 corresponding to the same sensor 21_1 is displayed on the respective displays of operating status monitoring devices 10_1 and 10_2. In this case, if the association between the sensor 21_1 and the mounting location p1 of the subject P1 is made first in one operating status monitoring device 10_1, the display control unit 12 of the other operating status monitoring device 10_2 performs the process of deleting the sensor icon i21_1 corresponding to the already associated sensor 21_1.

[0047] In other words, the sensor icon i21_1 will not be displayed on the display unit 11 of the operating status monitoring device 10_2. To put it another way, only the sensor icons i21-2 to i21_11 corresponding to the available sensors will remain on the display unit 11 of the operating status monitoring device 10_2. If the same sensor icon is displayed on two operating status monitoring devices 10, the user may delete the sensor icon on one of the operating status monitoring devices 10 to prevent simultaneous setting operations for the same sensor on each device 10. For example, the user can delete the sensor icon by dragging and dropping it onto the trash can icon.

[0048] Alternatively, in the operating status monitoring device 10_2, the display control unit 12 may disable the sensor icon i21_1 so that the user cannot perform a setting operation on the sensor icon i21_1. In other words, on the display unit 11 of the operating status monitoring device 10_2, only the sensor icons i21-2 to i21_11 corresponding to the available sensors will be in a state where setting operations can be input. This prevents a single sensor from being set on multiple operating status monitoring devices 10.

[0049] Furthermore, in the operational status monitoring device 10_1, it is conceivable that the sensor 21_1 associated with the subject P1's upper right arm (part p1) may malfunction during use, rendering it inoperable. In this case, the user can perform a reset operation on the sensor icon displayed in the sensor icon display area S1, corresponding to an available sensor that is not currently associated. This allows the reception unit 13 to accept the user's reset operation on the sensor icon.

[0050] Specifically, of the sensors 21_1 to 21_11, sensors 21_1 and 21_2, which have undergone mapping processing by the operating state monitoring device 10_1, and sensors 21_3 and 21_4, which have undergone mapping processing by the operating state monitoring device 10_2, are usable, as are sensors 21_5 to 21_11.

[0051] For example, the user drags and drops sensor icon i21_5, which is one of the sensor icons i21_5 to i21_11 corresponding to sensors 21_5 to 21_11, onto the upper right arm p_1 of the human body diagram S2. As a result, the reception unit 13 receives the user's reset operation for sensor icon i21_5. The processing unit 14 can then associate sensor 21_5, which corresponds to sensor icon i21_5, with the upper right arm (part p1) of subject P1, in place of sensor 21_1, which is in an inoperable state.

[0052] This makes it possible to change the mapping between the sensor and the mounting area with a simple operation. Before performing the mapping process between other sensors 21_5 and the subject's upper right arm p1, the user may perform an input operation to unmap the originally mapped sensor 21_1 from the subject's upper right arm (area p1).

[0053] As described above, when multiple operating status monitoring devices 10 share multiple sensors 21, it is conceivable that sensors used by different subjects may get mixed up. In this case, there is a problem in that it becomes impossible to know which sensor corresponds to which operating status monitoring device. Therefore, the operating status monitoring device 10_1 has a control unit 16. The control unit 16 changes the display mode of the corresponding sensor icon in response to input from the sensor 21.

[0054] The control unit 16 can change the display mode so that the corresponding sensor icon i21_1 moves in accordance with the movement of one of the multiple sensors 21, sensor 21_1. For example, the control unit 16 can change the sensor icon of the target displayed on the screen of the display unit 11 over time in conjunction with the movement of sensor 21.

[0055] For example, as shown in Figure 6, the control unit 16 can rotate the target sensor icon i21_1 around a predetermined axis in response to the rotational movement of the sensor 21_1. As one example, the control unit 16 can rotate the target sensor icon i21_1 around an axis passing through its center of gravity, and display the rotating image of the sensor icon i21_1 on the display unit 11, as indicated by the dotted arrow in Figure 6.

[0056] Furthermore, the control unit 16 may, for example, change the display color of the target sensor icon to a different color from the display colors of other sensor icons and display it on the display unit 11. The control unit 16 may also make the target sensor icon blink.

[0057] The sensor 21 may include an acceleration sensor. The control unit 16 may change the display mode of the target sensor icon based on the tap input to the sensor 21 collected by the acceleration sensor. The sensor 21 may also include a switch. The control unit 16 may change the display mode of the target sensor icon based on the pressed state of the switch.

[0058] In this way, by changing the display mode of the sensor icon in response to input from the sensor 21, even if multiple operating status monitoring devices 10_1 and 10_2 display the same sensor icon, it is easy to identify which operating status monitoring device 10_1 or 10_2 corresponds to which icon.

[0059] Furthermore, the control unit 16 can delete from the display unit 11 any sensor icons among the multiple sensor icons displayed on the display unit 11 that do not change their display mode in response to input from the sensor 21. For example, in the operating status monitoring devices 10_1 and 10_2, if the same sensor icon i21_1 corresponding to the same sensor 21_1 is displayed, the display mode of the target sensor icon i21_1 displayed on the display unit 11 of the operating status monitoring device 10_1 may have changed in response to input from the sensor 21_1.

[0060] In this case, the display mode of the sensor icon i21_1 does not change in the operating status monitoring device 10_2, so the sensor icon i21_1 may be deleted from the display unit 11. In addition, in the operating status monitoring device 10_2, the control unit 16 may delete from the display unit 11 any sensor icons whose display mode does not change for a predetermined time. As a result, only the sensor icons i21_3 and i21_4 of the sensors 21_3 and 21_4 associated with the operating status monitoring device 10_2 will remain on the display unit 11 of the operating status monitoring device 10_2.

[0061] In this way, sensors 21_1, 21_2, 21_5~21_11, which correspond to the deleted sensor icons i21_1, i21_2, i21_5~i21_11, are disconnected from the operating status monitoring device 10_2. As a result, the disconnected sensors can be used by connecting and associating them with other operating status monitoring devices 10. Alternatively, a user may delete a sensor icon that does not change its display in response to input from sensor 21 by dragging and dropping it onto the trash can icon.

[0062] (Operation of Training Support System 1) Figures 7 and 8 are flowcharts illustrating the operation of the training support system 1. Here, as described above, the flexion and extension movements of the right elbows of subjects P1 and P2 are monitored by motion state monitoring devices 10_1 and 10_2, respectively. Specifically, sensors are attached to the upper right arm (part p1) and right forearm (part p2) of subject P1, and sensors are attached to the upper right arm (part p1) and right forearm (part p2) of subject P2. Therefore, motion state monitoring device 10_1 uses two sensors (sensors 21_1 and 21_2), and motion state monitoring device 10_2 uses two different sensors (sensors 21_3 and 21_4).

[0063] In the following example, the operation status monitoring device 10_1 first performs the process of associating the sensor with the mounting target, and then the operation status monitoring device 10_2 performs the process of associating the sensor with the mounting target. Figure 7 shows the operation of the operation status monitoring device 10_1. Figure 8 shows the operation of the operation status monitoring device 10_2. In Figures 7 and 8, the same processes are denoted by the same reference numerals.

[0064] As shown in Figures 7 and 8, first, the operating status monitoring devices 10_1 and 10_2 each display sensor icons i21_1 to i21_11 corresponding to multiple sensors within a predetermined distance on the display unit 11 (S11). At this time, the operating status monitoring devices 10_1 and 10_2 do not each display multiple sensor icons for all sensors; there may be sensor icons that are not displayed depending on the distance from the operating status monitoring devices 10_1 and 10_2.

[0065] Here, as an example, we assume that all sensors 21_1 to 21_11 are within a predetermined distance from both the operating status monitoring devices 10_1 and 10_2. Therefore, both the operating status monitoring devices 10_1 and 10_2 will display the corresponding sensor icons i21_1 to i21_1 for all sensors 21_1 to 21_11.

[0066] The display unit 11 displays a display screen that includes a sensor icon display area S1, which displays sensor icons corresponding to sensors within a predetermined distance from the operating status monitoring device 10, as shown in Figure 5, and a schematic diagram of the human body S2, which displays the mounting target area.

[0067] Furthermore, when the user specifies the monitoring target operation of subject P, the display unit 11 may display the mounting location of the sensor used to measure the specified monitoring target operation. The display units 11 of the operation status monitoring devices 10_1 and 10_2 can highlight the upper right arm p_1 and the right forearm p2 in the human body schematic diagram S2 using a different display method (color, blinking, shading, etc.) than the other parts p3 to p11. That is, in the human body schematic diagram S2 of Figure 5, the upper right arm p_1 and the right forearm p2 may be displayed in a different manner than the other parts p3 to p11.

[0068] Referring to Figure 7, the operation of the operating status monitoring device 10_1 will be explained. In the operating status monitoring device 10_1, the user, for example, drags and drops one sensor icon i21_1 from the sensor icons i21_1 to i21_11 displayed in the sensor icon display area S1 onto the upper right arm p_1 of the human body schematic diagram S2. As a result, the reception unit 13 accepts the setting operation (S12).

[0069] Subsequently, the operation status monitoring device 10_1 associates the identification information of sensor 21_1 corresponding to the sensor icon i21_1 with the identification information of the upper right arm (part p1) of subject P1 to which the sensor is to be attached, according to the set operation. This establishes the correspondence between sensor 21_1 and subject P1's upper right arm (part p1) (S13). Similarly, for other attachment sites (right forearm (part p2)), the process of dragging and dropping sensor icon i21_2 and establishing the correspondence between sensor 21_2 and subject P1's right forearm (part p2) is performed. In other words, steps S12 and S13 in Figure 7 can be repeated for each attachment site of subject P1.

[0070] After the correspondence between sensor 21_1 and mounting location p1, and between sensor 21_2 and mounting location p2, the sensors 21_1 and 21_2 used to measure the monitored operation are then calibrated (S14). Calibration is a process that measures the output value (error component) of the sensor used to measure the monitored operation in a stationary state, and subtracts that error component from the measured value. In this example, at least sensors 21_1 and 21_2 are calibrated. However, calibration is not limited to sensors used to measure the monitored operation; for example, it may be performed on all sensors 21_1 to 21_11 before the display process of the sensor icon corresponding to the paired sensor.

[0071] After calibration is complete, the sensor 21 can be identified before actually attaching the measuring device 20, including the sensor 21, to the subject P1 (S15). The sensor 21 can be identified by moving the sensor 21 to change the display pattern of the sensor icon. For example, by rotating the sensor 21_1, the sensor icon i21_1 rotates as shown in Figure 5. This makes it easy to identify which operating state monitoring device 10 a sensor 21 corresponds to, even if sensors used by other subjects are mixed in when multiple sensors 21 are shared among multiple operating state monitoring devices 10.

[0072] Furthermore, the control unit 16 can delete from the display unit 11 any sensor icons whose display mode does not change in response to input from the sensor 21. The sensors 21_1, 21_2, 21_5~21_11 corresponding to the deleted sensor icons i21_1, i21_2, i21_5~i21_11 can be disconnected from the operating status monitoring device 10_2. As a result, the disconnected sensors can be used by connecting them to and associating them with other operating status monitoring devices 10.

[0073] Sensors 21_1 and 21_2 are attached to subject P1 (S16). Subsequently, the monitored operation is measured based on the detection results of sensors 21_1 and 21_2 (S17).

[0074] The calculation result representing the "right elbow flexion and extension" motion state can be calculated from the difference between the detection result of sensor 21_1 attached to the upper right arm (part p1) of subject P1 and the detection result of sensor 21_2 attached to the right forearm (part p2). The motion state monitoring device 10_1 generates a calculation result representing the "right elbow flexion and extension" motion state based on the detection results from sensors 21_1 and 21_2, respectively. The display unit 11 displays details of the measurement results (for example, graphed measurement results).

[0075] Next, the operation of the operating status monitoring device 10_2 will be explained with reference to Figure 8. After the mapping process between sensors 21_1 and 21_2 and the mounting target area in the operating status monitoring device 10_1 is completed, the operating status monitoring device 10_2 performs a deletion process (S20) of the sensor icons i21_1 to i21_11 displayed on the display unit 11 that correspond to sensors 21_1 and 21_2 set in the operating status monitoring device 10_1. As a result, the sensor icon display area S1 of the display unit 11 of the operating status monitoring device 10_2 will be left with the usable sensor icons i21_3 to i21_11, excluding sensor icons i21_1 and i21_2. As mentioned above, the sensor icons i21_1 and i21_2 may also be disabled.

[0076] Then, in the operating status monitoring device 10_2, the user, for example, drags and drops one sensor icon i21_3 from the sensor icons i21_3 to i21_11 displayed in the sensor icon display area S1 onto the upper right arm p_1 of the human body schematic diagram S2. As a result, the reception unit 13 accepts the setting operation (S12).

[0077] Subsequently, the operation status monitoring device 10_2 associates the identification information of sensor 21_3 corresponding to the sensor icon i21_3 with the identification information of the upper right arm (part p1) of subject P2, where the sensor is to be attached, according to the set operation. This establishes the correspondence between sensor 21_3 and subject P2's upper right arm (part p1) (S13). Similarly, for other attachment sites (right forearm (part p2)), the process of dragging and dropping sensor icon i21_4 and establishing the correspondence between sensor 21_4 and subject P2's right forearm (part p2) is performed. In other words, steps S12 and S13 in Figure 8 can be repeated for each attachment site of subject P2. As explained below in Figure 7, the operation status monitoring device 10_2 also executes the processes S14 to S17.

[0078] As described above, the training support system 1 according to this embodiment has multiple operating state monitoring devices 10 that display multiple sensor icons corresponding to multiple sensors within a predetermined distance. Each operating state monitoring device 10 associates the sensor corresponding to the displayed sensor icon with the mounting area of ​​the subject, according to the setting operation for that sensor icon. As a result, the training support system 1 can share multiple sensors 21_1 to 21_11 among multiple operating state monitoring devices 10, realizing a highly convenient system.

[0079] Furthermore, when a sensor is associated with a mounting location on a subject in one operational status monitoring device, other operational status monitoring devices will either delete the sensor icon corresponding to that associated sensor or disable the sensor icon so that setting operations cannot be performed. This prevents a single sensor from being set in multiple operational status monitoring devices 10.

[0080] Note that the processing order of the training support system 1 is not limited to the order shown in Figures 7 and 8. For example, calibration may be performed before the display of the sensor icon corresponding to the paired sensor. Alternatively, after attaching the sensor 21 to the subject P, it may be confirmed which operating status monitoring device 10 the sensor 21 corresponds to.

[0081] Furthermore, although the above embodiments described the present disclosure as a hardware configuration, the present disclosure is not limited thereto. The present disclosure can be implemented by having a CPU (Central Processing Unit) execute a computer program to control the operation status monitoring device.

[0082] Furthermore, the aforementioned programs can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media, magneto-optical recording media, CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memory. Examples of magnetic recording media include flexible disks, magnetic tapes, and hard disk drives. Examples of magneto-optical recording media include magneto-optical disks. Examples of semiconductor memory include mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory). In addition, programs may be supplied to a computer using various types of transient computer-readable media. Examples of transient computer-readable media include electrical signals, optical signals, and electromagnetic waves. Temporary computer-readable media can supply programs to a computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels. [Explanation of Symbols]

[0083] 1. Training support system 10. Operating status monitoring device 10_1, 10_2 Operating status monitoring device 11 Display section 12 Display Control Unit 13 Reception Department 14 Processing Unit 15 Wireless Communication Section 16 Control Unit 17. Arithmetic Processing Unit 18 Control section 20 Measuring Instruments 20_1~20_11 Measuring Instruments 21 sensors 21_1~21_11 Sensors 22_1 Pad 23_1 Belt P Subject p1~p11 site S display screen S1 Sensor icon display area S2 Human body schematic diagram

Claims

1. Multiple sensors attached to different parts of the bodies of multiple subjects, Multiple operating status monitoring devices that monitor each subject individually using the attached sensors, An operational status monitoring system including, Each of the multiple operating status monitoring devices is An icon display unit that displays multiple sensor icons corresponding to each of the multiple sensors, A display control unit that displays, among the multiple sensors, the sensor whose distance from the operating status monitoring device is within a predetermined distance on the icon display unit, A reception unit that receives setting operations for the sensor icons displayed on the icon display unit, A processing unit that associates the sensor corresponding to the sensor icon with the mounting location on the subject, in accordance with the setting operation, A control unit that changes the display mode of the corresponding sensor icon in response to the input from the aforementioned sensor, Equipped with, Operating status monitoring system.

2. The control unit removes from the icon display unit any sensor icons that do not change their display mode in response to input from the sensor, and disconnects the connection between the sensor corresponding to the sensor icon and the operating status monitoring device. The operating status monitoring system according to claim 1.

3. The control unit removes sensor icons whose display mode does not change for a predetermined time from the icon display unit, and disconnects the connection between the sensor corresponding to the sensor icon and the operating status monitoring device. The operating status monitoring system according to claim 2.

4. The control unit changes the display mode so that the corresponding sensor icon moves in accordance with the movement of one of the plurality of sensors. The operating status monitoring system according to claim 1.

5. The aforementioned sensor includes an accelerometer, The control unit changes the display mode based on the tap input to the acceleration sensor collected by the acceleration sensor. The operating status monitoring system according to claim 1.

6. The aforementioned sensor includes a switch, The control unit changes the display mode based on the state in which the switch is pressed. The operating status monitoring system according to claim 1.

7. Multiple sensors attached to different parts of the bodies of multiple subjects, Multiple operating status monitoring devices that monitor each subject individually using the attached sensors, A control method for an operating status monitoring system, including, Each of the multiple operating status monitoring devices, A process to display multiple sensor icons on the icon display unit, corresponding to each sensor among the multiple sensors whose distance from the operating state monitoring device is within a predetermined distance, A process for receiving setting operations for the sensor icon displayed in the aforementioned icon display unit, In accordance with the setting operation, the process involves associating the sensor corresponding to the sensor icon with the mounting location on the subject, A process to change the display mode of the corresponding sensor icon in response to the input from the aforementioned sensor, To execute Control method.

8. Multiple sensors attached to different parts of the bodies of multiple subjects, Multiple operating status monitoring devices that monitor each subject individually using the attached sensors, A program for controlling an operational status monitoring system, including, Each of the multiple operating status monitoring devices, A process to display multiple sensor icons on the icon display unit, corresponding to each sensor among the multiple sensors whose distance from the operating state monitoring device is within a predetermined distance, A process for receiving setting operations for the sensor icon displayed in the aforementioned icon display unit, In accordance with the setting operation, the process involves associating the sensor corresponding to the sensor icon with the mounting location on the subject, A process to change the display mode of the corresponding sensor icon in response to the input from the aforementioned sensor, To execute program.

Images