Data relay device, measurement system, data relay method, and program

Abstract

To provide a data relay device, etc. capable of appropriately collecting walking data acquired for walking of an object person in accordance with his or her daily life.SOLUTION: A data relay device includes: a communication unit for receiving walking data including a feature amount extracted from sensor data on a motion of the foot measured by a measuring device mounted on a footwear of an object person; a storage unit for storing the received walking data; a voice input / output unit for outputting voice to the object person in response to the reception of the walking data; and an output unit for outputting object data including the walking data stored in the storage unit at transmission timing set beforehand.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a data relay device and the like used for relaying data.

Background Art

[0002] With the increasing interest in healthcare, attention has been focused on services that provide information according to gait. For example, techniques for analyzing gait using sensor data measured by sensors mounted on footwear such as shoes have been developed. In the time-series data of sensor data, features associated with walking events related to the physical state appear. By analyzing the walking data including the features associated with the walking events, the physical state of the subject can be estimated.

[0003] Patent Document 1 discloses a pedometer worn on shoes. The pedometer of Patent Document 1 includes a first signal generator, a second signal generator, and a sensor assembly. The first signal generator and the second signal generator are separated by a certain distance and mounted on different parts of the first shoe. The sensor assembly is mounted on the second shoe. The sensor assembly has a proximity sensor and a microcontroller unit. The proximity sensor senses the signals generated by the first signal generator and the second signal generator and generates corresponding electrical signals. The microcontroller unit has an input coupled to the proximity sensor, receives the corresponding electrical signals, and converts the corresponding electrical signals into the motion data of the walker.

[0004] Patent Document 2 discloses a measuring device that measures the number of steps and the like. The device of Patent Document 2 includes a measuring means, a measuring information storage means, and a wireless communication means. The measuring means measures the number of steps, step length, and walking speed of the user. The measuring information storage means stores the measuring information including the measured information and the measuring time. The wireless communication means performs wireless communication with the outside.

[0005] Patent Document 3 discloses a state detection device that uses information obtained from sensors installed in a closed environment to detect a specific state of a subject in that room. The device in Patent Document 3 uses second information obtained from a second sensor to identify action intervals in which the subject performed a specific action and non-action intervals in which the subject did not perform a specific action. The device in Patent Document 3 determines a specific state of the subject for each action interval and non-action interval. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2012-113527 [Patent Document 2] Japanese Patent Publication No. 2006-308301 [Patent Document 3] International Publication No. 2016 / 139844 [Overview of the project] [Problems that the invention aims to solve]

[0007] The pedometer described in Patent Document 1 measures steps by receiving magnetic impulse signals emitted from a first signal generator and a second signal generator, respectively, using a proximity sensor. The pedometer in Patent Document 1 generates a step count and step time when one shoe passes over the other. The pedometer in Patent Document 1 can measure steps. However, the pedometer in Patent Document 1 could not measure acceleration or angular velocity, which are used for gait analysis.

[0008] The device described in Patent Document 2 is attached to the user's shoe. The device in Patent Document 2 can measure the number of steps, stride length, and walking speed according to the user's gait, simply by the user wearing the shoe and walking. Patent Document 2 does not disclose the timing of sensor data collection. Therefore, the method described in Patent Document 2 sometimes failed to accurately collect data related to the user's gait.

[0009] The device described in Patent Document 3 detects a specific state of a subject in a closed environment. In order to analyze the subject's gait, walking data measured in accordance with walking outside the closed environment is necessary. However, the device described in Patent Document 3 could not detect a specific state of a subject walking outside the closed environment.

[0010] The purpose of this disclosure is to provide a data relay device, etc., that can accurately collect walking data acquired in accordance with the subject's walking, in line with the subject's daily life. [Means for solving the problem]

[0011] A data relay device according to one aspect of the present disclosure includes a communication unit that receives walking data including feature quantities extracted from sensor data relating to foot movement measured by a measuring device mounted on the footwear of a subject, a storage unit that stores the received walking data, an audio input / output unit that outputs audio to the subject in response to the receipt of walking data, and an output unit that outputs target data including the walking data stored in the storage unit at a preset transmission timing.

[0012] In one embodiment of the data relay method of this disclosure, walking data including feature quantities extracted from sensor data relating to the movement of a subject's feet is received, the received walking data is stored, voice is output to the subject in response to the receipt of walking data, and target data including the stored walking data is output at a preset transmission timing.

[0013] A program in one aspect of this disclosure causes a computer to perform the following processes: receiving walking data including feature quantities extracted from sensor data relating to the movement of a subject's feet; storing the received walking data; outputting audio to the subject in response to the receipt of walking data; and outputting target data including the stored walking data at a preset transmission timing. [Effects of the Invention]

[0014] According to the present disclosure, it becomes possible to provide a data relay device or the like that can accurately collect walking data acquired according to the walking of a subject in accordance with the daily life of the subject.

Brief Description of the Drawings

[0015] [Figure 1] It is a block diagram showing an example of the configuration of a measurement system according to the first embodiment. [Figure 2] It is a block diagram showing an example of the configuration of a measurement device included in the measurement system according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the arrangement of a measurement device included in the measurement system according to the first embodiment. [Figure 4] It is a conceptual diagram for explaining the human body surface used in the description of the measurement device included in the measurement system according to the first embodiment. [Figure 5] It is a conceptual diagram for explaining the walking cycle used in the description of the measurement device included in the measurement system according to the first embodiment. [Figure 6] It is a block diagram showing an example of the configuration of a data relay device included in the measurement system according to the first embodiment. [Figure 7] It is a flowchart for explaining an example of the operation of a measurement device included in the measurement system according to the first embodiment. [Figure 8] It is a flowchart for explaining an example of the walking data measurement process by the measurement system according to the first embodiment. [Figure 9] It is a flowchart for explaining an example of the operation of a data relay device included in the measurement system according to the first embodiment. [Figure 10] It is a block diagram showing an example of the configuration of a measurement system according to the second embodiment. [Figure 11] It is a conceptual diagram showing an example of the installation of a measurement system according to the second embodiment. [Figure 12] It is a block diagram showing an example of the configuration of a data relay device included in the measurement system according to the second embodiment. [Figure 13] It is a flowchart for explaining an example of the operation of a measurement device included in a measurement system according to a second embodiment. [Figure 14] It is a flowchart for explaining an example of the operation of a data relay device included in a measurement system according to a second embodiment. [Figure 15] It is a conceptual diagram for explaining an application example of a measurement system according to a second embodiment. [Figure 16] It is a conceptual diagram for explaining an application example of a measurement system according to a second embodiment. [Figure 17] It is a conceptual diagram for explaining an application example of a measurement system according to a second embodiment. [Figure 18] It is a block diagram showing an example of the configuration of a data relay device according to a third embodiment. [Figure 19] It is a block diagram showing an example of a hardware configuration for executing the control and processing of each embodiment.

Mode for Carrying Out the Invention

[0016] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. However, although the embodiments described below have technically preferable limitations for carrying out the present invention, they do not limit the scope of the invention as follows. In all the drawings used in the following description of the embodiments, the same reference numerals are given to the same parts unless there is a particular reason. Also, in the following embodiments, repeated explanations regarding the same configuration and operation may be omitted.

[0017] (First Embodiment) First, the configuration of the measurement system according to the first embodiment will be explained with reference to the drawings. The measurement system uses sensors installed on footwear such as shoes to measure sensor data related to the movement of the subject's feet in accordance with their walking. The measurement system collects sensor data in accordance with the subject's actions. For example, the measurement system collects sensor data transmitted in accordance with the subject putting on and taking off their shoes. From the measured sensor data, the measurement system extracts walking data that includes features used to estimate the subject's physical condition. The measurement system transmits the collected walking data to a database or the like built on a cloud or server.

[0018] (composition) Figure 1 is a block diagram showing an example of the configuration of the measurement system 1 according to this embodiment. The measurement system 1 comprises a measurement device 10 and a data relay device 15. The measurement device 10 transmits walking data to the data relay device 15 when it is within communication range of the data relay device 15. The data relay device 15 is connected to a database 150 via a network 140 such as an intranet or the internet. The data relay device 15 transmits the walking data stored in the data relay device 15 to the database 150 at a preset timing. Below, an overview of the measurement system 1 will be described, followed by a detailed explanation of the configurations of the measurement device 10 and the data relay device 15.

[0019] The measuring device 10 is installed on the footwear of the subject (user) from whom walking data is collected. The measuring device 10 measures sensor data in accordance with the subject's walking. From the measured sensor data, the measuring device 10 extracts walking data that includes features used to estimate the subject's physical state. The measuring device 10 stores the extracted walking data. In response to the detection of the subject putting on or taking off their shoes, the measuring device 10 transmits the walking data stored in the device. For example, the measuring device 10 detects putting on or taking off shoes in accordance with changes in acceleration, velocity, or position in a specific direction.

[0020] If walking data has not been accumulated at the time when the subject puts on or takes off their shoes, the measuring device 10 transmits a signal (also called a shoe-on / shoe-off signal) indicating that the subject has put on or taken off their shoes. For example, if different signals are transmitted when the action of putting on shoes is detected and when the action of taking off shoes is detected, the data relay device 15 can distinguish between the subject leaving the house and returning home.

[0021] The data relay device 15 is placed in a designated location, such as the entrance of the residence where the subject lives. The data relay device 15 receives walking data transmitted from the measurement device 10. The data relay device 15 stores the received walking data. For example, the data relay device 15 collects walking data measured for subjects who do not own a portable device. For example, the subject is an elderly person who requires care / support. Such elderly people often do not own portable devices such as smartphones. For example, the subject may be a young child or adolescent who does not own a portable device. The subject may also be a person who does not have the habit of carrying a portable device or a person who tends to forget to carry a portable device. The subject may also be a person who carries a portable device. There are no limitations on the subject as long as the physical condition is estimated using the walking data.

[0022] The data relay device 15 may be placed in a location other than the residence of the subject. If the subject is an elderly person requiring care / support, the data relay device 15 may be placed in a facility such as a day care center, hospital, or clinic that the subject attends. It is conceivable that the subject is residing in a facility such as a nursing home or care facility. In such a situation, the data relay device 15 may be placed near the entrance to the room where the subject is staying or near the bed assigned to the subject. There are no restrictions on the location where the data relay device 15 is placed, as long as it is near where the subject's shoes are placed. For example, in the case of managing the health status of employees at a company, the data relay device 15 may be placed in the subject's office or near the entrance to the company building.

[0023] When the data relay device 15 receives walking data, it outputs a voice message to the subject. When the data relay device 15 receives walking data transmitted from the measurement device 10 at the moment the subject puts on their shoes, it outputs a voice message to the subject who is going outside. When the data relay device 15 receives walking data transmitted from the measurement device 10 at the moment the subject takes off their shoes, it outputs a voice message to the subject who has returned home.

[0024] Furthermore, the data relay device 15 receives audio from the subject in response to the audio output to the subject. The data relay device 15 converts the received audio into audio data. The data relay device 15 stores the converted audio data. Preferably, the audio data is stored linked to the time the audio was received. If the audio data and time are stored linked, the time the subject left / returned home can be determined. Also, if the time of leaving and the time of returning home can be determined, the subject's time away from home can be calculated.

[0025] The data relay device 15 transmits target data to a database 150 built on a cloud or server via the network 140. Target data is a general term for walking data and voice data. If voice data of the subject is stored, the data relay device 15 transmits the voice data to the database 150 in addition to the walking data. The target data stored in the database 150 is used for estimating the physical condition of the subject, etc. There are no limitations on the use of the target data stored in the database 150. For example, the data relay device 15 may transmit the target data to a terminal device (not shown) handled by a care manager or other person in charge of a subject who is subject to care / support.

[0026] [Measuring device] Figure 2 is a block diagram showing an example of the configuration of the measuring device 10. The measuring device 10 includes a sensor 11 and a walking data generation unit 12. In this embodiment, an example is given in which the sensor 11 and the walking data generation unit 12 are integrated. The sensor 11 and the walking data generation unit 12 may be provided as separate devices.

[0027] <Sensor> As shown in Figure 2, sensor 11 includes an acceleration sensor 111 and an angular velocity sensor 112. Figure 2 shows an example in which the acceleration sensor 111 and the angular velocity sensor 112 are included in sensor 11. Sensor 11 may also include sensors other than the acceleration sensor 111 and the angular velocity sensor 112. The description of sensors other than the acceleration sensor 111 and the angular velocity sensor 112 that may be included in sensor 11 is omitted.

[0028] The acceleration sensor 111 is a sensor that measures acceleration in three axes (also called spatial acceleration). The acceleration sensor 111 measures acceleration (also called spatial acceleration) as a physical quantity related to the movement of the foot. The acceleration sensor 111 outputs the measured acceleration to the walking data generation unit 12. For example, the acceleration sensor 111 can be a piezoelectric, piezoresistive, or capacitive type sensor. The sensor used as the acceleration sensor 111 is not limited to any measurement method as long as it can measure acceleration.

[0029] The angular velocity sensor 112 is a sensor that measures angular velocity (also called spatial angular velocity) around three axes. The angular velocity sensor 112 measures angular velocity (also called spatial angular velocity) as a physical quantity related to the movement of the foot. The angular velocity sensor 112 outputs the measured angular velocity to the walking data generation unit 12. For example, the angular velocity sensor 112 can use sensors of the vibration type, capacitive type, etc. The sensor used as the angular velocity sensor 112 is not limited to any measurement method as long as it can measure angular velocity.

[0030] Sensor 11 can be implemented, for example, by an inertial measurement device that measures acceleration and angular velocity. An example of an inertial measurement device is an IMU (Inertial Measurement Unit). An IMU includes an acceleration sensor 111 that measures acceleration in three axes and an angular velocity sensor 112 that measures angular velocity around three axes. Sensor 11 may also be implemented by an inertial measurement device such as a VG (Vertical Gyro) or AHRS (Attitude Heading). Alternatively, sensor 11 may be implemented by a GPS / INS (Global Positioning System / Inertial Navigation System). Sensor 11 may also be implemented by a device other than an inertial measurement device, as long as it can measure physical quantities related to foot movement.

[0031] Figure 3 is a conceptual diagram showing an example of the placement of the measuring device 10. In the example in Figure 3, the measuring device 10 is placed inside the shoes 100 for both feet. In the example in Figure 3, the measuring device 10 is installed in a position corresponding to the underside of the arch of the foot. For example, the measuring device 10 is placed in the insole inserted into the shoe 100. For example, the measuring device 10 may be placed on the bottom surface of the shoe 100. For example, the measuring device 10 may be embedded in the body of the shoe 100. The measuring device 10 may or may not be detachable from the shoe 100. The measuring device 10 may be installed in a position other than the underside of the arch of the foot, as long as it can measure sensor data related to foot movement. The measuring device 10 may also be installed in the socks worn by the subject or in anklets or other ornaments worn by the subject. The measuring device 10 may also be directly attached to the foot or embedded in the foot. Figure 3 shows an example in which the measuring device 10 is installed in the shoe 100 for the right foot. The measuring device 10 may be installed on one shoe 100.

[0032] Figure 4 is a conceptual diagram illustrating the planes (also called body planes) that are set on the human body. In this embodiment, the sagittal plane divides the body into left and right halves, the coronal plane divides the body into front and back halves, and the horizontal plane divides the body horizontally.

[0033] <Walking Data Generation Unit> As shown in Figure 2, the walking data generation unit 12 (also called a walking data generation device) includes an acquisition unit 121, a normalization unit 122, an extraction unit 123, a storage unit 125, a detection unit 126, and a transmission / reception unit 127. The walking data generation unit 12 performs overall control and data processing of the measurement device 10. For example, the walking data generation unit 12 is implemented by a microcomputer or microcontroller. For example, the walking data generation unit 12 includes a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), flash memory, etc. The walking data generation unit 12 controls the acceleration sensor 111 and the angular velocity sensor 112 to measure angular velocity and acceleration. The walking data generation unit 12 may also be implemented on the side of a portable terminal (not shown) carried by the subject (user).

[0034] The acquisition unit 121 acquires acceleration in three axes from the acceleration sensor 111. The acquisition unit 121 also acquires angular velocity around the three axes from the angular velocity sensor 112. For example, the acquisition unit 121 performs analog-to-digital conversion (AD conversion) on the acquired physical quantities (analog data) such as angular velocity and acceleration. Note that the physical quantities (analog data) measured by the acceleration sensor 111 and the angular velocity sensor 112 may be converted to digital data by the acceleration sensor 111 and the angular velocity sensor 112, respectively.

[0035] The acquisition unit 121 outputs the converted digital data (also called sensor data) to the normalization unit 122. The acquisition unit 121 may be configured to store the sensor data in a storage unit (not shown). The sensor data includes at least acceleration data converted to digital data and angular velocity data converted to digital data. The acceleration data includes acceleration vectors in the three axes. The angular velocity data includes angular velocity vectors around the three axes. The acquisition time of the acceleration data and angular velocity data is associated with the acceleration data and angular velocity data. The acquisition unit 121 may apply corrections to the acceleration data and angular velocity data, such as mounting error correction, temperature correction, and linearity correction. The acquisition unit 121 may also convert the coordinate system of the sensor data from the local coordinate system of the measuring device 10 to the world coordinate system. The coordinate system conversion may be performed by the normalization unit 122.

[0036] Furthermore, the acquisition unit 121 outputs sensor data for detecting the putting on and taking off of shoes to the detection unit 126. Putting on and taking off shoes is detected based on the actions of the subject putting on shoes and taking off shoes. For example, putting on and taking off shoes can be detected according to the values, changes, and waveforms of spatial acceleration / spatial angular velocity. For example, the acquisition unit 121 outputs all of the acquired sensor data to the detection unit 126. For example, the acquisition unit 121 outputs spatial acceleration / spatial angular velocity that exceeds a preset threshold from the acquired sensor data to the detection unit 126. For example, the acquisition unit 121 outputs spatial acceleration / spatial angular velocity that exceeds a preset change amount from the acquired sensor data to the detection unit 126.

[0037] The normalization unit 122 acquires sensor data from the acquisition unit 121. The normalization unit 122 extracts time-series data equivalent to one walking cycle (also called walking waveform data) from the time-series data of acceleration in the three axes and angular velocity around the three axes included in the sensor data. The normalization unit 122 normalizes the time of the extracted walking waveform data equivalent to one walking cycle to a walking cycle of 0 to 100% (percent) (also called first normalization). Timings such as 1% and 10% included in the 0 to 100% walking cycle are also called walking phases. Furthermore, the normalization unit 122 normalizes the walking waveform data equivalent to one walking cycle that has been first normalized so that the stance phase accounts for 60% and the swing phase accounts for 40% (also called second normalization). The stance phase is the period when at least a part of the sole of the foot is in contact with the ground. The swing phase is the period when the sole of the foot is off the ground. By second normalizing the walking waveform data, the shift in the walking phase from which features are extracted can be reduced.

[0038] Figure 5 is a conceptual diagram illustrating gait events detected in a single gait cycle based on the right foot. The horizontal axis of Figure 5 represents the gait cycle normalized with one gait cycle of the right foot set as 100 percent (%). The point when the right heel touches the ground is considered the starting point (0%), and the point when the right heel touches the ground again is considered the ending point (100%). Each of the multiple timings included in one gait cycle is a gait phase. One gait cycle of one foot is broadly divided into the stance phase and the swing phase. In the example in Figure 5, the gait cycle is normalized so that the stance phase accounts for 60% and the swing phase accounts for 40%. The stance phase is subdivided into early stance T1, mid-stance T2, late stance T3, and early swing T4. The swing phase is subdivided into early swing T5, mid-swing T6, and late swing T7. The gait waveform for one gait cycle does not necessarily have to start from the moment the heel touches the ground. For example, the starting point of the gait waveform for one gait cycle may be set to the middle of the stance phase.

[0039] Walking event E1 represents heel contact (HC), the beginning of a single step cycle. Heel contact occurs when the heel of the right foot, which was off the ground during the swing phase, lands on the ground. Walking event E2 represents opposite toe off (OTO). Opposite toe off occurs when the toes of the left foot leave the ground while the sole of the right foot remains in contact with the ground. Walking event E3 represents heel rise (HR). Heel rise occurs when the heel of the right foot lifts off the ground while the sole of the right foot remains in contact with the ground. Walking event E4 represents opposite heel strike (OHS). Opposite heel strike occurs when the heel of the left foot, which was off the ground during the swing phase of the left foot, lands on the ground. Walking event E5 represents toe-off (TO). Toe-off is the event where the toes of the right foot leave the ground while the sole of the left foot remains in contact with the ground. Walking event E6 represents foot-adjacent (FA). Foot-adjacent is the event where the left and right feet cross while the sole of the left foot remains in contact with the ground. Walking event E7 represents tibia vertical (TV). Tibia vertical is the event where the tibia of the right foot becomes nearly perpendicular to the ground while the sole of the left foot remains in contact with the ground. Walking event E8 represents heel strike (HS), the end of one walking cycle. Walking event E8 corresponds to the end of the walking cycle that began with walking event E1, and also to the beginning of the next walking cycle.

[0040] The normalization unit 122 normalizes the section from heel strike (HC), where the walking phase is 0%, to toe-off (TO), which follows the heel strike (HC), to 0-60%. The normalization unit 122 also normalizes the section from toe-off (TO), which follows the toe-off (TO), to heel strike (HC), where the walking phase is 100%, to 60-100%. As a result, the walking waveform data for one gait cycle is normalized into a section where the walking cycle is 0-60% (stance phase) and a section where the walking cycle is 60-100% (swing phase). Figure 8 shows the walking waveform data after the second normalization as a solid line. In the walking waveform data after the second normalization, the timing of toe-off (TO) coincides with 60%.

[0041] The normalization unit 122 extracts and normalizes walking waveform data for one step cycle with respect to accelerations / angular velocities other than acceleration in the direction of travel, in accordance with the walking cycle of acceleration in the direction of travel. Alternatively, the normalization unit 122 may generate time-series data of angles around the three axes by integrating the time-series data of angular velocities around the three axes. In that case, the normalization unit 122 also extracts and normalizes walking waveform data for one step cycle with respect to angles around the three axes, in accordance with the walking cycle of acceleration in the direction of travel.

[0042] The normalization unit 122 may extract and normalize walking waveform data for one step cycle based on acceleration / angular velocity other than the acceleration in the direction of travel. For example, the normalization unit 122 may detect heel strike (HC) and toe-off (TO) from the time-series data of vertical acceleration. The timing of heel strike (HC) is the timing of a steep minimum peak that appears in the time-series data of vertical acceleration. At the timing of the steep minimum peak, the value of vertical acceleration is approximately 0. The minimum peak that serves as a marker for the timing of heel strike (HC) corresponds to the smallest peak in the walking waveform data for one step cycle. The interval between consecutive heel strike (HC) is one step cycle. The timing of toe-off (TO) is the timing of an inflection point in the time-series data of vertical acceleration, which gradually increases after passing through an interval of small fluctuation following the maximum peak immediately after heel strike (HC).

[0043] Furthermore, the normalization unit 122 may extract and normalize walking waveform data for one step cycle based on both forward acceleration and vertical acceleration. Alternatively, the normalization unit 122 may extract and normalize walking waveform data for one step cycle based on accelerations other than forward acceleration and vertical acceleration, such as angular velocity and angle.

[0044] The extraction unit 123 acquires walking waveform data for one walking cycle that has been normalized by the normalization unit 122. The extraction unit 123 extracts features used to estimate index values ​​indicating the state of the knee from the walking waveform data for one walking cycle. The extraction unit 123 stores the extracted features in the storage unit 125. For example, the extraction unit 123 extracts features for each walking phase cluster from walking phase clusters that integrate temporally consecutive walking phases based on pre-set conditions. A walking phase cluster includes at least one walking phase. A walking phase cluster may also include a single walking phase.

[0045] The extraction unit 123 may generate feature quantities (second feature quantities) for walking phase clusters. A walking phase cluster is a cluster that integrates temporally consecutive walking phases. A walking phase cluster includes at least one walking phase. A walking phase cluster may consist of a single walking phase. The extraction unit 123 stores the feature quantities for each walking phase cluster in the storage unit 125.

[0046] For example, the extraction unit 123 generates second features by applying a feature construct formula to the features (first features) extracted from each of the walking phases constituting the walking phase cluster. The feature construct formula is a pre-set calculation formula for generating the features of the walking phase cluster. For example, the feature construct formula is a calculation formula related to arithmetic operations. For example, the second features calculated using the feature construct formula may be the integral mean, arithmetic mean, slope, and variability of the first features in each walking phase included in the walking phase cluster. For example, the extraction unit 123 applies a calculation formula that calculates the slope and variability of the first features extracted from each of the walking phases constituting the walking phase cluster as the feature construct formula. For example, if the walking phase cluster consists of a single walking phase, it is not possible to calculate the slope and variability, so a feature construct formula that calculates the integral mean or arithmetic mean should be used.

[0047] Depending on the type of walking data transmitted from the measuring device 10, the normalization unit 122 and the extraction unit 123 may be omitted. For example, if unnormalized sensor data is transmitted as walking data, the normalization unit 122 and the extraction unit 123 may be omitted. For example, if normalized sensor data is transmitted as walking data, the extraction unit 123 can be omitted.

[0048] The memory unit 125 stores walking data. For example, the memory unit 125 stores feature quantities extracted by the extraction unit 123 as walking data. For example, the memory unit 125 may store feature quantities of walking phase clusters generated by the extraction unit 123 as walking data. The memory unit 125 may also store raw sensor data or normalized sensor data as walking data. The walking data stored in the memory unit 125 is output by the transmitting / receiving unit 127 in response to the detection of putting on or taking off shoes by the detection unit 126. If walking data is output at the time of shoe removal, walking data will not be stored in the memory unit 125 at the next time of putting on shoes. Therefore, the walking data stored in the memory unit 125 is mainly output at the time of shoe removal. At the time of shoe removal, walking data measured according to the subject's walking is accumulated in the memory unit 125. Therefore, the time of shoe removal is a time when the accumulated walking data can be accurately output.

[0049] The detection unit 126 acquires sensor data from the acquisition unit 121 to detect when shoes are put on or taken off. The detection unit 126 detects when shoes are put on or taken off based on the actions of the subject putting on or taking off shoes. For example, the detection unit 126 detects when shoes are put on or taken off according to the values, changes, and waveforms of spatial acceleration / spatial angular velocity. When shoe-wearing is detected, the detection unit 126 outputs a signal indicating shoe-wearing to the transmission / reception unit 127. It is presumed that the subject who has put on shoes is going out. When shoe-removal is detected, the detection unit 126 outputs a signal indicating shoe-removal to the transmission / reception unit 127. It is presumed that the subject who has removed their shoes has returned home. In this way, it is possible to determine whether the subject is going out or returning home by detecting when shoes are put on or taken off.

[0050] For example, the detection unit 126 acquires all of the sensor data acquired by the acquisition unit 121. For instance, the detection unit 126 detects shoe-wearing in response to a sudden change in spatial acceleration / spatial angular velocity from a near-zero state. For instance, the detection unit 126 detects shoe-removal in response to a sudden change in spatial acceleration / spatial angular velocity from a near-zero state. By setting a threshold for the change in spatial acceleration / spatial angular velocity, the detection unit 126 can detect shoe-wearing or removal in response to the change in spatial acceleration / spatial angular velocity exceeding the threshold.

[0051] For example, the detection unit 126 acquires spatial acceleration / spatial angular velocity data from the sensor data acquired by the acquisition unit 121 that exceeds a preset threshold. For example, the detection unit 126 acquires spatial acceleration / spatial angular velocity data from the sensor data acquired by the acquisition unit 121 that exceeds a preset change amount. The detection unit 126 can detect putting on or taking off shoes in response to the acquisition of spatial acceleration / spatial angular velocity data that exceeds a preset threshold or spatial acceleration / spatial angular velocity data that exceeds a preset change amount.

[0052] The detection unit 126 may detect the putting on or taking off of shoes in accordance with specific actions performed by the subject when putting on or taking off shoes. There are no particular limitations on the specific actions that the detection unit 126 is supposed to detect. Examples of specific actions that are supposed to be detected are listed below. For example, the way a subject puts on or takes off shoes often varies from person to person. Therefore, a model may be created that has been trained on the characteristics of a subject's shoe-putting and taking-off, and the system may be configured to use this model to detect the putting on or taking off of shoes. If configured in this way, the subject can be identified according to the characteristics detected during shoe-putting and taking-off.

[0053] For example, it is assumed that the subject puts their foot into a shoe placed in the entryway and lifts their heel to put on their shoes. In such a case, the detection unit 126 can detect that the shoe has been put on by detecting a sudden change in the angle of the measuring device 10 based on sensor data. For example, it is assumed that the subject lifts the shoe to a certain height or higher to put on a shoe placed in the entryway. In such a case, the detection unit 126 can detect that the shoe has been put on by detecting that the height of the measuring device 10 based on sensor data has been raised to a certain height or higher. For example, it is assumed that the subject puts their foot into a shoe placed in the entryway and then taps their toes on the ground to put on their shoes. In such a case, the detection unit 126 can detect that the shoe has been put on by detecting a periodic change in the spatial position of the measuring device 10 based on sensor data.

[0054] For example, it is assumed that when a person returns home, they stop walking in front of the door, then move inside the entrance hall to take off their shoes. In such a case, the detection unit 126 can detect that the spatial acceleration of the measuring device 10 based on sensor data becomes zero for a certain period of time, and then immediately after that, the spatial acceleration / spatial angular velocity shows a complex change and becomes zero, thereby detecting that the person has taken off their shoes. For example, it is assumed that when a person returns home, they take off their shoes at the entrance hall and line up the shoes they have taken off. In such a case, the detection unit 126 can detect that the spatial acceleration / spatial angular velocity becomes zero after the orientation of the measuring devices 10 based on sensor data installed on the left and right shoes has aligned. For example, it is assumed that when a person returns home, the shoes they have taken off at the entrance hall are left in a positional relationship that would not be possible if they were being worn. In such a case, the detection unit 126 can detect that the orientation and position of the measuring devices 10 based on sensor data installed on the left and right shoes are different, and the spatial acceleration / spatial angular velocity becomes zero, thereby detecting that the person has taken off their shoes.

[0055] The transmitting / receiving unit 127 transmits walking data stored in the storage unit 125 in response to the detection unit 126 detecting the putting on or taking off of shoes. For example, the transmitting / receiving unit 127 transmits walking data to the data relay device 15 via wireless communication. For example, the transmitting / receiving unit 127 is configured to transmit walking data to the data relay device 15 via a wireless communication function (not shown) conforming to standards such as Bluetooth® or WiFi®. The communication function of the transmitting / receiving unit 127 may conform to standards other than Bluetooth® or WiFi®.

[0056] [Data relay device] Figure 6 is a block diagram showing an example of the configuration of the data relay device 15. The data relay device 15 includes a communication unit 151, an audio input / output unit 153, a storage unit 155, and an output unit 157.

[0057] The communication unit 151 receives walking data transmitted from the measuring device 10. The communication unit 151 stores the received walking data in the storage unit 155. The communication unit 151 communicates with the transmitting / receiving unit 127 of the measuring device 10 using a common communication method. For example, the communication unit 151 receives walking data from the data relay device 15 via wireless communication. For example, the communication unit 151 is configured to receive walking data from the data relay device 15 via a wireless communication function (not shown) conforming to standards such as Bluetooth® or WiFi®. Note that the communication function of the communication unit 151 may conform to standards other than Bluetooth® or WiFi®.

[0058] The audio input / output unit 153 includes a speaker for outputting sound and a microphone for receiving sound. The audio input / output unit 153 outputs sound to the subject in response to the reception of walking data. The audio data converted into sound for the subject can be stored in the storage unit 155. When the audio input / output unit 153 receives walking data transmitted from the measuring device 10 at the moment the subject puts on their shoes, it outputs sound directed at the subject who is going outside. When the audio input / output unit 153 receives walking data transmitted from the measuring device 10 at the moment the subject takes off their shoes, it outputs sound directed at the subject who has returned home. If only audio output is required, the microphone may be omitted.

[0059] The audio input / output unit 153 receives audio emitted from a target person in response to audio output directed to that person. The audio input / output unit 153 converts the received audio into audio data. Audio data is digital data. The audio input / output unit 153 stores the converted audio data in the storage unit 155. Preferably, the audio data is stored linked to the time the audio was received. For this reason, it is preferable that the data relay device 15 includes a clock such as a real-time clock. If the audio data is stored linked to the time, the time the target person left / returned home can be determined.

[0060] The storage unit 155 stores walking data and voice data. The walking data and voice data stored in the storage unit 155 are collectively referred to as target data. Target data is accumulated in the storage unit 155 at the interval of transmission of target data by the output unit 157. The target data accumulated in the storage unit 155 is output at the timing of target data transmission. The target data accumulated in the storage unit 155 is deleted in conjunction with the transmission of target data. For example, it is conceivable that the transmitted target data may not reach the database 150. Therefore, the system may be configured to delete the target data accumulated in the storage unit 155 only after a signal notifying the receipt of target data is obtained from the database 150.

[0061] The output unit 157 is a communication interface for transmitting target data. The output unit 157 transmits the target data to a database 150 built on a cloud or server via the network 140. The target data stored in the database 150 is used for estimating the physical condition of the subject. For example, the physical condition of the subject to be estimated may include bunions, the degree of pronation / supination, and left-right balance during walking. For example, the physical condition of the subject to be estimated may include muscle strength indicators such as grip strength and knee extension strength, dynamic balance, lower limb muscle strength, mobility, static balance, and susceptibility to falls. The physical condition of the subject to be estimated is not particularly limited as long as it can be estimated using the walking data included in the target data. For example, the output unit 157 may transmit the target data to a terminal device (not shown) used by care managers, doctors, physical therapists, etc., who are in charge of the subject who is subject to care / support. There are no limitations on the use of the walking data stored in the database 150.

[0062] The output unit 157 may be a general-purpose interface conforming to a standardized specification, rather than a communication interface. For example, international standards include USB (Universal Serial Bus) and IEEE (Institute of Electrical and Electronics Engineers). There are no particular limitations on the standard to which the output unit 157 is applied.

[0063] The output unit 157 may be an interface that allows data to be read from and written to a recording medium, rather than a communication interface. For example, examples of recording media include optical recording media, semiconductor recording media, and magnetic recording media. Examples of optical recording media include CDs (Compact Discs) and DVDs (Digital Versatile Discs). Examples of semiconductor recording media include USB (Universal Serial Bus) memory and SD (Secure Digital) cards. An example of a magnetic recording medium is a flexible disk. There are no particular limitations on the type of recording medium through which data is read from and written via the output unit 157.

[0064] (operation) Next, the operation of the measurement system 1 will be explained with reference to the drawings. Here, the measurement device 10 and the data relay device 15 included in the measurement system 1 will be explained individually.

[0065] [Measurement Device] Figure 7 is a flowchart illustrating an example of the operation of the measurement device 10. In the explanation following the flowchart in Figure 7, the measurement device 10 will be described as the main operator.

[0066] In Figure 7, first, the measuring device 10 measures sensor data in standby mode (step S101). Standby mode is a low-power operating mode for detecting the putting on and taking off of shoes. In standby mode, the measuring device 10 measures sensor data at a less frequent measurement interval compared to the measurement mode. That is, in standby mode, the measuring device 10 measures sensor data at a longer measurement interval compared to the measurement mode. In standby mode, the measuring device 10 may measure only the spatial acceleration / spatial angular velocity used to detect the putting on and taking off of shoes.

[0067] Next, the measuring device 10 determines whether the subject is wearing shoes (step S102). If the measuring device 10 detects that the subject is wearing shoes (Yes in step S102), it transmits the accumulated walking data (step S103). The walking data transmitted from the measuring device 10 is received by the data relay device 15. At this stage, there is a possibility that no walking data has been accumulated in the measuring device 10. In such a case, the measuring device 10 should be configured to transmit a signal that notifies the subject of wearing shoes (also called a shoe-wearing notification signal). By receiving the shoe-wearing notification signal, the data relay device 15 can take action in accordance with the timing when the subject goes outside. If the measuring device 10 does not detect that the subject is wearing shoes (No in step S102), it returns to step S101.

[0068] Following step S103, the measuring device 10 measures sensor data in measurement mode (step S104). The measuring device 10 measures sensor data at a shorter interval than in measurement mode. That is, in measurement mode, the measuring device 10 measures sensor data at a shorter interval than in standby mode. In measurement mode, the measuring device 10 measures all spatial acceleration / spatial angular velocity used to estimate the body state.

[0069] Next, the measuring device 10 determines whether the subject is walking (step S105). If the measuring device 10 detects that the subject is walking (Yes in step S105), it performs walking data measurement processing (step S106). In the walking data measurement processing, the measuring device 10 measures walking data using the sensor data measured by the sensor 11. Details of the walking data measurement processing will be described later. If the subject is not walking (No in step S105), the process proceeds to step S107.

[0070] If step S106 is followed by step S106, or if step S105 is No, the measuring device 10 determines whether the subject has removed their shoes (step S107). If the measuring device 10 detects that the subject has removed their shoes (Yes in step S107), it transmits the accumulated walking data (step S108). At this stage, walking data based on sensor data measured by the measuring device 10 according to the walking of the subject who was outside has been accumulated in the measuring device 10. If the measuring device does not detect that the subject has removed their shoes (No in step S107), the process returns to step S106.

[0071] If measurement is to be stopped after step S108 (Yes in step S109), the process according to the flowchart in Figure 7 is complete. If measurement is to be continued (No in step S109), return to step S101. The criteria for deciding whether to stop or continue measurement can be set in advance.

[0072] <Walking data measurement and processing> Next, we will explain the details of the gait data measurement process (step S106) in the flowchart of Figure 8, referring to the diagram. In the explanation following the flowchart of Figure 8, the measuring device 10 will be described as the main operating component.

[0073] In Figure 8, first, the measuring device 10 extracts a walking waveform for one step cycle from the time-series data of the sensor data (step S121). For example, the measuring device 10 detects heel strike and toe-off from the time-series data of the sensor data. The measuring device 10 extracts the time-series data of the interval between consecutive heel strikes as a walking waveform for one step cycle.

[0074] Next, the measuring device 10 normalizes the extracted walking waveform for one step (step S122). The measuring device 10 normalizes the walking waveform for one step to a walking cycle of 0-100% (first normalization). Furthermore, the measuring device 10 normalizes the ratio of the stance phase to the swing phase of the walking waveform for the first normalized one step to 60:40 (second normalization). The normalized walking waveform is called walking waveform data.

[0075] Next, the measuring device 10 extracts features used to estimate the physical state from the normalized gait waveform data (step S123). The extracted features are set according to the physical state to be estimated.

[0076] Next, the measurement device 10 generates feature quantities for each walking phase cluster using the extracted feature quantities (step S124).

[0077] Next, the measurement device 10 integrates the feature quantities for each walking phase cluster to generate walking data for one step cycle (step S125).

[0078] Next, the measuring device 10 records the generated walking data as walking data (step S126). After step S126, the process proceeds to step S107 in the flowchart of Figure 7.

[0079] [Data Relay Device] Figure 9 is a flowchart illustrating an example of the operation of the data relay device 15. In the explanation following the flowchart in Figure 9, the data relay device 15 will be described as the main operating component.

[0080] In Figure 9, first, the data relay device 15 determines whether the subject has put on or taken off their shoes (step S151). When it receives walking data corresponding to the subject putting on or taking off their shoes (Yes in step S151), the data relay device 15 records the received walking data (step S152). If it receives a shoe-wearing notification signal from the measurement device 10, the data relay device 15 only needs to record the time the shoe-wearing notification signal was received. The time the shoe-wearing notification signal was received corresponds to the time the subject left the house. If it does not receive walking data corresponding to the subject putting on or taking off their shoes (No in step S151), it proceeds to step S156. The determination of whether the subject has put on or taken off their shoes can be made at a pre-set timing.

[0081] Following step S152, the data relay device 15 outputs voice information to the subject in response to the subject putting on / taking off their shoes (step S153). For example, if walking data corresponding to the subject putting on their shoes is received, the data relay device 15 outputs voice information such as "Have a good day." For example, if walking data corresponding to the subject taking off their shoes is received, the data relay device 15 outputs voice information such as "Welcome back." There are no particular limitations on the voice information output from the data relay device 15.

[0082] Following step S153, when the data relay device 15 receives the subject's voice (Yes in step S154), it records voice data corresponding to the received voice (step S155). The data relay device 15 records the time the voice data was received, associating it with the voice data. The data relay device 15 also records target data that associates the voice data with the walking data accumulated at the time the voice data was received.

[0083] If the response after step S155, or if the response is No in step S151 or step S154, and it is time to send the target data (Yes in step S156), proceed to step S157. If it is not time to send the target data (No in step S156), return to step S151.

[0084] If the answer in step S156 is Yes and measurement is to be stopped (Yes in step S157), the process according to the flowchart in Figure 9 is complete. If measurement is to be continued (No in step S157), the process returns to step S151. The criteria for deciding whether to stop or continue measurement can be set in advance.

[0085] As described above, the measurement system of this embodiment comprises a measurement device and a data relay device. The measurement device is mounted on the subject's footwear. The measurement device has a sensor and a gait data generation unit. The sensor measures spatial acceleration and spatial angular velocity. The sensor generates sensor data related to foot movement using the measured spatial acceleration and spatial angular velocity. The sensor outputs the generated sensor data. The gait data generation unit acquires time-series data of the sensor data. The gait data generation unit extracts features related to gait from the time-series data of the sensor data. The gait data generation unit generates gait data including the extracted features. The gait data generation unit transmits the generated gait data to the data relay device.

[0086] The data relay device comprises a communication unit, an audio input / output unit, a storage unit, and an output unit. The communication unit receives walking data. The walking data includes feature quantities extracted from sensor data related to foot movement measured by a measuring device mounted on the subject's footwear. The audio input / output unit outputs audio to the subject in response to the reception of walking data. The storage unit stores the received walking data. The output unit outputs target data, including the walking data stored in the storage unit, at a preset transmission timing.

[0087] The data relay device of this embodiment outputs audio to a subject in response to the reception of walking data measured according to the subject's walking. The transmission of the subject's walking data roughly coincides with the timing of the subject putting on or taking off their shoes. The subject puts on their shoes when they go out. On the other hand, the subject takes off their shoes when they return home. The period when the subject is out includes the period when they are walking. The transmission of walking data measured according to the subject's walking to the data relay device is timed to coincide with the timing of the subject going out / returning home. Therefore, according to this embodiment, walking data acquired according to the subject's walking can be accurately collected in accordance with the subject's daily life.

[0088] In one embodiment of this system, the audio input / output unit generates audio data corresponding to the subject's voice. The audio input / output unit stores the generated audio data in the storage unit. The output unit outputs target data, including walking data and audio data stored in the storage unit, at a preset transmission timing. The subject's audio data is acquired at the time of the subject's departure and return home. Therefore, according to this embodiment, target data including audio data acquired in accordance with the subject's daily life can be accurately collected.

[0089] In one embodiment of this system, the communication unit receives a putting-on / taking-off signal indicating that the subject is putting on or taking off their footwear. The audio input / output unit outputs audio to the subject in response to the putting-on / taking-off signal. In this embodiment, the audio is output to the subject in response to them putting on or taking off their footwear. Therefore, according to this embodiment, it is possible to output audio in response to the subject putting on or taking off their footwear.

[0090] In one embodiment of this design, the on / off signal includes information indicating the putting on and taking off of footwear. When the on / off signal indicates the putting on of footwear, the audio input / output unit outputs audio corresponding to the subject's departure. When the on / off signal indicates the taking off of footwear, the audio input / output unit outputs audio corresponding to the subject's return home. In this embodiment, the subject's departure and return home can be distinguished by the on / off signal, which includes information indicating the putting on and taking off of footwear. Therefore, according to this embodiment, the data relay device can output appropriate audio according to the subject's departure / return home.

[0091] (Second embodiment) Next, a measurement system according to the second embodiment will be described with reference to the drawings. The measurement system of this embodiment is configured such that a human presence sensor is added to the measurement system of the first embodiment.

[0092] (composition) Figure 10 is a block diagram showing an example of the configuration of the measurement system 2 according to this embodiment. The measurement system 2 comprises a measurement device 20, a data relay device 25, and a human presence sensor 26. The data relay device 25 is connected to a database 250 via a network 240 such as an intranet or the internet. The data relay device 25 transmits the walking data stored in the data relay device 25 to the database 250 at a preset timing. Below, an overview of the measurement system 2 will be described, followed by a description of the configuration of the data relay device 25. The configuration of the measurement device 20 is the same as in the first embodiment, so it will be omitted.

[0093] Figure 11 is a conceptual diagram showing an example of the arrangement of the measurement system 2. Figure 11 is a view from above of a part of the floor plan of the subject's residence. The measurement device 20, data relay device 25, and motion sensor 26 that make up the measurement system 2 are placed in the entrance of the subject's residence. The measurement device 20 is placed on the subject's shoes 200. The data relay device 25 is placed on top of the shoe rack in the entrance. The motion sensor 26 is placed above the entrance door. Figure 11 is just one example of the arrangement of the measurement system 2 and does not limit the arrangement of the measurement system 2. For example, the data relay device 25 transmits the accumulated target data to a router 270 located in another room at a predetermined timing. The router 270 transmits the received target data to a database 250 via the network 240.

[0094] The motion sensor 26 is positioned near the data relay device 25. The motion sensor 26 is connected to the data relay device 25. For example, the motion sensor 26 is connected to the data relay device 25 by wireless communication. The motion sensor 26 may also be connected to the data relay device 25 by wired communication. There are no particular limitations on the method of connection between the motion sensor 26 and the data relay device 25.

[0095] The motion sensor 26 detects a person entering its detection range. Upon detecting a person, the motion sensor 26 outputs a signal (also called a detection signal) to the data relay device 25 to notify it that a person has been detected. For example, the motion sensor 26 detects a person using infrared light, such as from a thermopile or infrared sensor. There are no particular limitations on the configuration of the motion sensor 26. For example, the motion sensor 26 may be configured to detect a person using waves such as sound waves or vibrations.

[0096] The data relay device 25 receives a detection signal from the motion sensor 26. The data relay device 25 is connected to the measuring device 20. In response to receiving the detection signal transmitted from the motion sensor 26, the data relay device 25 transmits a data request signal to the measuring device 20. For example, the data relay device 25 is connected to the measuring device 20 by wireless communication. The data relay device 25 may also be connected to the measuring device 20 by wired communication. There are no particular limitations on the connection method between the data relay device 25 and the measuring device 20.

[0097] The measuring device 20 is mounted on the subject's footwear. When the measuring device 20 is within communication range of the data relay device 25, it receives a data request signal from the data relay device 25. In response to the data request signal, the measuring device 20 transmits the accumulated walking data to the data relay device 25.

[0098] The data relay device 25 receives walking data transmitted from the measuring device 20 in response to a data request signal. The data relay device 25 stores the received walking data. When the data relay device 25 receives walking data transmitted from the measuring device 20 at the moment the subject puts on their shoes, the data relay device 25 outputs a voice message directed at the subject who is going outside. When the data relay device 25 receives walking data transmitted from the measuring device 20 at the moment the subject takes off their shoes, the data relay device 25 outputs a voice message directed at the subject who has returned home.

[0099] Furthermore, the data relay device 25 receives audio from the target person in response to the audio output to that person. The data relay device 25 converts the received audio into audio data. The data relay device 25 stores the converted audio data. Preferably, the audio data is stored linked to the time the audio was received. If the audio data is stored linked to the time, the time the target person left / returned home can be determined.

[0100] The data relay device 25 may be configured to estimate the emotions and fatigue levels of a subject based on their voice. For example, the data relay device 25 may be pre-trained using machine learning techniques to learn emotions and fatigue levels corresponding to the frequency and tone of the subject's voice. In this way, the emotions and fatigue levels of the subject can be estimated based on the input of their voice. The data relay device 25 may also be configured to estimate the subject's state by analyzing the content of their responses as text. If configured in this way, it is also possible to estimate emotions such as joy, anger, sadness, and happiness based on the text contained in the subject's responses.

[0101] The data relay device 25 transmits target data to a database 250 built on a cloud or server via the network 240. Target data is a general term for walking data and voice data. If voice data of the subject is stored, the data relay device 25 transmits the voice data to the database 250 in addition to the walking data. The target data stored in the database 250 is used for estimating the physical condition of the subject, etc. There are no limitations on the use of the target data stored in the database 250. For example, the data relay device 25 may transmit the target data to a terminal device (not shown) handled by a care manager or other person in charge of a subject who is subject to care / support.

[0102] [Data relay device] Figure 12 is a block diagram showing an example of the configuration of the data relay device 25. The data relay device 25 includes a communication unit 251, an audio input / output unit 253, a storage unit 255, a detection unit 256, and an output unit 257.

[0103] The communication unit 251 transmits a data request signal in response to the detection signal received by the detection unit 256. The data request signal transmitted from the communication unit 251 is sent to the measuring device 20. The communication unit 251 receives walking data transmitted from the measuring device 20 in response to the data request signal. The communication unit 251 stores the received walking data in the storage unit 255. The communication unit 251 communicates with the measuring device 20 using a common communication method.

[0104] The audio input / output unit 253 has the same configuration as the audio input / output unit 153 of the first embodiment. The audio input / output unit 253 has a speaker that outputs sound and a microphone that receives sound. The audio input / output unit 253 outputs sound for the subject in response to the reception of walking data. The audio data that is converted into sound for the subject can be stored in the storage unit 255. When the audio input / output unit 253 receives walking data transmitted from the measuring device 20 at the moment the subject puts on their shoes, it outputs sound for the subject who is going out. When the audio input / output unit 253 receives walking data transmitted from the measuring device 20 at the moment the subject takes off their shoes, it outputs sound for the subject who has returned home. If only audio output is performed, the microphone may be omitted.

[0105] The audio input / output unit 253 receives audio emitted from a target person in response to audio output directed to that person. The audio input / output unit 253 converts the received audio into audio data. The audio data is digital data. The audio input / output unit 253 stores the converted audio data in the storage unit 255. Preferably, the audio data is stored in association with the time the audio was received. For this reason, it is preferable that the data relay device 25 includes a clock such as a real-time clock. If the audio data is stored in association with the time, the time the target person left / returned home can be determined.

[0106] The storage unit 255 has the same configuration as the storage unit 155 in the first embodiment. The storage unit 255 stores walking data and voice data. The walking data and voice data stored in the storage unit 255 are collectively referred to as target data. Target data is accumulated in the storage unit 255 at the interval of transmission of target data by the output unit 257. The target data accumulated in the storage unit 255 is output at the timing of target data transmission. The target data accumulated in the storage unit 255 is deleted in conjunction with the transmission of target data. For example, it is conceivable that the transmitted target data may not reach the database 250. Therefore, the system may be configured to delete the target data accumulated in the storage unit 255 only after a signal notifying the receipt of target data is obtained from the database 250.

[0107] The detection unit 256 receives a detection signal from the human presence sensor 26. Upon receiving the detection signal, the detection unit 256 outputs a transmission instruction for a data request signal to the communication unit 251. The detection signal is a signal that notifies that a person has entered the detection range of the human presence sensor 26. The detection signal may also be transmitted in response to the detection of animals or other objects instead of people. Therefore, even if a data request signal is transmitted in response to the reception of a detection signal, a response (walking data) from the measuring device 20 may not be received.

[0108] The output unit 257 has the same configuration as the output unit 157 of the first embodiment. The output unit 257 is a communication interface for transmitting target data. The output unit 257 transmits target data to a database 250 built on a cloud or server via the network 240. The target data stored in the database 250 is used for estimating the physical condition of the subject, etc. There are no limitations on the use of the walking data stored in the database 250. The output unit 257 may be a general-purpose interface conforming to a standardized specification instead of a communication interface. The output unit 257 may be an interface that can read and write data to a recording medium instead of a communication interface.

[0109] (operation) Next, the operation of the measurement system 2 will be explained with reference to the drawings. Here, the measurement device 20 and the data relay device 25 included in the measurement system 2 will be explained individually. The operation of the human presence sensor 26 will be omitted from the explanation.

[0110] [Measurement Device] Figure 13 is a flowchart illustrating an example of the operation of the measurement device 20. In the explanation following the flowchart in Figure 13, the measurement device 20 will be described as the main operator.

[0111] In Figure 13, first, the measuring device 20 measures sensor data in standby mode (step S201). Standby mode is a low-power operating mode when no data request signal has been received. In standby mode, the measuring device 20 measures sensor data at a less frequent measurement interval compared to the measurement mode. That is, in standby mode, the measuring device 20 measures sensor data at a longer measurement interval compared to the measurement mode. The measuring device 20 may be configured to activate in response to the reception of a data request signal.

[0112] When a data request signal is received (Yes in step S202), the measuring device 20 transmits the accumulated walking data (step S203). The walking data transmitted from the measuring device 20 is received by the data relay device 25. At this stage, there is a possibility that no walking data has been accumulated in the measuring device 20. In such a case, the measuring device 20 should be configured to transmit a signal that notifies the subject of putting on shoes (also called a shoe-wearing notification signal). By receiving the shoe-wearing notification signal, the data relay device 25 can take action in accordance with the timing when the subject goes outside. If a data request signal has not been received (No in step S202), the process returns to step S201.

[0113] Following step S203, the measuring device 20 measures sensor data in measurement mode (step S204). The measuring device 20 measures sensor data at a shorter interval than in measurement mode. That is, in measurement mode, the measuring device 20 measures sensor data at a shorter interval than in standby mode. In measurement mode, the measuring device 20 measures all spatial acceleration / spatial angular velocity used to estimate the body state. The measuring device 20 may be set to activate in response to the reception of a data request signal and measure spatial acceleration / spatial angular velocity.

[0114] If the device detects the subject's walking (Yes in step S205), the measuring device 20 performs walking data measurement processing (step S206). In the walking data measurement processing, the measuring device 20 measures walking data using the sensor data measured by the measuring device 20. The walking data measurement processing in step S206 is the same as the walking data measurement processing in the first embodiment (Figure 8). If the device does not detect the subject's walking (No in step S205), proceed to step S207.

[0115] If step S206 is followed by step S207, or if step S205 is No, the measuring device 20 determines whether the subject has removed their shoes (step S207). If the measuring device 20 detects that the subject has removed their shoes (step S207 is Yes), the measuring device 20 transmits the accumulated walking data (step S208). At this stage, walking data based on sensor data measured by the measuring device 20 according to the walking of the subject who was outside is accumulated in the measuring device 20. If the measuring device does not detect that the subject has removed their shoes (step S207 is No), the process returns to step S206. The removal of shoes by the subject may also be determined by the detection of a person by the human presence sensor 26.

[0116] If measurement is to be stopped after step S208 (Yes in step S209), the process according to the flowchart in Figure 13 is complete. If measurement is to be continued (No in step S209), return to step S201. The criteria for deciding whether to stop or continue measurement can be set in advance.

[0117] [Data Relay Device] Figure 14 is a flowchart illustrating an example of the operation of the data relay device 25. In the explanation following the flowchart in Figure 14, the data relay device 25 will be described as the main operating component.

[0118] In Figure 14, when the data relay device 25 receives a detection signal from the human presence sensor 26 (Yes in step S251), it sends a data request signal to the measuring device 20 (step S252). If the human presence sensor 26 has not received a detection signal (No in step S251), the process proceeds to step S258.

[0119] If walking data is received after step S252 (Yes in step S253), the data relay device 25 records the received walking data (step S254). If a shoe-wearing notification signal is received from the measuring device 20, the data relay device 25 only needs to record the time the shoe-wearing notification signal was received. The time the shoe-wearing notification signal was received corresponds to the time the subject left the house. If no walking data is received (No in step S253), proceed to step S258.

[0120] Following step S254, the data relay device 25 outputs voice information to the subject in response to the subject putting on / taking off their shoes (step S255). For example, if walking data corresponding to the subject putting on their shoes is received, the data relay device 25 outputs voice information such as "Have a good day." For example, if walking data corresponding to the subject taking off their shoes is received, the data relay device 25 outputs voice information such as "Welcome back." There are no particular limitations on the voice information output from the data relay device 25.

[0121] Following step S255, when the data relay device 25 receives the subject's voice (Yes in step S256), it records voice data corresponding to the received voice (step S257). The data relay device 25 records the time the voice data was received, associating it with the voice data. The data relay device 25 also records target data that associates the voice data with the walking data accumulated at the time the voice data was received.

[0122] If the answer to step S257 is No, or if the answer to step S251, step S253, or step S256 is No, then if it is time to send the target data (Yes in step S258), proceed to step S259. If it is not time to send the target data (No in step S258), return to step S251.

[0123] If the answer in step S258 is Yes and measurement is to be stopped (Yes in step S259), the process according to the flowchart in Figure 14 is complete. If measurement is to be continued (No in step S259), the process returns to step S251. The criteria for deciding whether to stop or continue measurement can be set in advance.

[0124] (Examples of application) Next, an application example according to this embodiment will be described with reference to the drawings. Figures 15 to 17 are conceptual diagrams for explaining this application example. In this application example, the measuring device 20, data relay device 25, and motion sensor 26, which constitute the measurement system 2, are placed at the entrance of the subject's residence.

[0125] Figure 15 is a conceptual diagram showing a subject putting on shoes 200 in preparation for going out. A measuring device 20 is installed inside the shoes 200. The motion sensor 26 transmits a detection signal to the data relay device 25 in response to detecting a subject. The data relay device 25 outputs the voice message "Have a good day" in response to the voice message output from the data relay device 25. The data relay device 25 records the voice data corresponding to the subject's response.

[0126] Figure 16 is a conceptual diagram showing a subject walking while outdoors. The measuring device 20 measures sensor data according to the subject's walking. The measuring device 20 stores walking data corresponding to the sensor data.

[0127] Figure 17 is a conceptual diagram showing a subject returning home from going out. The motion sensor 26 transmits a detection signal to the data relay device 25 upon detecting the subject. The data relay device 25 outputs the voice message "Welcome home" upon receiving the detection signal. The subject responds "I'm home" in response to the voice message output from the data relay device 25. The data relay device 25 records the voice data corresponding to the subject's response. Furthermore, the data relay device 25 estimates the subject's state based on their response. In the example in Figure 17, the data relay device 25 estimates that the subject is fatigued based on their response. The data relay device 25 outputs the voice message "You seem tired. Please take a good rest" in response to the estimation of the subject's state. Hearing these words of encouragement from the data relay device 25 may make the subject feel more content than if they received no response at all.

[0128] According to this application example, walking data acquired according to the subject's walking style can be accurately collected in accordance with the subject's daily life. Furthermore, according to this application example, there is a possibility that the quality of life (QOL) of subjects living alone can be improved by interacting with them through voice information from the data relay device 25.

[0129] As described above, the measurement system of this embodiment comprises a measuring device, a data relay device, and a human presence sensor. The human presence sensor is positioned near the data relay device. The human presence sensor transmits a detection signal to the data relay device in response to the detection of a person, including a target person. In response to the detection signal, the data relay device transmits a data request signal to the measuring device requesting the transmission of walking data. In response to the data request signal, the measuring device transmits the stored walking data to the data relay device. The data relay device receives the walking data transmitted in response to the data request signal. The data relay device stores the received walking data.

[0130] In this embodiment, the data relay device acquires walking data from a measuring device mounted on the footwear of a subject when the subject is detected near the data relay device. If the data relay device is located at the entrance of the subject's residence, the timing when the subject comes near the data relay device is likely to coincide with the subject's departure from or return to work. Therefore, according to this embodiment, walking data acquired in accordance with the subject's walking can be accurately collected in line with the subject's daily life.

[0131] (Third embodiment) Next, a data relay device according to the third embodiment will be described with reference to the drawings. The data relay device of this embodiment has a simplified configuration compared to the data relay devices included in the measurement systems of the first and second embodiments.

[0132] Figure 18 is a block diagram showing an example of the configuration of the data relay device 35 according to this embodiment. The data relay device 35 includes a communication unit 351, an audio input / output unit 353, a storage unit 355, and an output unit 357.

[0133] The communication unit 351 receives walking data. The walking data includes feature quantities extracted from sensor data related to foot movement measured by a measuring device mounted on the subject's footwear. The audio input / output unit 353 outputs audio to the subject in response to the reception of walking data. The storage unit 355 stores the received walking data. The output unit 357 outputs target data, including the walking data stored in the storage unit, at a preset transmission timing.

[0134] As described above, the data relay device of this embodiment outputs audio to the subject in response to the reception of walking data measured according to the subject's walking. The transmission of the subject's walking data roughly coincides with the timing when the subject puts on or takes off their shoes. The subject puts on their shoes when they go out. On the other hand, the subject takes off their shoes when they return home. The period when the subject is out includes the period when they are walking. The transmission of walking data measured according to the subject's walking to the data relay device is timed to coincide with the timing when the subject goes out / returns home. Therefore, according to this embodiment, walking data acquired according to the subject's walking can be accurately collected in accordance with the subject's daily life.

[0135] (Hardware) Here, the hardware configuration for executing the control and processing according to each embodiment of this disclosure will be explained using the information processing device 90 (computer) in Figure 19 as an example. Note that the information processing device 90 in Figure 19 is an example configuration for executing the control and processing of each embodiment and does not limit the scope of this disclosure.

[0136] As shown in Figure 19, the information processing device 90 comprises a processor 91, main memory 92, auxiliary storage 93, input / output interface 95, and communication interface 96. In Figure 19, interface is abbreviated as I / F (Interface). The processor 91, main memory 92, auxiliary storage 93, input / output interface 95, and communication interface 96 are connected to each other via a bus 98, enabling data communication. Furthermore, the processor 91, main memory 92, auxiliary storage 93, and input / output interface 95 are connected to a network such as the Internet or an intranet via the communication interface 96.

[0137] The processor 91 loads programs (instructions) stored in the auxiliary storage device 93, etc., into the main memory 92. For example, the program is a software program for executing the control and processing of each embodiment. The processor 91 executes the program loaded into the main memory 92. By executing the program, the processor 91 executes the control and processing of each embodiment.

[0138] The main memory 92 has an area where the program is loaded. The processor 91 loads the program stored in the auxiliary memory 93, etc., into the main memory 92. The main memory 92 is implemented by volatile memory such as DRAM (Dynamic Random Access Memory). Alternatively, non-volatile memory such as MRAM (Magneto Resistive Random Access Memory) may be configured / added as the main memory 92.

[0139] The auxiliary storage device 93 stores various data, such as programs. The auxiliary storage device 93 is implemented by a local disk such as a hard disk or flash memory. It is also possible to omit the auxiliary storage device 93 by configuring the system to store various data in the main memory 92.

[0140] The input / output interface 95 is an interface for connecting the information processing device 90 to peripheral devices, based on standards and specifications. The communication interface 96 is an interface for connecting to external systems and devices via a network such as the Internet or an intranet, based on standards and specifications. The input / output interface 95 and the communication interface 96 may be shared as interfaces for connecting to external devices.

[0141] The information processing device 90 may be connected to input devices such as a keyboard, mouse, or touch panel, as needed. These input devices are used to input information and settings. When a touch panel is used as an input device, the screen with touch panel functionality serves as the interface. The processor 91 and the input devices are connected via an input / output interface 95.

[0142] The information processing device 90 may be equipped with a display device for displaying information. If a display device is provided, the information processing device 90 is equipped with a display control device (not shown) for controlling the display of the display device. The information processing device 90 and the display device are connected via an input / output interface 95.

[0143] The information processing device 90 may be equipped with a drive device. The drive device mediates between the processor 91 and the recording medium (program recording medium) by reading data and programs stored on the recording medium and writing the processing results of the information processing device 90 to the recording medium. The information processing device 90 and the drive device are connected via an input / output interface 95.

[0144] The above is an example of a hardware configuration for enabling the control and processing according to each embodiment of the present invention. The hardware configuration in Figure 19 is an example of a hardware configuration for executing the control and processing according to each embodiment and does not limit the scope of the present invention. Programs that cause a computer to execute the control and processing according to each embodiment are also included in the scope of the present invention.

[0145] A program recording medium that stores the program according to each embodiment is also included in the scope of the present invention. The recording medium can be implemented as an optical recording medium such as a CD (Compact Disc) or DVD (Digital Versatile Disc). The recording medium may also be implemented as a semiconductor recording medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) card. Furthermore, the recording medium may be implemented as a magnetic recording medium such as a flexible disk, or other recording media. When a program executed by a processor is recorded on a recording medium, that recording medium corresponds to a program recording medium.

[0146] The components of each embodiment may be combined in any way. The components of each embodiment may be implemented by software. The components of each embodiment may be implemented by circuitry.

[0147] Although the present invention has been described above with reference to embodiments, the present invention is not limited to the above embodiments. Various modifications to the configuration and details of the present invention can be made that will be understood by those skilled in the art within the scope of the present invention. [Explanation of Symbols]

[0148] 1, 2 Measurement Systems 10, 20 Measuring devices 11 sensors 12 Walking data generation unit 15, 25, 35 Data relay devices 26 motion sensors 111 Accelerometer 112 Angular velocity sensor 121 Acquisition Department 122 Normalization section 123 Extraction part 125 Storage section 126 Detection unit 127 Transmitter / Receiver 151, 251, 351 Communications Department 153, 253, 353 Audio Input / Output Section 155, 255, 355 storage section 157, 257, 357 Output section 256 Detection unit

Claims

1. A communication means for receiving walking data, which includes feature quantities extracted from sensor data relating to foot movement measured by a measuring device mounted on the footwear of a subject, in the vicinity of the position where the subject puts on or takes off their shoes, A storage means for storing the received walking data, An audio input / output means having a speaker that outputs sound and a microphone that receives sound, The system includes an output means that transmits target data, including the walking data stored in the storage means, to a database used for estimating the physical condition of the subject at a predetermined transmission timing, The aforementioned communication means is The measuring device receives an on / off signal indicating either putting on or taking off the footwear, measured in accordance with the change in the sensor data. The aforementioned audio input / output means is When the aforementioned putting on / taking off signal indicates putting on the footwear, an audio signal corresponding to going out is output. A data relay device that outputs audio corresponding to returning home when the aforementioned footwear removal signal indicates the removal of footwear.

2. The aforementioned audio input / output means is A voice data corresponding to the voice of the subject is generated, The generated audio data is stored in the storage means. The output means is The data relay device according to claim 1, which outputs the target data, including the walking data and the voice data stored in the storage means, at a preset transmission timing.

3. The data relay device is equipped with a detection means for receiving a detection signal corresponding to the detection of a person, including the target person, in the vicinity of the data relay device. The aforementioned communication means is In response to receiving the aforementioned detection signal, a data request signal is transmitted to request the transmission of the walking data. The data relay device according to claim 1, which stores the walking data transmitted in response to the data request signal in the storage means.

4. A data relay device according to any one of claims 1 to 3, Equipped with a measuring device mounted on the subject's footwear, The aforementioned measuring device is A sensor that measures spatial acceleration and spatial angular velocity, generates sensor data related to foot movement using the measured spatial acceleration and spatial angular velocity, and outputs the generated sensor data, A measurement system comprising: a means for acquiring time-series data of the sensor data; extracting gait-related features from the time-series data of the sensor data; generating walking data including the extracted features; and transmitting the generated walking data to the data relay device.

5. The aforementioned measuring device is Using the aforementioned sensor data, the putting on and taking off of the footwear by the subject is detected. The measurement system according to claim 4, wherein, in response to detection of the subject putting on or taking off the footwear, the subject transmits a putting on or taking off signal indicating the subject putting on or taking off the footwear to the data relay device.

6. Includes a motion sensor positioned near the data relay device, which transmits a detection signal to the data relay device in response to the detection of a person, including the target person, The aforementioned data relay device is In response to receiving the detection signal, a data request signal requesting the transmission of the walking data is sent to the measuring device. The aforementioned measuring device is The measurement system according to claim 4, wherein the accumulated walking data is transmitted to the data relay device in response to the data request signal.

7. Computers Near the location where the subject puts on or takes off their shoes, walking data including feature quantities extracted from sensor data related to foot movement measured by a measuring device mounted on the subject's footwear is received. The received walking data is stored, At a predetermined transmission timing, the target data, including the stored walking data, is transmitted to a database used to estimate the physical condition of the subject. The measuring device receives an on / off signal indicating either putting on or taking off the footwear, measured in accordance with the change in the sensor data. When the aforementioned putting on / taking off signal indicates putting on the footwear, an audio signal corresponding to going out is output. A data relay method that outputs audio corresponding to returning home when the aforementioned footwear removal signal indicates the removal of footwear.

8. A process for receiving walking data, which includes feature quantities extracted from sensor data relating to foot movement measured by a measuring device mounted on the subject's footwear, in the vicinity of the position where the subject puts on or takes off their shoes, A process for storing the received walking data, A process that transmits the target data, including the stored walking data, to a database used for estimating the physical condition of the subject at a predetermined transmission timing, The process of receiving an on / off signal from the measuring device that indicates either putting on or taking off the footwear, measured in accordance with the change in the sensor data, When the aforementioned putting on / taking off signal indicates that the footwear is being put on, the process outputs a sound corresponding to going out. A program that causes a computer to perform the following actions when the aforementioned putting on / taking off signal indicates that the footwear has been taken off: outputting an audio signal corresponding to returning home.

Images