Data measurement system and method for presenting measurement data

Abstract

A data measurement system (10) that comprises a plurality of measurement devices (130), a signal transmitter (110), and a data processing device (150). The signal transmitter (110) transmits trigger signals to the plurality of measurement devices (130). The data processing device (150): acquires measurement data that was measured between a start signal that corresponds to a trigger signal transmitted at a first time and an end signal that corresponds to a trigger signal transmitted at a second time that is later in time than the first time from each of the plurality of measurement devices (130); makes the start signals and the end signals of the acquired data coincide in time; and presents the measurement data from the plurality of measurement devices (130) to a user.

Description

[Technical Field]

[0001] The present invention relates to a data measurement system and a method for presenting measurement data, and more particularly to a technique for presenting data measured by a plurality of measurement devices in a synchronized time series manner. [Background technology]

[0002] In recent years, research into human motion analysis has been progressing. For example, Non-Patent Document 1 below introduces a system that visualizes working posture based on multiple motion sensors and biosensors attached to a worker and images of the worker while working. The system described in Non-Patent Document 1 aims to improve productivity by recognizing and analyzing the load on the worker during work and improving the work environment.

[0003] Furthermore, Non-Patent Document 2 discloses a gaze measurement device, which is an example of a biosensor applicable to the above-mentioned system. The gaze measurement device disclosed in Non-Patent Document 2 is provided with an input terminal for an external signal for starting and ending measurement. [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] Creact CAPTIV-L7000 Solution, https: / / www.creact.co.jp / item / measure / ergonomics / captiv-l7000 / l7000-top [Non-patent document 2] Tobii Tobii Pro Glasses 2 User's Manual,https: / / www.tobiipro.com / siteassets / tobii-pro / user-manuals / tobii-pro-glasses-2-user-manual.pdf / ?v=1.1.3 Summary of the Invention [Problem to be solved by the invention]

[0005] In the above-mentioned motion analysis, it is important to understand the time-series relationship between image information for recording the subject's motion, biometric information indicating the subject's condition such as body temperature and pulse rate, and environmental information indicating the state of the environment in which the subject is placed such as temperature and noise. However, this information is often obtained using separate measuring devices such as a camera, biometric sensor, and temperature and humidity sensor.

[0006] One method for chronologically synchronizing measurement data acquired by multiple measurement devices is to refer to the timestamps generated by the timing functions of each measurement device and synchronize the acquired measurement data based on whether the timestamps are the same. In this case, it is rare for the times of all measurement devices operating independently to match, and the time on each measurement device may have a significant time offset from the actual time.

[0007] Furthermore, the clock frequency of the oscillator that generates the clock signal used to perform the timing function in each measurement device may have some error. Therefore, even if there is no offset in the start times of the measurement devices, the time indicated by the same clock count may differ from one measurement device to another. As a result, even if the start times of the measurement devices are the same, the time difference between the measurement data may increase, especially as the measurement period becomes longer, and the degree of correlation between the data may decrease.

[0008] To address these issues, one possible solution is to centrally control all of the sensors and cameras used in the system using a common control device to ensure the simultaneity of measurement data. However, such a system requires dedicated control devices and sensors / cameras. This means that commercially available sensors cannot be used, resulting in poor versatility and the system itself could become large-scale and expensive.

[0009] The present invention has been made to solve the above-mentioned problems, and its purpose is to synchronize the acquired measurement data in a chronological order using a relatively simple method in a system that collects and presents measurement data acquired from multiple measurement devices. [Means for solving the problem]

[0010] The present invention of According to one aspect, a data measurement system includes a plurality of measurement devices, a transmitter, and a data processing device. The transmitter transmits a first signal to the plurality of measurement devices. The data processing device presents data acquired from the plurality of measurement devices to a user. The data processing device acquires, from each of the plurality of measurement devices, measurement data measured between a start signal corresponding to the first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is temporally delayed from the first time, and temporally matches the start signals and the end signals in the acquired data to present the measurement data of the plurality of measurement devices to the user.

[0011] A method according to another aspect of the present invention relates to a method for presenting measurement data to a user in a data measurement system including a plurality of measurement devices. The data measurement system includes a transmitter and a data processing device. Prepare The method includes the steps of: i) transmitting a first signal to a plurality of measurement devices by a transmitter; ii) acquiring, in a data processing device, measurement data measured between a start signal corresponding to the first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is delayed in time from the first time, from each of the plurality of measurement devices; and iii) matching, in the data processing device, the start signals and the end signals in the acquired data in time, and presenting the measurement data of the plurality of measurement devices to a user. [Effects of the Invention]

[0012] According to the data measurement system of the present invention, measurement data from a start signal to an end signal based on a first signal (trigger signal) transmitted from a common transmitter is acquired from each of multiple measurement devices, and the acquired measurement data is presented to a user by aligning the start signals and the end signals in time. In this way, by aligning the measurement data in each measurement device based on the start signal and the end signal and synchronizing the multiple measurement data in time series, the synchronization accuracy of the measurement data can be improved. Furthermore, by using a common trigger signal, commercially available sensors and the like can be used as long as the measurement device has an external input, making it possible to build a system relatively easily. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is an overall block diagram of a data measurement system according to an embodiment; [Figure 2] 10A and 10B are diagrams for explaining the relationship between measurement data and a marker signal in a measurement device. [Figure 3] 10A and 10B are diagrams for explaining the relationship between each measurement data and a marker signal in the case of a plurality of measurement devices. [Figure 4] 10A and 10B are diagrams showing examples of waveforms when a marker signal is superimposed on measurement data; [Figure 5] FIG. 10 is a diagram for explaining a marker signal in a camera image. [Figure 6] 1 is an example of a display in a data measurement system. [Figure 7] 10A and 10B are diagrams for explaining a correction process when the timings of marker signals in two pieces of measurement data do not match. [Figure 8] 10 is a flowchart illustrating processing by each device in the data measurement system. DETAILED DESCRIPTION OF THE INVENTION

[0014] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals and description thereof will not be repeated.

[0015] [Data measurement system configuration] FIG. 1 is an overall block diagram of a data measurement system 10 according to an embodiment. Referring to FIG. 1, the data measurement system 10 includes a signal transmitter 110, multiple signal receivers 120A, 120B, and 120X (collectively referred to as "signal receivers 120" below), measurement devices 130A and 130B, video cameras 130X and 130Y, a data processing device 150, and a display device 160. In the following description, the measurement devices 130A and 130B and the video cameras 130X and 130Y are also collectively referred to as "measurement devices 130." The data measurement system 10 synchronizes and displays measurement data, including image data, acquired from the multiple measurement devices 130 in chronological order. The data measurement system is used, for example, to observe and analyze the relationship between an event experienced by a subject or an observed object and a state change occurring in the subject or object due to the event.

[0016] The signal transmitter 110 transmits a trigger signal (first signal) used to synchronize measurement data of multiple measuring devices 130. The signal transmitter 110 broadcasts a pulse-shaped trigger signal, for example, using wireless and / or wired communication. In this embodiment, the trigger signal is not a start-up signal or measurement start signal for each measuring device, but a signal for specifying a measurement period for each measuring device, and is transmitted at the start and end of the measurement period. Basically, the trigger signal is transmitted while each measuring device 130 is started and performing measurement. Note that the trigger signal is not necessarily limited to a pulse signal, and may be a signal having a specific pattern such as a sine wave, or a packet signal including ID data for identification.

[0017] The signal receiver 120 is configured to be able to receive the trigger signal transmitted from the signal transmitter 110. In response to receiving the trigger signal, the signal receiver 120 transmits a marker signal (second signal) corresponding to the trigger signal to the measuring device 130.

[0018] 1, signal receiver 120A is connected to measuring device 130A, and signal receiver 120B is connected to measuring device 130B. In this case, signal receivers 120A and 120B transmit the received trigger signals to measuring devices 130A and 130B, respectively. If the trigger signal is a pulse signal, the received trigger signal is transferred directly from signal receiver 120 to measuring device 130. If the trigger signal is a signal in a form other than a pulse signal, the signal receiver 120 converts the trigger signal into a pulse signal and transmits it to measuring device 130.

[0019] Note that a signal receiver does not have to be individually arranged for each measurement device, and a signal from one signal receiver may be transmitted to two or more measurement devices. As will be described later, in measurement devices 130A and 130B, signals transmitted from signal receivers 120A and 120B are stored in memory device 133 in chronological order together with measurement data.

[0020] The signal receiver 120X is a light-emitting device and has a light-emitting element (not shown) such as an LED. The signal receiver 120X turns the light-emitting element on or off in response to receiving a trigger signal. If the measurement device is a video camera, it cannot store the above-mentioned pulse signal as a signal independent of the image data. By placing the signal receiver 120X within the field of view of the video camera, the change in the light-emitting element (on / off) is recorded in consecutive image frames. Therefore, the measurement data can be synchronized using the timing of the change in the light-emitting element.

[0021] The measuring devices 130A and 130B are, for example, environmental sensors for detecting the state of the environment in which a subject or object is placed, such as temperature, air pressure, humidity, and noise, and / or biosensors for detecting the state of the subject, such as body temperature, pulse, respiration, heart rate, brain waves, line of sight, cerebral blood flow, and acceleration. Each of the measuring devices 130A and 130B includes a CPU 131, a detection unit 132, and a storage device 133. The CPU 131 is a control device for overall control of the measuring device 130. In the measuring devices 130A and 130B, data detected by the detection unit 132 is stored in the storage device 133. In the measuring devices 130A and 130B, a signal receiver 120A , 120B are stored in the storage device 133 together with the measurement data.

[0022] The measurement devices 130A and 130B can communicate with the data processing device 150. In the example of Fig. 1, the measurement device 130A transmits stored measurement data and marker signals to the data processing device 150 using wired communication. Meanwhile, the measurement device 130B transmits measurement data and marker signals to the data processing device 150 using wireless communication.

[0023] Video cameras 130X and 130Y include an imaging unit (image sensor) 135 and a storage device 136. Video cameras 130X and 130Y store image data of the subject or the behavior of the observed object acquired by imaging unit 135 in storage device 136. Video cameras 130X and 130Y acquire, for example, images of the subject's working scene captured from multiple angles, images of the subject's facial expressions, and images of changes in the subject's pupils.

[0024] The image data stored in the storage device 136 is retrieved by a removable external storage medium 140 such as a memory card and read into the data processing device 150. Note that the transfer of measurement data from the video camera to the data processing device 150 may be performed by wired communication or wireless communication, similar to the above-described measuring devices 130A and 130B.

[0025] Each measuring device 130 is provided with a storage device 133, 136 inside the device, and signal transmission between the detection unit 132 and imaging unit 135 that acquire data and these storage devices 133, 136 is performed via wired connections. Wireless data transmission increases the possibility of data defects. Therefore, by using a wired method for data transmission between the data acquisition unit and the storage devices, data loss in the measurement data and marker signals can be reduced.

[0026] The data processing device 150 includes a CPU 151 and a storage device 152. The data processing device 150 acquires measurement data from each measurement device 130 via communication or an external storage medium. Based on a marker signal transmitted together with each measurement data, the data processing device 150 performs synchronization processing so that the acquisition periods of each measurement data coincide, and displays the processed measurement data on a display device 160. A user of the data measurement system 10 can use the data displayed on the display device 160 to analyze how the subject's condition changes in response to an event that has occurred.

[0027] 1, the signal receiver 120 is depicted as a device independent of the measuring device 130, but the measuring device 130 may include the functions of the signal receiver 120. If the measuring device 130 is a dedicated device adapted to the system of this embodiment, it is more preferable to have the signal receiver and the measuring device integrated into one unit. On the other hand, in the case of a general-purpose measuring device, using a separate signal receiver makes it possible to easily apply it to this system.

[0028] Furthermore, any of the measurement devices 130 may include the functionality of the signal transmitter 110. In this case, by operating the measurement start (end) in the measurement device that includes the signal transmitter functionality, it is possible to start (end) measurement and data storage in the other measurement devices in response to the operation.

[0029] One method for chronologically synchronizing measurement data acquired by multiple measurement devices is to refer to the timestamps generated by the timing functions of each measurement device and synchronize the measurement data so that the timestamps are synchronized. In this case, it is rare for the times on all measurement devices to match, and the time on each measurement device may have a significant time offset from the actual time.

[0030] Furthermore, the clock frequency of the oscillator that generates the clock signal used to perform the timing function in each measurement device can have a significant error. Therefore, even if there is no offset in the start times of the measurement devices, the time indicated by the same clock count can differ from one measurement device to another. As a result, even if the start times of the measurement devices are the same, the time difference between the measurement data can become larger, especially as the measurement period becomes longer, and the degree of correlation between the data (synchronization accuracy) can decrease.

[0031] In the data measurement system 10 according to this embodiment, a marker signal based on a trigger signal simultaneously transmitted from the signal transmitter 110 is stored together with the measurement data in each measurement device, and the data processing device 150 synchronizes each measurement data based on a marker signal (start signal) at the start of the measurement period and a marker signal (end signal) at the end of the measurement period. With this configuration, even if there is an error in the timestamp or clock period of each measurement device, the relative time difference between the two marker signals recognized by each measurement device will be at least one control period or less for each measurement device. Therefore, by using the synchronization process according to this embodiment, the synchronization accuracy between data within the measurement period can be improved.

[0032] [Synchronization process explanation] 2 is a diagram for explaining the relationship between measurement data and marker signals in the measuring device 130. The upper part of Fig. 2 shows measurement values ​​detected by the detection unit 132, and the lower part shows marker signals.

[0033] 2, a start marker signal is received at time t1, and an end marker signal is received at time t2 (line LN11). That is, the measurement period is from time t1 to time t2. In the measuring device 130, the measurement data that changes as shown by line LN10 is sampled at a predetermined sampling rate and stored in the storage device 133. At this time, the measurement data and the marker signal are stored in association with a timestamp (time) in the device's internal clock function.

[0034] 3 is a diagram for explaining the relationship between each measurement data and a marker signal in the case of multiple measurement instruments. In FIG. 3, for example, (a) is data in the measurement instrument 130A in FIG. 1, and (b) is data in the measurement instrument 130B in FIG. 1. In the example of FIG. 3, in the timestamps in the measurement instrument 130A, the start time of the measurement period is t10 and the end time is t11. On the other hand, in the timestamps in the measurement instrument 130B, the start time of the measurement period is t10A (≠t10) and the end time is t11A (≠t11). Note that the length of the measurement period, i.e., the length from time t10 to t11, is the same as the length from time t10A to t11A.

[0035] When there is a discrepancy in the timestamps of the measuring devices, even if the times indicated by the timestamps of the measuring devices are matched, the correlation between measurement value 1 of measuring device 130A (solid line LN20 in FIG. 3) and measurement value 2 of measuring device 130B (dashed line LN26 in FIG. 3) is not correct. In the synchronization process of this embodiment, the start marker signals (start signals) and the end marker signals (end signals) are matched (solid line LN25 in FIG. 3). This improves the synchronization accuracy of the measurement data during the measurement period.

[0036] 2 and 3 have described an example in which the measuring device 130 is configured to be able to store the marker signal from the signal receiver 120 in a separate channel different from that of the measurement data, but some measuring devices 130 may not be able to input external signals. In such cases, the start / end of the measurement period may be stored by superimposing a marker signal on the measurement data, as shown by line LN30 in FIG.

[0037] Next, synchronization processing when the measurement device is a video camera 130X in Fig. 5 will be described. In the case of a video camera, it is generally not possible to store a marker signal in a separate channel as shown in Fig. 2. Therefore, as described above, a signal receiver 120X with a light-emitting function is placed within the imaging range of the camera, and synchronization processing is performed based on the light-emitting state of the signal receiver 120X.

[0038] Referring to Fig. 5, in general, a video camera records a moving image as a series of still images captured continuously at a predetermined frame rate. In Fig. 5, images from frame 1 to frame (N+1) are shown in chronological order. In each recorded image, signal receiver 120X is placed within the imaging range, and the light emission state of the light emitting section of signal receiver 120X can be recognized.

[0039] In the example of FIG. 5, signal receiver 120X is in an emitting state in frames 2 and N. That is, a start trigger signal is received at the time frame 2 is captured, and an end trigger signal is received at the time frame N is captured. Therefore, the period from frame 2 to frame N is the measurement target period. Then, in data processing device 150, frame 2 is linked to the start signal (for example, time t10 in FIG. 3) of another measurement device, and frame N is linked to the end signal (time t11 in FIG. 3). This allows image data (frames 2 to N) within the measurement target period acquired by video camera 130X to be synchronized with the measurement data of measurement device 130A.

[0040] In the example of FIG. 5, the trigger signal is recognized based on the light-emitting state of the light-emitting element in the image. However, since a video camera can record audio data along with image data, the trigger signal may be recognized based on an audio signal. In this case, a signal receiver capable of outputting a specific audio signal, such as a beep, is used, and the audio signal is output in response to reception of the trigger signal. Then, the timing at which the audio signal is recorded in the audio data is used to determine the start and end of the measurement period in the data processing device 150, thereby synchronizing with other measurement data. In this way, synchronization processing may be performed using an audio signal. Such synchronization processing using the state of the light-emitting element and / or the recording of the audio signal in the video camera also corresponds to superimposing a marker signal (the state of the light-emitting element, the audio signal) on the measurement data (image data).

[0041] Fig. 6 is a diagram showing an example of a display on the display device 160 of the data measurement system 10 of this embodiment. In Fig. 6, image data 161, 162, and 163 captured by three video cameras are shown in the upper row, and measurement data (a) to (e) detected by the measurement devices (environmental sensors / biological sensors) are shown in the lower row.

[0042] 6, image data 161 is an image taken by camera 1 that captures the working state of a worker (subject). Image data 162 is an image taken by camera 2 that captures the facial expression of the worker. Image data 163 is an image taken by camera 3 that captures the state of the worker's pupils.

[0043] The measurement data shown are (a) room temperature, (b) humidity, (c) body temperature, (d) heart rate, and (e) respiratory rate. Each image data and measurement data is associated with each other by the synchronization process described with reference to FIGS. 3 and 5. FIG. 6 shows data for time t50 indicated by cursor 165. By moving cursor 165 with an operation unit (not shown) of display device 160 (for example, a keyboard or mouse), an image and each measurement data value corresponding to the time indicated by cursor 165 are displayed. This display allows an event occurring to the worker to be associated with the environmental and biological conditions at that time for analysis.

[0044] (Variation) In the above embodiment, the interval between the start marker signal and the end marker signal recognized by the measurement device, i.e., the measurement target period, is the same for each measurement device. Sampling Rate Even if the values ​​are slightly different, it can be guaranteed that they are measured during the measurement period.

[0045] However, due to differences in sampling rates between measurement devices, there may be a difference in the timing of marker signal recognition, and Measurement period In this case, there is a possibility that the correspondence between the measured values ​​will not be properly established.

[0046] Therefore, in this modified example, when a difference in the measurement period occurs due to a discrepancy in the recognition of the marker signal as described above, a configuration is described in which the measurement values ​​are appropriately matched to each other by correcting the timestamp intervals of the stored measurement values.

[0047] FIG. 7 is a diagram illustrating a correction process when the timing of the marker signals in two measurement data does not match. In FIG. 7, the upper part of FIG. 7(a) shows the measurement values ​​and marker signals measured by measuring device 130A, and the middle part of FIG. 7(b) shows the measurement values ​​and marker signals measured by measuring device 130B. The lower part of FIG. 7(c) shows the measurement values ​​and marker signals of measuring device 130B after correction processing. Note that FIGS. 7(a) to 7(c) are drawn so that the timing of the start signals (times t30, t30A, and t30B) match.

[0048] Referring to FIG. 7, the measuring device 130A samples the measurement value at a sampling rate ST1, and the measurement period from the start signal (time t30) to the end signal (time t31) is T1 (line LN41 in FIG. 7(a)).

[0049] On the other hand, the measuring device 130B samples the measurement values ​​at a longer sampling rate ST2 (>ST1) than the measuring device 130A. That is, the number of sampled measurement values ​​in a specific period is smaller for the measuring device 130B than for the measuring device 130A. In this case, the measuring device 130B may detect an end signal at the sampling timing of time t31A after detecting the start signal and before the period T1 arrives (line LN51 in FIG. 7(b)). In this case, the measurement target period T2 is shorter than the measurement target period T1 recognized by the measuring device 130A (T2 <T1)。

[0050] In such a situation, it may not be possible to properly establish a time-series correspondence between the measurement values ​​measured by each measuring device, so the data processing device 150 performs a process to correct the measurement period and the sampling interval of each measurement value of the other measuring devices so that they match the measurement period of the measuring device with the largest number of sampled measurement values ​​during the measurement period recognized by each measuring device (i.e., the measuring device with the highest sampling rate).

[0051] In the case of Fig. 7, the sampling interval of each measurement value is corrected (line LN50A in Fig. 7(c)) so that the measurement period T2 of the measurement data of the measuring device 130B coincides with the measurement period T1 of the measuring device 130A (line LN51A in Fig. 7(c)). This makes it possible to synchronize the measurement data even when using measuring devices with different sampling rates.

[0052] 7, a case has been described in which the measurement target period T2 recognized by the measuring device 130B is shorter than the measurement target period T1 recognized by the measuring device 130A, but depending on the emission timing of the marker signal, there may be a case in which the measuring device 130B detects the end marker signal later than the measuring device 130A (i.e., T2>T1). Even in this case, if the number of samples within the recognized measurement target period is greater in the measuring device 130A than in the measuring device 130B, the sampling interval of the measurement data of the measuring device 130B is corrected so as to shorten the measurement target period T2 in the measuring device 130B to the measurement target period T1.

[0053] In the above description, the sampling rate for detecting measurement data and the sampling rate for detecting marker signals are the same for each measurement device. On the other hand, for a measurement device with a slow sampling rate for measurement data, the sampling rate for detecting marker signals may be set higher than the sampling rate for detecting measurement data to improve the detection accuracy of the marker signals, thereby reducing the difference in measurement target period with other measurement devices.

[0054] [Data measurement system control] Fig. 8 is a flowchart for explaining the processing of each device in the data measurement system according to this embodiment. Note that the flowchart in Fig. 8 includes the correction processing of the above-described modified example.

[0055] 8, in step (hereinafter, step will be abbreviated as S) 10, signal transmitter 110 generates a trigger indicating the start of a measurement period at the timing of a user operation or at a predetermined timing registered in signal transmitter 110 in advance. Signal (start trigger signal) Broadcast.

[0056] The signal transmitter 110 broadcasts a trigger signal (end trigger signal) indicating the end of the measurement period at the timing of a user operation or at the timing when a predetermined period has elapsed since the start signal (S12).

[0057] In the measuring device 130, in S20, the measurement process is started by an operation from the user, and the storage of the measurement data in the storage device 133 is started. Note that the measurement process in the measuring device 130 is preferably started before the marker signal is received from the signal receiver 120, but may be started in response to the reception of the marker signal in S22.

[0058] In S22, the measuring device 130 determines whether or not it has received a marker signal (start signal) transmitted from the signal receiver 120 in response to the trigger signal from the signal transmitter 110. If it has not received the marker signal (start signal) (NO in S22), ) If this is the case, the process returns to S22, and the measurement device 130 continues the measurement process while waiting for the marker signal to be received.

[0059] If a marker signal (start signal) has been received (YES in S22), the process proceeds to S24, where the measuring device 130 associates the received marker signal with the measurement data and stores it in the storage device 133. Then, in S26, the measuring device 130 determines whether or not a marker signal (end signal) indicating the end of measurement has been received from the signal receiver 120. If a marker signal (end signal) has not been received from the signal receiver 120 (NO in S26), the process proceeds to S24, where the measuring device 130 continues to store the measurement data at a predetermined sampling rate.

[0060] On the other hand, if a marker signal (end signal) is received from the signal receiver 120 (YES in S26), the process proceeds to S28, and the measuring device 130 outputs the measurement data and the marker signal data for the measurement period from the start signal to the end signal to the data processing device 150. Thereafter, the measuring device 130 stops the measurement process by a user operation or the like (S30).

[0061] Note that step S28 is omitted when data stored in measurement device 130 is read into data processing device 150 using an external storage device. Furthermore, when the measurement devices are video cameras 130X and 130Y, the marker signal is recorded as an emission signal in the image data, and therefore, it may not be possible to determine whether the marker signal has been received, as in steps S22 and S26. In such cases, the entire image data during the measurement period is read into data processing device 150, and synchronization processing is performed in data processing device 150, either by user operation or automatically.

[0062] Furthermore, when measurement processing is performed over a long period of time, the influence of differences in sampling rates among the measuring devices 130 increases as the measurement time elapses. In such a case, it is preferable to reduce the influence of differences in sampling rates by dividing the data within the entire measurement period into shorter periods and transmitting them to the data processing device 150. In this case, the measuring device 130 continues to store the measurement data and marker signal in S24 while transmitting the measurement data to the data processing device 150 in S28 of Fig. 7. Each time a marker signal is transmitted from the signal receiver 120, the measurement data and marker signal data stored since the previous marker signal was received are transmitted to the data processing device 150.

[0063] In this way, by dividing the measurement data and transmitting it to the data processing device 150 for processing, synchronization processing of the measurement data of each measuring device 130 is performed on a block-by-block basis of the transmitted measurement data, making it possible to maintain data synchronization accuracy even in the case of measurements over a long period of time.

[0064] Next, the processing in the data processing device 150 will be described. In S40, the data processing device 150 acquires measurement data and image data from each measuring device 130. In S42, the data processing device 150 calculates the measurement period between adjacent marker signals from the marker signals included in the acquired data. Then, in S44, the data processing device 150 determines whether the lengths of the measurement periods calculated for the measurement data of each measuring device 130 match.

[0065] If the lengths of the measurement periods of the measuring devices 130 match (YES in S44), the process proceeds to S48, where the data processing device 150 matches the start signals and end signals of the measurement data of the measuring devices 130 and displays them on the display device 160 as shown in Fig. 6. Using this display, the user performs motion analysis on the subject.

[0066] On the other hand, if there is a measurement device with a mismatch in the length of the measurement period (NO in S44), the process proceeds to S46, where the data processing device 150 executes the correction process as described in Fig. 7. Thereafter, the process proceeds to S48, where the measurement data are displayed on the display device 160 in a synchronized state, as described above.

[0067] By controlling each device according to the above process, it is possible to appropriately synchronize and present measured data in a data measurement system using multiple measurement devices, thereby improving the accuracy of synchronization between multiple measurement data and the accuracy of analyzing their causal relationships.

[0068] [Aspect] (Item 1) A data measurement system according to one aspect includes a plurality of measurement devices, a transmitter, and a data processing device. The transmitter transmits a first signal to the plurality of measurement devices. The data processing device presents data acquired from the plurality of measurement devices to a user. The data processing device acquires, from each of the plurality of measurement devices, measurement data measured between a start signal corresponding to a first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is temporally delayed from the first time, and temporally matches the start signals and end signals in the acquired data to present the measurement data of the plurality of measurement devices to a user.

[0069] According to the data measurement system described in paragraph 1, measurement data from a start signal to an end signal based on a first signal from a common transmitter is acquired from each measurement device, and the acquired measurement data is presented to a user by aligning the start signals and the end signals in time. In this way, by aligning the measurement data based on the start and end signals in each measurement device and synchronizing the multiple measurement data in time series, the simultaneity of the measurement data can be ensured. Furthermore, especially when performing long-term measurements, transmitting the first signal at appropriate intervals allows the synchronization process to be performed sequentially, thereby reducing the effects of deviations in sampling rate or clock signal. Furthermore, using a common first signal allows commercially available sensors and other devices to be used as long as they have an external input, making it relatively easy to build a system.

[0070] (Item 2) The data measurement system according to item 1 further comprises a display device for displaying measurement data from the plurality of measurement devices to a user.

[0071] According to the data measurement system described in paragraph 2, a user can observe and analyze the measurement data displayed on the display device.

[0072] (Clause 3)Clause 1 orIn the data measurement system described in paragraph 2, the plurality of measurement devices include a first device and a second device. If a first interval from a start signal to an end signal in the first device is different from a second interval from a start signal to an end signal in the second device, the data processing device corrects the measurement data of the second device so that the second interval becomes the first interval.

[0073] According to the data measurement system described in paragraph 3, when the interval between the start signal and the end signal differs due to a difference in the sampling rate of each measurement device, the measurement data with the short interval is corrected and synchronization processing of the measurement data is performed, thereby improving the synchronization accuracy between the measurement data.

[0074] (4) In the data measurement system according to any one of paragraphs 1 to 3, the transmitter is included in one of the plurality of measurement devices.

[0075] According to the data measurement system described in paragraph 4, one of the multiple measurement devices includes the transmitter function, which makes it possible to build a system without preparing a separate transmitter.

[0076] (Item 5) In the data measurement system according to any one of items 1 to 3, the transmitter is included in the data processing device.

[0077] According to the data measurement system described in paragraph 5, the data processing device includes the function of a transmitter, so it is possible to build a system without preparing a separate transmitter.

[0078] (Item 6) In the data measurement system described in any one of items 1 to 5, each of the multiple measurement devices includes one of an environmental sensor that measures environmental information, a biological sensor that measures biological information, and an image sensor that captures images.

[0079] According to the data measurement system described in paragraph 6, an environmental sensor, a biosensor, and an image sensor (camera) can be used as the measurement device.

[0080] (Item 7) In the data measurement system described in item 6, each of the multiple measurement devices includes a memory device for storing the measurement data measured by the measurement device, and the signal transmission means from the sensor to the memory device is wired.

[0081] According to the data measurement system described in paragraph 7, each measurement device does not use wireless communication for signal transmission from the sensor to the storage device. Wireless communication carries a risk of data loss, but storing measurement data in the storage device using wired communication can reduce data loss.

[0082] (Item 8) In the data measurement system described in any one of Items 1 to 7, in each of the plurality of measurement devices, the sampling rate of the second signal is equal to or higher than the sampling rate of the measurement data.

[0083] According to the data measurement system described in paragraph 8, the sampling rate of the second signal used for synchronization processing with other measurement data is set to the same as that of the measurement data. Sampling Rate The above setting is used. Depending on the measurement device, the sampling rate of the measurement data may be relatively slow, and sampling the second signal at that sampling rate may result in a large deviation from the second signals of other measurement devices, which may reduce synchronization accuracy. Therefore, when the sampling rate of the measurement data is relatively slow, the sampling rate of the second signal may be set higher than the sampling rate of the measurement data to prevent a reduction in synchronization accuracy.

[0084] (Item 9) In the data measurement system according to any one of items 1 to 8, the transmitter transmits the first signal by wireless communication.

[0085] According to the data measurement system described in paragraph 9, the transmitter broadcasts the first signal using wireless communication. This eliminates the need for wiring connecting the transmitter and receiver, making it easier to build the system.

[0086] (Item 10) In the data measurement system according to any one of items 1 to 9, First signal is integrated into the measurement data and stored.

[0087] According to the data measurement system described in paragraph 10, the measurement device measures the measurement data. First signal If it is not possible to store these as independent signals, the measurement data First signal In the case of a camera, it can be added to the image data. First signal By recording First signal can be stored.

[0088] (Clause 11) The data measurement system described in Clause 1 further includes at least one receiver that transmits a second signal to a corresponding one of the plurality of measurement devices in response to receiving a first signal transmitted from the transmitter. The start signal is a second signal corresponding to the first signal transmitted at the first time. The end signal is a second signal corresponding to the first signal transmitted at the second time.

[0089] According to the data measurement system described in paragraph 11, by using a receiver that converts a first signal from a transmitter into a second signal, it becomes possible to use commercially available sensors or other measuring devices that have external inputs in the data measurement system, making it possible to build a system relatively easily.

[0090] (Item 12) A measurement device according to another aspect is used in the data measurement system described in item 1. The measurement device includes a transmitter.

[0091] (13th Item) A transmitter according to another aspect is used in the data measurement system according to any one of the first to twelfth items.

[0092] (14th paragraph) A receiver according to another aspect is used in the data measurement system according to any one of the first to twelfth paragraphs.

[0093] (15th Item) A data processing device according to another aspect is used in the data measurement system according to any one of the first to twelfth items.

[0094] (Clause 16) A method according to another aspect relates to a method for presenting measurement data to a user in a data measurement system including a plurality of measurement devices. The data measurement system includes a transmitter and a data processing device. The method includes: i) a step of transmitting a first signal to the plurality of measurement devices by the transmitter; ii) a step of acquiring, in the data processing device, measurement data measured between a start signal corresponding to the first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is delayed in time from the first time, from each of the plurality of measurement devices; and iii) a step of presenting the measurement data of the plurality of measurement devices to a user by temporally matching the start signals and the end signals in the acquired data in the data processing device.

[0095] According to the method described in paragraph 16, measurement data from a start signal to an end signal based on a first signal from a common transmitter is acquired from each measurement device, and the acquired measurement data is presented to a user by aligning the start signals and the end signals in time. In this way, by aligning the measurement data based on the start and end signals in each measurement device and synchronizing multiple measurement data in time series, the simultaneity of the measurement data can be ensured. Furthermore, when performing measurements over a long period of time, transmitting the first signal at appropriate intervals allows the synchronization process to be performed sequentially, thereby reducing the effects of deviations in sampling rate or clock signal. Furthermore, using a common first signal allows commercially available sensors and other devices to be used as long as they have an external input, making it relatively easy to build a system.

[0096] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The present invention is defined by the scope of the claims, not by the description of the above-mentioned embodiments, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0097] 10 Data measurement system, 110 Signal transmitter, 120, 120A, 120B, 120X Signal receiver, 130, 130A, 130B Measurement device, 130X, 130Y Video camera, 131, 151 CPU, 132 Detection unit, 133, 136, 152 Storage device, 135 Imaging unit, 140 External storage medium, 150 Data processing device, 160 Display device.

Claims

1. a plurality of measurement devices including a first device and a second device; a transmitter that transmits a first signal to the plurality of measuring devices; a data processing device that processes data acquired from the plurality of measurement devices, Each measuring device is acquiring measurement data from before to after the time when the first signal was received; storing the first signal together with the acquired measurement data independently or in a form superimposed on the measurement data; The data processing device includes: acquiring, from each of the plurality of measurement devices, measurement data measured between a start signal corresponding to the first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is delayed in time from the first time; time-matching start signals and end signals in the acquired data so that a first interval from the start signal to the end signal in the first device matches a second interval from the start signal to the end signal in the second device, and presenting the measurement data of the plurality of measurement devices to a user; each of the plurality of measurement devices includes any one of an environmental sensor that measures environmental information, a biological sensor that measures biological information, and an image sensor that captures an image; A data measurement system, wherein the measurement data acquired from the plurality of measurement devices includes at least two types of data detected by the environmental sensor, the biosensor, and the image sensor.

2. The data measurement system according to claim 1 , further comprising a display device for displaying measurement data from the plurality of measurement devices to a user.

3. 2. The data measurement system according to claim 1, wherein, when a first interval from a start signal to an end signal in the first device is different from a second interval from a start signal to an end signal in the second device, the data processing device corrects the measurement data of the second device so that the second interval becomes the first interval.

4. The data measurement system according to claim 1 , wherein the transmitter is included in one of the plurality of measurement devices or the data processing device.

5. 2. The data measurement system according to claim 1, wherein each of the plurality of measurement devices includes a storage device for storing measurement data measured by the measurement device, and signal transmission means from the sensors to the storage device is performed by wire.

6. 2. The data measurement system according to claim 1, wherein in each of the plurality of measurement devices, a sampling rate of the first signal is equal to or greater than a sampling rate of the measurement data.

7. The data measurement system according to claim 1 , wherein the first signal is integrated into the measurement data and stored.

8. and further comprising at least one receiver configured to transmit a second signal to a corresponding one of the plurality of measurement devices in response to receiving the first signal transmitted from the transmitter; the start signal is the second signal corresponding to the first signal transmitted at the first time, the end signal is the second signal corresponding to the first signal transmitted at the second time, the plurality of measurement devices include a video camera; 2. The data measurement system according to claim 1, wherein the receiver corresponding to the video camera is a light emitting device or an audio output device.

9. The data measurement system according to claim 8 , wherein each measurement device acquires measurement data covering a period before and after the time when the second signal is received.

10. A receiver used in the data measurement system according to claim 8.

11. A data processing device used in the data measurement system according to claim 1.

12. 1. A method for processing measurement data in a data measurement system including a plurality of measurement devices, including a first device and a second device, comprising: the data measurement system includes a transmitter and a data processing device; The method comprises: transmitting a first signal to the plurality of measurement devices by the transmitter; acquiring, by each measurement device, measurement data covering a period before and after the time when the first signal is received; storing the first signal together with the acquired measurement data either independently or superimposed on the measurement data; acquiring, from each of the plurality of measurement devices in the data processing device, measurement data measured between a start signal corresponding to the first signal transmitted at a first time and an end signal corresponding to the first signal transmitted at a second time that is delayed in time from the first time; and presenting the measurement data of the plurality of measurement devices to a user in the data processing device by temporally matching start signals and end signals in the acquired data so that a first interval from the start signal to the end signal in the first device matches a second interval from the start signal to the end signal in the second device, each of the plurality of measurement devices includes any one of an environmental sensor that measures environmental information, a biological sensor that measures biological information, and an image sensor that captures an image; The method, wherein the measurement data acquired from the plurality of measurement devices includes at least two types of data detected by the environmental sensor, the biosensor, and the image sensor.

Images