Information processing device, wearing state determination method, and recording medium

Abstract

The present invention relates to an information processing device, a program, and a wearing state determination method. The information processing device has a processor, which periodically obtains output values ​​of a sensor worn on a user's body via a wearable device, derives amplitude parameters of the obtained sensor output values ​​that represent amplitudes in output values ​​obtained at multiple different timings within a predetermined determination period, counts the number of amplitude parameters that exceed a determination value among the derived amplitude parameters that represent each of multiple amplitudes generated at mutually different timings as a determination amplitude number, and determines whether the wearable device is correctly worn on the user's body based on the counted determination amplitude number.

Description

Technical Field

[0001] The present invention relates to an information processing device, a program, and a wearing state determination method. Background Art

[0002] Conventionally, there is a known technique for determining the wearing state of a wearable device worn on a user's body. Japanese Patent Application Laid-Open No. 2009-153832 describes a pulse measurement device that determines whether a pulse sensor is correctly worn on a finger as a measurement site based on whether the output of a light receiving element is lower than a predetermined threshold value for a continuous period of time or higher than a predetermined threshold value for a continuous period of time. Summary of the invention

[0003] In order to achieve the above-mentioned purpose, an information processing device of one embodiment of the present invention has a processor, which periodically obtains the output value of a sensor worn on the body of a user via a wearable device, derives amplitude parameters of the obtained sensor output values ​​that represent the amplitudes of the output values ​​obtained at multiple different timings within a predetermined judgment period, counts the number of amplitude parameters that exceed the judgment value among the derived amplitude parameters and each of the amplitude parameters of multiple amplitudes generated at different timings, as a judgment amplitude number, and determines whether the wearable device is correctly worn on the body of the user based on the counted judgment amplitude number. BRIEF DESCRIPTION OF THE DRAWINGS

[0004] Figure 1 It is a diagram showing the external structure of a wearable terminal according to one embodiment of the present invention.

[0005] Figure 2 This is a block diagram showing the hardware configuration of a wearable terminal according to one embodiment of the present invention.

[0006] Figure 3 This is a functional block diagram showing a part of the functional structure of a wearable terminal according to one embodiment of the present invention.

[0007] Figure 4 This is a flowchart showing an example of the flow of a wearing state determination process executed by the wearable terminal according to one embodiment of the present invention.

[0008] Figure 5 : is a graph showing the measurement results of the output value of the proximity sensor when the wearable terminal is worn in the first wearing state.

[0009] Figure 6 : is a graph showing the measurement results of the output value of the proximity sensor when the wearable terminal is worn in the second wearing state.

[0010] Figure 7 1 is a graph showing the measurement results of the output value of the proximity sensor when the wearable terminal is worn in the third wearing state.

[0011] Figure 8 1 is a graph showing the measurement results of the pulse rate measured by the wearable terminal and the pulse rate measured by the chest strap when the wearable terminal is worn in the first wearing state.

[0012] Fig. 9 1 is a graph showing the measurement results of the pulse rate measured by the wearable terminal and the pulse rate measured by the chest belt when the wearable terminal is worn in the second wearing state.

[0013] Fig.10 : is a graph showing the measurement results of the pulse rate measured by the wearable terminal and the pulse rate measured by the chest belt when the wearable terminal is worn in the third wearing state. DETAILED DESCRIPTION

[0014] Hereinafter, embodiments of the present invention will be described using the drawings.

[0015] <Wearable terminal>

[0016] A wearable terminal 10 according to an embodiment of the present invention will be described. Figure 1 2 is a diagram showing the external structure of the wearable terminal 10 . Figure 2 2 is a block diagram showing the hardware configuration of the wearable terminal 10 .

[0017] The wearable terminal 10 has an information processing function and is a wearable device worn on the user's body. The wearable terminal 10 of this embodiment is a smart watch that is worn on the user's wrist and has a function of determining its wearing state and measuring the user's biological information such as pulse. The wearable terminal 10 is paired with a computer such as a smartphone or tablet computer held by the user (hereinafter referred to as a user terminal) to send and receive various information.

[0018] The external structure of the wearable terminal 10 is described. Figure 1 As shown, the wearable terminal 10 includes a main body 11 , a strap 12 attached to the main body 11 , and a display 251 for displaying an image, and the display 251 is a part of the output unit 25 .

[0019] The strap 12 includes a first strap 121 attached to one end of the main body 11 , and a second strap 122 attached to the main body 11 at an end on the opposite side to the side on which the first strap 121 is attached.

[0020] The first strap 121 is provided with a buckle 13 at the end opposite to the side on which the main body 11 is provided. The buckle 13 has a hook 131 and a rod 132. The second strap 122 is provided with a plurality of small holes 14 for locking the rod 132. Specifically, the second strap 122 is provided with small holes 141, 142, 143, and 144 arranged in parallel in the direction in which the second strap 122 extends.

[0021] Next, the hardware structure of the wearable terminal 10 is described. Figure 2 As shown, the wearable terminal 10 is a computer having: at least one CPU (Central Processing Unit) 21 as a processor, at least one ROM (Read Only Memory) 22 as a memory, a RAM (Random Access Memory) 23, an input unit 24, an output unit 25, a storage unit 26, a communication unit 27, a GNSS unit 28, a biosensor 29, an acceleration sensor 31, a proximity sensor 32, a battery 33, a bus 34, an input / output interface 35, and a short-range communication unit 36.

[0022] The CPU 21, ROM 22, and RAM 23 are connected to each other via a bus 34. The CPU 21 executes various processes according to a program recorded in the ROM 22 or a program loaded in the RAM 23. The RAM 23 also stores data and the like necessary for the CPU 21 to execute various processes as appropriate.

[0023] The bus 34 is also connected to the input / output interface 35. The input / output interface 35 is connected to the battery 33, the input unit 24, the output unit 25, the storage unit 26, the communication unit 27, the GNSS unit 28, the biosensor 29, the acceleration sensor 31, the proximity sensor 32, and the short-distance communication unit 36 ​​in addition to the bus 34.

[0024] The battery 33 supplies power to the wearable terminal 10. For example, the battery 33 is composed of a lithium ion battery.

[0025] The input unit 24 and the output unit 25 are user interfaces electrically connected to the input / output interface 35 by wire or wireless. The input unit 24 is composed of buttons and a display 251, and the output unit 25 is composed of the display 251, a speaker (not shown) for amplifying sound, a vibration motor (not shown) for generating vibration, etc. The display 251 is composed of, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Electro-Luminescent) display, and a touch panel for detecting a user's touch position is provided on the image display surface of the display 251. The user can input information by touching the image display surface of the display 251.

[0026] The storage unit 26 is composed of a semiconductor memory such as a DRAM (Dynamic Random Access Memory), and is a device for storing various data of the wearable terminal 10 .

[0027] The communication unit 27 is a first wireless communication unit for an Internet line that connects the CPU 21 to a network such as the Internet.

[0028] The GNSS unit 28 is a positioning information acquisition unit for acquiring position information. GNSS is the abbreviation of Global Navigation Satellite System, and the GNSS unit 28 uses a satellite positioning system such as GPS. The GNSS unit 28 includes an antenna, receives positioning satellite signals transmitted from a plurality of positioning satellites, and transmits the received positioning satellite signals to the CPU 21. The CPU 21 determines its own position based on the positioning satellite signals received from the GNSS unit 28.

[0029] The biosensor 29 is a device that detects the biological information of the user. As the biological information detected by the biosensor 29, pulse information related to the pulse of the user is listed.

[0030] The biosensor 29 of this embodiment is disposed on the back side (the side that contacts the user's wrist when the wearable terminal 10 is worn by the user) of the body 11 of the wearable terminal 10. The biosensor 29 uses, for example, an optical sensor or a current detection sensor based on electric current.

[0031] In the case of an optical type, the biosensor 29 detects the pulse of the user by irradiating light to the user's skin and measuring the reflected light, etc., when the wearable terminal 10 is worn by the user. The type of light irradiated by the biosensor 29 can be, for example, visible light or infrared light. Among them, green visible light is more preferred from the perspective of pulse measurement accuracy.

[0032] In the case of the current detection method, the biosensor 29 acquires the biometric information by directly detecting the weak current of the user's skin, or by using a bioimpedance method that allows a weak current to flow through the skin to measure the pulse. The biometric information acquisition operation of the biosensor 29 may be started in response to the user's operation, or may be started when it is determined that the user is in motion based on the user's body motion information acquired by the acceleration sensor 31.

[0033] The acceleration sensor 31 is a device that detects movement and acceleration in any direction. For example, the acceleration sensor 31 is a three-axis sensor of an electrostatic capacitance type or a piezo-resistance element type, and detects accelerations generated in three mutually orthogonal axes. The acceleration sensor 31 can be used to obtain body motion information of a user wearing the wearable terminal 10.

[0034] The proximity sensor 32 is arranged on the back side of the main body 11 of the wearable terminal 10 (the side that contacts the wrist of the user when the wearable terminal 10 is worn by the user). The proximity sensor 32 is a light sensor having a light emitting portion and a light receiving portion. As a light sensor, for example, there is a sensor that irradiates infrared light, visible light, etc. from the light emitting portion to an object, and receives reflected light from the object in the irradiated light by the light receiving portion. The proximity sensor 32 of this embodiment is an infrared sensor that irradiates infrared light from the light emitting portion to the user's skin when the wearable terminal 10 is worn by the user. The irradiated infrared light is reflected by the user's skin, and light including the reflected light (including external light other than the reflected light) is incident on the light receiving portion of the proximity sensor 32. In addition, the proximity sensor 32 measures the incident light incident on the light receiving portion through the light receiving portion, and outputs the output value corresponding to the measured incident light in a waveform. In addition, if the wearable terminal 10 (main body 11) moves relative to the user's wrist due to the user's body movement, the incident light (including external light) to the light receiving part changes accordingly, thereby changing the amplitude of the output value of the proximity sensor 32. In this case, the greater the relative movement of the wearable terminal 10 with respect to the user's wrist, the greater the amplitude of the output value of the proximity sensor 32.

[0035] The short-distance communication unit 36 ​​is a second wireless communication unit for communicating with a user terminal. The short-distance communication unit 36 ​​includes an antenna and communicates with the user terminal using a communication method based on a communication standard such as BLE (Bluetooth (registered trademark) Low Energy) or Wi-Fi (Wireless Fidelity).

[0036] Next, the functional configuration of the wearable terminal 10 will be described. Figure 3 1 is a functional block diagram showing a part of the functional structure of the wearable terminal 10 .

[0037] The control unit 40 that performs various controls on the wearable terminal 10 is implemented by the CPU 21 that performs arithmetic processing. The control unit 40 of this embodiment includes: a communication processing unit 41, an input processing unit 42, a position information acquisition unit 43, a biological information acquisition unit 44, a body movement information acquisition unit 45, an output value acquisition unit 46, a wearing state determination unit 47, an output processing unit 48, and a determination reference setting unit 49.

[0038] The communication processing unit 41 performs processing for exchanging various information with a network such as the Internet via the communication unit 27, and performs processing for exchanging various information with a user terminal via the short-distance communication unit 36. For example, the communication processing unit 41 may also transmit biological information detected by the biological sensor 29 to the user terminal.

[0039] The input processing unit 42 executes a process of accepting a user's operation on the input unit 24. For example, the input processing unit 42 executes a process of inputting to a touch panel provided on the display 251 in accordance with a button operation by the user.

[0040] The position information acquisition unit 43 executes a process of acquiring position information indicating the current position of the wearable terminal 10 based on the positioning signal detected by the GNSS unit 28 .

[0041] The biometric information acquisition unit 44 executes a process of acquiring biometric information such as the pulse rate of the user based on the signal acquired by the biometric sensor 29 .

[0042] The body motion information acquisition unit 45 executes a process of acquiring body motion information of a user wearing the wearable terminal 10 based on a signal detected by the acceleration sensor 31 .

[0043] The output value acquisition unit 46 executes a process of acquiring (sampling) the output value from the proximity sensor 32 at a predetermined sampling frequency (for example, 32 Hz).

[0044] The wearing state determination unit 47 derives an amplitude parameter representing the amplitude of the output value (output waveform) of the proximity sensor 32 obtained by the output value acquisition unit 46 within a predetermined determination period. The determination period is set to a period predetermined by experiments or the like (e.g., 10 seconds, etc.). The start timing of the determination period is set, for example, corresponding to the timing of the start of the biological information acquisition operation of the biological information acquisition unit 44. For example, the wearing state determination unit 47 may start the determination period at a timing substantially the same as the timing of the start of the biological information acquisition operation. In addition, the determination period may be set to a different period corresponding to the size of the user's body movement, or may be set to a certain period regardless of the size of the body movement, etc. As the amplitude parameter, for example, the difference between the maximum value and the minimum value adjacent to each other on the time axis included in the obtained output value (output waveform) is derived (calculated). Alternatively, as the amplitude parameter, any one of the following values ​​(a) to (e) may be derived (calculated).

[0045] (a) The absolute value of the difference between the minimum and maximum values

[0046] (b) The difference between the maximum value and 1 / 2 of the sum of the maximum value and the minimum value ((maximum value + minimum value) / 2)

[0047] (c) The absolute value of the difference between the minimum value and the value that is half of the sum of the maximum value and the minimum value

[0048] (d) The difference between the local maximum value and the central value of multiple local maximum values ​​(local maximum value and local minimum value) of the output value (output waveform) within the determination period

[0049] (e) The absolute value of the difference between the local minimum value and the central value of multiple extreme values ​​(maximum value and local minimum value) of the output value (output waveform) within the determination period

[0050] In addition, the wearing state determination unit 47 counts the number of amplitude parameters that exceed the determination value among the amplitude parameters of each of the multiple amplitudes generated at different timings, which are derived as the determination amplitude number, and determines whether the wearable terminal 10 is correctly worn on the user's wrist based on the counted determination amplitude number. Specifically, the wearing state determination unit 47 determines that the wearable terminal 10 is not correctly worn on the user's wrist when the above-mentioned counted determination amplitude number exceeds the determination number. On the other hand, when the determination amplitude number is less than the determination number, it is determined that the wearable terminal 10 is correctly worn on the user's wrist. In this way, the wearing state is determined based on the change of the output value (output waveform) within a certain determination period, so it is possible to appropriately determine whether the wearing state of the wearable terminal 10 is correct (whether the wearing is not loose) in a state that reflects the change of the wearing position of the wearable terminal 10 caused by the user's body movement. The wearing state determination unit 47 can also repeatedly perform the above-mentioned wearing state determination processing until the acquisition action of the biological information stops. In this case, the wearing state determination unit 47 may start the next wearing state determination process continuously after one determination period ends, or may start the next wearing state determination process at a certain interval.

[0051] In addition, the wearing state determination unit 47 may also stop the biometric information acquisition operation of the biometric information acquisition unit 44 when it is determined that the wearable terminal 10 is not correctly worn on the user's body. At this time, the wearing state determination unit 47 may also perform a process of deleting the biometric information acquired by the biometric information acquisition unit 44 and stored in the RAM 23 and the storage unit 26 before the biometric information acquisition operation is stopped from the RAM 23 and the storage unit 26.

[0052] The output processing unit 48 performs processing for displaying an image on the output unit 25 of the wearable terminal 10, generating vibrations, emitting sounds, and the like. For example, the output processing unit 48 performs processing for displaying information acquired from the user terminal, or for displaying information acquired by the biological information acquisition unit 44, or for displaying information acquired by the body motion information acquisition unit 45, or for displaying the determination result of the wearing state determination unit 47. In addition, for example, when the wearing state determination unit 47 determines that the wearable terminal 10 is not worn correctly, the output processing unit 48 outputs information for prompting the user to re-evaluate the wearing state. Specifically, when the output processing unit 48 determines that the wearable terminal 10 is not worn correctly, the output processing unit 48 causes the output unit 25 to display an image for prompting the re-evaluation of the wearing state, generate vibrations for prompting the re-evaluation of the wearing state, and emit sounds for prompting the re-evaluation of the wearing state.

[0053] The judgment criterion setting unit 49 sets the judgment criterion used by the wearing state judgment unit 47 in judging the wearing state based on the body motion information obtained by the body motion information acquisition unit 45. The judgment criterion setting unit 49 may also set the above-mentioned judgment value, judgment number, etc. based on the body motion information, for example. More specifically, for example, with respect to the judgment criterion setting unit 49, the greater the body motion of the user, the greater the judgment value related to the magnitude of the amplitude parameter is set to a larger value, and the smaller the body motion is, the smaller the judgment value is set to a smaller value. That is, the judgment criterion setting unit 49 may also be set so that as the body motion of the user increases, the judgment value increases continuously (linearly / non-linearly) or in stages. Thus, the wearing state can be judged by considering the ease of change of the wearing position caused by the body motion of the user, and therefore a more appropriate judgment can be made. In addition, the judgment criterion setting unit 49 may also set the judgment number based on the length of the above-mentioned judgment period, for example. More specifically, for example, the determination criterion setting unit 49 may set the determination number to a smaller number as the body movement is smaller, and may set the determination number to a smaller number as the determination period is shorter.

[0054] <Example of wearing status determination>

[0055] Next, refer to Figure 4 Next, an example of the wearing state determination process executed by the control unit 40 of the wearable terminal 10 will be described. Figure 4 2 is a flowchart showing an example of the flow of the wearing state determination process executed by the control unit 40 of the wearable terminal 10. The control unit 40 starts the wearing state determination process at the timing of receiving an operation signal from the user for starting the acquisition operation of the biological information, for example.

[0056] In step S10, the wearing state determination unit 47 determines whether the biometric information acquisition operation of the biometric information acquisition unit 44 has started. When the wearing state determination unit 47 determines that the biometric information acquisition operation has started (Yes in step S10), it sets the start timing of the determination period (step S10A), and the process proceeds to step S11. When this time is after the biometric information acquisition operation of the wearing state determination unit 47 has started in step S10, the start timing of the determination period is set to the timing when the biometric information acquisition operation starts, or, in consideration of the time delay of the proximity sensor 32, is set to the timing when a certain time (for example, 1.0 sec) has passed from the above-set timing. In addition, when this time is not after the biometric information acquisition operation has started, but when it is determined in step S13A described later that the last determination period has ended, the start timing of the determination period is set to the timing after the last determination period has ended. On the other hand, when the wearing state determination unit 47 determines that the biometric information acquisition operation has not started (No in step S10), the process of step S10 is repeated.

[0057] In step S11 , the body motion information acquisition unit 45 acquires body motion information of the user, that is, motion information of the wrist of the user wearing the wearable terminal 10 , from the signal detected by the acceleration sensor 31 .

[0058] In step S12 , the criterion setting unit 49 sets the criterion (critique value, criterion number determination period) for the wearing state determination unit 47 to determine the wearing state based on the body motion information acquired in step S11 as described above.

[0059] In step S13, the wearing state determination unit 47 derives an amplitude parameter indicating the amplitude of the output value (output waveform) of the proximity sensor 32. Specifically, for example, the wearing state determination unit 47 derives the amplitude parameter of the output value (output waveform) as the difference between the maximum value and the minimum value of the output value (output waveform) of the proximity sensor 32 acquired by the output value acquisition unit 46 within a predetermined determination period. The wearing state determination unit 47 derives the respective amplitude parameters based on the output values ​​(output waveforms) generated at a plurality of different timings within the determination period.

[0060] In step 13A, the wearing state determination unit 47 determines whether the determination period has ended, that is, whether a time corresponding to the determination period has passed from the start timing of the determination period set in step S10A. If the determination period has not ended, the wearing state determination unit 47 returns the process to step S13. On the other hand, if the determination period has ended, the process proceeds to step S14.

[0061] In step S14 , the wearing state determination unit 47 counts the number of amplitude parameters that exceed the determination value set in step S12 among the amplitude parameters derived in step S13 and indicating each of the plurality of amplitudes generated at different timings as the determination amplitude number.

[0062] In step S15, the wearing state determination unit 47 determines whether the wearable terminal 10 is correctly worn on the user's wrist based on the number of amplitudes for determination counted in step S14. Specifically, when the number of amplitudes for determination counted in step S14 by the wearing state determination unit 47 is less than the number of determinations set in step S12 (No in step S15), it is determined that the wearable terminal 10 is correctly worn on the user's wrist. Next, it is determined whether the end condition of the wearing state determination process is met (step S18). The end condition is met on the condition that the power of the wearable terminal 10 is turned off and the user performs an operation to end the acquisition of biological information. If the end condition of the wearing state determination process is met (step S18: Yes), the process is terminated directly. If the end condition of the wearing state determination process is not met (step S18: No), the process returns to step S10A. On the other hand, when the number of amplitudes for determination counted by the wearing state determination unit 47 in step S14 is greater than the number of determinations set in step S12 (yes in step S15), it is determined that the wearable terminal 10 is not correctly worn on the user's wrist, and the process proceeds to step S16. For example, when the determination period is set to 10 seconds, the determination value is set to 500, and the number of determinations is set to 4 times, if the number of amplitude parameters exceeding 500 among the amplitude parameters derived from the output value of the proximity sensor 32 obtained within 10 seconds exceeds 4, it is determined that the wearable terminal 10 is not correctly worn on the user's body.

[0063] In step S16 , the biometric information acquisition unit 44 stops the biometric information acquisition operation.

[0064] In step S17, the output processing unit 48 causes the output unit 25 to display an image for prompting the user to correctly wear the main body 11, or causes the output unit 25 to generate a sound or vibration for prompting the user to correctly wear the main body 11. Next, the steps after step S18 are executed.

[0065] As described above, in the wearing state determination process, during the period from the start of the biometric information acquisition operation to the establishment of the end condition of the wearing state determination process, the determination period (steps S10A, S12) is repeatedly set each time it ends, and the wearing state of the wearable terminal 10 is determined based on the number of determination amplitudes counted in each determination period. In addition, after temporarily determining that the wearable terminal 10 is not worn correctly (step S15: Yes), if it is determined that the wearable terminal 10 is worn correctly by re-determination (step S15: No), it is considered that the end condition is established and the present process is terminated. In this case, it is also possible that the end condition is established based on the situation that the wearable terminal 10 is determined to be worn correctly for multiple consecutive times (for example, 3 times).

[0066] Next, refer to Figures 5 to 10 The influence of the wearing state of the wearable terminal 10 and the output value (output waveform) of the proximity sensor 32 and the pulse information based on the body motion of the user will be described.

[0067] <Evaluation test>

[0068] In the evaluation test, the influence of the wearing state of the smart watch as the wearable terminal 10 and the amplitude parameter of the output value (output waveform) of the proximity sensor 32 based on body movement and the measurement result of the pulse information was confirmed. The evaluation test was implemented using the wearable terminal 10, a chest belt with a pulse sensor, and a treadmill. As the proximity sensor 32, an infrared sensor was used that outputs an output value corresponding to the wearing position of the main body of the wearable terminal 10 relative to the user's body by irradiating infrared rays on the user's skin and detecting its reflected light. The output value is a value obtained by sampling the output from the infrared sensor at 32Hz as the sampling frequency and performing A / D conversion.

[0069] In the evaluation test, the output value (output waveform) and pulse information of the proximity sensor 32 when the user wearing the wearable terminal 10 on the wrist and wearing the chest belt tightly with its pulse sensor located on the chest implemented the following training menu on the treadmill platform were measured. As the training menu of the treadmill, 1 minute of standing with the platform stopped, 2 minutes of walking with the platform speed set to walking speed, 1 minute of jogging with the platform speed set to faster than walking, 3 minutes of running with the platform speed set to faster than jogging, 1 minute of walking, and 1 minute of standing. In addition, in any of the walking, jogging and running in the above training menu, the user's periodic arm swing (reciprocating movement of the arm in the front and back direction of the user) is generated. In addition, in the evaluation test, the output value (output waveform) and pulse information of the proximity sensor 32 when the wearable terminal 10 is worn in different wearing states are measured. The first wearing state is a state in which the main body 11 and the strap 12 of the wearable terminal 10 are tightly worn in a manner close to the user's wrist. The second wearing state is a state where the small hole 14 is loosened by two holes from the first wearing state. The third wearing state is a state where the small hole 14 is further loosened by one hole from the second wearing state. Figure 1 Taking the wearable terminal 10 shown in the figure as an example, when the state in which the rod 132 is stuck in the small hole 141 is set as the first wearing state, the second wearing state is equivalent to the state in which the rod 132 is stuck in the small hole 143, and the third wearing state is equivalent to the state in which the rod 132 is stuck in the small hole 144. In addition, the wearing state of the chest strap does not change during each measurement.

[0070] <Evaluation test results>

[0071] Figure 5 is a graph showing the measurement result of the output value (output waveform) of the infrared sensor as the proximity sensor 32 in the first wearing state, Figure 6 is a graph showing the measurement results of the output value (output waveform) of the infrared sensor in the second wearing state, Figure 7 It is a graph showing the measurement results of the output value (output waveform) of the infrared sensor in the third wearing state. Figure 5 to Figure 7 The horizontal axis represents time (Time, in seconds), and the vertical axis represents the output value of the infrared sensor (IR AD Value). The single-point dashed line represents the start time of jogging and the end time of running. Figures 5 to 7 In the figure, an example of the judgment criteria of the wearing state set by the judgment criteria setting unit 49 of the wearable terminal 10 of the present embodiment, i.e., the sizes of the judgment values ​​A1 to A3, and the lengths of the predetermined judgment periods T1 to T3 are illustrated. Specifically, A1 is the size of the judgment value when walking, A2 is the size of the judgment value when jogging, and A3 is the size of the judgment value when running. In addition, T1 is the length of the judgment period when walking, T2 is the length of the judgment period when jogging, and T3 is the length of the judgment period when running. As Figure 5 to Figure 7 As shown, the greater the user's body movement, the larger the judgment value is set. Figure 5 to Figure 7 Since the scales of the vertical axes are different, the sizes of the judgment values ​​in each figure are different in appearance, but are set to the same size.

[0072] Figure 8 is the pulse rate derived by the CPU 21 based on the pulse measured by the biosensor 29 when the wearable terminal 10 is in the first wearing state, Fig. 9 is the pulse rate derived by the CPU 21 based on the pulse measured by the biosensor 29 when the wearable terminal 10 is in the second wearing state, Fig.10 This is the pulse rate derived by the CPU 21 based on the pulse measured by the biosensor 29 when the wearable terminal 10 is in the third wearing state. Figure 8 to Figure 10 The horizontal axis represents time (sec), and the vertical axis represents pulse rate (bpm). In addition, the solid line represents the pulse rate derived by the CPU 21 of the wearable terminal 10 in each wearing state, and the dotted line represents the pulse rate measured by the chest strap. Fig. 9 and Fig.10 , a case where the pulse rate is derived regardless of the determination result of the wearing state of the wearable terminal 10 (the determination result of step S15 ) is shown.

[0073] like Figure 5 As shown, in the first wearing state, through the entire process (standing (Standing) → walking (Walking) → jogging (Jogging) → running (Running) → walking (Walking) → standing (Standing)), the amplitude of the output value of the infrared sensor is suppressed to be small, and in the judgment period T1~T3, the amplitude parameter becomes smaller than the judgment value A1~A3. This is considered to be because, in the first wearing state, the strap 12 of the wearable terminal 10 is tightly worn on the wrist, so the change in the wearing position of the main body 11 caused by the user's body movement, that is, the swing of the user's arm, is small. In addition, as Figure 8 As shown, although there is a slight difference between the pulse rate detected by the biosensor 29 of the wearable terminal 10 when jogging and the pulse rate of the chest strap, the MEA (Mean Absolute Error) calculated by averaging the difference between the pulse rate of the wearable terminal 10 and the pulse rate of the chest strap through all the processes is suppressed to a low level. Specifically, the MEA is 1.182.

[0074] like Figure 6 As shown, in the second wearing state, when standing (Standing) with almost no movement of the user's arms and at the beginning of walking (Walking) when the swing of the user's arms is relatively small, the amplitude of the output value (output waveform) of the infrared sensor is suppressed to a low level. On the other hand, when walking (Walking), the amplitude of the output value (output waveform) gradually increases with the passage of time. When about 1 minute has passed since the start of walking (Walking) and 2 minutes have passed, when jogging (Jogging) when the swing of the arms is relatively large and faster, and when running (Running), the output value (output waveform) increases or decreases (vibrates) by an amplitude of about 500, and the amplitude of the output value (output waveform) is relatively large, exceeding the judgment values ​​A1 to A3. As shown Fig. 9 As shown, the difference in pulse rate between the wearable terminal 10 and the chest strap is suppressed to a low level when standing and starting to walk. On the other hand, the difference in pulse rate between the wearable terminal 10 and the chest strap becomes larger when about 1 minute has passed since the start of walking (Walking) when the amplitude of the output value (output waveform) becomes relatively large, when jogging (Jogging), and when running (Running). The MEA in the second wearing state is 5.674. As Figure 6 as well as Fig. 9As shown, it can be confirmed that as the body movement increases, the amplitude of the output value (output waveform) of the infrared sensor increases, and as the amplitude of the output value (output waveform) of the infrared sensor increases, the measurement accuracy of the pulse rate decreases.

[0075] like Figure 7 As shown in FIG. 1 , in the third wearing state, the amplitude of the output value (output waveform) of the infrared sensor is particularly large when jogging or running, and the amplitude of the output value (output waveform) is not suppressed when walking. Fig.10 As shown, the difference in pulse rate between the case of the wearable terminal 10 and the case of the chest strap is further increased compared to the second wearing state. The MEA is 16.692, which confirms that the pulse rate is not measured correctly.

[0076] According to the above evaluation test results, it can be confirmed that the looser the strap 12 of the wearable terminal 10 is worn on the wrist, the greater the degree of change in the wearing position of the wearable terminal 10 caused by the user's body movement (arm swing), the greater the amplitude of the output value (output waveform) of the infrared sensor, and thus multiple relatively large amplitudes will be generated. In addition, it can be confirmed that if the amplitude of the output value (output waveform) of the infrared sensor becomes larger, the measurement error of the pulse rate will also tend to become larger.

[0077] As described above, the wearable terminal 10 of the present embodiment has: a control unit 40, which obtains the output value (output waveform) of the proximity sensor 32 worn on the user's body via the wearable terminal 10, derives an amplitude parameter representing the amplitude of the output value (output waveform) obtained within a predetermined judgment period, counts the number of amplitude parameters that exceed the judgment value among the derived amplitude parameters and each of the amplitude parameters representing multiple amplitudes generated at different timings, as a judgment amplitude number, and determines whether the wearable device is correctly worn on the user's body based on the counted judgment amplitude number.

[0078] Thus, the wearing state is determined based on the change of the output value (output waveform) within a certain determination period, so the movement of the main body 11 relative to the user's body can be more sensitively detected to determine the wearing state. Therefore, even when the user moves his body, it is possible to appropriately determine whether the wearable terminal 10 is correctly worn on the user's body.

[0079] In addition, in the wearable terminal 10 of the present embodiment, when the determination amplitude number is larger than the determination number, the control unit 40 determines that the wearable terminal 10 is not correctly worn on the user's body.

[0080] Thus, it is possible to identify that the wearable terminal 10 is not correctly worn on the user's body by a simple process of counting the amplitude parameters that exceed the determination value within a certain determination period.

[0081] Furthermore, in the wearable terminal 10 of the present embodiment, the control unit 40 acquires the body motion information of the user and sets the determination value based on the acquired body motion information.

[0082] Thus, the determination criterion of the wearing state can be set corresponding to the body motion information, so that the size of the body motion can be considered to determine whether the wearable terminal 10 is correctly worn on the user's body. For example, the greater the body motion, the higher the determination value related to the size of the amplitude parameter is set. Thus, the ease of change of the wearing position of the wearable terminal 10 caused by large body motion can be considered, and excessive restraint of the strap 12 of the wearable terminal 10 can be avoided. On the contrary, even in the case where the wearing position of the wearable terminal 10 is difficult to change due to small body motion, the amplitude of the smaller output value (output waveform) can be determined as the determination value, so that even in the case of small body motion, the incompleteness of the wearing state can be more reliably determined. Therefore, before starting a large action such as running, the wearing state of the wearable terminal 10 can be re-evaluated in advance.

[0083] In addition, in the wearable terminal 10 of the present embodiment, the control unit 40 acquires the biological information of the user, and sets the start timing of the determination period in accordance with the timing of starting the operation of acquiring the biological information.

[0084] As a result, the wearing state of the wearable terminal 10 can be determined in accordance with the timing of starting the biological information acquisition operation, so that accurate pulse information can be acquired in the correct wearing state.

[0085] In addition, in the wearable terminal 10 of the present embodiment, when the control unit 40 determines that the wearable terminal 10 is not correctly worn on the user's body, the control unit 40 stops the operation of acquiring the biological information.

[0086] This can avoid acquisition of inaccurate biological information that is measured when the wearable terminal 10 is not correctly worn on the user's body.

[0087] Furthermore, in the wearable terminal 10 of the present embodiment, when determining that the wearable terminal 10 is not correctly worn on the user's body, the control unit 40 outputs information for prompting re-evaluation of the wearing state of the wearable terminal 10 .

[0088] This makes it possible to promptly notify the user that the wearable terminal 10 is not worn correctly.

[0089] In addition, the present invention is not limited to the above-mentioned embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are also included in the present invention.

[0090] In the above-mentioned embodiment, the judgment criterion setting unit 49 sets the judgment criterion such as the judgment value related to the magnitude of the amplitude parameter representing the amplitude of the output value (output waveform) of the proximity sensor 32 according to the body movement, but the judgment criterion may also be set according to the illumination information of the external light. For example, the judgment criterion setting unit 49 may also obtain the illumination information of the external light incident on the proximity sensor 32, and set the judgment value according to the obtained illumination information. More specifically, with respect to the judgment criterion setting unit 49, the lower the illumination, the smaller the judgment value related to the magnitude of the amplitude parameter is set, and the higher the illumination, the larger the judgment value related to the magnitude of the amplitude parameter is set. Thus, the wearing state of the wearable terminal 10 is determined by considering the illumination of the external light that affects the output of the proximity sensor 32, so that it is possible to determine with higher accuracy whether the wearable terminal 10 is correctly worn on the user's body.

[0091] In the above-mentioned embodiment, the wearable terminal 10 has a criterion setting unit 49, and the criterion setting unit 49 sets the criterion of the wearing state according to the body motion information. However, the wearable terminal 10 may not have the criterion setting unit 49, and the criterion of the wearing state may be a preset fixed value.

[0092] In the above-described embodiment, the biometric sensor 29 for detecting the biometric information of the user and the biometric information acquisition unit 44 for acquiring the biometric information are provided. However, a configuration without the biometric sensor 29 and the biometric information acquisition unit 44 is also possible.

[0093] In addition, in the above-mentioned embodiment, when the control unit 40 determines that the wearable terminal 10 is not correctly worn on the user's body, the control unit 40 stops the acquisition of biological information by the biological information acquisition unit 44, but can also stop the detection of biological information by the biological sensor 29.

[0094] In addition, in the above-mentioned embodiment, the wearable terminal 10 is set as an information processing device having a control unit 40 for determining the wearing state of the wearable terminal 10 itself worn on the user's body, but the CPU 21 included in the wearable terminal 10 may also be set as an information processing device. In addition, in the above-mentioned embodiment, the control unit 40 is composed of one CPU 21, but the control unit 40 may also be composed of multiple CPUs, and the functions are executed by separate CPUs.

[0095] In the above-mentioned embodiment, the biosensor 29 detects the pulse information of the user, and the biometric information acquisition unit 44 acquires (derives) the pulse rate of the user, but the biometric information of the user detected by the biometric sensor 29 and acquired by the biometric information acquisition unit 44 is not particularly limited. For example, it may be the blood flow, blood pressure, etc. of the user.

[0096] In addition, in the above-mentioned embodiment, the wearing status of the main body 11 is determined on the wearable terminal 10 side, but the amplitude parameter representing the amplitude of the output value (output waveform) of the proximity sensor 32 can also be obtained (derived) on the user terminal side to determine the wearing status of the main body 11 of the wearable terminal 10.

[0097] In addition, in the above-mentioned embodiment, the determination criteria for the wearing state of the main body 11 are set on the wearable terminal 10 side, but the user's body movement information may be obtained on the user terminal side to set the determination criteria for the wearing state of the wearable terminal 10.

[0098] In addition, in the above-mentioned embodiment, the wearable terminal 10 is a smart watch worn on the user's wrist, but is not limited to being worn on the wrist, and can also be a wearable device worn on other appropriate parts such as the arm, ankle, shoe, leg, waist, chest, head, etc.

[0099] In addition, in the above-mentioned embodiment, walking, jogging, running and other sports accompanied by periodic arm swings of the user are described as examples related to body movement, but the type of sports is not particularly limited. For example, it can also be based on hiking, swimming, ball games, yoga, bodybuilding, training, etc.

[0100] In addition, in the above-mentioned embodiment, the proximity sensor 32 of the wearable terminal 10 is set as an infrared sensor, but it can also be an electrostatic capacitance type sensor. In addition, the control unit 40 can also derive an amplitude parameter representing the amplitude of the output value (output waveform) of the electrostatic capacitance type sensor obtained within a predetermined judgment period, and count the number of amplitude parameters exceeding the judgment value among the derived amplitude parameters and each of the amplitude parameters representing multiple amplitudes generated at different timings as the number of amplitudes for judgment, and judge whether the wearable device is correctly worn on the user's body based on the counted number of amplitudes for judgment.

[0101] The above series of processes can be executed by hardware or by software. In other words, the functional structures shown in the above embodiments and modified examples are merely illustrative and are not particularly limited. That is, as long as the wearable terminal 10 has a function that can execute the above series of processes as a whole, what kind of functional blocks are used to implement the function is not particularly limited to the above embodiments and modified examples. In addition, a functional block can be composed of a hardware unit, a software unit, or a combination of them.

[0102] In addition, the hardware structure shown in the above-mentioned embodiment and the modification example is only an example and is not particularly limited to this structure. The processor that can be used in this embodiment includes, in addition to a single-core processor, a multi-core processor, and a device composed of various processing devices such as a multi-core processor, a device composed of these various processing devices and a processing circuit such as an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array).

[0103] When a series of processes are executed by software, the program constituting the software is installed from a network or a recording medium to a computer, etc. The computer may also be a computer assembled in dedicated hardware. In addition, the computer may also be a computer capable of executing various functions by installing various programs, such as a general-purpose personal computer.

[0104] In the present specification, the steps describing the program recorded in the recording medium include not only processes performed in time series according to the order, but also processes not necessarily performed in time series and processes performed in parallel or individually.

[0105] Several embodiments of the present invention have been described above, but these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can adopt various other embodiments, and various changes such as omission and substitution can be made without departing from the scope of the present invention. These embodiments and their modifications are included in the scope or gist of the invention described in this specification, etc., and are included in the invention described in the claims and their equivalents.

Claims

1. An information processing device, characterized in that: With processor, The processor periodically obtains output values ​​of a sensor worn on a user's body via a wearable device, derives an amplitude parameter of the obtained output values ​​of the sensor, which indicates the amplitude of the output values ​​obtained at a plurality of different timings within a predetermined determination period, counts the number of amplitude parameters exceeding a determination value among the derived amplitude parameters and indicating each of a plurality of amplitudes generated at mutually different timings as the number of determination amplitudes, and determines whether the wearable device is correctly worn on the user's body based on the counted number of determination amplitudes, When the number of determination amplitudes counted within the determination period is greater than the number of determinations, the processor determines that the wearable device is not correctly worn on the body of the user.

2. The information processing device according to claim 1, characterized in that The processor determines the number of determinations according to a length of the determination period.

3. The information processing device according to claim 1, characterized in that The processor acquires body motion information of the user and sets the determination value based on the acquired body motion information.

4. The information processing device according to claim 1, characterized in that The processor acquires illuminance information of external light incident on the sensor, and sets the determination value according to the acquired illuminance information.

5. The information processing device according to claim 1, characterized in that The processor obtains biological information of the user, The start timing of the determination period is set in accordance with the timing of starting the biometric information acquisition operation.

6. The information processing device according to claim 5, characterized in that: The processor stops the biometric information acquisition operation when it is determined that the wearable device is not correctly worn on the user's body.

7. The information processing device according to claim 1, characterized in that: The processor outputs information for prompting a re-evaluation of a wearing state of the wearable device when it is determined that the wearable device is not correctly worn on the body of the user.

8. The information processing device according to claim 1, characterized in that The sensor is a light sensor, The output value is a measurement result obtained by receiving, by a light receiving unit of the optical sensor, reflected light reflected by the body of the user among the light emitted from the optical sensor.

9. A recording medium storing a program, characterized in that: The program enables the computer to execute the following processing functions: In the information processing device, an output value of a sensor worn on a user's body via a wearable device is obtained; deriving an amplitude parameter representing the amplitude of the output value obtained within a predetermined determination period; counting the number of amplitude parameters exceeding the determination value among the amplitude parameters derived and representing each of a plurality of amplitudes generated at mutually different timings as the determination amplitude count; determining whether the wearable device is correctly worn on the user's body based on the counted number of determination amplitudes, When the number of determination amplitudes counted within the determination period is greater than the number of determinations, it is determined that the wearable device is not correctly worn on the user's body.

10. A wearing status determination method executed by an information processing device, characterized in that: The wearing state determination method comprises the following processing steps: Obtaining output values ​​of sensors worn on a user's body via a wearable device; deriving an amplitude parameter representing the amplitude of the output value obtained within a predetermined determination period; counting the number of amplitude parameters exceeding the determination value among the amplitude parameters derived and representing each of a plurality of amplitudes generated at mutually different timings as the determination amplitude count; determining whether the wearable device is correctly worn on the user's body based on the counted number of determination amplitudes, When the number of determination amplitudes counted within the determination period is greater than the number of determinations, it is determined that the wearable device is not correctly worn on the user's body.

Images