Shoes and retaining member

Abstract

To provide shoes capable of improving the convenience of users of wireless earphones.SOLUTION: Shoes each comprise: a sole portion having a ground-contact surface; an upper portion connected to the sole portion; and a retaining portion for retaining a wireless earphone. The wireless earphone includes: an earphone portion insertable into a user's external auditory canal and including a speaker for outputting an audio signal; a sensor unit configured to acquire data obtained when the user walks; and a transceiver unit configured to transmit the data to an external device and receive an audio signal from the external device.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present disclosure relates to shoes and a holding member.

Background Art

[0002] In recent years, wireless earphones that wirelessly receive and output an audio signal from an external device have been used.

[0003] Patent Document 1 discloses a companion communication device that determines a wearing state indicating whether a user is wearing wireless earphones based on a signal received from the wireless earphones, and transmits audio information to an output unit based on the wearing state.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In wireless earphones, it is required to improve the convenience for users.

[0006] The purpose of the shoes and the holding member is to make it possible to improve the convenience for users of wireless earphones.

Means for Solving the Problems

[0007] The shoes according to the embodiment include a sole portion having a ground contact surface, an upper portion connected to the sole portion, an earphone portion including a speaker that outputs an audio signal and is insertable into the user's external auditory canal, a sensor portion that acquires data obtained when the user walks, and a holding portion that holds a wireless earphone including a transmission / reception portion that transmits data to an external device and receives an audio signal from the external device.

[0008] In the shoes according to the embodiment, it is preferable that the holding part has an insertion opening into which the main body part connected to the earphone part of the wireless earphone can be inserted.

[0009] In the shoes according to the embodiment, it is preferable that the holding part presses and fixes the entire wireless earphone to the upper part.

[0010] In the shoes according to the embodiment, the wireless earphone has an insertion sensor part for detecting whether the user has inserted the wireless earphone into the external auditory canal, and it is preferable that the holding part holds the earphone part in a manner in which the insertion sensor part detects that the wireless earphone has been inserted into the user's external auditory canal.

[0011] In the shoes according to the embodiment, it is preferable that the holding part is arranged on the outer side surface, the inner side surface, the toe side surface, or the heel side surface of the upper part.

[0012] The holding member according to the embodiment is a holding member attachable to the shoes, and has a holding part for holding a wireless earphone including an earphone part that can be inserted into the user's external auditory canal and outputs an audio signal, a sensor part that acquires data obtained when the user walks, and a transmission / reception part that transmits data to an external device and receives an audio signal from the external device.

Advantages of the Invention

[0013] The shoes and the holding member can improve the convenience for users of the wireless earphone.

Brief Description of the Drawings

[0014]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0015] Hereinafter, shoes according to one aspect of the embodiment will be described with reference to the drawings. However, note that the technical scope of the present invention is not limited to those embodiments, and extends to the invention described in the claims and its equivalents.

[0016] FIG. 1 is a diagram showing the schematic configuration of the walking posture state estimation system 1 according to the embodiment.

[0017] As shown in FIG. 1, the walking posture state estimation system 1 includes a first wearable device 100, one or more second wearable devices 200, one or more wireless earphone devices 300, shoes 400, an information processing device 500, a server device 600, and the like. The first wearable device 100, each second wearable device 200, each wireless earphone device 300, and the shoes 400 are worn and used by the user. The information processing device 500 is used by an administrator or the like who manages the user's health. The server device 600 is, for example, a server arranged on a cloud network or the like.

[0018] The first wearable device 100 and each second wearable device 200, and the first wearable device 100 and each wireless earphone device 300 are communicably connected to each other via a wireless network such as Bluetooth (registered trademark) or wireless LAN (Local Area Network). Also, the first wearable device 100, the information processing device 500, and the server device 600 are communicably connected to each other via the network N. The network N is a wired network such as the Internet or an intranet. The network N may also be a wireless network such as wireless LAN (Local Area Network). Further, each second wearable device 200, each wireless earphone device 300, the information processing device 500, and the server device 600 may be communicably connected to each other via the network N.

[0019] FIGS. 2(A) and (B) are schematic diagrams for explaining the wireless earphone device 300. FIG. 2(A) is a schematic diagram of the wireless earphone device 300 for the left ear as viewed from the outside (left side), and FIG. 2(B) is a schematic diagram of the wireless earphone device 300 for the left ear as viewed from the inside (right side).

[0020] The wireless earphone device 300 is a terminal device that can be worn by the user. The wireless earphone device 300 is an earphone-type wearable computer worn on the user's ear. The wireless earphone device 300 includes an earphone unit 301, a main body unit 302, a third input device 303, a third display device 304, a speaker 305, an insertion sensor 306, and the like.

[0021] The earphone unit 301 includes a speaker 305 and is provided so as to be insertable into the user's external auditory canal. The main body unit 302 is provided so as to be connected to the earphone unit 301. In the example shown in FIGS. 2(A) and (B), the main body unit 302 is connected below the earphone unit 301 when the earphone unit 301 is worn on the user's ear. The main body unit 302 may be connected to the earphone unit 301 at an arbitrary position with respect to the earphone unit 301, such as above, in front (on the user's face side), behind (on the user's occipital side), outside, etc. of the earphone unit 301 when the earphone unit 301 is worn on the user's ear.

[0022] The third input device 303 has an input device such as a button and an interface circuit that acquires a signal from the input device, and outputs an operation signal according to a user's input operation. The third display device 304 has an LED (Light Emitting Diode) and an interface circuit that controls the LED, and notifies the user by lighting or extinguishing.

[0023] The speaker 305 is disposed in the earphone unit 301 so as to face the tympanic membrane side of the user in a state where the earphone unit 301 is inserted into the user's external auditory canal, and outputs an audio signal according to the control from a third processing device described later.

[0024] The insertion sensor 306 is an example of an insertion sensor unit and is a sensor for detecting whether or not the user has inserted the wireless earphone device 300 into the external auditory canal. The insertion sensor 306 is disposed on the earphone unit 301 so as to be disposed within the external auditory canal in a state where the earphone unit 301 is inserted into the user's external auditory canal. The insertion sensor 306 may be disposed at any position of the wireless earphone device 300. The insertion sensor 306 is, for example, an optical proximity sensor including a light emitter and a light receiver. The light emitter is an LED or the like and irradiates light such as visible light or infrared light. The light receiver is a photodiode or the like and receives the light irradiated by the light emitter and reflected by the object. The optical proximity sensor detects whether or not the user has inserted the wireless earphone device 300 into the external auditory canal based on whether or not the time from when the light emitter irradiates light to when the light receiver receives the light is below a threshold value. The insertion sensor 306 may be any other arbitrary sensor such as a pressure sensor that detects whether or not it is in contact with the external auditory canal, a thermal sensor that detects whether or not the ambient temperature is within a predetermined range, or a humidity sensor that detects whether or not the ambient humidity is within a predetermined range. The insertion sensor 306 outputs a detection signal indicating whether or not the user has inserted the wireless earphone device 300 into the external auditory canal.

[0025] FIGS. 3(A) and 3(B) are schematic diagrams for explaining the shoe 400. FIG. 3(A) is a schematic diagram of the left-foot-side shoe 400 viewed from the outside (left side), and FIG. 3(B) is a cross-sectional view taken along line A-A' of FIG. 3(A).

[0026] As shown in FIGS. 3(A) and 3(B), the shoe 400 is a shoe worn on the user's foot. The shoe 400 includes a sole portion 401, an upper portion 402, a holding portion 403, and the like.

[0027] The sole part 401 is disposed on the bottom surface of the shoe 400 and has a ground contact surface 401a that contacts the ground when the user walks while wearing the shoe 400. The sole part 401 is formed of natural rubber, synthetic rubber, natural leather, synthetic leather, or the like. The upper part 402 is connected to the sole part 401 so as to be disposed above the sole part 401 and is provided so as to cover the upper side of the instep. The upper part 402 is formed of chemical fiber mesh, TPU film (thermoplastic urethane), natural leather, synthetic leather, or the like.

[0028] The holding part 403 is disposed on the outer side surface 402a of the upper part 402 so as to hold the wireless earphone device 300. The holding part 403 includes a main body storage part 404 and a recess 405. The main body storage part 404 is sewn to the outer side surface 402a so as to have an insertion opening 404a into which the main body part 302 of the wireless earphone device 300 can be inserted, and forms a pocket in which the main body part 302 is stored. The shoe 400 can stably fix the wireless earphone device 300 by the main body storage part 404, and the wireless earphone device 300 can accurately measure the acceleration and / or angular velocity in the three-axis directions applied to the wireless earphone device 300.

[0029] The concave portion 405 is formed on the outer side surface 402a so that the earphone unit 301 is housed in a state where the main body unit 302 of the wireless earphone device 300 is housed in the main body storage unit 404. As shown in FIG. 3(B), the concave portion 405 has an opposing surface 405a that opposes the insertion sensor 306 in a state where the main body unit 302 is housed in the holding unit 403. When the insertion sensor 306 faces the opposing surface 405a, it detects a state (such as light, pressure, temperature, or humidity) similar to a state where the wireless earphone device 300 is inserted into the user's external auditory canal. That is, when the insertion sensor 306 faces the opposing surface 405a, the holding unit 403 holds the earphone unit 301 in a manner that the insertion sensor 306 detects that the wireless earphone device 300 has been inserted into the user's external auditory canal. Thereby, even when the wireless earphone device 300 is not worn on the user's ear, when it is held by the holding unit 403, it can execute the same operations as when it is worn on the user's ear. For example, even when the wireless earphone device 300 is not worn on the user's ear, when it is held by the holding unit 403, it can output data obtained when the user walks.

[0030] FIG. 4 is a diagram showing a schematic configuration of the first wearable device 100.

[0031] The first wearable device 100 is an example of a walking state estimation device and an external device. The first wearable device 100 is a terminal device that can be worn by a user, such as a multifunctional mobile phone (so-called smartphone) or a tablet PC. The first wearable device 100 includes a first input device 101, a first display device 102, a first communication device 103, a first interface device 104, a first sensor 105, a first storage device 110, a first processing device 120, and the like. The first input device 101, the first display device 102, the first communication device 103, the first interface device 104, the first sensor 105, the first storage device 110, and the first processing device 120 are interconnected via a CPU (Central Processing Unit) bus or the like.

[0032] The first input device 101 has an input device such as a touch panel type and an interface circuit that acquires signals from the input device, and outputs an operation signal according to the input operation of the user.

[0033] The first display device 102 has a display including liquid crystal, organic EL (Electro-Luminescence), etc. and an interface circuit that outputs image data to the display, and displays the image data on the display.

[0034] The first communication device 103 has an antenna that transmits and receives wireless signals and a wireless communication interface circuit according to a communication protocol such as a wireless LAN. The first communication device 103 communicates and connects with the network N according to a communication standard such as a wireless LAN. The first communication device 103 sends the data received from the information processing device 500 or the server device 600, etc. via the network N to the first processing device 120. Also, the first communication device 103 transmits the data received from the first processing device 120 to the information processing device 500 or the server device 600, etc. via the network N.

[0035] The first interface device 104 has an antenna that transmits and receives wireless signals and a wireless communication interface circuit according to a communication protocol such as Bluetooth (registered trademark). The first interface device 104 communicates and connects with each second wearable device 200 according to a communication standard such as Bluetooth (registered trademark). The first interface device 104 sends the data received from each second wearable device 200 or each wireless earphone device 300 to the first processing device 120. Also, the first interface device 104 transmits the data received from the first processing device 120 to each second wearable device 200 or each wireless earphone device 300.

[0036] The first sensor 105 includes an acceleration sensor that measures the three-axis acceleration applied to the first wearable device 100, a gyro sensor that measures the three-axis angular velocity applied to the first wearable device 100, and the like. The acceleration sensor and the gyro sensor output measurement signals indicating the measured acceleration and angular velocity to the first processing device 120.

[0037] Note that the first sensor 105 may include a geomagnetic sensor that detects the geomagnetism applied to the first wearable device 100, that is, the movement of the user wearing the first wearable device 100, and the like. Further, the first sensor 105 may include a barometric pressure sensor that detects the barometric pressure around the first wearable device 100, that is, the movement of the user wearing the first wearable device 100 in the vertical direction. Further, the first sensor 105 may include a GPS (Global Positioning System) sensor that detects the position of the first wearable device 100, that is, the movement of the user wearing the first wearable device 100. In that case, the first sensor 105 outputs a measurement signal indicating the detected geomagnetism, barometric pressure, or position to the first processing device 120.

[0038] The first storage device 110 has a memory device such as a RAM (Random Access Memory) and a ROM (Read Only Memory), a fixed disk device such as a hard disk, or a portable storage device such as a flexible disk and an optical disk. Further, various computer programs, databases, tables, etc. used for various processes of the first wearable device 100 are stored in the first storage device 110. The computer program may be installed in the first storage device 110 using a known setup program or the like from a computer-readable portable recording medium. The portable recording medium is, for example, a CD-ROM (compact disc read only memory), a DVD-ROM (digital versatile disc read only memory), or the like. The computer program may be stored in a recording medium of a predetermined server and installed via the network N.

[0039] The first processing device 120 operates based on a program stored in the first storage device 110 in advance. The first processing device 120 is, for example, a CPU. As the first processing device 120, a DSP (digital signal processor), LSI (large scale integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), etc. may be used. The first processing device 120 is connected to the first input device 101, the first display device 102, the first communication device 103, the first interface device 104, the first sensor 105, the first storage device 110, etc., and controls each device. The first processing device 120 acquires data measured by the first sensor 105 when the user walks. Also, the first processing device 120 acquires data measured by the second wearable device 200 when the user who holds the second wearable device 200 walks, from the second wearable device 200 via the first interface device 104. Also, the first processing device 120 acquires data measured by the wireless earphone device 300 when the user who holds the wireless earphone device 300 walks, from the wireless earphone device 300 via the first interface device 104. The first processing device 120 transmits the acquired data to the information processing device 500 via the first communication device 103.

[0040] The first processing device 120 reads a computer program stored in the first storage device 110 and operates according to the read computer program. Thereby, the first processing device 120 functions as the first acquisition unit 121 and the first transmission unit 122.

[0041] FIG. 5 is a diagram showing a schematic configuration of the second wearable device 200.

[0042] The second wearable device 200 is a terminal device wearable by a user. For example, the second wearable device 200 is a wristwatch-type wearable computer worn on the user's wrist. Also, the second wearable device 200 is an insole-type wearable computer worn inside the shoes 400. The second wearable device 200 includes a second input device 201, a second display device 202, a second communication device 203, a second interface device 204, a second sensor 205, a second storage device 210, a second processing device 220, and the like. The second input device 201, the second display device 202, the second communication device 203, the second interface device 204, the second sensor 205, the second storage device 210, and the second processing device 220 are interconnected via a CPU bus or the like.

[0043] The second input device 201 includes an input device such as a button and an interface circuit that acquires signals from the input device, and outputs an operation signal according to the user's input operation. The second input device 201 may be omitted.

[0044] The second display device 202 includes a display including liquid crystal, organic EL, etc. and an interface circuit that outputs image data to the display, and displays the image data on the display. The second display device 202 may have an LED or the like and may notify the user by lighting or extinguishing. The second display device 202 may be omitted.

[0045] The second communication device 203 includes an antenna that transmits and receives wireless signals and a wireless communication interface circuit according to a communication protocol such as a wireless LAN. The second communication device 203 communicates and connects with the network N according to a communication standard such as a wireless LAN. The second communication device 203 sends the data received from the information processing device 500 or the server device 600 or the like via the network N to the second processing device 220. Also, the second communication device 203 transmits the data received from the second processing device 220 to the information processing device 500 or the server device 600 or the like via the network N.

[0046] The second interface device 204 includes an antenna for transmitting and receiving wireless signals and a wireless communication interface circuit according to a communication protocol such as Bluetooth (registered trademark). The second interface device 204 communicatively connects with the first wearable device 100 according to a communication standard such as Bluetooth (registered trademark). The second interface device 204 sends the data received from the first wearable device 100 to the second processing device 220. Also, the second interface device 204 transmits the data received from the second processing device 220 to the first wearable device 100.

[0047] The second sensor 205 includes an acceleration sensor that measures the three-axis acceleration applied to the second wearable device 200, a gyro sensor that measures the three-axis angular velocity applied to the second wearable device 200, and the like. The acceleration sensor and the gyro sensor output measurement signals indicating the measured acceleration and angular velocity to the second processing device 220. The second sensor 205 may include an insole-type pressure sensor. In that case, the second sensor 205 includes a resistance change type or capacitance change type pressure sensor arranged in one dimension or two dimensions, generates sole data using the magnitude of the pressure measured by each pressure sensor as a gradation value, and outputs the data to the second processing device 220. The sole data is, for example, a sole image using the magnitude of the pressure measured by each pressure sensor as the gradation value of each pixel. The sole data may be, for example, a sole vector having the pressure measured by each pressure sensor as an element.

[0048] The second storage device 210 includes a memory device such as a RAM or a ROM, a fixed disk device such as a hard disk, or a portable storage device such as a flexible disk or an optical disk. Further, the second storage device 210 stores computer programs, databases, tables, etc. used for various processes of the second wearable device 200. The computer program may be installed in the second storage device 210 using a known setup program or the like from a computer-readable portable recording medium. The portable recording medium is, for example, a CD-ROM, a DVD-ROM, or the like. The computer program may be stored in a recording medium of a predetermined server and installed via the network N.

[0049] The second processing device 220 operates based on a program stored in the second storage device 210 in advance. The second processing device 220 is, for example, a CPU. As the second processing device 220, a DSP, an LSI, an ASIC, an FPGA, or the like may be used. The second processing device 220 is connected to the second input device 201, the second display device 202, the second communication device 203, the second interface device 204, the second sensor 205, the second storage device 210, etc., and controls each device. The second processing device 220 acquires data measured by the second sensor 205 when the user walks and transmits it to the first wearable device 100 via the second interface device 204.

[0050] The second processing device 220 reads a computer program stored in the second storage device 210 and operates according to the read computer program. Thereby, the second processing device 220 functions as a second acquisition unit 221 and a second transmission unit 222.

[0051] FIG. 6 is a diagram showing a schematic configuration of the wireless earphone device 300.

[0052] In addition to the above-described respective parts, the wireless earphone device 300 includes a third communication device 307, a third interface device 308, a third sensor 309, a third storage device 310, a third processing device 320, and the like. The third input device 303, the third display device 304, the speaker 305, the insertion sensor 306, the third communication device 307, the third interface device 308, the third sensor 309, the third storage device 310, and the third processing device 320 are interconnected via a CPU bus or the like.

[0053] The third communication device 307 includes an antenna for transmitting and receiving wireless signals and a wireless communication interface circuit according to a communication protocol such as a wireless LAN. The third communication device 307 communicatively connects with the network N according to a communication standard such as a wireless LAN. The third communication device 307 sends data received from an information processing device 500, a server device 600, or the like via the network N to the third processing device 320. Also, the third communication device 307 transmits data received from the third processing device 320 to an information processing device 500, a server device 600, or the like via the network N.

[0054] The third interface device 308 is an example of a transmitting and receiving unit. The third interface device 308 includes an antenna for transmitting and receiving wireless signals and a wireless communication interface circuit according to a communication protocol such as Bluetooth (registered trademark). The third interface device 308 communicatively connects with the first wearable device 100 according to a communication standard such as Bluetooth (registered trademark). The third interface device 308 sends data received from the first wearable device 100 to the third processing device 320. Also, the third interface device 308 transmits data received from the third processing device 320 to the first wearable device 100.

[0055] The third sensor 309 includes an acceleration sensor that measures the acceleration in three axial directions applied to the wireless earphone device 300, a gyro sensor that measures the angular velocity in three axial directions applied to the wireless earphone device 300, and the like. The acceleration sensor and the gyro sensor output measurement signals indicating the measured acceleration and angular velocity to the third processing device 320.

[0056] The third storage device 310 includes a memory device such as a RAM or a ROM, a fixed disk device such as a hard disk, or a portable storage device such as a flexible disk or an optical disk. Further, the third storage device 310 stores computer programs, databases, tables, etc. used for various processes of the wireless earphone device 300. The computer program may be installed in the third storage device 310 using a known setup program or the like from a computer-readable portable recording medium. The portable recording medium is, for example, a CD-ROM, a DVD-ROM, or the like. The computer program may be stored in a recording medium possessed by a predetermined server and installed via the network N.

[0057] The third processing device 320 operates based on a program stored in the third storage device 310 in advance. The third processing device 320 is, for example, a CPU. As the third processing device 320, a DSP, an LSI, an ASIC, an FPGA, or the like may be used. The third processing device 320 is connected to the third input device 303, the third display device 304, the speaker 305, the insertion sensor 306, the third communication device 307, the third interface device 308, the third sensor 309, and the third storage device 310, etc., and controls each device. The third processing device 320 acquires data measured by the third sensor 309 when the user walks and transmits it to the first wearable device 100 via the third interface device 308.

[0058] The third processing device 320 reads the computer program stored in the third storage device 310 and operates according to the read computer program. Thereby, the third processing device 320 functions as a control unit 321, a third acquisition unit 322, and a third transmission unit 323.

[0059] The control unit 321 periodically receives a detection signal from the insertion sensor 306 and transmits the received detection signal to the first wearable device 100 via the third interface device 308. The first acquisition unit 121 of the first wearable device 100 receives a detection signal from the wireless earphone device 300 via the first interface device 104, and determines whether the user has inserted the wireless earphone device 300 into the external auditory canal based on the received detection signal.

[0060] When the first acquisition unit 121 receives a voice output request from the user, it transmits a voice signal to the wireless earphone device 300 via the first interface device 104 on the condition that the user has inserted the wireless earphone device 300 into the external auditory canal. The control unit 321 receives a voice signal from the first wearable device 100 via the third interface device 308 and outputs the received voice signal from the speaker 305. Note that the wireless earphone device 300 further has a microphone, and the control unit 321 may transmit the voice signal input from the microphone to the first wearable device 100 via the third interface device 308. In that case, when the first acquisition unit 121 receives a voice input request from the user, it receives a voice signal from the wireless earphone device 300 via the first interface device 104 on the condition that the user has inserted the wireless earphone device 300 into the external auditory canal.

[0061] Note that instead of the first acquisition unit 121, the control unit 321 may determine whether the user has inserted the wireless earphone device 300 into the external auditory canal, and perform the transmission and reception of voice signals only when the user has inserted the wireless earphone device 300 into the external auditory canal.

[0062] FIG. 7 is a diagram showing a schematic configuration of the information processing apparatus 500.

[0063] The information processing apparatus 500 is an example of a walking posture state estimation apparatus. The information processing apparatus 500 includes a fourth communication device 501, a fourth storage device 510, a fourth processing device 520, and the like. The fourth communication device 501, the fourth storage device 510, and the fourth processing device 520 are interconnected via a CPU bus or the like.

[0064] The fourth communication device 501 has a wired communication interface circuit that conforms to a communication protocol such as TCP / IP. The fourth communication device 501 communicates and connects with the network N in accordance with a communication standard such as Ethernet (registered trademark). The fourth communication device 501 sends the data received from the first wearable device 100, the second wearable device 200, the wireless earphone device 300, the server device 600, etc. via the network N to the fourth processing device 520. The fourth communication device 501 transmits the data received from the fourth processing device 520 to the first wearable device 100, the second wearable device 200, the wireless earphone device 300, the server device 600, etc. via the network N. Note that the fourth communication device 501 may have an antenna for transmitting and receiving wireless signals and a wireless communication interface circuit that conforms to a communication protocol such as a wireless LAN, and communicate and connect with the network N in accordance with a communication standard such as a wireless LAN.

[0065] The fourth storage device 510 includes a memory device such as a RAM and a ROM, a fixed disk device such as a hard disk, or a portable storage device such as a flexible disk and an optical disk. In addition, various computer programs, databases, tables, etc. used for various processes of the information processing device 500 are stored in the fourth storage device 510. The computer program may be installed in the fourth storage device 510 from a computer-readable portable recording medium such as a CD-ROM and a DVD-ROM using a known setup program or the like. The computer program may be stored in a recording medium of a predetermined server and installed via the network N.

[0066] In the fourth memory device 510, a learned model 511, a data table 512, etc. are stored as data. The learned model 511 is a model for estimating the walking posture state of a user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300. In the data table 512, each data measured by the first sensor 105 of the first wearable device 100, the second sensor 205 of the second wearable device 200, or the third sensor 309 of the wireless earphone device 300 is stored. Details of the data table 512 will be described later.

[0067] The fourth processing device 520 operates based on a program stored in the fourth memory device 510 in advance. The fourth processing device 520 is, for example, a CPU. As the fourth processing device 520, a DSP, an LSI, an ASIC, an FPGA, etc. may be used. The fourth processing device 520 is connected to the fourth communication device 501, the fourth memory device 510, etc., and controls each device.

[0068] The fourth processing device 520 reads a computer program stored in the fourth memory device 510 and operates according to the read computer program. Thereby, the fourth processing device 520 functions as a fourth acquisition unit 521, an estimation unit 522, and an output control unit 523.

[0069] FIG. 8 is a schematic diagram showing an example of the data structure of the data table 512.

[0070] In the data table 512, the angular velocity, acceleration, geomagnetism, atmospheric pressure (not shown), position (not shown), or sole data acquired from the first wearable device 100, the second wearable device 200, or the wireless earphone device 300 is stored in association with the identification information (device ID) of each device and the acquisition time when each data was acquired.

[0071] FIG. 9 is a sequence showing an example of the operation of the estimation process in the walking posture state estimation system 1.

[0072] Next, an example of the operation of the estimation process will be described with reference to the flowchart shown in FIG. 9. Note that the flow of the operation described below is mainly executed by each processing device of each device in cooperation with each element of each device based on a program stored in each storage device of each device of the walking posture state estimation system 1 in advance.

[0073] First, the third acquisition unit 322 of each wireless earphone device 300 acquires a measurement signal from the third sensor 309. The third acquisition unit 322 acquires the acceleration and angular velocity in the three-axis directions applied to the wireless earphone device 300 indicated by the measurement signal as third data obtained when the user walks (step S101). Also, the third acquisition unit 322 acquires a detection signal from the insertion sensor 306. The third acquisition unit 322 periodically acquires the third data and the detection signal.

[0074] Next, the third transmission unit 323 transmits the third data and the detection signal acquired by the third acquisition unit 322 to the first wearable device 100 via the third interface device 308 together with the device ID of the wireless earphone device 300 and the acquisition time when the third data was acquired (step S102). The third transmission unit 323 transmits the third data to the first wearable device 100 every time the third acquisition unit 322 acquires the third data. The third transmission unit 323 may also transmit a plurality of third data acquired by the third acquisition unit 322 to the first wearable device 100 at an arbitrary timing in a lump.

[0075] Next, the first acquisition unit 121 of the first wearable device 100 acquires the third data, the detection signal, the device ID, and the acquisition time from each wireless earphone device 300 via the first interface device 104 (step S103). The first acquisition unit 121 determines, based on the detection signal, whether the insertion sensor 306 has detected that the user has inserted the wireless earphone device 300 into the external auditory canal. The first acquisition unit 121 acquires the third data when the insertion sensor 306 has detected that the user has inserted the wireless earphone device 300 into the external auditory canal, and discards the third data when the insertion sensor 306 has detected that the user has not inserted the wireless earphone device 300 into the external auditory canal.

[0076] In this way, the first acquisition unit 121 acquires the third data only when the wireless earphone device 300 is inserted into the user's external auditory canal or held by the holding unit 403 of the shoes 400. Note that instead of the first acquisition unit 121, the third acquisition unit 322 may determine whether the insertion sensor 306 has detected that the user has inserted the wireless earphone device 300 into the external auditory canal. In that case, in step S101, the third acquisition unit 322 determines, based on the detection signal, whether the insertion sensor 306 has detected that the user has inserted the wireless earphone device 300 into the external auditory canal. When the insertion sensor 306 has detected that the user has inserted the wireless earphone device 300 into the external auditory canal, the third acquisition unit 322 acquires the third data, and when the insertion sensor 306 has detected that the user has not inserted the wireless earphone device 300 into the external auditory canal, the third acquisition unit 322 discards the third data.

[0077] Next, the second acquisition unit 221 of each second wearable device 200 acquires a measurement signal from the second sensor 205. The second acquisition unit 221 acquires, as second data obtained when the user walks, the triaxial acceleration and angular velocity applied to the second wearable device 200 indicated by the measurement signal or the sole data indicating the magnitude of the pressure applied to each position of the user's sole (step S104). The second data is different from the third data. The second acquisition unit 221 periodically acquires the second data.

[0078] Next, the second transmission unit 222 transmits the second data acquired by the second acquisition unit 221, together with the device ID of the second wearable device 200 and the acquisition time at which the second data was acquired, to the first wearable device 100 via the second interface device 204 (step S105). The second transmission unit 222 transmits the second data to the first wearable device 100 every time the second acquisition unit 221 acquires the second data. The second transmission unit 222 may also transmit a plurality of second data acquired by the second acquisition unit 221 to the first wearable device 100 at an arbitrary timing after aggregating them.

[0079] Next, the first acquisition unit 121 of the first wearable device 100 acquires by receiving second data, a device ID, and an acquisition time from the second wearable device 200 via the first interface device 104 (step S106).

[0080] Next, the first acquisition unit 121 acquires a measurement signal from the first sensor 105. The first acquisition unit 121 acquires the acceleration, angular velocity, geomagnetism, air pressure, or position in the three-axis directions of the first wearable device 100 indicated by the measurement signal as first data obtained when the user walks (step S107). The first data is different from the second data and the third data. The first acquisition unit 121 periodically acquires the first data.

[0081] Next, the first transmission unit 122 transmits the first data, the second data, and the third data acquired by the first acquisition unit 121, together with the device ID and the acquisition time corresponding to each data, to the information processing device 500 via the first communication device 103 (step S108). The first transmission unit 122 analyzes a plurality of continuously measured first data, second data, and third data, and detects the maximum and minimum values in the first data, second data, and third data arranged in time series. The first transmission unit 122 detects the vibration periods of the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the detected maximum and minimum values. The first transmission unit 122 specifies the swing interval of the legs of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the detected vibration periods. Then, the first transmission unit 122 transmits the first data, the second data, and the third data for a predetermined number of steps (for example, 10 steps) of the user to the information processing device 500.

[0082] As a result, as will be described later, when the input data to be input to the learned model 511 is data for a predetermined number of steps, the information processing apparatus 500 does not need to extract data for a predetermined number of steps from the acquired first data, second data, and third data. The walking posture state estimation system 1 can reduce the processing load in the information processing apparatus 500, and can reduce the processing load as a whole.

[0083] Note that the first transmission unit 122 may transmit the first data, second data, or third data to the information processing apparatus 500 each time the first acquisition unit 121 acquires the first data, second data, or third data. Further, the first transmission unit 122 may collectively transmit a plurality of first data, second data, or third data acquired by the first acquisition unit 121 to the information processing apparatus 500 at an arbitrary timing.

[0084] Next, the fourth acquisition unit 521 of the information processing apparatus 500 acquires the first data, second data, third data, device ID, and acquisition time from the first wearable device 100 via the fourth communication device 501 (step S109). The fourth acquisition unit 521 stores the acquired first data, second data, and third data in the data table 512 in association with the corresponding device ID and acquisition time.

[0085] Next, the estimation unit 522 estimates the walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the first data, second data, and third data acquired by the third acquisition unit 322 (step S110). The estimation unit 522 estimates the walking posture state of the user using the learned model 511.

[0086] The learned model 511 includes one or more learned models. The learned model 511 is pre-generated by an information processing device 500, a server device 600, or the like. The learned model 511 is pre-trained by supervised learning such as deep learning or a support vector machine. The learned model 511 may be pre-trained by a random forest or the like. The learned model 511 is trained to output the walking posture state of the user wearing the first wearable device 100, the second wearable device 200, or the wireless earphone device 300 that generated the input data when the input data is input.

[0087] The input data is the first data acquired by the first wearable device 100, the second data acquired by the second wearable device 200, and / or the third data acquired by the wireless earphone device 300. The input data may be data generated based on the first data, the second data, and / or the third data. For example, the input data is a set of the first data, the second data, and / or the third data for a predetermined number of consecutive steps or a predetermined period (e.g., 5 seconds) (a vector arranged one-dimensionally or two-dimensionally with the magnitude of the pressure measured by each pressure sensor, or the acceleration or angular velocity measured by each acceleration sensor or each gyro sensor as elements). The input data may be a statistical value such as the average value, median value, maximum value, or minimum value of the first data, the second data, and / or the third data for a predetermined number of consecutive steps or a predetermined period. Also, the input data may be a quaternion calculated from the angular velocity, acceleration, or geomagnetism included in the first data and / or the second data.

[0088] Alternatively, the input data may be a predetermined component (such as the first principal component and / or the second principal component, etc.) calculated by principal component analysis for the three-axis angular velocity or acceleration or sole data included in the first data, the second data, and / or the third data. In that case, if the contribution rate of the first principal component is greater than a predetermined ratio (for example, 80%), the first principal component is used as the input data. If the contribution rate of the first principal component is equal to or less than the predetermined ratio, the second principal component may be used as the input data. Also, the principal component analysis may be performed after noise is removed using a known noise processing technique. In these cases, as the learned model 511, a model pre-trained by random forest or the like is used. In these cases, as the learned model 511, a model pre-trained by a neural network or the like may also be used. Thereby, the walking posture state estimation system 1 can further improve the accuracy of the learned model 511.

[0089] Alternatively, the input data may include an image of the spectrum converted by short-time Fourier transform or wavelet transform for each angular velocity and / or acceleration in the three-axis directions included in the first data, the second data, and / or the third data. The image of the spectrum converted by short-time Fourier transform or wavelet transform for each angular velocity and / or acceleration in the three-axis directions included in the first data is an example of the first image data and the image data. The image of the spectrum converted by short-time Fourier transform or wavelet transform for each angular velocity and / or acceleration in the three-axis directions included in the second data is an example of the second image data and the image data. In these cases, as the learned model 511, a model pre-trained by random forest or the like is used. In these cases, as the learned model 511, a model pre-trained by a neural network or the like may also be used. Thereby, the walking posture state estimation system 1 can further improve the accuracy of the learned model 511.

[0090] Alternatively, the input data may be a feature vector including the gradation value (pressure) of each pixel of the sole image or each element of the sole vector, and angular velocity, acceleration, geomagnetism, atmospheric pressure, and / or position as elements.

[0091] The walking posture state output from the learned model 511 includes five elements. The first element indicates the state of the step length, particularly whether the user's step length is sufficient or insufficient. The second element indicates the state of the center of gravity position, particularly whether the user's center of gravity is normal, leaning forward, or leaning backward. The third element indicates the state of the leading leg, particularly whether the user is not kicking, dragging, or kicking the leg being put forward. The fourth element indicates the state of the supporting leg, particularly whether the user's axis leg is stretched or not. The fifth element indicates the state of the hip joint, particularly whether the user's hip joint is open or not. The first element is an element related to the premise of the walking posture. The second and third elements are elements related to the axis in the front-rear direction. The fourth and fifth elements are elements related to the rotation (left-right direction) axis. The walking posture state does not have to include all the elements from the first element to the fifth element, and it may include at least one element.

[0092] The walking posture state output from the learned model 511 is not limited to the information directly indicating each element from the first element to the fifth element, and may be a predetermined feature quantity related to each element from the first element to the fifth element.

[0093] The learned model 511 includes, for example, learned models corresponding to each of the first wearable device 100, each second wearable device 200, and each wireless earphone device 300. That is, the learned model 511 includes a first learned model, a second learned model, and a third learned model. The first learned model can output a first walking posture state estimated based on first data obtained from the first wearable device 100. The second learned model can output a second walking posture state estimated based on second data obtained from each second wearable device 200. The third learned model can output a third walking posture state estimated based on third data obtained from each wireless earphone device 300.

[0094] Alternatively, the first pre-trained model may be capable of outputting a first walking posture state estimated based on first image data based on the first data acquired from the first wearable device 100. The second pre-trained model may be capable of outputting a second walking posture state estimated based on second image data based on the second data acquired from each second wearable device 200. The third pre-trained model may be capable of outputting a third walking posture state estimated based on third image data based on the third data acquired from each wireless earphone device 300.

[0095] Thereby, the walking posture state estimation system 1 can estimate the walking posture state for each body part on which the first wearable device 100, the second wearable device 200, or the wireless earphone device 300 is worn, and comprehensively estimate the walking posture state of the user based on the walking posture state estimated for each part.

[0096] In these cases, the estimation unit 522 may obtain the walking posture state by inputting the input data based on the first data into the first layer of the first pre-trained model, inputting the input data based on the second data into the second layer of the second pre-trained model, and inputting the input data based on the third data into the third layer of the third pre-trained model. This first layer is a specific layer among the input layer or the intermediate layer. This second layer is a layer different from the first layer and is a specific layer among the input layer or the intermediate layer. This third layer is a layer different from the first layer and / or the second layer and is a specific layer among the input layer or the intermediate layer. Thereby, the walking posture state estimation system 1 can flexibly change the number of processing layers (number of processing steps) in each pre-trained model and suppress an increase in processing time and processing load.

[0097] In addition, the estimation unit 522 may acquire the first output data, the second output data, and the third output data as walking posture states. The first output data is data output from the first layer of the first learned model when input data based on the first data is input to the first learned model. The second output data is data output from the second layer of the second learned model when input data based on the second data is input to the second learned model. The third output data is data output from the third layer of the third learned model when input data based on the third data is input to the third learned model. This first layer is a specific layer among the intermediate layer or the output layer. This second layer is a layer different from the first layer and is a specific layer among the intermediate layer or the output layer. This third layer is a layer different from the first layer and / or the second layer and is a specific layer among the intermediate layer or the output layer. Thereby, the walking posture state estimation system 1 can flexibly change the number of processing layers (number of processing steps) in each learned model, and can suppress an increase in processing time and processing load.

[0098] Note that the learned model 511 may be generated to correspond to a plurality of devices among the first wearable device 100, the second wearable device 200, and the wireless earphone device 300. In particular, the learned model 511 may be generated to correspond to all of the first wearable device 100, the second wearable device 200, and the wireless earphone device 300. That is, the learned model 511 includes a single learned model capable of outputting a walking posture state estimated based on the first data acquired from the first wearable device 100, the second data acquired from each second wearable device 200, and the third data acquired from the wireless earphone device 300.

[0099] Alternatively, the learned model 511 includes a single learned model capable of outputting a walking posture state estimated based on image data based on the first data, the second data, and the third data acquired from the first wearable device 100, each second wearable device 200, and each wireless earphone device 300.

[0100] In these cases, the learned model 511 is learned to output a walking posture state when a vector including first data, second data, and third data acquired from a plurality of wearable devices at mutually corresponding times (substantially matching times) is input.

[0101] Thereby, the walking posture state estimation system 1 can comprehensively estimate the walking posture state based on the first data, the second data, and the third data acquired from the first wearable device 100, each second wearable device 200, and each wireless earphone device 300.

[0102] Also, the learned model 511 includes learned models corresponding to each of the first to fifth elements. That is, the learned model 511 includes a plurality of learned models capable of outputting information regarding each of the first to fifth elements. The learned model 511 may include a single learned model capable of collectively outputting information regarding each of the first to fifth elements.

[0103] Also, the learned model 511 may include an upstream learned model and a downstream learned model arranged in series. In that case, the upstream learned model is learned to output a predetermined feature amount when input data is input, and the downstream learned model is learned to output a walking posture state when the feature amount output from the intermediate layer or the output layer of the upstream learned model is input. The predetermined feature amount is a feature amount regarding the input data or a feature amount regarding the walking posture state.

[0104] In addition, the learned model 511 may include any combination of the above-described learned models. For example, the learned model 511 includes a first upstream learned model, a second upstream learned model, a third upstream learned model, and a downstream learned model. The first upstream learned model is learned to output a predetermined feature amount when the first principal component of the sole data is input. The second upstream learned model is learned to output a predetermined feature amount when the second principal component of the sole data is input. The third upstream learned model is learned to output a predetermined feature amount when the first principal component of the angular velocity or acceleration is input. Alternatively, the third upstream learned model is learned to output a predetermined feature amount when an image of a spectrum obtained by performing a short-time Fourier transform or a wavelet transform on the angular velocity and / or acceleration is input. The downstream learned model is learned to output a walking posture state when a feature vector including data output from the output layer or the intermediate layer of the first upstream learned model, the second upstream learned model, and the third upstream learned model is input. Thereby, the walking posture state estimation system 1 can further improve the accuracy of the learned model 511.

[0105] Alternatively, the learned model 511 includes a first upstream learned model, a second upstream learned model, and a downstream learned model. The first upstream learned model is learned to output a predetermined feature amount when sole data is input. The second upstream learned model is learned to output a predetermined feature amount when the angular velocity or acceleration is input. The downstream learned model is learned to output a walking posture state when a feature vector including data output from the output layer or the intermediate layer of the first upstream learned model and the second upstream learned model is input. Thereby, the walking posture state estimation system 1 can further improve the accuracy of the learned model 511.

[0106] In this way, the learned model 511 is provided to be able to output the estimated walking posture state of a user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300.

[0107] The learning data of the learned model 511 includes a combination of pre-generated input data and the walking posture state of a user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 that generated the input data. Each learning data is created by an expert who has viewed a moving image of a user wearing the device that generated the first data, the second data, or the third data when the first data, the second data, or the third data is generated by each device.

[0108] Each learning data is composed of, for example, a set of the first data, the second data, or the third data for a predetermined number of consecutive steps or a predetermined period, and a combination with the walking posture state. In that case, each learning data may be generated such that a part of the first data, the second data, or the third data included in each learning data overlaps. That is, the first learning data may include information for a predetermined number of steps or a predetermined period from the first time, and the second learning data may include data for a predetermined number of steps or a predetermined period from the second time immediately after the first time (for example, 1 second later). Thereby, the walking posture state estimation system 1 can efficiently generate the learned model 511 from a small amount of sample data, and can reduce the time and labor required for generating the learned model 511.

[0109] When the learned model 511 is pre-trained by a random forest or the like, each learning data is composed of, for example, a vector in which the first data, the second data, or the third data for a predetermined number of consecutive steps or a predetermined period is arranged linearly, and a combination with the walking posture state. Each learning data may include only the angular velocity in the three-axis direction among, for example, the first data, the second data, or the third data. The walking posture state estimation system 1 can improve the accuracy of the learned model 511 by generating the learned model 511 based on both the angular velocity and the acceleration. On the other hand, the walking posture state estimation system 1 can reduce the time and labor required for generating the learned model 511 by generating the learned model 511 based only on the angular velocity. Also in these cases, each learning data may be generated such that a part of the first data, the second data, or the third data included in each learning data overlaps.

[0110] The estimation unit 522 converts the first data, the second data, and the third data acquired in step S109 into a format corresponding to the learned model 511 and inputs them to the learned model 511. The estimation unit 522 estimates the walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the information output from the learned model 511. The estimation unit 522 estimates the walking posture state of the user for each element included in the walking posture state.

[0111] When the information output from the learned model 511 is a feature amount, the information processing device 500 stores in advance in the fourth storage device 510 a table or formula indicating the relationship between the feature amount and the walking posture state. The estimation unit 522 refers to the table or formula stored in the fourth storage device 510 and specifies the walking posture state of the user corresponding to the feature amount output from the learned model 511.

[0112] In addition, when the learned model 511 includes a plurality of learned models corresponding to the first wearable device 100, each second wearable device 200, and each wireless earphone device 300, the estimation unit 522 estimates that the walking posture state output from the most learned models among the walking posture states output from each learned model is the walking posture state of the user.

[0113] In this way, the estimation unit 522 estimates the walking posture state of the user based on the acquired first data, second data, and third data by using the learned model 511. That is, the estimation unit 522 acquires the walking posture state estimated based on the acquired first data, second data, and third data by using the learned model 511.

[0114] Next, the output control unit 523 outputs the estimated walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 by transmitting it to the first wearable device 100 via the fourth communication device 501 (step S111).

[0115] Next, the first acquisition unit 121 of the first wearable device 100 acquires the estimated walking posture state of the user by receiving it from the information processing device 500 via the first communication device 103 (step S112).

[0116] Next, the first acquisition unit 121 outputs and notifies the user by displaying the acquired walking posture state on the first display device 102 (step S113), and ends a series of steps. Thereby, the user can recognize his / her own walking posture state.

[0117] Note that in step S103, the first acquisition unit 121 may acquire the third data regardless of whether the insertion sensor 306 detects that the user is inserting the wireless earphone device 300 into the external auditory canal.

[0118] Further, S104 to S106 and / or S107 may be omitted, and the first acquisition unit 121 may estimate the walking posture state without using the first data and / or the second data. By estimating the walking posture state without using the first data and / or the second data, the walking posture state estimation system 1 can estimate the walking posture state at low cost and with low load without using the first wearable device 100 and / or the second wearable device 200. On the other hand, the walking posture state estimation system 1 can estimate the walking posture state with high accuracy by estimating the walking posture state based on the first data and / or the second data.

[0119] Also, in step S111, the output control unit 523 of the information processing device 500 may transmit the estimated walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 to the administrator device owned by the administrator who manages the user's health. In that case, the administrator device notifies the administrator by displaying the received walking posture state. The administrator can recognize the walking posture state of the user and propose improvements to the walking posture state to the user.

[0120] Also, the timings at which the processes of step S101, step S104, and step S107 are executed may be arbitrary and may be simultaneous. For example, when the first acquisition unit 121 of the first wearable device 100 receives an instruction to start measurement from the user using the first input device 101, it transmits a measurement request signal requesting start of measurement to the wireless earphone device 300 and the second wearable device 200 via the first interface device 104, and acquires first data. On the other hand, when the third acquisition unit 322 of the wireless earphone device 300 receives a measurement request signal from the first wearable device 100 via the third interface device 304, it acquires third data and transmits the third data to the first wearable device 100 via the third interface device 304. Further, when the second acquisition unit 221 of the second wearable device 200 receives a measurement request signal from the first wearable device 100 via the second interface device 204, it acquires second data and transmits the second data to the first wearable device 100 via the second interface device 204. The first acquisition unit 121 repeats the above processes until it receives an instruction to end measurement from the user using the first input device 101, and then executes the process of step S108.

[0121] Further, the learned model 511 may be stored in the server device 600 instead of the fourth storage device 510. In that case, in step S110, the estimation unit 522 accesses the server device 600 to obtain the walking posture state estimated by the learned model 511. The estimation unit 522 transmits a request signal for requesting the transmission of the user's walking posture state to the server device 600 via the fourth communication device 501. The request signal includes the first data, the second data, and / or the third data converted into a format corresponding to the learned model 511. The server device 600 receives the request signal from the information processing device 500. The server device 600 inputs the first data, the second data, and / or the third data included in the received request signal into the learned model 511 and obtains the output data output from the learned model 511. The server device 600 transmits the obtained output data to the information processing device 500. The estimation unit 522 obtains the output data by receiving it from the server device 600 via the fourth communication device 501, and estimates the walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the obtained output data.

[0122] By using the learned model stored in the server device 600, the walking posture state estimation system 1 can estimate the walking posture state using the latest learned model updated by the server device 600. Further, the walking posture state estimation system 1 can reduce the storage capacity of the information processing device 500 by using the learned model stored in the server device 600. On the other hand, the information processing device 500 can estimate the walking posture state or the aged data even when the communication connection with the server device 600 is disconnected by using the learned model stored in its own device. Further, the information processing device 500 can reduce the communication volume between the information processing device 500 and the server device 600 by using the learned model stored in its own device.

[0123] Alternatively, the estimation of the walking posture state may be performed by the first wearable device 100 instead of the information processing device 500. In that case, the learned model 511 and the data table 512 are stored in the first storage device 110 of the first wearable device 100. Further, the first processing device 120 functions as the first acquisition unit 121 and the first transmission unit 122, and also functions as an estimation unit and an output control unit having the same functions as the estimation unit 522 and the output control unit 523.

[0124] The processes of steps S108 to S112 are omitted. In step S107, the first acquisition unit 121 acquires first data obtained when the user walks, and stores the acquired first data, second data, and third data in the data table 512 in association with the corresponding device ID and acquisition time. Then, the estimation unit of the first wearable device 100 estimates the walking posture state of the user wearing the first wearable device 100, the second wearable device 200, and the wireless earphone device 300 based on the first data, second data, and third data in the same manner as the process of step S110.

[0125] Even when the first wearable device 100 estimates the walking posture state of the user, the first wearable device 100 may estimate the walking posture state of the user based on the output information of the learned model 511 stored in the server device 600.

[0126] The inventor evaluated the learned model 511 for all of the first to fifth elements, and confirmed that the accuracy rate of the information output from the learned model 511 was 93% or higher, and the accuracy was sufficiently high. That is, it was confirmed that the walking posture state estimation system 1 can more accurately estimate the user's walking posture state by using the learned model 511. Further, the walking posture state estimation system 1 can calculate the walking posture state for various combinations of various types of parameters with high accuracy and efficiency by using the learned model 511. Further, the walking posture state estimation system 1 can identify the walking posture state without storing the corresponding walking posture state for various combinations of various types of parameters by using the learned model 511, so that the storage capacity of the storage device can be reduced. Further, the walking posture state estimation system 1 can identify the walking posture state without performing complex determination according to various combinations of various types of parameters by using the learned model 511, so that the processing time and processing load of the estimation process can be reduced.

[0127] Hereinafter, the technical significance of the walking posture state including the first to fifth elements will be described.

[0128] The main power source of the walking motion is the lifting of the thigh, and the main power source of the running motion is the kick of the toes. Therefore, the walking motion and the running motion, that is, the motion of running slowly to the limit, are fundamentally different motions, and clearly changing the motion between the walking motion and the running motion is related to the user's health. In order to kick with the toes, the ball of the thumb touches the floor, the foot turns inward, and the arch disappears. As a result, the bones of the foot become loose as a whole, and the impact on the foot is likely to be transmitted to the knee or the waist. Since the running motion involves a burden on the foot, it is not desirable to perform a running motion that places a burden on the foot while walking.

[0129] The walking posture state estimation system 1 can identify whether a user is performing an appropriate walking motion without running by estimating each element from the first element to the fifth element as the walking posture state of the user. In particular, each element from the first element to the fifth element is related to each other, and in the order from the first element to the fifth element, as the user's posture is improved, the user can easily improve the walking posture.

[0130] First, it should not be the case that the stride is too short and the walking speed is too slow. The stride needs to be guaranteed to be a certain length or more. By including, as a first element indicating whether the user's stride is sufficient or insufficient, in the walking posture state, the walking posture state estimation system 1 can ensure that the user's stride is a certain length or more.

[0131] Next, when the user's posture is not straight, the user has to run. When the user stands straight with the heel as the center of gravity, the user can lift the leg using the thigh, but when in a forward-leaning posture, the upper body covers the leg, making it difficult to lift the leg using the thigh, and the user has to kick with the toes. By including, as a second element indicating whether the user's center of gravity is normal, forward-leaning, or backward-leaning, as an element related to the axis in the front-rear direction, in the walking posture state, the walking posture state estimation system 1 can confirm whether the user's posture is kept straight.

[0132] Next, even if the user's center of gravity is straight, if the thigh lift is not performed correctly, the user has to run. Even if the user's center of gravity is straight and the foot can be lifted without kicking with the toes, kicking with the toes will cause violent vertical movement. Also, even though the user's center of gravity is straight, since the user does not have the habit of lifting the foot with the thigh, the user may drag the foot. By including, as an element related to the axis in the front-rear direction, a third element indicating whether the user is not kicking, dragging, or kicking the foot that is put forward, the walking posture state estimation system 1 can confirm whether the user's thigh lift is performed correctly.

[0133] Next, even if the axis in the front-rear direction is correct, if the rotation (left-right direction) axis is incorrect, the appropriate walking motion is not performed. If the knee goes inside relative to the toes, the knee gets in the way and the opposite foot cannot come out correctly. That is, when the axis foot is tense or the hip joint is not open, the foot that wants to be put forward cannot rise correctly. On the other hand, when the user rotates the hip joint, a space for the opposite foot to come out is secured, the foot is likely to rise, and the thigh lift is performed correctly. By including, as elements related to the rotation (left-right direction) axis, a fourth element indicating whether the user's axis foot is tense or not and a fifth element indicating whether the user's hip joint is open or not in the walking posture state, the walking posture state estimation system 1 can confirm whether the rotation axis is correct.

[0134] As described in detail above, the shoe 400 has a holding portion 403 that holds the wireless earphone device 300. Thereby, when the user is not listening to the sound output from the first wearable device 100 or is not having a conversation using the wireless earphone device 300, etc., the user can remove the wireless earphone device 300 from the ear and store it in the shoe 400. Therefore, the shoe 400 can improve the convenience for the user of the wireless earphone device 300.

[0135] In addition, even when the wireless earphone device 300 is stored in the shoes 400, the acceleration and acceleration applied to the user's body can be measured, and the walking posture state estimation system 1 can accurately estimate the user's walking posture state.

[0136] FIGS. 10(A) and (B) are schematic diagrams for explaining shoes 410 according to another embodiment. FIG. 10(A) is a schematic diagram of the left-foot side shoes 410 viewed from the outside (left side), and FIG. 10(B) is a cross-sectional view taken along the line A-A' of FIG. 10(A).

[0137] The shoes 410 have the same structure and functions as the shoes 400. However, the shoes 410 have a holding part 413 instead of the holding part 403. The holding part 413 is disposed on the outer side surface 402a of the upper part 402 so as to hold the wireless earphone device 300. The holding part 413 is sewn to the outer side surface 402a so as to have an insertion opening 413a into which the entire wireless earphone device 300 can be inserted, and forms a pocket in which the entire wireless earphone device 300 is stored. The insertion opening 413a is formed of an elastic member such as a rubber member, and abuts or is close to the outer side surface 402a in a state where the entire wireless earphone device 300 is stored in the holding part 413. Thereby, the holding part 413 presses and fixes the entire wireless earphone device 300 to the upper part 402. The shoes 410 can stably fix the wireless earphone device 300, and the wireless earphone device 300 can accurately measure the acceleration and / or angular velocity in the three-axis directions applied to the wireless earphone device 300.

[0138] The portion facing the holding portion 413 of the outer side surface 402a has an opposing surface 413b that opposes the insertion sensor 306 when the wireless earphone device 300 is housed in the holding portion 413. When the insertion sensor 306 is facing the opposing surface 413b, it detects a state (such as light, pressure, temperature, or humidity) similar to the state where the wireless earphone device 300 is inserted into the user's external auditory canal. That is, when the insertion sensor 306 faces the opposing surface 413b, the holding portion 413 holds the wireless earphone device 300 in a manner that the insertion sensor 306 detects that the wireless earphone device 300 has been inserted into the user's external auditory canal.

[0139] As described in detail above, even when the shoe 410 presses and fixes the entire wireless earphone device 300 to the upper portion 402, it is possible to improve the convenience for the user of the wireless earphone device 300.

[0140] FIG. 11(A) is a schematic diagram for explaining a shoe 420 according to still another embodiment. FIG. 11(A) is a schematic diagram of the left-foot shoe 420 viewed from the inside (right side).

[0141] The shoe 420 has the same structure and function as the shoe 400. However, the shoe 420 has a holding portion 423 instead of the holding portion 403. The holding portion 423 has the same structure and function as the holding portion 403. However, the holding portion 423 is disposed on the inner side surface 402b instead of the outer side surface 402a of the upper portion 402.

[0142] FIG. 11(B) is a schematic diagram for explaining a shoe 430 according to still another embodiment. FIG. 11(B) is a schematic diagram of the left-foot shoe 430 viewed from the inside (right side).

[0143] The shoe 430 has the same structure and function as the shoe 410. However, the shoe 430 has a holding portion 433 instead of the holding portion 413. The holding portion 433 has the same structure and function as the holding portion 413. However, the holding portion 433 is disposed on the inner side surface 402b instead of the outer side surface 402a of the upper portion 402.

[0144] Figure 12(A) is a schematic diagram for explaining a shoe 440 according to still another embodiment. Figure 12(A) is a schematic diagram of the left-foot side shoe 440 viewed from above.

[0145] The shoe 440 has the same structure and function as the shoe 400. However, the shoe 440 has a holding part 443 instead of the holding part 403. The holding part 443 has the same structure and function as the holding part 403. However, the holding part 443 is disposed on the toe-side surface 402c instead of the outer side surface 402a of the upper part 402.

[0146] Figure 12(B) is a schematic diagram for explaining a shoe 450 according to still another embodiment. Figure 12(B) is a schematic diagram of the left-foot side shoe 450 viewed from above.

[0147] The shoe 450 has the same structure and function as the shoe 410. However, the shoe 450 has a holding part 453 instead of the holding part 413. The holding part 453 has the same structure and function as the holding part 413. However, the holding part 453 is disposed on the toe-side surface 402c instead of the outer side surface 402a of the upper part 402.

[0148] Figure 13(A) is a schematic diagram for explaining a shoe 460 according to still another embodiment. Figure 13(A) is a schematic diagram of the left-foot side shoe 460 viewed from the rear.

[0149] The shoe 460 has the same structure and function as the shoe 400. However, the shoe 460 has a holding part 463 instead of the holding part 403. The holding part 463 has the same structure and function as the holding part 403. However, the holding part 463 is disposed on the heel-side surface 402d instead of the outer side surface 402a of the upper part 402.

[0150] FIG. 13(B) is a schematic diagram for explaining a shoe 470 according to yet another embodiment. FIG. 13(B) is a schematic diagram of the left-foot side shoe 470 viewed from the rear.

[0151] The shoe 470 has the same structure and functions as the shoe 410. However, the shoe 470 has a holding portion 473 instead of the holding portion 413. The holding portion 473 has the same structure and functions as the holding portion 413. However, the holding portion 473 is disposed on the heel side side surface 402d instead of the outer side surface 402a of the upper portion 402.

[0152] As described in detail above, even when the shoe is disposed on the inner side surface 402b, the toe side side surface 402c, or the heel side side surface 402d, it is possible to improve the convenience for the user of the wireless earphone device 300.

[0153] Although the preferred embodiments have been described above, the embodiments are not limited thereto. For example, the second wearable device 200 and / or the wireless earphone device 300 may transmit the second data and / or the third data directly to the information processing device 500 instead of transmitting them to the information processing device 500 via the first wearable device 100. Thereby, the walking posture state estimation system 1 can reduce the processing load on the first wearable device 100. On the other hand, by the first wearable device 100 aggregating the second data from the second wearable device 200 and the third data from the wireless earphone device 300, the walking posture state estimation system 1 can reduce the processing load on the information processing device 500.

[0154] Also, in the walking posture state estimation system 1, the first wearable device 100 and / or the second wearable device 200 may be omitted. Also, in the walking posture state estimation system 1, a plurality of first wearable devices 100 and / or a plurality of information processing devices 500 may cooperate to share each step of the above-described respective processes.

[0155] Further, the above-described holding parts 403, 413, 423, 433, 443, 453, 463, or 473 may be detachably provided with respect to the shoes 400, 410, 420, 430, 440, 450, 460, or 470. The holding part that is detachable with respect to each shoe is an example of a holding member attachable to the shoe. In that case, the holding member has a contact part that contacts the shoe, and the shoe has a part to be contacted where the contact part of the holding member is contacted. The contact part and the part to be contacted are brought into contact with each other by an adhesive, a hook-and-loop fastener, or the like.

Explanation of Reference Numerals

[0156] 300 Wireless earphone device, 305 Speaker, 306 Insertion sensor, 308 Third interface device, 309 Third sensor, 400, 410, 420, 430, 440, 450, 460, 470 Shoes, 401 Sole part, 402 Upper part, 402a Outer side surface, 402b Inner side surface, 402c Toe side surface, 402d Heel side surface, 403, 413, 423, 433, 443, 453, 463, 473 Holding part, 404a Insertion opening

Claims

1. a sole part having a ground contact surface; an upper part connected to the sole part; a holding part that holds a wireless earphone including an earphone part that can be inserted into the user's external auditory canal and includes a speaker that outputs an audio signal, a sensor part that acquires data obtained when the user walks, and a transceiver part that transmits the data to an external device and receives the audio signal from the external device; The shoe is characterized by having the above.

2. The shoe according to claim 1, wherein the holding part has an insertion opening into which a main body part connected to the earphone part of the wireless earphone can be inserted.

3. The shoe according to claim 1, wherein the holding part presses and fixes the entire wireless earphone to the upper part.

4. The wireless earphone has an insertion sensor part for detecting whether the user has inserted the wireless earphone into the external auditory canal. The shoe according to claim 1 or 2, wherein the holding part holds the earphone part in a manner in which the insertion sensor part detects that the wireless earphone has been inserted into the user's external auditory canal.

5. The shoe according to claim 1 or 2, wherein the holding part is disposed on an outer side surface, an inner side surface, a toe side surface, or a heel side surface of the upper part.

6. A holding member attachable to a shoe, characterized by having a holding part that holds a wireless earphone including an earphone part that can be inserted into the user's external auditory canal and includes a speaker that outputs an audio signal, a sensor part that acquires data obtained when the user walks, and a transceiver part that transmits the data to an external device and receives the audio signal from the external device.

Images