Information presentation device, information presentation method, and program

Abstract

An information presentation device according to one embodiment includes: a determination unit for determining a landing state of a user on the basis of foot pressure data acquired according to landing of the user; an update unit for updating a pattern of presentation information for presenting the landing state to a tactile sense of the user in a second period following a first period on the basis of a plurality of determination results in the first period; and a generation unit for generating presentation information according to the landing state determined in the second period on the basis of the updated pattern.

Description

Information Presentation Device, Information Presentation Method, and Program

[0001] Embodiments relate to an information presentation device, an information presentation method, and a program.

[0002] As sports that can be easily started without special equipment, walking and running are known. Because of their ease, walking and running have a large number of competitors, but many people start on their own. Therefore, as a result of walking and running with an incorrect form in which the sole of the foot is not landing correctly, it is often the case that the foot is injured.

[0003] In order to prevent such foot injuries, support technologies have been proposed that allow users to acquire the correct form by providing feedback on the landing state of the sole of the foot.

[0004] For example, Non-Patent Document 1 discloses visualizing the current form from video data and ground reaction force data and utilizing the obtained analysis results in the next training.

[0005] Also, for example, Non-Patent Document 2 discloses determining the landing state in a timely manner using a shoe-type foot pressure sensor and providing feedback by sound information for inappropriate landings.

[0006] Isao Matsumura, Kento Kawabe, Hirofumi Kanda, "Attempts to correct running motion using a pneumatic body weight unloading treadmill: In the case of university women's middle distance runners with heel strike", Sports Performance Research, 14, 82-96, 2022. Masato Tsuchiya, Shuhei Tsuchitani, "Design research on a running form correction system", Design Research of the Japan Society of Designers, BULLETIN OF JSSD 2019. Taha Moriyama, Tetsushi Takahashi, Hiroyuki Kajiimoto, "Development of a high-resolution tactile vest that transfers the touch of fingertips to the back", The 24th Virtual Reality Society, 6A-02, 20l9.

[0007] According to Non-Patent Document 1, athletes will check their form after training. Therefore, although it is understandable that the landing state is inappropriate, how to improve it in the next training is left to the user's trial and error.

[0008] Furthermore, according to Non-Patent Literature 2, real-time feedback allows the user to recognize that the landing was inappropriate. However, the user is not provided with information on how the landing was inappropriate.

[0009] The present invention has been made in view of the above circumstances, and its purpose is to provide an information display device, an information display method, and a program that display the user's landing status in real time.

[0010] One embodiment of the information presentation device comprises a determination unit, an update unit, and a generation unit. The determination unit determines the user's landing state based on foot pressure data acquired in response to the user's landing. The update unit updates the pattern of presentation information for presenting the landing state to the user's sense of touch in a second period following the first period, based on multiple determination results in the first period. The generation unit generates presentation information corresponding to the landing state determined in the second period, based on the updated pattern.

[0011] According to the embodiment, it is possible to provide an information display device, an information display method, and a program that display the user's landing status in real time.

[0012] Figure 1 is a schematic diagram showing an example of the configuration of a training system including an information display device according to the embodiment. Figure 2 is a schematic diagram showing an example of the arrangement of foot pressure sensors included in the training system according to the embodiment. Figure 3 is a schematic diagram showing an example of the arrangement of vibration elements in a wearable device included in the training system according to the embodiment. Figure 4 is a block diagram showing an example of the hardware configuration of the information display device according to the embodiment. Figure 5 is a block diagram showing an example of the functional configuration of the information display device according to the embodiment. Figure 6 is a schematic diagram showing an example of a landing state determined by the information display device according to the embodiment. Figure 7 is a diagram showing an example of the data structure of the determination history stored in the information display device according to the embodiment. Figure 8 is a diagram showing an example of presentation information corresponding to the overall presentation pattern from the pattern list stored in the information display device according to the embodiment. Figure 9 is a diagram showing an example of presentation information corresponding to the left and right presentation patterns from the pattern list stored in the information display device according to the embodiment. Figure 10 is a flowchart showing an example of information presentation processing in the information display device according to the embodiment. Figure 11 is a schematic diagram showing an example of the relationship between the landing state determined by the information display device according to the embodiment and the presentation pattern. Figure 12 is a schematic diagram showing an example of the configuration of a training system including an information presentation device according to the first modified example. Figure 13 is a diagram showing an example of presentation information corresponding to the overall presentation pattern from the pattern list stored in the information presentation device according to the second modified example. Figure 14 is a schematic diagram showing an example of the arrangement of vibration elements in a wearable device included in the information presentation device according to the third modified example. Figure 15 is a diagram showing an example of presentation information corresponding to the left and right presentation patterns from the pattern list stored in the information presentation device according to the third modified example.

[0013] Embodiments will be described below with reference to the drawings. In the following description, components having the same function and configuration will be denoted by the same reference numerals.

[0014] 1. Embodiment First, an information display device according to an embodiment will be described.

[0015] 1.1 Configuration 1.1.1 Training System Figure 1 is a schematic diagram showing an example of the configuration of a training system including an information presentation device according to an embodiment.

[0016] Training system 1 is, for example, equipment for a user USR to perform walking and running indoors. As shown in Figure 1, training system 1 includes a treadmill™, a head-mounted display HMD, a foot pressure sensor FS, a wearable device WD, and an information display device 10.

[0017] The Treadmill™ is a device for users (USRs) to perform walking and running training. The Treadmill™ includes, for example, a running section and a display section. The display section has a touch panel for setting the running speed and course incline, and a display for showing various information. The running section rotates according to the speed set on the display section, enabling the user (USR) to simulate running. The running section is also configured to tilt according to the incline set on the display section.

[0018] A head-mounted display (HMD) is a device worn on the head that presents virtual visual information to the user (USR). For example, the HMD may be linked with a treadmill™ to present virtual scenery corresponding to the user's distance traveled, or it may present various types of information similar to those displayed on the treadmill™'s display.

[0019] The foot pressure sensor FS is a pressure sensor embedded in the sole of the shoes worn by the user USR. The foot pressure sensor FS measures the load applied to the feet during walking and running. The foot pressure sensor FS measures the load each time the right and left feet land, and outputs the measurement results as sensor data to the information display device 10.

[0020] Figure 2 is a schematic diagram showing an example of the arrangement of foot pressure sensors included in the training system according to the embodiment. Figure 2 shows the arrangement of the foot pressure sensors FS on the right foot, of which both feet are provided. As shown in Figure 2, multiple foot pressure sensors FS are distributed across the entire sole of the foot. Each of the multiple foot pressure sensors FS measures the load applied to the location where it is placed.

[0021] The sole of the foot is divided into three regions: A1, A2, and A3. Region A1 is the area from the phalanges to the metatarsals and is also called the forefoot area. Region A2 is the area near the navicular bone and is also called the middle area. Region A3 is the area near the calcaneus and is also called the heel area.

[0022] Multiple foot pressure sensors FS are arranged to be evenly distributed across the three regions A1, A2, and A3 described above. In the example shown in Figure 2, nine foot pressure sensors FS are arranged in each of regions A1, A2, and A3.

[0023] A wearable device WD is a garment-type device configured to provide vibrations to a user USR. The wearable device WD includes, for example, multiple vibration elements VE. Each vibration element VE is, for example, an element that receives an electrical signal as input and generates vibrations of a degree perceptible to humans.

[0024] The wearable device WD vibrates multiple vibration elements VE based on information presented from the information display device 10. The vibration of the multiple vibration elements VE allows the user USR to understand which of the areas A1, A2, and A3 of the sole of their foot is making contact with the ground when walking or running.

[0025] Figure 3 is a schematic diagram showing an example of the arrangement of vibration elements in a wearable device included in the training system according to the embodiment. The left side (A) of Figure 3 shows the arrangement area A4 of the vibration elements VE within the wearable device WD, when the user USR is viewed from below. The right side (B) of Figure 3 shows an example of the arrangement of vibration elements VE in the arrangement area A4 located on the back of the user USR within the wearable device WD.

[0026] As shown in the left side (A) of Figure 3, the area A4 where the vibration element VE is located is provided on the back of the user USR while wearing the wearable device WD.

[0027] As shown in the right side (B) of Figure 3, the placement area A4 extends across the entire back surface of the user USR. In the example in Figure 3, 20 vibration elements VE are arranged in a matrix of 5 rows and 4 columns within the placement area A4.

[0028] The wearable device WD can operate multiple vibration elements VE individually and independently based on information presented from the information presentation device 10. This allows the vibration element VE to be changed according to the landing state of the user USR, and the user USR can be presented with differences in the landing state.

[0029] The information display device 10 is, for example, an information processing device such as a PC or a server. Based on sensor data from the foot pressure sensor FS, the information display device 10 generates display information to vibrate multiple vibration elements VE. The information display device 10 outputs the generated display information to the wearable device WD. Hereinafter, the series of processes performed in the information display device 10, from the acquisition of sensor data to the output of display information, will also be referred to as the information display process.

[0030] 1.1.2 Information Display Device Next, the configuration of the information display device 10 will be described.

[0031] Figure 4 is a block diagram showing an example of the hardware configuration of an information display device according to the embodiment.

[0032] As shown in Figure 4, the information display device 10 includes, for example, a control circuit 11, storage 12, a communication module 13, an interface 14, a drive 15, and a storage medium 16.

[0033] The control circuit 11 is a circuit that controls all components of the information display device 10 as a whole. The control circuit 11 includes a CPU (central processing unit), RAM (random access memory), and ROM (read-only memory), etc. The CPU of the control circuit 11 controls the entire information display device 10 according to the program stored in the ROM of the control circuit 11. The RAM of the control circuit 11 has a working area for the CPU of the control circuit 11. The ROM of the control circuit 11 stores programs and the like that used by the information display device 10.

[0034] The storage device 12 includes, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 12 stores information used in the information presentation processing by the information presentation device 10.

[0035] The communication module 13 is a circuit used for transmitting and receiving data between the information display device 10 and the foot pressure sensor FS and the wearable device WD. The communication module 13 may be configured to connect the information display device 10 to a network (not shown).

[0036] Interface 14 is an interface that manages communication with the administrator (not shown) of the information display device 10. Interface 14 includes input devices and output devices. Input devices include, for example, a keyboard, a touch panel, and operation buttons. Output devices include, for example, an LCD (Liquid Crystal Display) or EL (Electroluminescence) display, a printer, etc.

[0037] Drive 15 is a device for reading software stored on the storage medium 16. Drive 15 includes, for example, a CD (Compact Disk) drive or a DVD (Digital Versatile Disk) drive.

[0038] The storage medium 16 is a medium for storing software by electrical, magnetic, optical, mechanical, or chemical means. The storage medium 16 may also store programs used by the information presentation device 10.

[0039] Figure 5 is a block diagram showing an example of the functional configuration of an information presentation device according to this embodiment.

[0040] As shown in Figure 5, the control circuit 11 of the information display device 10 functions as a computer comprising an input unit 21, a calibration unit 22, a landing state determination unit 24, a display pattern update unit 26, a display information generation unit 27, and an output unit 29. The storage 12 of the information display device 10 stores calibration data 23, a determination history 25, and a pattern list 28.

[0041] The input unit 21 acquires foot pressure data from the foot pressure sensor FS. The input unit 21 outputs the acquired foot pressure data to the calibration unit 22.

[0042] The calibration unit 22 calibrates the foot pressure data by referring to the calibration data 23. The calibration unit 22 outputs the calibrated foot pressure data to the landing condition determination unit 24.

[0043] Specifically, for example, calibration data 23 stores the load applied to multiple foot pressure sensors FS located on each of the right and left feet while the user USR is stationary. The calibration unit 22 calculates a value by subtracting the load value stored in calibration data 23 from the acquired foot pressure data. Then, the calibration unit 22 calculates the average value of the calibrated foot pressure data corresponding to region A1, region A2, and region A3 for each of the right and left feet. The calibration unit 22 outputs the calculated average values ​​of the calibrated foot pressure data for each of the regions A1, A2, and A3 of the right foot, as well as the average values ​​of the calibrated foot pressure data for each of the regions A1, A2, and A3 of the left foot, to the landing state determination unit 24. For the sake of explanation, the average values ​​of the calibrated foot pressure data for each of the regions A1, A2, and A3 will also be referred to as the pressure values ​​for regions A1, A2, and A3, respectively.

[0044] The landing state determination unit 24 determines, as the landing state, in which of the regions A1, A2, and A3 the user USR lands when landing with each of the right foot and the left foot, based on the calibrated foot pressure data. The landing state determination unit 24 outputs the determination result to the presentation pattern update unit 26 and stores it in the determination history 25.

[0045] FIG. 6 is a diagram schematically showing an example of the landing state determined by the information presentation device according to the embodiment. In FIG. 6, when a load is applied to the right foot, cases where it is mainly determined that the landing is on regions A1, A2, and A3 are shown as the left part (A), the middle part (B), and the right part (C), respectively.

[0046] As shown in the left part (A) of FIG. 6, when the pressure value of the region A1 of the right foot is greater than the respective pressure values of the regions A2 and A3 of the right foot (that is, the pressure value of the region A1 of the right foot is the largest), the landing state determination unit 24 determines that the landing is on the region A1 of the right foot. Such a landing state is also called a forefoot. As shown in the middle part (B) of FIG. 6, when the pressure value of the region A2 of the right foot is greater than the respective pressure values of the regions A1 and A3 of the right foot (that is, the pressure value of the region A2 of the right foot is the largest), or when the pressure values of the regions A1 and A3 of the right foot are equal, the landing state determination unit 24 determines that the landing is on the region A2 of the right foot. Such a landing state is also called a midfoot. As shown in the right part (C) of FIG. 6, when the pressure value of the region A3 of the right foot is greater than the respective pressure values of the regions A1 and A2 of the right foot (that is, the pressure value of the region A3 of the right foot is the largest), the landing state determination unit 24 determines that the landing is on the region A3 of the right foot. Such a landing state is also called a heel strike.

[0047] In FIG. 6, the case where the landing state of the right foot is classified into three types: forefoot, midfoot, and heel strike has been described, but the same applies to the left foot. Thereby, the landing state determination unit 24 determines that for each of the right foot and the left foot, at the right time for each landing timing, it is in one of the three types of landing states.

[0048] FIG. 7 is a diagram showing an example of the data structure of the determination history stored in the information presentation device according to the embodiment. As shown in FIG. 7, in the determination history 25, a period, a landing state, and the number of determinations are stored in association with each other.

[0049] The period is a period to which the timing at which the determination process by the landing state determination unit 24 is executed belongs. The length of the period is predetermined, for example, 1 minute.

[0050] The landing state is the landing state determined as a result of the determination process by the landing state determination unit 24 (that is, forefoot, midfoot, and heel strike).

[0051] The number of determinations indicates the number of times that the same landing state has been determined within a predetermined period. That is, updating the determination history 25 based on the determination result by the landing state determination unit 24 is synonymous with incrementing the corresponding period, landing state, and the number of determinations associated with the foot.

[0052] In the example of FIG. 7, by referring to the determination history 25, it can be seen that in the period D1, the number of times the landing state is determined to be forefoot is 30 times for the right foot and 50 times for the left foot. In the period D1, it can be seen that the number of times the landing state is determined to be midfoot is 30 times for the right foot and 80 times for the left foot. In the period D1, it can be seen that the number of times the landing state is determined to be heel strike is 120 times for the right foot and 50 times for the left foot.

[0053] Similarly, in the period D2 following the period D1, it can be seen that the number of times the landing state is determined to be forefoot is 40 times for the right foot and 40 times for the left foot. In the period D2, it can be seen that the number of times the landing state is determined to be midfoot is 100 times for the right foot and 100 times for the left foot. In the period D2, it can be seen that the number of times the landing state is determined to be heel strike is 40 times for the right foot and 40 times for the left foot.

[0054] The presentation pattern update unit 26 refers to the judgment history 25 in accordance with the timing when the landing state determination process is performed by the landing state determination unit 24, and updates the presentation pattern used to present the landing state to the user USR in terms of the vibration form of the vibration element VE. The presentation pattern update process by the presentation pattern update unit 26 is performed at predetermined intervals. Specifically, for example, the presentation pattern update unit 26 updates the presentation pattern in accordance with the period (D1, D2, ...) for which the number of determinations is stored in the judgment history 25.

[0055] Specifically, for example, when the presentation pattern update unit 26 updates the presentation pattern to be presented to the user USR during a certain period, it uses the period immediately preceding that period for updating the presentation pattern. The presentation pattern update unit 26 updates the presentation pattern with the presentation pattern corresponding to the landing state with the most judgment counts within the period used for updating.

[0056] In the example in Figure 7, during period D1, the most frequently judged landing state for the left foot is a heel strike, and the most frequently judged landing state for the right foot is a middle foot. Therefore, the presentation pattern update unit 26 applies a presentation pattern to the user USR during period D2, which follows period D1, that indicates that the landing state for the left foot is a heel strike and the landing state for the right foot is a middle foot. In the following, presentation patterns that represent different landing states for the right and left feet, as in the example based on the judgment results of period D1, are also called left and right presentation patterns.

[0057] Furthermore, in period D2, the most frequently determined landing state for both the left and right feet is the middle foot. Therefore, the presentation pattern update unit 26 applies a presentation pattern to the user USR in period D3, which follows period D2, that indicates that both the left and right feet are landing in the middle foot position. In the following examples, a presentation pattern that shows the same landing state for both the right and left feet is also called the overall presentation pattern.

[0058] The presentation information generation unit 27 reads presentation information to be presented to the wearable device WD from the pattern list 28 at each timing when the landing state is determined. If the latest presentation pattern updated by the presentation pattern update unit 26 is a left / right presentation pattern, the presentation information generation unit 27 reads presentation information corresponding to the left / right presentation pattern from the pattern list 28. If the latest presentation pattern updated by the presentation pattern update unit 26 is an overall presentation pattern, the presentation information generation unit 27 reads presentation information corresponding to the overall presentation pattern from the pattern list 28. The presentation information generation unit 27 outputs the presentation information read from the pattern list 28 to the output unit 29.

[0059] Figure 8 shows an example of presentation information corresponding to the overall presentation pattern from the pattern list stored in the information presentation device according to the embodiment. Figure 9 shows an example of presentation information corresponding to the left and right presentation patterns from the pattern list stored in the information presentation device according to the embodiment. In Figures 8 and 9, the areas corresponding to the vibrating vibrating element VE among the multiple vibrating elements VE arranged in the arrangement area A4 are hatched to indicate the landing state of the right and left feet, respectively.

[0060] First, let's refer to Figure 8 to explain when the overall presentation pattern is applied.

[0061] When the overall presentation pattern is applied, the same presentation information is stored in pattern list 28 whether the landing state of the right foot or the landing state of the left foot is determined. A specific example is shown below.

[0062] Pattern (a): Regardless of whether it is the right or left foot, if the landing state is forefoot, information indicating that the eight vibrating elements VE located in the rows corresponding to the upper part of the placement area A4 (rows 1-2 in the example of Figure 8) are to be vibrated is stored in association with the pattern.

[0063] Pattern (b): Regardless of whether it is the right or left foot, if the landing state is midfoot, information indicating that the 12 vibrating elements VE located in the rows corresponding to the central part of the placement area A4 (rows 2-4 in the example in Figure 8) are vibrated is associated and stored.

[0064] - Pattern (c): Regardless of whether it is the right or left foot, if the landing condition is a heel strike, information indicating that the eight vibration elements VE located in the rows corresponding to the lower part of the placement area A4 (rows 4-5 in the example in Figure 8) are to be vibrated is associated and stored.

[0065] Next, with reference to Figure 9, we will explain the case in which the left-right presentation pattern is applied.

[0066] When the left / right presentation pattern is applied, different presentation information is stored in the pattern list 28 depending on whether the landing state of the left foot or the landing state of the right foot is determined. A specific example is shown below.

[0067] • Pattern (d): When the left foot lands in a forefoot position, information indicating that the four vibration elements VE located in the rows corresponding to the upper left portion of the placement area A4 (in the example in Figure 9, rows 1-2 and columns 1-2) are to be vibrated is stored in association with the pattern.

[0068] - Pattern (e): When the right foot lands on the forefoot, information indicating that the four vibration elements VE located in the rows corresponding to the upper right portion of the placement area A4 (in the example in Figure 9, rows 1-2 and columns 3-4) are to be vibrated is stored in association with the pattern.

[0069] - Pattern (f): When the left foot lands in a midfoot position, information is associated with and stored indicating that the six vibrating elements VE located in the rows corresponding to the left half of the central part of the placement area A4 (in the example in Figure 9, rows 2-4 and columns 1-2) should be vibrated.

[0070] - Pattern (g): When the right foot lands in a midfoot position, information is associated with and stored that indicates that the six vibrating elements VE located in the rows corresponding to the right half of the central part of the placement area A4 (in the example in Figure 9, rows 2-4 and columns 3-4) should be vibrated.

[0071] - Pattern (h): When the left foot lands in a heel strike position, information is associated with and stored that indicates that the four vibration elements VE located in the rows corresponding to the lower left portion of the placement area A4 (in the example in Figure 9, rows 4-5 and columns 1-2) should be vibrated.

[0072] Pattern (i): When the right foot lands in a heel strike position, information indicating that the four vibration elements VE located in the rows corresponding to the lower right portion of the placement area A4 (in the example in Figure 9, rows 4-5 and columns 3-4) are to be vibrated is stored in association with the pattern.

[0073] The output unit 29 outputs the presentation information received from the presentation information generation unit 27 to the wearable device WD.

[0074] With the above configuration, the information display device 10 can determine the landing state each time a foot lands based on foot pressure data and output display information corresponding to the determination result to the wearable device WD. Furthermore, the information display device 10 can determine a display pattern from the user USR's landing state trends observed over the most recent period and output display information corresponding to the latest display pattern to the wearable device WD. As a result, the user USR can understand the trends in their landing state through the vibration pattern of the vibration element VE placed on the wearable device WD.

[0075] 1.2 Operation Next, the operation of the information display device 10 will be described.

[0076] 1.2.1 Flowchart 10 is a flowchart illustrating an example of information presentation processing in an information presentation device according to an embodiment.

[0077] When the user USR starts walking or running training using the training system 1 (start), the input unit 21 acquires foot pressure data from the foot pressure sensor FS worn by the user USR (S11).

[0078] The calibration unit 22 calibrates the foot pressure data acquired in the S11 process based on the calibration data 23 (S12). The S12 process eliminates the influence of differences in user USR weight and other factors from the calibrated foot pressure data.

[0079] The landing state determination unit 24 determines the landing state (S13) based on the calibrated foot pressure data obtained in the processing of S12. This determines whether the landing state during walking or running by the user USR is forefoot, midfoot, or heel strike.

[0080] The landing state determination unit 24 stores the determination result from the processing in S13 in the determination history 25 (S14). The information stored in the determination history 25 includes a count value of the number of times the same landing state was determined to occur during a predetermined period (for example, 1 minute).

[0081] The presentation pattern update unit 26 determines whether or not to update the presentation pattern that shows the trend of the most recent landing state by the user USR (S15). Specifically, the presentation pattern update unit 26 determines whether or not the measurement period of the count value stored in the determination history 25 in the processing of S14 has expired for a predetermined period.

[0082] If it is determined that the presentation pattern needs to be updated (i.e., the measurement period for the count value has reached the end of a predetermined period) (S15; yes), the presentation pattern update unit 26 updates the presentation pattern based on the determination history 25 (S16). Specifically, if the most frequent landing state for the left foot and the most frequent landing state for the right foot are the same during the latest measurement period for the count value, the presentation pattern update unit 26 applies the overall presentation pattern to the presentation pattern. If the most frequent landing state for the left foot and the most frequent landing state for the right foot are different during the latest measurement period for the count value, the presentation pattern update unit 26 applies the left and right presentation patterns to the presentation pattern.

[0083] After the processing in S16, or if it is determined that the presentation pattern will not be updated (S15; no), the presentation information generation unit 27 refers to the pattern list 28 and generates presentation information corresponding to the landing state determined in the processing in S13 and the latest presentation pattern combination (S17).

[0084] The output unit 29 outputs the presentation information generated in the processing of S17 to the wearable device WD (S18).

[0085] The information display device 10 determines whether or not the walking or running training by the user USR using the training system 1 has been completed (S19).

[0086] If the training is not yet complete (S19; no), the input unit 21 acquires foot pressure data from the foot pressure sensor FS worn by the user USR (S11). Then, the subsequent processes S12 to S19 are executed. In this way, processes S11 to S19 are repeatedly executed until the training is completed.

[0087] If the training is completed (S19; yes), the information presentation process ends (end).

[0088] 1.2.2 Specific Example Figure 11 schematically shows an example of the relationship between the landing state determined by the information presentation device according to the embodiment and the presentation pattern. In Figure 11, as an example, the presentation information to the user USR is shown when the presentation pattern is updated based on the determination history 25 shown in Figure 7.

[0089] As shown in Figure 11, during period D2 when the left / right presentation patterns are applied, each time the left or right foot lands, a presentation pattern is selected in the placement area A4 of the wearable device WD that simultaneously identifies the left / right foot that landed and the landing state. More specifically, the first of the four steps shown in period D2 is the left foot, and the landing state is determined to be a midfoot. Therefore, the user USR receives tactile sensation corresponding to pattern (f) shown in Figure 9. The second of the four steps shown in period D2 is the right foot, and the landing state is determined to be a midfoot. Therefore, the user USR receives tactile sensation corresponding to pattern (g) shown in Figure 9. The third of the four steps shown in period D2 is the left foot, and the landing state is determined to be a forefoot. Therefore, the user USR receives tactile sensation corresponding to pattern (d) shown in Figure 9. The fourth of the four steps shown in period D2 is the right foot, and the landing state is determined to be a heel strike. Therefore, the user USR is given tactile sensations corresponding to pattern (i) shown in Figure 9.

[0090] Thus, in period D2, the left / right presentation pattern is applied because the landing tendencies differed between the left and right sides in the preceding period D1. This allows user USR to make modifications in period D2 so that the left and right landing states become identical (i.e., so that the overall presentation pattern is applied in the subsequent period D3).

[0091] During period D3, when the overall presentation pattern is applied, a presentation pattern is selected for the placement area A4 of the wearable device WD that allows for the identification of only the landing state, without distinguishing between the left and right feet that landed. More specifically, the landing state of the first and second steps of the four steps illustrated during period D3 is determined to be midfoot. Therefore, the user USR is given tactile sensations corresponding to pattern (b) shown in Figure 8. The landing state of the third step of the four steps illustrated during period D3 is determined to be forefoot. Therefore, the user USR is given tactile sensations corresponding to pattern (a) shown in Figure 8. The landing state of the fourth step of the four steps illustrated during period D3 is determined to be heel strike. Therefore, the user USR is given tactile sensations corresponding to pattern (c) shown in Figure 8.

[0092] Thus, in period D3, the overall presentation pattern is applied because the landing tendency was consistent on both the left and right sides in the preceding period D2. This allows the user USR to continue walking or running while concentrating on their landing state, such as ensuring that their landing state stabilizes on the midfoot.

[0093] By continuing the actions described above, the user (USR) can recognize the ideal landing state through the presented information.

[0094] 1.3 According to the embodiment of the effect, the landing state determination unit 24 determines the landing state of the user USR based on foot pressure data acquired in response to the user USR's landing. The presentation pattern update unit 26 updates the pattern of presentation information for presenting the landing state to the user USR's sense of touch in period D2 following period D1, based on the multiple determination results by the landing state determination unit 24 in period D1. The presentation information generation unit 27 generates presentation information corresponding to the landing state determined by the landing state determination unit 24 in period D2, based on the pattern updated by the presentation pattern update unit 26. As a result, the user USR can recognize their own landing state through touch each time they land.

[0095] Furthermore, the presented information is information for vibrating multiple vibration elements VE placed on the wearable device WD worn by the user USR. The presented pattern, which is updated based on the judgment results of period D1, associates the vibration elements VE to be vibrated in period D2 with the tendency of the user USR's landing state in period D1. Specifically, the presented pattern update unit 26 updates to an overall presented pattern if the landing state most frequently determined for the right foot matches the landing state most frequently determined for the left foot, and updates to a left / right presented pattern if they are different. This allows the user USR to be prompted to learn a more correct form if the landing state is inappropriate. Therefore, the judgment results of the landing state based on the sensing results from the soles of the feet can be fed back to other body parts in real time, enabling the user USR to learn the correct landing form.

[0096] 2. Modifications, etc. The above-described embodiments can be modified in various ways.

[0097] The following section will primarily describe configurations and operations that differ from those of the embodiments. Descriptions of configurations and operations equivalent to those of the embodiments will be omitted as appropriate.

[0098] 2.1 First Modification In the above-described embodiment, the user USR was presented with tactile information via a vibration element VE implemented in the wearable device WD as presented information, but the user is not limited to this. For example, the user USR may be presented with visual or other sensory information as presented information.

[0099] Figure 12 is a schematic diagram showing an example of the configuration of a training system including an information presentation device according to the first modified example. Figure 12 corresponds to Figure 1 in the embodiment. As shown in Figure 12, the training system 1 may further include a control device 30.

[0100] The control device 30 is configured to control the treadmill™ and head-mounted display HMD based on the information output from the information display device 10. For example, based on the information output, the control device 30 causes the treadmill™ and head-mounted display HMD to display information that can visually present the landing state to the user USR, such as as shown in Figure 6, each time the user USR lands. This allows the user USR to understand their landing state through visual information in addition to tactile information, and to easily correct their walking or running to an ideal state.

[0101] 2.2 Second Modification In the above embodiment, the case in which multiple presentation patterns are mapped to the arrangement area A4 by using all of the evenly distributed vibrating elements VE has been described, but the invention is not limited to this. For example, in order to make the identification of the presentation patterns by the user USR clearer, some of the evenly distributed vibrating elements VE may be left unused when mapping multiple presentation patterns to the arrangement area A4.

[0102] Figure 13 shows an example of presentation information corresponding to the overall presentation pattern from the pattern list stored in the information presentation device according to the second modified example. Figure 13 corresponds to Figure 8 in the embodiment.

[0103] As shown in Figure 13, the three landing states may have a nonlinear (asymmetrical) mapping to the placement region A4. Furthermore, there may be a vibration element VE that does not vibrate in any of the landing states. Specific examples are shown below.

[0104] • Pattern (a'): Regardless of whether it is the right or left foot, if the landing state is forefoot, information indicating that the four vibrating elements VE located in the row corresponding to the upper part of the placement area A4 (the first row in the example of Figure 13) are to be vibrated is associated and stored.

[0105] • Pattern (b'): Regardless of whether it is the right or left foot, if the landing state is midfoot, information indicating that the four vibrating elements VE located in the row corresponding to the central part of the placement area A4 (the third row in the example in Figure 13) are to be vibrated is associated and stored.

[0106] - Pattern (c'): Regardless of whether it is the right or left foot, if the landing condition is a heel strike, information indicating that the eight vibrating elements VE located in the rows corresponding to the lower part of the placement area A4 (rows 4-5 in the example in Figure 13) are vibrated is stored in association with this pattern.

[0107] As described above, by adjusting the relationship between the landing state and the presented pattern, it is possible to achieve arbitrary mapping that makes it easier for the user (USR) to identify the presented pattern.

[0108] 2.3 Third Modification In addition, the above-described embodiment has described a case in which the vibration element VE is arranged on the back of the wearable device WD, but it is not limited to this. For example, the vibration element VE may be arranged on both the front and back surfaces of the wearable device WD.

[0109] Figure 14 is a schematic diagram showing an example of the arrangement of vibration elements in a wearable device included in the training system according to the third modified example. Figure 14 corresponds to the left part (A) of Figure 3 in the embodiment.

[0110] As shown in Figure 14, the wearable device WD is provided with a placement area A4 on the back of the user USR, and a further placement area A5 may be provided on the front of the user USR.

[0111] In this case, the pattern list 28 can store presentation patterns that allow the user USR to distinguish between three types of landing states and between the left and right feet by using placement areas A4 and A5 appropriately.

[0112] Figure 15 shows an example of presentation information corresponding to the left and right presentation patterns from the pattern list stored in the information presentation device according to the third modified example. Figure 15 corresponds to Figure 9 in the embodiment.

[0113] As shown in Figure 15, depending on the landing condition, the vibrating element VE placed in one or both of the placement areas A4 and A5 may be vibrated. Furthermore, the strength of the vibration of the vibrating element VE may be adjusted for each landing condition. Specific examples are shown below.

[0114] • Pattern (d"): When the left foot lands in a forefoot position, information indicating that the 10 vibration elements VE located in the rows corresponding to the left half of the placement area A5 (columns 1-2 in the example in Figure 15) are to be strongly vibrated is associated and stored.

[0115] - Pattern (e''): When the right foot lands in a forefoot position, information indicating that the 10 vibration elements VE located in the rows corresponding to the right half of the placement area A5 (in the example in Figure 15, columns 3-4) are to be strongly vibrated is associated and stored.

[0116] - Pattern (f''): When the left foot lands in a midfoot position, information is associated with and stored that indicates that the 20 vibration elements VE located in the rows corresponding to the left half of each of the placement areas A4 and A5 (columns 1-2 in the example in Figure 15) should be vibrated weakly.

[0117] - Pattern (g''): When the right foot lands in a midfoot position, information is associated with and stored that indicates that the 20 vibration elements VE located in the rows corresponding to the right half of each of the placement areas A4 and A5 (in the example in Figure 15, columns 3-4) should be vibrated weakly.

[0118] - Pattern (h''): When the left foot lands in a heel strike position, information indicating that the 10 vibration elements VE located in the rows corresponding to the left half of the placement area A4 (columns 1-2 in the example in Figure 15) are to be strongly vibrated is stored in association with this information.

[0119] - Pattern (i"): When the right foot lands in a heel strike position, information indicating that the 10 vibration elements VE located in the rows corresponding to the right half of the placement area A4 (columns 3-4 in the example in Figure 15) are to be strongly vibrated is associated and stored.

[0120] As described above, by adjusting the relationship between the landing state and the presented pattern, it is possible to achieve arbitrary mapping that makes it easier for the user (USR) to identify the presented pattern.

[0121] 2.4 Other embodiments described above have described a case in which one vibration element VE is placed in each section of the arrangement area A4, but the embodiment is not limited to this. For example, multiple vibration elements VE may be placed in each section of the arrangement area A4.

[0122] Furthermore, although the above-described embodiment described a case in which the program for performing information presentation processing is executed on the information presentation device 10, it is not limited to this. For example, the program for performing information presentation processing may be executed on computing resources on a cloud configured in a network (not shown).

[0123] It should be noted that the present invention is not limited to the embodiments described above, and can be modified in various ways during implementation without departing from its essence. Furthermore, each embodiment may be combined as appropriate, and in that case, the combined effects can be obtained. Moreover, the above embodiments include various inventions, and various inventions can be extracted by selecting combinations from the multiple constituent elements disclosed. For example, if the problem can be solved and effects obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiment, then the configuration with these deleted constituent elements can be extracted as an invention.

[0124] 1...Training system 10...Information display device 11...Control circuit 12...Storage 13...Communication module 14...Interface 15...Drive 16...Storage medium 21...Input unit 22...Calibration unit 23...Calibration data 24...Landing state determination unit 25...Determination history 26...Presentation pattern update unit 27...Presentation information generation unit 28...Pattern list 29...Output unit 30...Control device

Claims

1. An information presentation device comprising: a determination unit that determines the user's landing state based on foot pressure data acquired in response to the user's landing; an update unit that updates a pattern of presentation information for presenting the landing state to the user's sense of touch in a second period following the first period, based on multiple determination results in the first period; and a generation unit that generates presentation information corresponding to the landing state determined in the second period based on the updated pattern.

2. The information presentation device according to claim 1, wherein the presented information is information for causing a plurality of vibrating elements arranged in a wearable device worn by the user to vibrate, and the pattern associates the vibrating elements among the plurality of vibrating elements to be vibrated in the second period with the tendency of the user's landing state in the first period.

3. The information presentation device according to claim 2, wherein the update unit is configured to apply a first pattern if, with respect to the multiple judgment results, the landing state most frequently determined for the right foot matches the landing state most frequently determined for the left foot, and to apply a second pattern different from the first pattern if, with respect to the multiple judgment results, the landing state most frequently determined for the right foot is different from the landing state most frequently determined for the left foot.

4. The generation unit is configured to generate first presentation information according to a first landing state determined with respect to the left foot, and to generate second presentation information according to a second landing state determined with respect to the right foot, wherein when the first pattern is applied and the first landing state and the second landing state are the same, the first presentation information and the second presentation information are the same, and when the second pattern is applied and the first landing state and the second landing state are the same, the first presentation information and the second presentation information are different from each other, as described in claim 3.

5. When the second pattern is applied, the first presented information is information for vibrating a vibrating element located on the left side of the wearable device among the plurality of vibrating elements, and the second presented information is information for vibrating a vibrating element located on the right side of the wearable device among the plurality of vibrating elements, as described in claim 4.

6. The information display device according to claim 1, wherein the displayed information further presents the landing state to the user's visual field.

7. A method for presenting information to a user using an information presentation device, comprising: determining the user's landing state based on foot pressure data acquired in response to the user's landing; updating a pattern of presentation information for presenting the landing state to the user's sense of touch in a second period following the first period, based on multiple determination results in the first period; and generating presentation information corresponding to the determined landing state in the second period based on the updated pattern.

8. A program for causing a computer to function as a component of the information presentation device described in any one of claims 1 to 6.

Images