Training support device, training support method, and training support program

Abstract

To support training in which a user learns a time point to start moving the body in response to the stimulation of an outer environment.SOLUTION: A training support device for supporting training in which a user moves the body in response to a presented stimulation by presenting sound to the user includes a holding part, a determination part, and a presentation part. The holding part holds an individual difference time, which is the time from a judgement to the start to move the body of the time from the time when the user makes the judgement about moving the body in response to the presentation of stimulation according to the training to the time when the user actually starts to move the body. The determination part determines a sound presentation time, which is a time for presenting sound to the user on the basis of the individual difference time, which has been held. The presentation part presents the stimulation according to the training to the user, and presents the sound for a time from the start of the presentation of the stimulation to the determined sound presentation time.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] One aspect of the present invention relates to a training support device, a training support method, and a training support program. [Background technology]

[0002] In training to learn physical skills in sports and exercise, that is, how to move the body, there are systems that use sounds to assist in learning how to move the body. For example, as shown in Non-Patent Document 1, a device is known that uses sounds to indicate whether the rhythm of a body movement is good or not when the body is moved. This device provides feedback to the user doing the training as to whether the movement of the golf club swing is good or not at the position where the sound is emitted. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "The sound will let you know the ideal impact! I tried out the Diamond Swing 525 TR-525 ♪ | Gridge ~ Bringing the fun of golf to everyone!", [online], [Searched June 19, 2023], Internet<URL:https: / / gridge.info / article / swing / detail.php?id=6933> Summary of the Invention [Problem to be solved by the invention]

[0004] To acquire physical skills, it is necessary to understand the focal point (when this stimulus is received, make this movement) while also having the body intuitively memorize it. In particular, it is important to master the point at which to begin moving the body in response to a stimulus from the external environment.

[0005] However, existing systems, including the device disclosed in Non-Patent Document 1, only provide feedback on the quality of a physical movement in almost real time, and are not able to train the point at which to start moving the body in response to stimuli in the external environment.

[0006] The present invention has been made in light of the above circumstances, and aims to provide a technique for supporting training that enables a user to learn the point at which they should start moving their body in response to a stimulus from the external environment. [Means for solving the problem]

[0007] In one aspect of the present invention to solve the above problem, a training support device that supports a user in training to move his or her body in response to a presented stimulus by presenting a sound to the user includes a storage unit, a determination unit, and a presentation unit. The storage unit stores an individual difference time, which is the time from when the user receives a presented stimulus corresponding to the training and decides to move his or her body to when the user actually starts moving the body, to when the user makes the decision to move the body. The determination unit determines a sound presentation time, which is the time for presenting a sound to the user, based on the stored individual difference time. The presentation unit presents a stimulus corresponding to the training to the user, and presents the sound for the determined sound presentation time from the start of presentation of the stimulus. Effect of the Invention

[0008] That is, according to one aspect of the present invention, a technique can be provided that assists in training for a user to learn the point at which they start moving their body in response to a stimulus from the external environment. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a training support system including a training support device according to a first embodiment of the present invention. [Diagram 2]FIG. 2 is a schematic diagram showing the transition of the user's state from when he receives a stimulus to when he finishes moving his body. [Diagram 3] FIG. 3 is a diagram for explaining sounds presented according to the physical skill of the user. [Figure 4] FIG. 4 is a block diagram showing an example of a hardware configuration of the training support device according to the first embodiment. [Diagram 5] FIG. 5 is a block diagram showing an example of a software configuration of the training support device according to the first embodiment. [Figure 6] FIG. 6 is a block diagram illustrating an example of the configuration of the presentation information storage unit of the training support device illustrated in FIG. [Figure 7] FIG. 7 is a diagram showing an example of the structure of a record for each user in the user table of the presentation information storage unit shown in FIG. [Figure 8] FIG. 8 is a flowchart showing an example of a processing procedure and processing content of the pre-measurement processing executed by the control unit of the training support device shown in FIG. [Figure 9] FIG. 9 is a diagram for explaining the sound generation algorithm. [Figure 10] FIG. 10 is a flowchart showing an example of a processing procedure and processing contents of the training support processing executed by the control unit of the training support device shown in FIG. [Figure 11] FIG. 11 is a block diagram showing an example of the software configuration of a training support device according to the second embodiment of the present invention. [Figure 12] FIG. 12 is a flowchart showing an example of a processing procedure and processing contents of the training support processing executed by the control unit of the training support device shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0011] [First embodiment] (Configuration example) (1) System FIG. 1 is a diagram showing an example of the configuration of a training support system including a training support device TS according to a first embodiment of the present invention.

[0012] The training support system is a system for supporting training to learn the time when to start moving the body in response to a stimulus from an external environment. The training support system includes a content presentation device CP, a stimulus presentation device SP, and a sensor group SG in addition to the training support device TS according to the first embodiment.

[0013] The content presentation device CP is connected to the training support device TS by wire or wirelessly, and video content and sound corresponding to the body movement being trained are supplied from the training support device TS. The content presentation device CP presents the supplied video content and sound to the user who is training. The content presentation device CP may include, for example, a display device such as a monitor, projector, or head mounted display that reproduces and outputs the video content, and a sound output device such as a speaker, earphones, or headphones that reproduces and outputs the sound.

[0014] The stimulus presentation device SP is connected to the training support device TS by wire or wirelessly, and receives from the training support device TS a stimulus presentation instruction corresponding to the body movement to be trained. The stimulus presentation device SP presents an external stimulus to the user according to the received stimulus presentation instruction. The stimulus presentation device SP may include devices that do not come into contact with the user, such as an electric fan, a water sprayer, a lamp, and a speaker, for simulating an external environment such as wind, rain, or thunder. The stimulus presentation device SP may also include devices that come into contact with the user or are worn by the user, for example, for providing a direct stimulus such as an electric current, heat, pressure, or vibration to any part of the user's body.

[0015] The sensor group SG is connected to the training support device TS by wire or wirelessly, and transmits detection data to the training support device TS. The sensor group SG detects the user's body movement. The sensor group SG may include sensors that do not contact the user, such as a camera that captures the user's body movement and a sensor that detects the movement of an instrument that moves following the user's body movement. The sensor group SG may also include sensors that are worn or attached to the user and directly detect the user's body state, such as the user's muscle current and brain waves, and sensors that detect the user's posture, such as a three-dimensional acceleration sensor.

[0016] Any content presentation device CP, stimulus presentation device SP, and sensor group SG can be appropriately selected and used depending on the training content corresponding to the physical skill that the user is to acquire.

[0017] (2) Training Support Device TS FIG. 2 is a schematic diagram showing the transition of the user's state from when he receives a stimulus to when he finishes moving his body.

[0018] When a user receives an external stimulus, the user decides to move the body in response to the stimulus, actually starts to move the body, moves with the rhythm of the movement, and ends the movement, and the state changes. In this state change, the user decides to move the body before the body actually starts to move, and there is a time lag T(Δ) between this decision and the start of the movement. This time lag T(Δ) is generally said to be about 200 ms (see, for example, "Tetsuya Ijiri, Kimitaka Nakazawa, "Timing Control in Baseball Batting," Journal of the Japanese Society of Neural Networks, Vol. 24, No. 3 (2017), 124-131"). In addition, there is a time lag from the stimulus to the decision, generally called the delay time T(H). For example, in baseball batting, the batter waits until an appropriate time after the ball is released by the pitcher before starting to swing the bat.

[0019] When trying to have a user learn body movements that undergo such state changes, the initiation of the movement and the movement in response to stimulation by an advanced user of the movement that the user wants to learn are registered as teacher data, and this teacher data is used to evaluate the user's movements and to indicate the timing for starting the movement.

[0020] The training support device TS according to this embodiment supports training to learn the time when to start moving the body in response to a stimulus from the external environment. To achieve this, the training support device TS according to this embodiment adopts the time T(M) from when a stimulus is presented until the body starts moving as teacher data, as shown in Fig. 2. The training support device TS according to this embodiment aims to present to the user, by sound, the timing to judge the actual start of movement from when a stimulus is presented so that the user can start moving in accordance with the time T(M) as the teacher data.

[0021] However, due to individual differences in familiarity and athletic ability, there are individual differences in the time lag T(Δ) between deciding to move and actually starting to move, so training must take this individual difference into account. FIG. 3 is a diagram for explaining the sound presentation according to the physical skill of the user. As shown in FIG. 3, a low-skilled person has a long time lag T(Δ), and a high-skilled person has a short time lag T(Δ). Therefore, in order to start moving in accordance with the time T(M) of the teacher data, a low-skilled person is only allowed a short delay time T(H) from stimulation to decision. Also, a high-skilled person is allowed a long delay time T(H).

[0022] Therefore, the training support device TS changes the sound indicating the timing at which the user should actually decide to start moving after receiving the stimulus based on the individual differences of the user so that the user starts moving in accordance with the time T(M) of the teacher data. Specifically, as shown in FIG. 3, the training support device TS presents a short sound, such as "tap", corresponding to a short hold time T(H) to a low-skilled person with a long time lag T(Δ). On the other hand, the training support device TS presents a long sound, such as "turn", corresponding to a long hold time T(H) to a high-skilled person with a short time lag T(Δ). In this way, the training support device TS generates a sound corresponding to the hold time T(H) so that the start of the movement matches the teacher data.

[0023] 4 and 5 are block diagrams showing an example of the hardware configuration and the software configuration, respectively, of the training support device TS according to the first embodiment of the present invention.

[0024] The training support device TS is, for example, a personal computer, and includes a control unit 1 using a hardware processor such as a central processing unit (CPU). A storage unit having a program storage unit 2 and a data storage unit 3, an input / output interface unit 4, and a communication interface unit 5 are connected to the control unit 1 via a bus 6. In the figure, the interface is abbreviated as IF.

[0025] An input device 41 and an output device 42 are connected to the input / output interface unit 4. The input device 41 includes, for example, a keyboard, a mouse, and operation buttons. The input device 41 is mainly used by the user to input his / her own training data and to input operation data for operating the training support device TS itself. Note that, as the input device 41, for example, an external storage medium such as a USB (Universal Serial Bus) memory or a mobile terminal such as a smartphone may be used.

[0026] The output device 42 includes, for example, a display, and displays display data required for inputting the above-mentioned training data and operation data.

[0027] The communication interface unit 5 transmits information to be presented and control data to the content presentation device CP and the stimulus presentation device SP via a wireless line under the control of the control unit 1, and also receives detection data from the sensor group SG. Note that the communication interface unit 5 can also be used to transmit and receive data to and from other terminals or server computers on the Web or in the cloud via a network.

[0028] As the wireless line, for example, a wireless interface adopting a low-power wireless data communication standard such as WiFi (registered trademark) or Bluetooth (registered trademark) is used, but other wireless interfaces may be used. Furthermore, the communication interface unit 5 may be connected to the content presentation device CP, the stimulus presentation device SP, and the sensor group SG by wired connection such as a signal cable in addition to wireless connection.

[0029] The program storage unit 2 is configured by combining, for example, a non-volatile memory such as a solid state drive (SSD) as a storage medium that can be written and read at any time, and a non-volatile memory such as a read only memory (ROM). The program storage unit 2 stores application programs necessary for the training support control according to the first embodiment, in addition to middleware such as an operating system (OS). Hereinafter, the OS and each application program will be collectively referred to as a program.

[0030] The data storage unit 3 is configured by combining, for example, a non-volatile memory such as an SSD that can be written and read at any time as a storage medium, with a volatile memory such as a RAM (Random Access Memory). In the storage area of ​​the data storage unit 3, a presentation information storage unit 31, a teacher data storage unit 32, and a usage history storage unit 33 are prepared as main storage units required to implement the first embodiment of the present invention.

[0031] 6 is a block diagram showing an example of the configuration of the presentation information storage unit 31. The presentation information storage unit 31 includes a presentation information database 311 and a user table 312. In the figure, the database is abbreviated as DB.

[0032] The presentation information database 311 stores information on images, sounds, and stimuli to be presented to a user for each use content ID uniquely set for each training content. For example, if the training content is for learning the relationship between stimuli and timing for performing a form of bending the knees when strong winds come in in windsurfing, the presentation information database 311 stores information such as an image of the ocean and wind strength as stimuli. If the training content is for learning the relationship between stimuli and timing for performing a swing when a pitcher throws a ball in baseball as a batter, the presentation information database 311 stores information such as an image of the pitcher throwing the ball from the front and electric current stimuli applied to a part of the body as stimuli. If the training content is for learning the relationship between stimuli and timing for performing a jump when a shot is taken in soccer as a goalkeeper, the presentation information database 311 stores information such as an image of an opponent shooting as a video and electric current stimuli applied to a part of the body as stimuli. In addition, if the training content is to learn the relationship between the stimulus and timing of countering when the opponent throws a punch in boxing, the presentation information database 311 stores information such as a video of the opponent throwing a punch and an electric current stimulus applied to a part of the body as the stimulus.

[0033] The user table 312 is used to register information about a user. FIG. 7 is a diagram showing an example of the configuration of a record 312R for each user in the user table 312. As shown in FIG. 7, the user table 312 registers, for each user ID uniquely set for each user, a usage content ID used in the presentation information database 311 for identifying training content, a time lag T(Δ) that is the user's current physical skill, and a delay time T(H) that indicates the length of a sound presented during training. Note that, although FIG. 7 shows only one time lag T(Δ) and one delay time T(H), when there are multiple stimuli to be presented to the user, these are registered by the number of stimuli.

[0034] The teacher data storage unit 32 stores time T(M) for each used content ID as teacher data to be used for each training.

[0035] The usage history storage unit 33 stores, for each user ID, the user's movements measured during training.

[0036] Although not specifically shown in the figure, the memory area of ​​the data memory unit 3 also includes a temporary memory unit serving as a work memory for temporarily storing various information generated during processing by the processing unit that the control unit 1, which is provided as a processing function thereof as described below, has.

[0037] The control unit 1 includes, as processing functions necessary for carrying out the first embodiment of the present invention, a usage data acquisition processing unit 11, a presentation information determination processing unit 12, a presentation processing unit 13, a posture acquisition processing unit 14, a motion detection processing unit 15, and a stimulus update processing unit 16. All of these processing units 11 to 16 are realized by causing a hardware processor of the control unit 1 to execute a program stored in the program storage unit 2.

[0038] In addition, some or all of the above processing units 11 to 16 may be realized using hardware such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (field-programmable gate array), or a GPU (Graphics Processing Unit).

[0039] The usage data acquisition processing unit 11 acquires information such as a user ID for identifying the user, a content ID for specifying the training to be performed, and a system mode input by the user via the input / output interface unit 4. The system mode may include training-related conditions such as the number of repetitions when a practice movement is repeated multiple times in one training session, whether or not to update the sound depending on the training result, i.e., the physical skill updated by the training, and a sound update algorithm indicating what kind of update is to be performed if the sound is updated. It is not essential for the user to input all of these training-related conditions, and default conditions are used for conditions that are not input.

[0040] The presentation information determination processing unit 12 determines information to be presented to the user from the information stored in the presentation information storage unit 31 based on the information acquired by the utilization data acquisition processing unit 11, and reads out the information and its presentation form. Furthermore, the presentation information determination processing unit 12 acquires, for example, the file name and playback time of the video file for the video to be played. Furthermore, the presentation information determination processing unit 12 acquires, for example, the playback time, the type and strength of the stimulus, and the type and strength of the sound for the stimulus and sound. When a stimulus is presented multiple times in one practice motion, the information on the stimulus and sound is acquired for the number of times. Furthermore, the number of stimuli may be multiple, and for each stimulus, information on the stimulus and sound for the number of times may be acquired.

[0041] The presentation processing unit 13 transmits video and sound to the content presentation device CP via the communication interface unit 5 based on the presentation information determined by the presentation information determination processing unit 12, and causes the content presentation device CP to present the video and sound. The presentation processing unit 13 also transmits a stimulus to the stimulus presentation device SP via the communication interface unit 5 based on the presentation information determined by the presentation information determination processing unit 12, and causes the stimulus presentation device SP to present the stimulus. The presentation processing unit 13 presents video, sound, and stimulus at each time. For example, the presentation processing unit 13 updates the presentation content 20 times per second (20 fps).

[0042] The posture acquisition processing unit 14 receives sensor data, which is a detection result from the sensor group SG and indicates the posture of the user, via the communication interface unit 5, and acquires posture information of the user based on the received sensor data. The posture information includes, for example, time, skeletal coordinates, and marker coordinates. The time is the current time. The skeletal coordinates are obtained from an image of the user captured by a camera by an existing skeletal estimation method. The marker coordinates are obtained by obtaining the coordinates of the markers attached to the user's body from an image of the user captured by a camera by an existing marker detection method. The posture acquisition processing unit 14 acquires a set of posture information such as the time, skeletal coordinates, and marker coordinates at a sampling rate of 20 Hz in accordance with the refresh rate of the presentation processing unit 13.

[0043] The motion detection processing unit 15 detects the motion of the user based on the information that the presentation processing unit 13 causes the content presentation device CP and the stimulus presentation device SP to present, and the posture information of the user acquired by the posture acquisition processing unit 14. The motion of the user includes, for example, a motion start time, a motion end time, and the motion of the user. The motion detection processing unit 15 detects the motion of the user including the motion start time, the motion end time, and the motion of the user by the number of stimuli to be presented. The motion detection processing unit 15 stores the detected motion of the user in the usage history storage unit 33. The actual measurement data stored in the usage history storage unit 33 is, for example, "(time, stimulation time, sound end time, motion start time, motion end time, start of form A), (time, stimulation time, sound end time, motion start time, motion end time, completion of form A), ...". Here, the set in parentheses is one motion of the user for each stimulus. The stimulation time in the actual measurement data is the time when the presentation processing unit 13 starts presenting the stimulation, and the sound end time is the time when the presentation processing unit 13 ends presenting the sound. "Form A start" and "Form A completion" are detected user movements.

[0044] The stimulus update processing unit 16 calculates the time lag T(Δ) and the hold time T(H), which are the physical skills of the user, for each stimulus based on the teacher data stored in the teacher data storage unit 32 and the user's movement history stored in the usage history storage unit 33, and updates the registered contents of the user table 312 to these calculated time lag T(Δ) and hold time T(H). Furthermore, when this update is completed, the stimulus update processing unit 16 deletes the user's movement history stored in the usage history storage unit 33.

[0045] (Example of operation) Next, an example of the operation of the training support device TS configured as above will be described.

[0046] (1) Pre-measurement processing As mentioned above, there are individual differences in the time lag T(Δ) between when a user decides to move and when they actually start moving. Therefore, for users who have never trained before, it is necessary to measure this individual difference in time lag T(Δ) in advance.

[0047] 8 is a flowchart showing an example of the procedure and contents of a pre-measurement process executed by the control unit 1 of the training support device TS. When a pre-registration instruction is received from the user via the input / output interface unit 4, the hardware processor of the control unit 1 executes a program stored in the program storage unit 2 to execute the following pre-measurement process shown in this flowchart.

[0048] In step S101, the control unit 1 acquires user information under the control of the usage data acquisition processing unit 11. Specifically, the control unit 1 acquires the user ID and usage content ID input by the user from the input device 41 based on the output of the output device 42 via the input / output interface unit 4.

[0049] In step S102, under the control of the presentation information determination processing unit 12, the control unit 1 reads out the presentation information from the presentation information storage unit 31. Specifically, the control unit 1 first associates the acquired user ID with the used content ID and registers them in the user table 312 of the presentation information storage unit 31. That is, the control unit 1 creates a record 312R identified by the user ID of the user in the user table 312, and registers the used content ID therein. Then, the control unit 1 reads out the video, sound, and stimulation to be played from the presentation information storage unit 31 based on the used content ID.

[0050] Under the control of the presentation processing unit 13, in step S103, the control unit 1 transmits the read presentation information to the content presentation device CP and the stimulus presentation device SP via the communication interface unit 5, and plays it on them. Here, for the sound, the delay time T(H), which is the time for presenting the sound, has not yet been calculated, so it will be a specified time. The control unit 1 generates sound data that changes the frequency from a high "C" to a low "C" so that the length of the sound becomes this delay time T(H), and transmits it to the content presentation device CP to play it.

[0051] In addition, the content presentation device CP will explain to the user in advance how to proceed with the repetitive training by, for example, presenting a message in the form of video or sound such as, "Please start moving when the sound finishes. The stimulus you should pay attention to is the stimulus that occurs when the sound is played."

[0052] In step S104, the control unit 1, under the control of the posture acquisition processing unit 14, acquires sensor data from the sensor group SG via the communication interface unit 5. Then, the control unit 1 obtains posture information of the user based on the acquired sensor data.

[0053] In step S105, the control unit 1 detects a user's movement based on the obtained user's posture information under the control of the movement detection processing unit 15. The control unit 1 stores the detected user's movement in the usage history storage unit 33.

[0054] In step S106, the control unit 1 judges whether one practice motion, that is, a cycle of steps S103 to S105, has been performed a specified number of times, N times. The specified number of times can be five times, for example. In order to measure the time lag T(Δ), which is the individual difference time, while suppressing the variation, it is necessary to obtain a certain number of measured values ​​and take an average. The number of times the practice motion has been performed may be counted by a counter provided in the temporary storage unit, or may be determined by checking the number of user motions stored in the usage history storage unit 33. If the practice motion has not yet been performed the specified number of times, the control unit 1 repeats the process from step S103.

[0055] If it is determined in step S106 that the practice motion has been performed the specified number of times, the control unit 1 estimates the time lag T(Δ), which is the user's individual time difference, in step S107 under the control of the stimulus update processing unit 16. Specifically, the control unit 1 calculates the time lag T(Δ) for each stimulus from the sound end time and movement start time of each stimulus from the user's motions for the specified number of times stored in the usage history storage unit 33, and calculates the average value of the calculated time lag T(Δ) for the specified number of times. The control unit 1 registers this calculated average value of the time lag T(Δ) for each stimulus in the record 312R indicated by the user ID of the user in the user table 312 as the time lag T(Δ), which is the user's individual time difference for the stimulus.

[0056] Furthermore, the control unit 1 updates the sound in step S108 under the control of the stimulation update processing unit 16. Specifically, the control unit 1 reads out the training data from the training data storage unit 32 based on the usage content ID registered in the record 312R indicated by the user ID of the user in the user table 312. The training data is the user's motion acquired from the motion of an advanced user, and has the same storage structure as the actual measurement data stored in the usage history storage unit 33. For example, the training data is "(time, stimulation time, sound end time, movement start time, movement end time, start of Form A), (time, stimulation time, sound end time, movement start time, movement end time, completion of Form A), ...". The control unit 1 calculates, for each stimulation, the time T(M) from the stimulation time to the movement start time. In addition, the control unit 1 calculates, for each stimulation, the time from the stimulation time to the movement start time from the actual measurement data stored in the usage history storage unit 33, and calculates the difference from the time T(M) of the training data.

[0057] As described with reference to FIG. 3, the sound is changed according to the time lag T(Δ), which is the individual time difference of the user, but there is a premise that the training is aimed at acquiring the same movement as the teacher data. FIG. 9 is a diagram for explaining the sound generation algorithm. There is a variation time DT for each user between the time T(M) of the teacher data and the time from the stimulation time to the start time of the user's movement. Therefore, it is necessary to determine the sound taking this variation time DT into consideration. Therefore, the control unit 1 first calculates this variation time DT for each stimulation. Since it is calculated based on the average of the user's time lag T(Δ) for a specified number of times, this variation time DT can also be said to be the average of the variation time for the specified number of times.

[0058] Then, the control unit 1 calculates the hold time T(H) for each stimulus, which is the time for presenting the sound. Specifically, the control unit 1 calculates the hold time T(H) as the difference between the time T(M) of the teacher data and the time lag T(Δ) and the variation time DT, that is, T(H)=T(M)-T(Δ)-DT The control unit 1 registers the delay time T(H) for each stimulus thus calculated in the record 312R of the user table 312 that is indicated by the user ID of the user.

[0059] Then, the control unit 1 ends the preliminary measurement process shown in this flowchart.

[0060] (2) Training support processing 10 is a flowchart showing an example of the procedure and contents of the training support process executed by the control unit 1 of the training support device TS. When a training execution instruction is received from the input device 41 by the user via the input / output interface unit 4, the hardware processor of the control unit 1 executes a program stored in the program storage unit 2 to execute the following training support process shown in this flowchart.

[0061] This training support process can be performed immediately after the completion of the above-mentioned preliminary measurement process, or can be performed at a different date and time from the preliminary measurement process.

[0062] In step S201, the control unit 1 acquires user information under the control of the usage data acquisition processing unit 11. Specifically, the control unit 1 acquires the user ID, usage content ID, and system mode input by the user from the input device 41 based on the output of the output device 42 via the input / output interface unit 4.

[0063] In step S202, the control unit 1 determines whether or not the advance measurement has been completed under the control of the presentation information determination processing unit 12. Specifically, the control unit 1 checks whether or not the time lag T(Δ) of the user is registered in the user table 312 based on the acquired user ID and used content ID.

[0064] If the user's time lag T(Δ) has not been registered, in step S203, the control unit 1 requests the user to perform a pre-measurement via the output device 42 through the input / output interface unit 4. Then, the control unit 1 ends the training support process shown in this flowchart.

[0065] If the user's time lag T(Δ) is registered, the control unit 1, under the control of the presentation information determination processing unit 12, reads out the presentation information from the presentation information storage unit 31 in step S204. Specifically, the control unit 1 reads out the video, sound, and stimulation to be played from the presentation information database 311 and the user table 312 of the presentation information storage unit 31 based on the acquired usage content ID. The sound to be read out also includes the delay time T(H) from the user table 312.

[0066] Under the control of the presentation processing unit 13, the control unit 1 transmits the read presentation information to the content presentation device CP and the stimulus presentation device SP via the communication interface unit 5 in step S205, thereby reproducing the presentation information on these devices.

[0067] In step S206, the control unit 1, under the control of the posture acquisition processing unit 14, acquires sensor data from the sensor group SG via the communication interface unit 5. Then, the control unit 1 obtains posture information of the user based on the acquired sensor data.

[0068] In step S207, the control unit 1 detects a user's movement based on the obtained user's posture information under the control of the movement detection processing unit 15. The control unit 1 stores the detected user's movement in the usage history storage unit 33.

[0069] In step S208, the control unit 1 determines whether one practice motion, that is, a cycle of steps S205 to S207, has been performed a designated number of times, which is the number of times specified by the user as the system mode. If the practice motion has not yet been performed the designated number of times, the control unit 1 repeats the process from step S205.

[0070] In this way, the usage history storage unit 33 accumulates actual measurement data for the specified number of repetitions, such as actual measurement data of the user's current movement "(time, stimulation time, sound end time, movement start time, movement end time, start of Form A), (time, stimulation time, sound end time, movement start time, movement end time, Form A completed), ...", actual measurement data of the user's movement from before "(time, stimulation time, sound end time, movement start time, movement end time, start of Form A), (time, stimulation time, sound end time, movement start time, movement end time, Form A completed), ...", actual measurement data of the user's movement from before "(time, stimulation time, sound end time, movement start time, movement end time, start of Form A), (time, stimulation time, sound end time, movement start time, movement end time, Form A completed), ...", ....

[0071] If it is determined in step S208 that the practice motion has been performed the designated number of times, the control unit 1 determines in step S209 whether or not it is necessary to update the sound under the control of the stimulation update processing unit 16. This determination can be made based on the presence or absence of sound update designated by the user as the system mode. If it is not necessary to update the sound, the control unit 1 ends the pre-measurement process shown in this flowchart.

[0072] If the sound needs to be updated, the control unit 1, under the control of the stimulation update processing unit 16, estimates, for each stimulation, a time lag T(Δ), which is an individual difference time of the user that would have been updated as the physical skill improved through training, in step S210. The method of estimating this time lag T(Δ) is as described in the pre-measurement process. The control unit 1 registers the estimated time lag T(Δ) for each stimulation in the record 312R indicated by the user ID of the user in the user table 312.

[0073] Furthermore, the control unit 1 updates the sound in step S211 under the control of the stimulation update processing unit 16. The method of updating this sound is also as described in the pre-measurement process. The control unit 1 registers the calculated hold time T(H) for each stimulation in the record 312R indicated by the user ID of the user in the user table 312. Then, the control unit 1 ends the pre-measurement process shown in this flowchart.

[0074] In addition, since the actual measurement data of the user's actions is stored in the usage history storage unit 33 without being deleted until the processing of step S211 is completed, the processing related to updating the sound in steps S210 and S211 can be performed separately at a different date and time.

[0075] In addition, when a different algorithm is designated by the user as the system mode, the sound update algorithm, which is a method for updating the sound, can follow the designated sound update algorithm. In other words, the sound update algorithm is not limited to the one described above.

[0076] (effect) As described above, the training support device TS according to the first embodiment supports the user in training to move the body in response to a presented stimulus by presenting the user with sound, and registers in the user table 312 a time lag T(Δ) that is the time from the user's decision to move the body in response to the presentation of a stimulus corresponding to the training to the time the user actually starts moving the body. This time lag T(Δ) is an individual difference time that differs from user to user. In this way, the user table 312 is a storage unit that stores the individual difference time. Then, under the control of the presentation information determination processing unit 12, the training support device TS determines a delay time T(H) that is the sound presentation time that is the time for presenting the sound to the user based on this time lag T(Δ), and under the control of the presentation processing unit 13, causes the stimulus presentation device SP to present a stimulus corresponding to the training to the user, and causes the content presentation device CP to present the sound for the determined delay time T(H) from the start of presentation of the stimulus. In this way, the presentation information determination processing unit 12 is a determination unit that determines the sound presentation time, and the presentation processing unit 13 is a presentation unit that presents the stimulus and the sound to the user. In this way, according to the training support device TS of the first embodiment, when the timing to start moving the body is notified to the user by presenting a sound, the time from the end of the presentation of the sound to the user actually starting to move the body varies from person to person, so the time to end the presentation of the sound is determined taking into consideration the individual difference. This makes it possible to present a sound that intuitively realizes the instruction to learn the relationship between the "start of movement" at the appropriate timing and the "stimulus" that triggers it, customized for each user. Therefore, the training support device TS of the first embodiment can support training to learn the time when the user starts to move the body in response to a stimulus in the external environment.

[0077] Further, the training support device TS according to the first embodiment detects the start of the user's body movement based on the sensor data from the sensor group SG under the control of the posture acquisition processing unit 14, and acquires an initial value of the time lag T(Δ) under the control of the motion detection processing unit 15 to store it in the user table 312. In this way, the posture acquisition processing unit 14 is a detection unit that detects the start of the user's body movement, and the motion detection processing unit 15 is an acquisition unit that acquires an initial value of the time lag T(Δ), which is an individual difference time. More specifically, the training support device TS presents a stimulus under the control of the presentation processing unit 13 and presents a sound for a specified time from the start of the presentation of the stimulus, and measures the motion start time, which is the time from the time the user receives the presentation of the stimulus to the time the user starts moving the body, under the control of the motion detection processing unit 15 based on the detected detection result under the control of the posture acquisition processing unit 14, and acquires the initial value of the time lag T(Δ) by calculating the difference between the measured motion start time and the specified time. In this way, by grasping and registering in advance through experiments the time lag T(Δ) which varies from person to person from the time the sound presentation ends until the user's body actually starts moving, the training support device TS of the first embodiment can provide training support tailored to each individual user.

[0078] Here, the training support device TS of the first embodiment, under the control of the posture acquisition processing unit 14, determines the delay time T(H) to be the difference between the teacher time, which is the time T(M) corresponding to the training from when a stimulus is presented by an advanced player to when the body starts moving, and the time lag T(Δ). In this way, the training support device TS according to the first embodiment determines the sound presentation time based on the difference between the teacher time and the time when the body of an advanced player starts to move for the movement that the user is trying to acquire. Therefore, the training support device TS according to the first embodiment allows the user to carry out training that matches the body movement of an advanced player.

[0079] Moreover, in the training support device TS according to the first embodiment, after a prescribed number of repetitive practice sessions, the delay time T(H), which is an individual difference time, stored in the user table 312, is updated under the control of the stimulus update processing unit 16. In this way, the stimulus update processing unit 16 is a sound update unit that updates the individual difference time. More specifically, under the control of the stimulus update processing unit 16, the training support device TS calculates the difference between the average movement start time and the delay time T(H) in the prescribed number of repetitive practice sessions, acquires the calculated difference as a new time lag T(Δ), calculates the variation time DT, which is the difference between the teacher time and the average movement start time, calculates the difference between the teacher time and the new time lag T(Δ) and the variation time DT as the new delay time T(H), and updates the delay time T(H) stored in the user table 312 with the calculated new delay time T(H). In this way, according to the training support device TS of the first embodiment, since an individual's skill can be improved by repeated practice, a new time lag T(Δ) is obtained after a specified number of training sessions, and the delay time T(H), which is the sound presentation time, is updated. Therefore, in the training support device TS of the first embodiment, when the time lag T(Δ) is short and has improved, the sound of the delay time T(H) is updated, making it possible to follow the improvement of an individual's skill.

[0080] In the training support device TS according to the first embodiment, under the control of the presentation processing unit 13, a stimulus is presented to the user by the stimulus presentation device SP, and an image corresponding to the training is presented by the content presentation device CP. In this way, the training support device TS according to the first embodiment can present an image corresponding to the training, thereby allowing the user to perform training suited to an actual situation.

[0081] [Second embodiment] (Configuration example) The configuration of a training support system including a training support device TS according to the second embodiment of the present invention is similar to that of the first embodiment, and therefore a description thereof will be omitted.

[0082] 11 is a block diagram showing an example of the software configuration of a training support device TS according to a second embodiment of the present invention. The hardware configuration is similar to that of the first embodiment, so a description thereof will be omitted.

[0083] As shown in FIG. 11, in the training support device TS of this embodiment, the control unit 1 is equipped with an action evaluation processing unit 17 in addition to the processing units 11 to 16 in the first embodiment, as a processing function realized by causing the hardware processor of the control unit 1 to execute a program stored in the program storage unit 2.

[0084] The action evaluation processing unit 17 evaluates the user's action for each stimulus based on the user's action detected by the action detection processing unit 15 and the teacher data stored in the teacher data storage unit 32, and outputs the evaluation result to the output device 42 via the input / output interface unit 4. Specifically, the action evaluation processing unit 17 calculates the error of the user's movement start time with respect to the time T(M) which is the time from the stimulus time to the movement start time in the teacher data as the user's achievement level. The more the user can learn the time to start moving the body in response to a stimulus in the external environment, the smaller this error becomes. As a method of outputting the evaluation result by the output device 42, for example, the achievement level can be expressed by the pitch or type of sound, or by the color, brightness, or blinking state of light.

[0085] (Example of operation) In the operation of the training support device TS according to the second embodiment of the present invention configured as above, the pre-measurement process is similar to that in the first embodiment, and therefore a description thereof will be omitted.

[0086] 12 is a flowchart showing an example of the processing procedure and processing contents of the training support processing executed by the control unit 1 of the training support device TS according to the second embodiment. The processing from step S201 to step S207 is the same as in the first embodiment.

[0087] In step S220, under the control of the action evaluation processing unit 17, the control unit 1 evaluates the user's action for each stimulus based on the detection result of the user's action in step S207 and the teacher data corresponding to the content ID stored in the teacher data storage unit 32.

[0088] Under the control of the action evaluation processing unit 17, in step S221, the control unit 1 outputs the evaluation result for each stimulation via the output device .

[0089] The subsequent processes from step S208 to step S211 are similar to those in the first embodiment.

[0090] As described above, the training support device TS according to the second embodiment evaluates the user's achievement level based on the difference between the time T(M) corresponding to the training from when a stimulus is presented by an advanced user to when the user starts moving the body, which is the teacher time, and the measured movement start time, under the control of the action evaluation processing unit 17. In this way, the action evaluation processing unit 17 is an evaluation unit that evaluates the user's achievement level.

[0091] Therefore, the training support device TS according to the second embodiment can present to the user how well each practice motion repeated during one training session matches the motion of an advanced player. This allows the user to check how his or her own motion was in each practice motion and feed the results back to the next practice motion, thereby enabling the user to move his or her body closer to that of an advanced player.

[0092] [Other embodiments] All or part of the functions of the training support device TS may be provided in a server computer on the Web or in the cloud, other than in a personal computer. In addition, the configuration, functions, processing procedures, processing contents, etc. of the training support device TS may be modified in various ways without departing from the spirit and scope of the present invention.

[0093] Although the embodiment of the present invention has been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, in implementing the present invention, specific configurations according to the embodiment may be appropriately adopted.

[0094] In short, this invention is not limited to the above-mentioned embodiment as it is, and the components can be modified and embodied in the implementation stage without departing from the gist of the invention. In addition, various inventions can be formed by appropriately combining multiple components disclosed in the above-mentioned embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined. [Explanation of symbols]

[0095] 1...Control section 2...Program memory section 3. Data storage section 4... Input / Output Interface Section 5...Communication interface section 6…Bus 11...Usage data acquisition processing unit 12... Presentation information determination processing unit 13... Presentation processing unit 14...Attitude acquisition processing unit 15...Motion detection processing unit 16...Stimulus update processing unit 17...Motion evaluation processing unit 31...Presentation information storage section 32…Teacher data storage unit 33…Usage history storage section 41…Input device 42...Output device 311… Presentation information database 312...User table 312R…Record CP: Content presentation device DT: Dispersion time SG: Sensor group SP…stimulus presentation device TS: Training support device

Claims

1. A training support device that supports a user in training to move his / her body in response to a presented stimulus by presenting a sound to the user, A storage unit that stores an individual difference time, which is a time from when the user judges that the user will move his / her body in response to the presentation of the stimulus in accordance with the training to when the user actually starts moving the body, to when the user judges that the user will move the body to when the user actually starts moving the body; A determination unit that determines a sound presentation time, which is a time for presenting the sound to the user, based on the stored individual difference time; A presentation unit that presents the stimulus corresponding to the training to the user and presents the sound for the determined sound presentation time from when the presentation of the stimulus starts; A training support device comprising:

2. A detection unit that detects the start of a body movement of the user; an acquisition unit that acquires an initial value of the individual difference time and causes the initial value to be stored in the storage unit; Further comprising: the presentation unit presents the stimulus and presents the sound for a specified time from when presentation of the stimulus is started; The acquisition unit is measuring a movement start time, which is a time from when the user is presented with the stimulus to when the user starts moving the body, based on a detection result of the detection unit; A difference between the measured movement start time and the specified time is calculated to obtain an initial value of the individual difference time. The training support device according to claim 1 .

3. The training support device according to claim 2 , wherein the determination unit determines the sound presentation time to be a difference between a teacher time, which is a time according to the training from when the stimulus is presented to when the body starts moving, and the individual difference time.

4. Further comprising a sound update unit that updates the sound presentation time stored in the storage unit after a prescribed number of repeated practice sessions; The sound update unit is Calculate the difference between the average value of the movement start time in the prescribed number of repeated practice sessions and the sound presentation time, and obtain the calculated difference as a new individual difference time; Calculating a variation time which is a difference between the teacher time and the average value of the movement start time; A difference between the teacher time, the new individual difference time, and the variation time is calculated as a new sound presentation time, and the sound presentation time stored in the storage unit is updated with the calculated new sound presentation time. The training support device according to claim 3 .

5. The training support device according to claim 4 , further comprising an evaluation unit that evaluates a level of achievement of the user based on a difference between the teacher time and the measured movement start time.

6. The training support device according to claim 1 , wherein the presentation unit presents the stimulus to the user and also presents an image corresponding to the training.

7. 1. An operation assistance method executed by a training assistance device that includes a processor and a memory and that assists a user in training to move his or her body in response to a presented stimulus by presenting a sound to the user, the method comprising: The memory stores an individual difference time, which is a time from when the user judges that the user will move his / her body in response to the presentation of the stimulus in response to the training to when the user actually starts moving the body, to when the user judges that the user will move the body; The processor determines a sound presentation time, which is a time for presenting the sound to the user, based on the individual difference time stored in the memory; The processor causes the user to be presented with the stimulus corresponding to the training, and causes the processor to present the sound for the determined sound presentation time from the start of presentation of the stimulus; An operation assistance method comprising:

8. An operation support program that causes a processor included in the training support device to execute the processes performed by the determination unit and the presentation unit of the training support device according to claim 1 .

Images