Exercise support device and exercise support method

Abstract

To appropriately support participants' exercise during remote training or rehabilitation. [Solution] The control unit 40 includes a display control unit 41 that displays a model video of exemplary body movements on the display unit 31, a movement determination unit 44 that determines the difference between the participant's movements, which are performed in accordance with the model video displayed on the display unit 31, and the model video, a mind-body state estimation unit 45 that estimates the participant's mind-body state based on the participant's biological information, a factor estimation unit 46 that estimates the cause of the difference based on the type of difference and the participant's mind-body state if the movement determination unit 44 determines that there is a difference, and a stimulus determination unit 47 that determines the type and method of stimulus to be given to the participant in order to promote a change in at least one of the participant's visual system function, brain-nerve system function, and muscular system function, based on the estimation result of the factor estimation unit 46.

Description

Technical Field

[0001] The present invention relates to an exercise support device and an exercise support method.

Background Art

[0002] There is known a technology related to virtual fitness training in which, when a user exercises, the movement of muscles is measured using EMS (Electric Muscle Stimulation) or the like and feedback is given to the user (see, for example, Patent Document 1). There is known a technology for applying electrical muscle stimulation to the body using EMS in rehabilitation or the like (see, for example, Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] In online training via a communication network or the like, participants move in accordance with the actions of an instructor displayed on a screen. Feedback from the instructor to the participants is given, for example, by the instructor checking the video of the participants and speaking to them. However, for example, in training for preventing caregiving, rehabilitation after illness or injury, etc., it may be difficult to improve the exercise effect.

[0005] The present disclosure has been made in view of the above, and an object thereof is to appropriately support the exercise of participants in training or rehabilitation performed remotely.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objectives, the exercise support device according to this disclosure comprises: a display control unit that displays exemplary video of exemplary body movements on a display unit; an action determination unit that determines the difference between the actions of a participant who performs actions in accordance with the exemplary video displayed on the display unit and the exemplary video; a mind-body state estimation unit that estimates the mind-body state of the participant based on the participant's biological information; a factor estimation unit that, if the action determination unit determines that there is a difference, estimates the cause of the difference based on the type of difference and the participant's mind-body state; and a stimulus determination unit that determines the type and method of stimulus to be given to the participant in order to promote a change in at least one of the participant's visual system function, brain-nerve system function, and muscular system function, based on the estimation results of the factor estimation unit.

[0007] The exercise support method according to this disclosure includes a display control unit that displays exemplary video of exemplary body movements on a display unit; an exercise determination unit that determines the difference between the movements of a participant who performs the movements in accordance with the exemplary video displayed on the display unit and the exemplary video; a mind-body state estimation unit that estimates the mind-body state of the participant based on the participant's biological information; a factor estimation unit that, if the movement determination unit determines that there is a difference, estimates the cause of the difference based on the type of difference and the participant's mind-body state; and a stimulus determination unit that, based on the estimation results of the factor estimation unit, determines the type and method of stimulus to be given to the participant in order to promote a change in at least one of the participant's visual system function, brain-nerve system function, and muscular system function, and is executed by an exercise support device. [Effects of the Invention]

[0008] According to this disclosure, the technology can effectively support participants' exercise during remote training or rehabilitation. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of an exercise support system according to an embodiment. [Figure 2]Figure 2 is a block diagram showing an example configuration of a terminal device according to an embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of a server device according to the embodiment. [Figure 4] Figure 4 shows an example of the types of differences and the physical and mental state of the users. [Figure 5] Figure 5 shows an example of stimulus content for each factor of difference. [Figure 6] Figure 6 is a flowchart showing the processing flow in the driver assistance device according to the embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the exercise support system and exercise support method, including the exercise support device, relating to this disclosure will be described in detail below with reference to the attached drawings. However, this disclosure is not limited to the embodiments described below.

[0011] [Embodiment] <Exercise support system> Figure 1 is a schematic diagram showing an example configuration of an exercise support system according to an embodiment. Figure 2 is a block diagram showing an example configuration of a terminal device according to an embodiment. Figure 3 is a block diagram showing an example configuration of a server device according to an embodiment. The exercise support system 1, for example, when providing exercise guidance to a participant who is a user in a remote location via a communication network, provides stimulation to various parts of the participant's body according to the participant's movements and physical and mental state.

[0012] Exercise includes, for example, preventative care training for the elderly, and rehabilitation after illness or injury.

[0013] The exercise support system 1 comprises a terminal device 10 used by participants and a server device 30 that manages the terminal device 10. The terminal device 10 may consist of one or more units. The terminal device 10 and the server device 30 can communicate information via wired or wireless connection.

[0014] <Terminal device> The terminal device 10 is a device that detects the biological information of a participant and applies stimuli to each part of the participant's body. The terminal device 10 includes a biological sensor unit 11, a stimulation generation unit 12, a communication unit 19, and a control unit 20.

[0015] The biological sensor unit 11 is a detection unit that detects the biological information of a participant. The biological sensor unit 11 constantly detects biological information during the activation of the motion assistance system 1. The biological sensor unit 11 is worn on the participant's body. The biological sensor unit 11 includes one or more biological sensors. The biological sensor unit 11 is, for example, at least any one of a blood pressure sensor, a heart rate sensor, a pulse sensor, a gaze sensor, and a body temperature sensor. The biological sensor unit 11 outputs the detected vital data as sensor data to the sensor data acquisition unit 21. The biological sensor unit 11 may be mounted on a server device or the like. For example, it may analyze a face image of the participant taken by a mounted camera to obtain vital data.

[0016] The biological information of the participant is information that can estimate the mental and physical state of the participant. In other words, the biological information of the participant is vital data regarding the participant's body that changes according to the mental and physical state of the participant.

[0017] The vital data includes, for example, at least any one of blood pressure data, heart rate data, pulse data, gaze data, and body temperature data.

[0018] The blood pressure sensor measures the blood pressure of the participant. The blood pressure sensor constantly measures the blood pressure during the activation of the motion assistance system 1. The blood pressure sensor is worn on the participant's body. The blood pressure sensor may be implemented as a function of a wearable device. The blood pressure sensor may be shared with the function of an electronic device carried by the participant.

[0019] The heart rate sensor measures the heart rate of the participant. The heart rate sensor constantly measures the heart rate during the activation of the exercise support system 1. The heart rate sensor is attached to the body of the participant. The heart rate sensor may be implemented as a function of a wearable device. The heart rate sensor may also be shared with the function of an electronic device carried by the participant.

[0020] The pulse sensor measures the pulse of the participant. The pulse sensor constantly measures the pulse during the activation of the exercise support system 1. The pulse sensor is attached to the body of the participant. The pulse sensor may be implemented as a function of a wearable device. The pulse sensor may also be shared with the function of an electronic device carried by the participant.

[0021] The line-of-sight sensor detects the line of sight of the participant. The line-of-sight sensor constantly detects the line of sight during the activation of the exercise support system 1. The line-of-sight sensor is arranged facing the eyes of the participant. The line-of-sight sensor may be implemented in a server device or the like.

[0022] The body temperature sensor measures the body temperature of the participant. The body temperature sensor may measure the temperature of the finger or foot part of the participant as the body temperature. The body temperature sensor constantly measures the body temperature during the activation of the exercise support system 1. The body temperature sensor is attached to the body of the participant. The body temperature sensor may be implemented as a function of a wearable device. The body temperature sensor may also be shared with the function of an electronic device carried by the participant.

[0023] The stimulation generation unit 12 generates a stimulation to the body of the participant based on the data indicating the content of the stimulation, which is the type of stimulation and the method of applying the stimulation, received from the server device 30. The stimulation generation unit 12 is, for example, attached to each part of the body where the participant wants to apply stimulation, such as the hands, feet, neck, waist, etc. The stimulation generation unit 12 may be implemented as a function of a wearable device.

[0024] The stimulation generation unit 12 may be, for example, a notification light such as an LED (Light Emitting Diode) that applies a stimulation to the participant with light.

[0025] The stimulus generating unit 12 may be, for example, a speaker that provides sound stimuli to the participants.

[0026] The stimulation generating unit 12 may be, for example, a device worn by the participant that provides electrical stimulation to the participant.

[0027] Devices that provide electrical stimulation include, for example, devices that provide TENS (Transcutaneous Electrical Nerve Stimulation) for pain relief. Devices that provide electrical stimulation include, for example, devices that provide stimulation aimed at promoting changes in the state of the autonomic nervous system. Devices that provide electrical stimulation include, for example, devices that provide stimulation aimed at changing the state of the central nervous system. Devices that provide electrical stimulation include, for example, devices that provide EMS (Electrical Muscle Stimulation) to induce muscle contraction by stimulating muscles and motor nerves. Devices that provide electrical stimulation include, for example, devices that provide FES (Functional Electrical Stimulation) for the purpose of skeletal muscle contraction. Devices that provide electrical stimulation include, for example, devices that provide TES (Therapeutic Electrical Stimulation) for therapeutic purposes.

[0028] The stimulation generating unit 12 may also be adjustable in terms of stimulation intensity. For example, the stimulation generating unit 12 may be adjustable in two stages: strong and weak.

[0029] The communication unit 19 is a communication unit for wired or wireless communication. The communication unit 19 communicates using methods such as Wi-Fi (registered trademark) or mobile phone lines, and is connected to an intranet or the internet. The communication unit 19 is controlled by the communication control unit 29. The communication unit 19 communicates sensor data and data indicating the content of stimuli with the server device 30.

[0030] <Terminal device control unit> The control unit 20, which is a terminal control device, may be implemented as a function of a wearable device, such as a neckband, wristband, smart ring, smart glasses, smartwatch, or hands-free microphone, which is worn on the participant's body.

[0031] The control unit 20 is a processing unit composed of, for example, a CPU (Central Processing Unit). The control unit 20 loads a program stored in a storage unit (not shown) into memory and executes the instructions contained in the program. The control unit 20 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20. The control unit 20 includes a sensor data acquisition unit 21, a stimulus control unit 23, and a communication control unit 29.

[0032] The sensor data acquisition unit 21 acquires sensor data, which is the participant's vital data. The sensor data acquisition unit 21 acquires the participant's sensor data detected by the biosensor unit 11 while the exercise support system 1 is running. The sensor data acquisition unit 21 acquires, for example, at least one of blood pressure data, heart rate data, pulse rate data, gaze data, and body temperature data.

[0033] The stimulus control unit 23 controls the operation of the stimulus generation unit 12. Based on the stimulus content, which is the type of stimulus and the method of applying the stimulus, determined by the server device 30, the stimulus control unit 23 outputs a control signal to the stimulus generation unit 12 to generate a stimulus.

[0034] The stimulus control unit 23 controls, for example, the illumination of the notification light, which is the stimulus generating unit 12.

[0035] The stimulus control unit 23 controls, for example, the output of sound from the speaker, which is the stimulus generation unit 12.

[0036] The stimulus control unit 23 controls the operation of various devices that provide electrical stimulation to the participant, such as the stimulus generation unit 12.

[0037] The stimulus control unit 23 may, for example, generate multiple stimuli simultaneously or with a time difference if there are multiple stimuli determined by the server device 30.

[0038] The stimulus control unit 23 may, for example, if there are multiple stimulus options determined by the server device 30, administer one stimulus and the participant's function does not improve, then administer another stimulus.

[0039] The communication control unit 29 controls the communication unit 19 to control the communication of sensor data and data indicating the content of stimuli between it and the server device 30. More specifically, the communication control unit 29 controls the communication unit 19 to transmit sensor data to the server device 30. The communication control unit 29 controls the communication unit 19 to receive data indicating the content of stimuli from the server device 30.

[0040] <Server equipment> The server device 30 determines the content of the stimuli to be delivered from the terminal device 10 to each part of the participant's body, according to the participant's actions and physical and mental state acquired from the terminal device 10. The server device 30 includes a display unit 31, a speaker 32, a camera 33, a communication unit 39, and a control unit 40.

[0041] The display unit 31 displays a model video that serves as an example for the participants' actions. The display unit 31 is a display including, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 31 is a display device placed in a space such as a room where the participants are located. The display of the display unit 31 is controlled by the display control unit 41.

[0042] Speaker 32 outputs audio from a demonstration video that serves as an example for the participant's actions. Speaker 32 is an audio output device placed in a space such as a room where the participant is located. Speaker 32 may also be an audio output device shared with an electronic device carried by the participant. Speaker 32 may also be implemented as a function of a wearable device worn by the participant.

[0043] The demonstration video is, for example, real-time video footage of the instructor's body movements as they demonstrate the movement. The demonstration video may also be, for example, video footage of the instructor's body movements as they demonstrate the movement, which has been recorded and saved.

[0044] Camera 33 captures images of the participant's body movements as they perform the demonstration video displayed on the display unit 31. Camera 33 continuously captures images while the exercise support system 1 is running. Camera 33 is located, for example, on the display unit 31. Camera 33 outputs the captured images to the image acquisition unit 43.

[0045] The communication unit 39 is a communication unit for wired or wireless communication. The communication unit 39 communicates using methods such as Wi-Fi or mobile phone lines, and is connected to an intranet or the internet. The communication unit 39 is controlled by the communication control unit 48. The communication unit 39 communicates sensor data and data indicating the content of stimuli with the terminal device 10.

[0046] <Server unit control unit (exercise support device)> The control unit 40, which is a motor support device, is a processing unit composed of, for example, a CPU. The control unit 40 loads a program stored in a storage unit (not shown) into memory and executes the instructions contained in the program. The control unit 40 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 40. The control unit 40 includes a display control unit 41, an audio output control unit 42, an image acquisition unit 43, an action determination unit 44, a mental / physical state estimation unit 45, a factor estimation unit 46, a stimulus determination unit 47, and a communication control unit 48.

[0047] The display control unit 41 controls the display of various images on the display unit 31. The display control unit 41 controls the display of example images on the display unit 31 that serve as models for the participants' physical movements. The display control unit 41 outputs a video signal to the display unit 31.

[0048] The audio output control unit 42 controls the audio output from the speaker 32. The audio output control unit 42 outputs an audio signal to the speaker 32 that outputs the audio of the example video that serves as a model for the participant's actions.

[0049] The video acquisition unit 43 acquires video footage captured by the camera 33. The video acquisition unit 43 also acquires video footage of the participants' body movements as they watch the example video.

[0050] The motion determination unit 44 determines the difference between the participant's actions, which are performed in accordance with the example video displayed on the display unit 31, and the example video. More specifically, the motion determination unit 44 determines the difference between the participant's actions and the example video based on the video acquired by the video acquisition unit 43.

[0051] Figure 4 illustrates an example of a type of difference. Figure 4 shows an example of a type of difference and the user's physical and mental state. The types of differences include "different body part," "different direction," "delayed timing of movement," or "smaller amount of movement." The types of differences are not limited to these.

[0052] The motion determination unit 44 determines the type of difference between the participant's movements and the example video based on the video acquired by the video acquisition unit 43. In this embodiment, the motion determination unit 44 compares the participant's movements with the example video and determines that there is a difference if the moving body parts are different, the direction of the movements is different, the timing of the movements is different, or the amount of movement is small. The method for determining the difference in movements from the two videos is not limited to known methods and can be used.

[0053] The mental and physical state estimation unit 45 estimates the participant's mental and physical state based on their biological information. More specifically, the mental and physical state estimation unit 45 estimates the participant's mental and physical state based on sensor data received from the terminal device 10.

[0054] Figure 4 illustrates an example of a participant's mental and physical state. A mental and physical state is at least one of the following: a state of concentration, a state of stress, or a state of fatigue. However, the mental and physical state is not limited to these.

[0055] In this embodiment, the mental and physical state estimation unit 45 estimates at least one of the participant's concentration state, stress state, and fatigue state based on sensor data received from the terminal device 10. For example, the mental and physical state estimation unit 45 estimates whether the participant's concentration state is high or low based on sensor data received from the terminal device 10. The concentration state may be estimated, for example, based on gaze sensor data, whether the participant is looking at or not looking at the example video displayed on the display unit 31. For example, the mental and physical state estimation unit 45 estimates whether the participant's stress state is high or low based on sensor data received from the terminal device 10. For example, the mental and physical state estimation unit 45 estimates whether the participant's fatigue state is high or low based on sensor data received from the terminal device 10. The method for determining the participant's concentration state, stress state, and fatigue state from the sensor data is not limited to known methods.

[0056] If the action determination unit 44 determines that there is a difference, the factor estimation unit 46 estimates the factors of the difference based on the type of difference and the participant's mental and physical state. More specifically, the factor estimation unit 46 estimates the factors of the difference based on the type of difference determined by the action determination unit 44 and the participant's mental and physical state estimated by the mental and physical state estimation unit 45.

[0057] In this embodiment, the factor estimation unit 46 estimates at least one of the following as factors: a decline in the participant's visual system function, a decline in the brain and nervous system function, and a decline in the muscular system function.

[0058] Figure 5 is used to explain the factors causing the differences. Figure 5 is a diagram showing an example of the content of the stimulus for each factor causing the differences. Factors causing differences include, for example, not watching the example video, watching the example video but having a slow reaction, or not being able to move the body sufficiently. Not watching the example video can be further divided into decreased concentration due to fatigue and decreased concentration due to stress (boredom, irritation).

[0059] The factor estimation unit 46 stores the factors to be estimated as estimation data, pre-associating them with each combination of the type of difference and the participant's mental and physical state.

[0060] The factor estimation unit 46 uses estimation data to estimate factors corresponding to the combination of the determined type of difference and the estimated mental and physical state of the participant. For example, if the type of difference is determined to be "different body part" or "different direction," and the mental and physical state is estimated to be a state of concentration such as "low concentration level" or "not looking at the example video," the factor estimation unit 46 estimates the factor of the difference to be a decline in visual system function. For example, if the type of difference is determined to be "different body part" or "different direction," and the mental and physical state is estimated to be a state of concentration such as "low concentration level" or "not looking at the example video," and is further estimated to be "high fatigue level," the factor estimation unit 46 estimates the factor of the difference to be a decline in concentration due to fatigue. For example, if the factor estimation unit 46 determines that the type of difference is "different body part" or "different direction," and the mental and physical state is estimated to be a state of concentration where "concentration level is low" or "not watching the example video," and further estimated to be "high stress level" or "low fatigue level," then it estimates the factor of the difference to be decreased concentration due to stress (boredom, irritation). For example, if the factor estimation unit 46 determines that the type of difference is "slow timing of movement," and the mental and physical state is estimated to be "high concentration level," "low stress level," or "low fatigue level," then it estimates the factor of the difference to be decreased brain and nervous system function. For example, if the factor estimation unit 46 determines that the type of difference is "small amount of movement," and the mental and physical state is estimated to be "high concentration level," "low stress level," or "low fatigue level," then it estimates the factor of the difference to be decreased muscular system function. These are just examples and are not limited to these.

[0061] Based on the estimation results of the factor estimation unit 46, the stimulus determination unit 47 determines the type and method of stimulus to be given to the participant in order to promote a change in at least one of the participant's visual system function, brain and nervous system function, and muscular system function.

[0062] When participants perform actions while watching a demonstration video, (1) visual information is received, (2) travels through nerves and is recognized by the brain, and the brain, based on the recognized information, transmits commands to the muscles via nerves to "perform the same action as the demonstration video," and (3) moves the muscles. Therefore, focusing on (1) visual information recognition (sensory input of movement information), (2) brain and nervous system capabilities (movement control by the brain, nerves, etc.), and (3) muscular system capabilities (movement output by muscles, joints, etc.), we determine the type and method of stimuli to provide support for appropriate movements in line with the participant's demonstration video.

[0063] Using Figure 5, we will explain the content of the stimulus, which is the type of stimulus and the method of applying the stimulus. The type of stimulus and the method of applying the stimulus are determined for each factor of difference. Examples of stimulus types include stimuli that guide the user to focus on a model video, stimuli to improve fatigue, stimuli to improve stress, stimuli to improve brain and nervous system function, and stimuli to improve muscular system function.

[0064] Methods of applying stimulation include, for example, applying light and sound stimuli from a display device showing a model video; applying electrical stimulation (TENS for pain relief) from a stimulation generating unit 12 worn by the user; applying electrical stimulation (stimulation aimed at promoting changes in the state of the autonomic nervous system) from a stimulation generating unit 12 worn by the user; applying electrical stimulation (stimulation aimed at changing the state of the central nervous system) from a stimulation generating unit 12 worn by the user; applying electrical stimulation (EMS that causes muscle contraction by stimulating muscles and motor nerves, FES aimed at contracting skeletal muscles) from a stimulation generating unit 12 worn by the user; and applying TES for therapeutic purposes.

[0065] For example, if the factor of the difference estimated by the factor estimation unit 46 is "decreased visual system function," the stimulus determination unit 47 determines the type of stimulus to be "a stimulus that guides the user to focus on the example video" and the method of application to be "applying light and sound stimuli from the example video display device." If the factor of the difference estimated by the factor estimation unit 46 is "decreased visual system function" and "decreased concentration due to fatigue," the stimulus determination unit 47 determines the type of stimulus to be "a stimulus to improve fatigue" and the method of application to be "applying electrical stimulation (TENS for pain relief) from the stimulus generation unit 12, which is a device worn by the user." For example, if the factor of the difference estimated by the factor estimation unit 46 is "decreased visual system function" and "decreased concentration due to stress (boredom, irritation)," the stimulus determination unit 47 determines the type of stimulus to be "a stimulus to improve stress" and the method of application to be "applying electrical stimulation (stimuli aimed at promoting changes in the state of the autonomic nervous system) from the stimulus generation unit 12, which is a device worn by the user." For example, if the factor of the difference estimated by the factor estimation unit 46 is "decreased brain and nervous system function," the stimulus determination unit 47 determines the type of stimulus to be "stimulation to improve brain and nervous system function" and the method of application to be "electrical stimulation (stimulation aimed at promoting changes in the state of the central nervous system) from the stimulus generation unit 12, which is a device worn by the user." For example, if the factor of the difference estimated by the factor estimation unit 46 is "decreased muscular system function," the stimulus determination unit 47 determines the type of stimulus to be "stimulation to improve muscular system function" and the method of application to be "electrical stimulation (stimulation aimed at promoting changes in the state of the muscle, such as muscle contraction) from the stimulus generation unit 12, which is a device worn by the user." These are just examples and are not limited thereto.

[0066] If the factor estimation unit 46 estimates multiple factors, the stimulus determination unit 47 may determine the type of stimulus and the method of applying the stimulus according to each factor.

[0067] The communication control unit 48 controls the communication unit 39 to control communication between the terminal device 10 and the communication unit 48, such as sensor data and data indicating the content of stimuli. More specifically, the communication control unit 48 controls the communication unit 39 to receive sensor data from the terminal device 10. The communication control unit 48 controls the communication unit 39 to transmit data indicating the content of stimuli to the terminal device 10.

[0068] <Exercise support method> Next, the flow of exercise support processing in the control unit 40 will be explained using Figure 6. Figure 6 is a flowchart showing the processing flow in the driving support device according to the embodiment. When a participant performs, for example, preventative care training or rehabilitation after illness or injury, they activate the exercise support system 1. While the exercise support system 1 is running, the participant wears the terminal device 10 on their body. While the exercise support system 1 is running, a demonstration video is displayed on the display unit 31, and audio corresponding to the demonstration video is output from the speaker 32. While the exercise support system 1 is running, the biosensor unit 11 of the terminal device 10 detects the participant's sensor data and transmits it to the server device 30. While the exercise support system 1 is running, the camera 33 photographs the participant, and the video is output to the video acquisition unit 43.

[0069] The control unit 40 determines whether or not there is a difference in the operation (step S101). More specifically, the control unit 40 compares the participant's operation with the example video using the operation determination unit 44 and determines that there is a difference if the body part being operated on is different, the direction of the operation is different, the timing of the operation is different, or the amount of operation is smaller. If the control unit 40 determines that there is a difference in the operation (Yes in step S101), it proceeds to step S102. If the control unit 40 does not determine that there is a difference in the operation (No in step S101), it repeats the process in step S101.

[0070] If it is determined that there is a difference in the behavior (Yes in step S101), the control unit 40 estimates the participant's mental and physical state (step S102). The control unit 40 uses the mental and physical state estimation unit 45 to estimate at least one of the participant's concentration state, stress state, and fatigue state based on the sensor data received from the terminal device 10. The control unit 40 then proceeds to step S103.

[0071] The control unit 40 estimates the factors (step S103). More specifically, the control unit 40 estimates the factors of the difference based on the type of difference determined by the action determination unit 44 and the participant's mental and physical state estimated by the mental and physical state estimation unit 45, using the factor estimation unit 46. The control unit 40 estimates at least one of the following as factors: a decline in the participant's visual system function, a decline in the cranial nervous system function, and a decline in the muscular system function. The control unit 40 proceeds to step S104.

[0072] The control unit 40 determines the stimulus (step S104). More specifically, the control unit 40, using the stimulus determination unit 47, determines the type and method of stimulus to be applied to the participant in order to promote a change in at least one of the participant's visual system function, cranial system function, and muscular system function, based on the estimation results of the factor estimation unit 46. The control unit 40 then proceeds to step S105.

[0073] The control unit 40 transmits the determined stimulus content (step S105). More specifically, the control unit 40 transmits data indicating the stimulus content, which is the type and method of stimulus to be given to the participant, as determined by the stimulus determination unit 47, via the communication control unit 48. The control unit 40 then proceeds to step S106.

[0074] The control unit 40 determines whether or not to terminate the process (step S106). More specifically, the control unit 40 determines to terminate the process, for example, when an operation to terminate this process is detected, or when the display of the example video ends. If the control unit 40 determines to terminate the process (Yes in step S106), it terminates the process in this flowchart. If the control unit 40 does not determine to terminate the process (No in step S106), it executes the process in step S101 again.

[0075] In the terminal device 10, the stimulus generation unit 12 generates stimuli to the participant's body based on data indicating the content of the stimuli received from the server device 30.

[0076] Participants receive stimuli from a stimulation-generating unit 12 attached to their body, which guides them to focus on the example video, improves fatigue, reduces stress, improves brain and nervous system function, or improves muscular system function.

[0077] <Effects> As described above, this embodiment estimates the factors causing the differences based on the type of difference between the participant's movements and those of the example video, and the participant's physical and mental state. In this embodiment, depending on the estimated factors, it is possible to determine the type and method of stimulus to be given to the participant in order to promote a change in at least one of the participant's visual system function, brain and nervous system function, and muscular system function. According to this embodiment, it is possible to appropriately support the participant's movements in remote training or rehabilitation, etc.

[0078] In this embodiment, by comparing the participant's movements with the example video, it is possible to determine that there is a difference if the body parts being moved are different, the direction of the movement is different, the timing of the movement is different, or the amount of movement is small. In this embodiment, the differences between the participant's movements and the example video can be appropriately determined.

[0079] In this embodiment, it is possible to estimate at least one of the participant's concentration level, stress level, and fatigue level.

[0080] In this embodiment, at least one of the following factors can be estimated: a decline in the participant's visual system function, a decline in the brain and nervous system function, and a decline in the muscular system function.

[0081] Now, although the control unit 40 according to the present invention has been described, it may be implemented in various other forms besides those described above.

[0082] Each component of the illustrated control unit 40 is a functional concept and does not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage conditions of each device.

[0083] The configuration of the control unit 40 is realized, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks realized by the cooperation of hardware or software. That is, these functional blocks can be realized in various forms by hardware alone, software alone, or a combination thereof.

[0084] The above-described components include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the above-described components can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention. [Explanation of Symbols]

[0085] 1. Exercise support system 10 Terminal devices 11. Biosensor Unit 12 Stimulus generation area 19 Communications Department 20 Control Unit 21 Sensor data acquisition unit 23 Stimulus Control Unit 29 Communication Control Unit 30 Server Devices 31 Display section 32 speakers 33 Cameras 39 Communications Department 40 Control Unit (Movement Support Device) 41 Display Control Unit 42 Audio Output Control Unit 43 Video Acquisition Unit 44 Operation judgment section 45 Mental and Physical State Estimation Unit 46 Factor Estimation Unit 47 Stimulus determining part 48 Communication Control Unit

Claims

1. A display control unit that displays exemplary video footage of body movements on the display unit, An action determination unit that determines the difference between the actions of a participant performing actions in accordance with the example video displayed on the display unit and the example video, A mental and physical state estimation unit that estimates the mental and physical state based on the participant's biological information, If the operation determination unit determines that there is a difference, the factor estimation unit estimates the cause of the difference based on the type of difference and the mental and physical state of the participant, A stimulus determination unit determines, based on the estimation results of the factor estimation unit, the type and method of applying a stimulus to the participant in order to promote a change in at least one of the participant's visual system function, brain and nervous system function, and muscular system function. An exercise support device equipped with the following features.

2. The motion determination unit compares the participant's movements with the example video and determines that there is a difference if the body parts being moved are different, the direction of the movement is different, the timing of the movement is different, or the amount of movement is small. The exercise support device according to claim 1.

3. The mental and physical state estimation unit estimates at least one of the participant's state of concentration, stress, and fatigue. The exercise support device according to claim 1.

4. The factor estimation unit estimates at least one of the following factors in the participant: a decline in visual system function, a decline in brain and nervous system function, and a decline in muscular system function. The exercise support device according to claim 1.

5. A display control unit that displays exemplary video footage of body movements on the display unit, An action determination unit that determines the difference between the actions of a participant performing actions in accordance with the example video displayed on the display unit and the example video, A mental and physical state estimation unit that estimates the mental and physical state based on the participant's biological information, If the operation determination unit determines that there is a difference, the factor estimation unit estimates the cause of the difference based on the type of difference and the mental and physical state of the participant, A stimulus determination unit determines, based on the estimation results of the factor estimation unit, the type and method of applying a stimulus to the participant in order to promote a change in at least one of the participant's visual system function, brain and nervous system function, and muscular system function. A method of providing exercise support, which includes exercise support devices, and which is performed by an exercise support device.

Images