Exercise support system and exercise support method

Abstract

To provide an exercise support system capable of supporting exercise more effectively than ever before.SOLUTION: An exercise support system 10 is composed of a home device 20, a facility device 30, an exercise support device 40, etc. In the home device 20, a first control part 21d displays a support video for supporting exercise of a user generated on the basis of a detection result by a camera 21a in a display unit 21b, etc. in conjunction with the display of a training video. In the facility device 30, a second control part 31a calculates a difference between movements of the user detected by cameras 36a-36d and movements indicated by the training video, and displays a support video for supporting the exercise of the user generated on the basis of the difference in a projector 34 in conjunction with the display of the training video. Difference data indicating the difference is feedbacked to the home device 20 from the facility device 30 through the exercise support device 40.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an exercise support system and an exercise support method for supporting exercise training.

Background Art

[0002] Due to the recent spread of infectious diseases, it has become difficult to go to a fitness gym as before in order to avoid the three Cs (closed spaces, crowded places, and close-contact settings) and infections. There is a demand for a solution that allows easy exercise during short breaks at home. As one such solution, a technology has been proposed that enables comparison of a training video serving as a desired model and the movement of a user on a display by using a smartphone (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, according to the technology of Patent Document 1, although objective evaluation is possible because the difference between the training video serving as a model and the movement of the user can be understood to some extent, there is a problem that the accuracy of that difference is low. In the technology of Patent Document 1, the movement of the user is detected by a camera mounted on a smartphone, but with such a camera, it is difficult to detect the movement of the exercising user with high accuracy because the angle of view, resolution, and frame rate are not sufficient. Therefore, the technology of Patent Document 1 is not sufficient for effectively supporting exercise or promoting the habituation of exercise in the user.

[0005] Therefore, the present invention has been made in view of these circumstances, and aims to provide an exercise support system and exercise support method that can support exercise more effectively than conventional methods, and encourage users to make exercise a habit, thereby increasing its continuation. [Means for solving the problem]

[0006] To achieve the above objective, an exercise support system according to one embodiment of the present invention comprises: an in-home device that supports exercise training by a user in the home; a facility device that supports exercise training by the user in a facility; an exercise support device connected to the in-home device and the facility device via a communication path; and a storage unit provided in any of the in-home device, the facility device, and the exercise support device that holds a model training video. The in-home device includes: a first display unit that displays a video; a first control unit that controls the display of the training video held in the storage unit on the first display unit; and a first detection unit that detects the movements of the user exercising in accordance with the training video displayed on the first display unit. The first control unit further controls the display of a support video for assisting the user's exercise, generated based on the detection result by the first detection unit, in conjunction with the display of the training video. The facility device includes a second display unit for displaying video, a second control unit for controlling the display of training video stored in the storage unit on the second display unit, and a second detection unit for detecting the user's movements as they exercise in accordance with the training video displayed on the second display unit with higher accuracy than the first detection unit. The second control unit further calculates the difference between the user's movements detected by the second detection unit and the movements shown in the training video, and controls the display of support video for assisting the user's exercise, generated based on the calculated difference, in conjunction with the display of the training video on the second display unit. The exercise support device acquires difference data showing the difference calculated by the second control unit, generates a model training video based on the acquired difference data, and the in-home device acquires the training video generated by the exercise support device via the communication channel and stores it in the storage unit.

[0007] To achieve the above objective, an exercise support method according to one embodiment of the present invention is an exercise support method using an exercise support system comprising: an in-home device that supports exercise training by a user in the home; a facility device that supports exercise training by the user in a facility; an exercise support device connected to at least the in-home device via a communication path; and a storage unit provided in any of the in-home device, the facility device, and the exercise support device that holds a model training video, wherein the method comprises the steps of: the in-home device causing the training video held in the storage unit to be displayed on a first display unit; the in-home device using a first detection unit to detect the movements of the user exercising in accordance with the training video displayed on the first display unit; and the in-home device displaying a support video for assisting the user's exercise, generated based on the detection result by the first detection unit, on the first display unit in conjunction with the display of the training video. The process includes the steps of: the facility device displaying the training video stored in the storage unit on the second display unit; the facility device using a second detection unit to detect the user's movements in accordance with the training video displayed on the second display unit with higher accuracy than the first detection unit; the facility device calculating the difference between the user's movements detected by the second detection unit and the movements shown in the training video, and displaying a support video for assisting the user's movements, generated based on the calculated difference, on the second display unit in conjunction with the display of the training video; the exercise support device acquiring difference data indicating the difference calculated by the facility device, and generating a model training video based on the acquired difference data; and the in-home device acquiring the training video generated by the exercise support device via the communication channel and storing it in the storage unit. [Effects of the Invention]

[0008] The present invention provides an exercise support system and an exercise support method that can support exercise more effectively than conventional methods and encourage users to make exercise a habit, thereby increasing its continuation. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is an overall configuration diagram of the exercise support system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing the detailed configuration of the exercise support system shown in Figure 1. [Figure 3] Figure 3 is a flowchart showing the operation of the in-home device in the exercise support system according to the embodiment. [Figure 4] Figure 4 shows the operation of the in-home device in the exercise support system according to the embodiment. [Figure 5] Figure 5 is a flowchart showing the operation of the facility equipment in the exercise support system according to the embodiment. [Figure 6] Figure 6 shows the operation of the facility equipment in the exercise support system according to the embodiment. [Figure 7A] Figure 7A shows an example of the arrangement of cameras, floor load cells, and wall load cells in a user training area. [Figure 7B] Figure 7B shows an example of user movement detection by the second control unit using a camera, floor load cell, and wall load cell. [Figure 7C] Figure 7C shows an example of detecting the user's center of gravity using a floor load cell. [Figure 8] Figure 8 is a flowchart showing the details of steps S23a and S23b in Figure 5. [Figure 9] Figure 9 shows an example of displaying support and training videos using a projector in a facility according to the embodiment. [Figure 10] Figure 10 is a flowchart showing the movement of a facility device that changes the training video according to the user's condition while they are exercising. [Figure 11] Figure 11 is a block diagram showing the configuration of the exercise support device in an exercise support system according to a modified embodiment. [Figure 12A] Figure 12A is a communication sequence diagram showing the interaction between the in-home device and the exercise support device in an exercise support system according to a modified embodiment. [Figure 12B] Figure 12B is a communication sequence diagram showing the interaction between a facility and an exercise support device in an exercise support system according to a modified embodiment. [Modes for carrying out the invention]

[0010] The embodiments of the present invention will be described in detail below with reference to the drawings. The embodiments described below are all specific examples of the present invention. The numerical values, shapes, materials, components, arrangement and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit the present invention. Furthermore, the figures are not necessarily strictly accurate. In each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations are omitted or simplified.

[0011] Figure 1 is an overall configuration diagram of the exercise support system 10 according to an embodiment. The exercise support system 10 is a system that supports exercise training by a user, and comprises an in-home device 20 that supports exercise training by the user at home, a facility device 30 that supports the user in exercising under the guidance of an instructor in a facility such as a fitness gym (office, commercial facility, educational institution, medical institution, nursing care facility, amusement facility), and an exercise support device 40 that serves as an exercise server connected to the in-home device 20 and the facility device 30 via a communication channel such as the internet.

[0012] The facility device 30 can precisely and accurately support the user's training by highly accurately sensing the movements in the user's exercise compared to the in-house device 20. This exercise support system 10 is characterized in that a training video, which reflects the movements of the user highly accurately sensed by the facility device 30, that is, a model for effectively supporting the user's exercise while reflecting the user's individuality, is generated by the exercise support device 40 and fed back to the in-house device 20.

[0013] FIG. 2 is a block diagram showing the detailed configuration of the exercise support system 10 shown in FIG. 1.

[0014] The in-house device 20 is composed of a terminal device 21 and peripheral devices (lighting device 22, audio device 23, projector 24, air conditioner 25) controlled by the terminal device 21.

[0015] The terminal device 21 is, for example, a portable terminal such as a smartphone or a tablet, and includes a camera 21a, a display 21b, a first storage unit 21c, and a first control unit 21d.

[0016] The display 21b is an example of a first display unit for displaying a training video serving as a model and a support video for supporting the user's exercise, and is, for example, a liquid crystal display.

[0017] The first storage unit 21c is a storage unit for holding a training video serving as a model, and is, for example, a semiconductor non-volatile memory.

[0018] The camera 21a is an example of a first detection unit for detecting the movements of a user who exercises in accordance with the training video displayed on the display 21b, and is, for example, a digital imaging device.

[0019] The first control unit 21d controls the display of training videos stored in the first memory unit 21c on the display 21b and / or the projector 24, and generates support videos to assist the user's exercise based on detection results from the camera 21a, and controls the display of the generated support videos on the display 21b and / or the projector 24 in conjunction with the display of the training videos. The first control unit 21d consists of a memory for storing programs, a CPU for executing programs, an input / output interface connected to peripheral components, a communication unit 21e, etc. The communication unit 21e is a communication interface that communicates with external devices such as peripheral devices (lighting device 22, sound device 23, projector 24, air conditioning device 25), exercise support device 40, and facility device 30 by wireless or wired communication, and is, for example, a WiFi® or a communication card for a mobile phone network.

[0020] Although the first storage unit 21c has been described as being located in the in-home device 20, it may also be located in the third storage unit 47 of the exercise support device 40 or the second storage unit 31c of the facility device 30, and the training video may be transmitted to the terminal device 21 via a communication path, and the first control unit 21d may display it on the display 21b and / or projector 24.

[0021] The lighting device 22 is a device that illuminates the space where the user is located, and may be an LED lighting device such as a ceiling light, and may be used as a device that enhances the user's motivation to exercise by adjusting the brightness and color in conjunction with the training video or support video under the control of the terminal device 21.

[0022] The sound device 23 is a speaker that provides sounds such as music to the space where the user is located. Under the control of the terminal device 21, it is used as a device that enhances the user's motivation to exercise by playing audio contained in training videos or support videos.

[0023] The projector 24 is an example of a first display unit for displaying exemplary training videos and support videos under the control of the terminal device 21, either in place of or together with the display 21b of the terminal device 21. Similarly, under the control of the first terminal device 21, it may be used as a device that produces a visual effect to increase the user's motivation to exercise, in conjunction with the training video or support video. An example of the first display unit may be a TV or the like that supports AirPlay®.

[0024] The air conditioning device 25 is a device that adjusts the air in the space where the user is located, and is, for example, an air conditioner, air purifier, circulator, or fan. It is used as a device to maintain an environment such as room temperature suitable for the user to exercise, under the control of the terminal device 21.

[0025] Furthermore, the terminal device 21 does not necessarily have to be a portable terminal; it may be a stationary terminal device such as a desktop PC. Also, as a component of the exercise support system 10, both the display 21b and the projector 24 of the terminal device 21 are not necessarily required; either one is sufficient. Also, as a component of the exercise support system 10, the camera 21a is not limited to the one provided in the terminal device 21; an external camera such as a webcam may be used instead, or in addition to it. In addition, the peripheral devices (lighting device 22, sound device 23, projector 24, air conditioning device 25) do not necessarily have to be separate, independent devices; for example, the lighting device 22 may be an integrated smart light incorporating the sound device 23 and projector 24. Furthermore, the peripheral devices (lighting device 22, sound device 23, projector 24, air conditioning device 25) are not necessarily essential components of the exercise support system 10.

[0026] The facility equipment 30 consists of a controller 31 and peripheral equipment controlled by the controller 31 (lighting equipment 32, sound equipment 33, projector 34, cameras 36a to 36d, air conditioning equipment 35, floor load cell 37a, wall load cell 37b).

[0027] The controller 31 is a device that controls peripheral devices, such as a computer device like a PC, and includes a second storage unit 31c and a second control unit 31a.

[0028] The second memory unit 31c is a memory unit for storing exemplary training videos, and is, for example, a semiconductor non-volatile memory.

[0029] The second control unit 31a controls the display of training videos stored in the second memory unit 31c on the projector 34, calculates the difference between the user's movements detected by cameras 36a-36d, floor load cell 37a, and wall load cell 37b and the movements shown in the training videos, generates support videos to assist the user's movements based on the calculated difference, and controls the display of the generated support videos on the projector 34 in conjunction with the display of the training videos. The second control unit 31a consists of a memory for storing programs, a CPU for executing programs, input / output interfaces connected to peripheral components, a communication unit 31b, etc. The communication unit 31b is a communication interface that communicates with external devices, such as peripheral devices (lighting device 32, sound device 33, projector 34, cameras 36a-36d, air conditioning device 35, floor load cell 37a, wall load cell 37b), exercise support device 40, and in-home device 20, via wireless or wired communication. For example, it is a communication card for WiFi® or a mobile phone network.

[0030] The lighting device 32 is a device that illuminates the space where the user is located, and is, for example, an LED lighting device such as a ceiling light. Under the control of the controller 31, it is used as a device that enhances the user's motivation to exercise by adjusting the brightness and color in conjunction with the training video or support video. Note that the color adjustment referred to here includes full-color adjustment.

[0031] The sound device 33 is a speaker that provides sound such as music to the space where the user is located. Under the control of the controller 31, it is used as a device that produces a dramatic effect to enhance the user's motivation to exercise by playing sound contained in training videos or support videos.

[0032] Cameras 36a to 36d are examples of second detection units that detect the movements of a user exercising in accordance with training videos displayed by the projector 34 with higher precision than the first detection unit (i.e., camera 21a) that constitutes the in-home device 20, and are, for example, digital imaging devices. More specifically, cameras 36a to 36d are high-performance cameras that have at least one function greater than that of camera 21a in the in-home device 20, such as a wider field of view and a higher frame rate.

[0033] The projector 34 is an example of a second display unit for displaying exemplary training videos and support videos under the control of the controller 31. It is also used as a device that, under the control of the controller 31, produces a visual effect that enhances the user's motivation to exercise in conjunction with the training video or support video.

[0034] The air conditioning device 35 is a device that adjusts the air in the space where the user is located, and is such as an air conditioner, air purifier, circulator, or fan, and is used as a device to maintain an environment such as room temperature suitable for the user to exercise under the control of the controller 31.

[0035] The floor load cell 37a and wall load cell 37b are examples of force sensors included in the second detection unit that detect the user's pressing force against the floor and wall surfaces of the facility, respectively, and are sheets containing load cell sensors arranged in a two-dimensional manner.

[0036] Although the facility device 30 is equipped with four cameras 36a to 36d as a second detection unit, it may be equipped with only one, two, three, or five or more cameras, as long as they have higher accuracy than the first detection unit (i.e., camera 21a) that constitutes the in-home device 20. Furthermore, the peripheral devices (lighting device 32, sound device 33, projector 34, cameras 36a to 36d, air conditioning device 35, floor load cell 37a, wall load cell 37b) do not each need to be independent and separate devices. For example, the lighting device 32 may be an integrated smart light that incorporates the sound device 33 and projector 34. Also, the lighting device 32, sound device 33, air conditioning device 35, floor load cell 37a, and wall load cell 37b are not necessarily essential components of the exercise support system 10.

[0037] Although the second memory unit 31c has been described as being located in the facility device 30, it may also be located in the exercise support device 40, and the training video may be transmitted to the facility device 30 via a communication channel, and the second control unit 31a may then display it on the projector 34.

[0038] The exercise support device 40 is a server device that has the in-home device 20 and the facility device 30 as clients. For example, it is a computer device composed of a memory for storing programs, a CPU for executing programs, an input / output interface for connecting to peripheral devices, a communication unit, peripheral devices, etc. Functionally, it includes a training video generation unit 41. It may also include a third storage unit 47 for holding example training videos.

[0039] The training video generation unit 41 acquires difference data, calculated by the second control unit 31a of the facility device 30, which shows the difference between the user's movements and the movements shown in the training video, via a communication channel, and generates a model training video based on the acquired difference data. For example, the training video generation unit 41 stores the same training video used by the facility device 30 in the third storage unit 47, etc. The training video generation unit 41 adds images such as arrows indicating the direction to reduce the difference shown in the difference data acquired from the facility device 30 to the training video, or generates audio to guide the user in reducing the difference and includes it in the training video.

[0040] As a result, the terminal device 21 downloads exemplary training videos from the exercise support device 40 and stores them in the first memory unit 21c. When the user exercises at home, the terminal device 21 plays the videos back, allowing the user to effectively train using guided training videos that reflect the user's individuality, making effective use of the difference data generated by the facility device 30 equipped with a high-precision second detection unit (i.e., cameras 36a to 36d).

[0041] The training video generation unit 41 may acquire difference data from the facility device 30 offline, for example, via a portable recording medium owned by the user, without using a communication channel.

[0042] Next, we will explain the operation of the exercise support system 10 configured as described above.

[0043] Figure 3 is a flowchart showing the operation of the in-home device 20 in the exercise support system 10 according to the embodiment (i.e., an example of an exercise support method). Figure 4 is a diagram showing the operation of the in-home device 20 in the exercise support system 10 according to the embodiment.

[0044] The first control unit 21d of the in-home device 20 downloads exemplary training videos from the exercise support device 40, television broadcasts, or websites on the internet via the communication unit 21e and stores them in the first storage unit 21c (S10).

[0045] The first control unit 21d controls the display 21b or projector 24 to display the training video stored in the first memory unit 21c (S11). At this time, the first control unit 21d may play the audio included in the training video using the sound device 23, or it may analyze the intensity of the instructor's movements in the training video and, according to the analysis results, control the lighting device 22 and the sound device 23 to provide the user with a special effect, or it may control the air conditioning device 25 to adjust to a more comfortable room temperature.

[0046] The first control unit 21d uses the camera 21a to detect the movements of the user exercising in accordance with the training video displayed on the display 21b or projector 24 (S12). In other words, the first control unit 21d controls the camera 21a to capture the movements of the exercising user.

[0047] The first control unit 21d generates support video to assist the user's movements based on the detection results from the camera 21a (S13). The support video may be video showing the user's movements obtained from the camera 21a, or it may be a processed video such as a human body shape model (i.e., a skeleton model) generated by the analysis of that video by the first control unit 21d. The human body shape model is, for example, a model represented by multiple segments corresponding to the skeleton of the human body and multiple joints corresponding to the joints of the human body.

[0048] Then, as shown in Figure 4, the first control unit 21d controls the display 21b and / or projector 24 to display the generated support video 24a in conjunction with the display of the training video 24b, and if the support video includes sound, it controls the sound device 23 to play that sound (S14).

[0049] In this way, users can train at home while comparing their own movements with exemplary training videos. At this time, by downloading training videos that reflect the user's individuality using difference data generated by the exercise support device 40 as exemplary training videos (S10), effective exercise is supported, the habit of exercising is promoted, and the likelihood of continuing the exercise is increased.

[0050] In addition, the first control unit 21d may, in step S10, control the display 21b or projector 24 to display a training video on the display 21b or projector 24 from a model training video stored in the third storage unit 47 of the exercise support device 40 or the second storage unit 31c of the facility device 30, either from a television broadcast or a website on the internet (S11).

[0051] Figure 5 is a flowchart showing the operation of the facility device 30 in the exercise support system 10 according to the embodiment (i.e., an example of an exercise support method). Figure 6 is a diagram showing the operation of the facility device 30 in the exercise support system 10 according to the embodiment.

[0052] The second control unit 31a of the facility device 30 downloads exemplary training videos from the exercise support device 40, television broadcasts, or websites on the internet via the communication unit 31b and stores them in the second storage unit 31c (S20).

[0053] The second control unit 31a controls the display of the training video stored in the second memory unit 31c on the projector 34 (S21). At this time, the second control unit 31a may play the audio included in the training video using the sound device 33, or it may analyze the intensity of the instructor's movements in the training video and, according to the analysis results, control the lighting device 32 and the sound device 33 to provide a performance effect that enhances the user's motivation to exercise, or it may control the air conditioning device 35 to adjust to a more comfortable room temperature.

[0054] The second control unit 31a uses the second detection unit (i.e., cameras 36a to 36d, floor load cell 37a, and wall load cell 37b) to detect the user's movements in accordance with the training video displayed by the projector 34 with high precision (S22). The details of this will be described later.

[0055] The second control unit 31a then calculates the difference between the user's movements detected by the second detection unit (i.e., cameras 36a-36d, floor load cell 37a, and wall load cell 37b) and the movements shown in the training video (S23a), and generates a high-precision support video to assist the user's movements based on the calculated difference (S23b). For example, the second control unit 31a generates a human body shape model of the user and calculates muscle strength based on the calculated difference, and generates the generated human body shape model and calculated muscle strength as a support video. The details of this will be described later.

[0056] Then, as shown in Figure 6, the second control unit 31a controls the projector 34 to display the generated support video 51 in conjunction with the display of the training video 52, and if the support video 51 includes sound, it controls the sound device 33 to play that sound (S24).

[0057] Although the second memory unit 31c was described as being located in the facility device 30, it may also be located in the exercise support device 40, transmitting training video to the controller 31 via a communication channel, and then being displayed on the projector 34 by the second control unit 31a.

[0058] Figures 7A to 7C illustrate the details of step S22, in which user movement is detected with high precision using cameras 36a to 36d, floor load cell 37a, and wall load cell 37b.

[0059] Figure 7A shows an example of the arrangement of cameras 36a-36d, floor load cells 37a, and wall load cells 37b in the space where the user trains. Figure 7A(a) is a horizontal view of the space where the user trains. Figure 7A(b) is a vertical view of the space where the user trains. Camera 36a is positioned in front of the user to zoom in and photograph the user's face. Cameras 36b-36d, which constitute Kinect (a trademark of Microsoft Corporation) to capture the user's movements, are positioned on the walls in front of the user and to the left and right of the user. Sheet-shaped floor load cells 37a are positioned on the floor, and sheet-shaped wall load cells 37b are positioned on the wall in front of the user.

[0060] Figure 7B shows an example of user movement detection by the second control unit 31a using cameras 36a-36d, floor load cell 37a, and wall load cell 37b. Here, the positions of the joints in the human body shape model generated from the images captured by cameras 36b-36d are indicated by circles.

[0061] Figure 7C shows an example of detecting the user's center of gravity using a floor load cell 37a. Figure 7C(a) shows a user standing still on the floor load cell 37a (left figure) and the user's center of gravity detected by the floor load cell 37a at that time (circle 37c in the right figure). Figure 7C(b) shows a user moving on the floor load cell 37a (left figure) and the user's center of gravity detected by the floor load cell 37a at that time (circle 37c in the right figure).

[0062] Figure 8 is a flowchart showing the details of steps S23a and S23b in Figure 5.

[0063] The second control unit 31a analyzes the video footage showing the user's movements obtained from cameras 36b to 36d to generate a human body shape model of the user and calculates muscle strength (S23a1). Similarly, the second control unit 31a analyzes the training video to generate a human body shape model of the instructor in the training video and calculates muscle strength (S23a2).

[0064] More specifically, regarding the generation of the human body shape model, the second control unit 31a extracts the user's region from the images obtained by cameras 36b to 36d using methods such as YOLO (You Only Look Once) or SSD (Single Shot Multibox Detector), which enable high-speed object detection. Then, for the extracted region, it extracts skeletal points from the person image in each frame using a method such as CPN (Cascaded Pyramid Network), connects these skeletal points, and generates a three-dimensional human body shape model with multiple segments and joints. Furthermore, regarding muscle strength, the second control unit 31a calculates the joint force for each joint when the human body shape model performs movement, and calculates the muscle strength for each muscle by distributing the muscle strength obtained from the joint force for each joint in the human body shape model according to the cross-sectional area of ​​the multiple muscles that support the joint, based on a muscle model (muscle / muscle strength database) that defines the volume of the muscle and the position where the muscle attaches to the body segment (see Japanese Patent Publication No. 2013-68979 (Patent Document 2)).

[0065] The second control unit 31a then calculates the differences in body shape models and muscle strength between the user and the instructor (S23a3), and adds images such as arrows indicating the direction to reduce the differences to the calculated user body shape model, thereby generating a support video (S23b1). At this time, the second control unit 31a may also generate audio explaining the calculated differences, or audio guiding to reduce the differences, and include them in the support video.

[0066] Next, the second control unit 31a corrects the user's muscle strength calculated from the video using the pressing force detected by the floor load cell 37a and the wall load cell 37b (S23b2). For example, the second control unit 31a corrects the user's muscle strength calculated from the video to bring it closer to the muscle strength calculated from the pressing force detected by the floor load cell 37a and the wall load cell 37b.

[0067] Furthermore, the second control unit 31a corrects the center of gravity of the generated human body shape model based on the pressing force detected by the floor load cell 37a and the wall load cell 37b (S23b3). For example, the second control unit 31a corrects the center of gravity of the user's human body shape model calculated from the video to bring it closer to the center of gravity detected by the floor load cell 37a.

[0068] The corrected human body shape model and muscle strength are displayed as support images on the projector 34 in conjunction with the display of the training video, and the audio included in the support images is played back by the sound device 33.

[0069] Figure 9 shows an example of the display of support video 51 and training video 52 by the projector 34 of the facility device 30 according to the embodiment. As shown in this figure, the support video 51 is displayed on the left side of the wall in front of the user and consists of the outline 51a of the user exercising, a human body shape model 51b, muscle strength 51c, and an arrow 51d indicating the direction to approach the training video 52 which serves as an example. The training video 52 is displayed on the right side of the wall in front of the user and consists of the outline 52a of the instructor in the video, a human body shape model 52b, and muscle strength 52c.

[0070] In this way, by using the facility equipment 30 installed in fitness gyms, etc., users can understand the differences between their training and the training video with higher accuracy and from multiple perspectives compared to training at home, and can efficiently train to approximate the movements of the instructor shown in the example training video.

[0071] Furthermore, the facility device 30 has a function to change the training video according to the state of the user exercising. Figure 10 is a flowchart showing the movement of the facility device 30 in which the training video is changed according to the state of the user exercising.

[0072] The second control unit 31a estimates the user's emotions from the facial image of the exercising user captured by the camera 36a (S30). Specifically, the second control unit 31a acquires physiological data such as facial color and heart rate associated with changes in blood flow, and non-physiological data such as facial expressions identified by the position of facial feature points, from the user's facial image. Based on this acquired data, it calculates the user's arousal value and comfort value, estimates emotions such as "relaxed" and "distressed" from the user's training status, and calculates the degree of the estimated emotion ("relaxation" and "distress") (see Japanese Patent Application Publication No. 2017-144222 (Patent Document 3)).

[0073] Then, if the estimated emotion indicates a level of relaxation greater than a threshold (i.e., the emotion with the highest degree of matching is "relaxed," and its degree of matching exceeds the threshold) (Yes in S31), the second control unit 31a changes the displayed training video to a training video with a higher exercise load (S32). For example, the second control unit 31a speeds up the playback speed of the training video.

[0074] Furthermore, if the estimated emotion indicates a level of distress that exceeds a threshold (i.e., the emotion with the highest degree of matching is "distressed," and its degree of matching exceeds the threshold) (Yes in S33), the second control unit 31a changes the displayed training video to a training video with a lower exercise load (S34). For example, the second control unit 31a slows down the playback speed of the training video.

[0075] By modifying training videos based on emotion estimation, the exercise load given to the user will be adjusted to a value that matches the user's exercise ability and condition, thus providing effective exercise support to the user.

[0076] In the above embodiment, the in-home device 20 and the facility device 30 performed various processes such as generating support videos to assist the user's exercise. However, in addition to or instead of this, the exercise support device may perform various processes as a server device.

[0077] Figure 11 is a block diagram showing the configuration of the exercise support device 40a in the exercise support system 10a according to a modified embodiment. In addition to the training video generation unit 41 provided in the exercise support device 40 according to the above embodiment, this exercise support device 40a includes a human body shape model generation unit 42, a muscle strength calculation unit 43, a support video generation unit 44, and an emotion estimation unit 45.

[0078] The human body shape model generation unit 42 generates a human body shape model of the user by analyzing video footage showing the user's movements obtained by cameras sent from the in-home device 20 and the facility device 30, and also generates a human body shape model of the instructor in the training video by analyzing pre-stored training video footage.

[0079] The muscle strength calculation unit 43 calculates the user's muscle strength by analyzing video footage of the user's movements obtained from cameras sent from the in-home device 20 and the facility device 30, and also calculates the muscle strength of the instructor in the training video by analyzing pre-stored training videos.

[0080] The functions of the human body shape model generation unit 42 and the muscle strength calculation unit 43 correspond to the processing of steps S23a1 and S23a2 in the flowchart of Figure 8 in the above embodiment.

[0081] The support video generation unit 44 calculates the difference between the user's and instructor's human body shape models and muscle strength, which are generated and calculated by the human body shape model generation unit 42 and the muscle strength calculation unit 43. It then adds images such as arrows indicating the direction to reduce the difference to the generated user's human body shape model and processes it to generate a support video. At this time, the user's muscle strength calculated by the muscle strength calculation unit 43 may be corrected using the pressing force detected by the floor load cell 37a and wall load cell 37b sent from the facility device 30, or the center of gravity position of the human body shape model generated by the human body shape model generation unit 42 may be corrected from that pressing force. The function of this support video generation unit 44 corresponds to the processing of steps S23a3 to S23b3 in the flowchart of Figure 8 in the above embodiment.

[0082] The emotion estimation unit 45 estimates the user's emotions from the facial image of the moving user captured by the camera 36a, which is sent from the facility device 30. The function of this emotion estimation unit 45 corresponds to the process of step S30 in the flowchart of Figure 10 in the above embodiment.

[0083] Figure 12A is a communication sequence diagram showing the interaction between the in-home device 20 and the exercise support device 40a in an exercise support system 10a according to a modified embodiment. Figure 12A(a) shows a sequence in which the in-home device 20 repeatedly uploads video showing the user's movements obtained by the camera 21a of the in-home device 20 to the exercise support device 40a. Figure 12A(b) shows a sequence in which the exercise support device 40a streams support video generated by the human body shape model generation unit 42, muscle strength calculation unit 43, and support video generation unit 44 of the exercise support device 40a to the in-home device 20. The sequences shown in Figure 12A(a) and Figure 12A(b) are performed in parallel. Through such sequences, the in-home device 20 can support the user's exercise in real time using the support video generated by the exercise support device 40a.

[0084] Figure 12B is a communication sequence diagram showing the interaction between the facility device 30 and the exercise support device 40a in an exercise support system 10a according to a modified embodiment. Figure 12B(a) shows a sequence in which the facility device 30 repeatedly uploads video showing the user's movements obtained from the facility device 30's cameras 36a to 36d, and data on the user's pressing force detected by the floor load cell 37a and wall load cell 37b to the exercise support device 40a. Figure 12B(b) shows a sequence in which the exercise support device 40a repeatedly streams support video generated by the human body shape model generation unit 42, muscle strength calculation unit 43, and support video generation unit 44 of the exercise support device 40a to the facility device 30, and downloads data showing emotions estimated by the emotion estimation unit 45 of the exercise support device 40a. The sequences shown in Figure 12B(a) and Figure 12B(b) are performed in parallel. This sequence allows the facility device 30 to support the user's exercise in real time using support videos generated by the exercise support device 40a, and to adjust the load of the training videos according to the user's emotions.

[0085] The repetition of the sequence in Figures 12A and 12B is performed, for example, in predetermined units (a predetermined number of frames, a predetermined time, or each scene in the video) in the video uploaded to the motion support device 40a.

[0086] Furthermore, the in-home device 20, the facility device 30, and the exercise support device 40a may acquire exercise videos of athletes or instructors from television broadcasts or websites on the internet when acquiring training videos, generate a human body shape model from the acquired exercise videos, calculate muscle strength, and generate training videos with the generated human body shape model and calculated muscle strength added.

[0087] As described above, the exercise support system 10 according to this embodiment comprises a home device 20 that supports exercise training by a user at home, a facility device 30 that supports exercise training by a user in a facility, an exercise support device 40 connected to at least the home device 20 via a communication path, and a storage unit provided in any of the home device 20, facility device 30, and exercise support device 40 that holds exemplary training videos. The home device 20 has a first display unit such as a display 21b and / or a projector 24 that displays videos, a first control unit 21d that controls the display of the training videos held in the storage unit on the first display unit, and a first detection unit such as a camera 21a that detects the movements of a user exercising in accordance with the training videos displayed on the first display unit. The first control unit 21d further controls the display of support videos for assisting the user's exercise, which are generated based on the detection results of the first detection unit, on the first display unit in conjunction with the display of the training videos. The facility device 30 includes a second display unit such as a projector 34 that displays images, a second control unit 31a that controls the display of training images stored in the memory unit on the second display unit, and a second detection unit such as cameras 36a to 36d that detect the movements of the user exercising in accordance with the training images displayed on the second display unit with higher precision than the first detection unit of the in-home device 20. The second control unit 31a further calculates the difference between the user's movements detected by the second detection unit and the movements shown in the training images, and controls the display of support images to assist the user's exercise, which are generated based on the calculated difference, on the second display unit in conjunction with the display of the training images. The exercise support device 40 acquires difference data showing the difference calculated by the second control unit 31a of the facility device 30, and generates a model training image based on the acquired difference data. The in-home device 20 acquires the training images generated by the exercise support device 40 via a communication channel and stores them in the memory unit.

[0088] Furthermore, the above-mentioned storage units are provided as a first storage unit 21c and a second storage unit 31c in the in-home device 20 and the facility device 30, respectively. The first control unit 21e of the in-home device 20 controls the display of the training video held in the first storage unit 21c on the first display unit, and the second control unit 31d of the facility device 20 controls the display of the training video held in the second storage unit 31c on the second display unit. The in-home device 30 may also acquire the training video generated by the exercise support device 40 via a communication channel and store it in the first storage unit 21c.

[0089] As a result, information regarding the difference between the movements shown in the training video and the user's movements, obtained through high-precision sensing in the facility device 30, is fed back to the in-home device 20 via the exercise support device 40. In other words, the user can train using training videos that are tailored to the user and reflect their individual characteristics, using the in-home device 20. Thus, an exercise support system is realized that can support more effective exercise than before and encourage users to make exercise a habit, thereby increasing its continuation.

[0090] Furthermore, in the in-home device 20, the display 21b as the first display unit, the first storage unit 21c, the first control unit 21d, and the camera 21a as the first detection unit constitute a single terminal device 21 such as a smartphone. This allows users to easily perform exercise training at home using a terminal device such as a smartphone.

[0091] Furthermore, in the in-home device 20, the first display unit is a projector 24, and the first storage unit 21c, the first control unit 21d, and the camera 21a as the first detection unit may constitute a single terminal device 21 connected to the projector 24 by a communication path. This allows the user to perform exercise training in their home using a large screen projected by the projector 24, in an environment similar to that of the facility device 30.

[0092] Furthermore, in the facility device 30, the second control unit 31a controls the display of the training video to provide at least one of the video and sound that enhances the user's motivation to exercise in the space where the user is located. As a result, the facility device 30 provides a visual effect to the user exercising, thereby increasing the user's motivation to exercise.

[0093] Furthermore, the first detection unit of the in-home device 20 is a single camera 21a, and in the facility device 30, the second detection unit is one or more cameras 36a to 36d having at least one function of wider field of view and higher frame rate than the camera 21a of the in-home device 20, and the second display unit is a projector 34. As a result, the facility device 30 can sense the user's movements with high accuracy and effectively support the user's movement.

[0094] Furthermore, the exercise support device 40 acquires exercise videos of athletes or instructors from television broadcasts or websites on the internet, generates a human body shape model from the acquired exercise videos, calculates muscle strength, and generates training videos using the generated human body shape model and calculated muscle strength. As a result, high-quality training videos can be produced without the time and cost required to outsource to a specialized production company.

[0095] Furthermore, in the facility device 30, the second control unit 31a generates a human body shape model of the user and calculates muscle strength based on the calculated difference, and displays the generated human body shape model and calculated muscle strength as support images on the projector 34, which serves as the second display unit. As a result, in the facility device 30, the user can intuitively grasp the difference between the training video and their own movements by checking the displayed human body shape model and muscle strength, and efficiently improve their skills.

[0096] Furthermore, the second detection unit includes a floor load cell 37a and a wall load cell 37b as force sensors that detect the user's pressing force against at least one of the facility's floor and wall surfaces. The second control unit 31a then corrects the muscle force calculated from the pressing force detected by the floor load cell 37a and the wall load cell 37b. This allows for the calculation of an accurate muscle force that reflects the actual pressing force applied by the user.

[0097] Furthermore, the second control unit 31a corrects the center of gravity of the generated human body shape model based on the pressing force detected by the floor load cell 37a and wall load cell 37b, which act as force sensors. This allows for the calculation of an accurate center of gravity that reflects the user's actual weight shift.

[0098] Furthermore, the second detection unit includes a camera 36a that captures the user's face, and the second control unit 31a estimates the user's emotions from the user's face captured by the camera 36a. If the estimated emotion indicates a level of relaxation that is greater than a threshold, the displayed training video is changed to a training video with a higher exercise load. If the estimated emotion indicates a level of discomfort that is greater than a threshold, the displayed training video is changed to a training video with a lower exercise load. As a result, the exercise load given to the user is appropriate to the user's exercise ability and condition, and exercise support is effectively provided to the user.

[0099] Furthermore, the present invention may be implemented as a program in the home device 20 or the facility device 30. The program is a program executed by a computer in the home device 20 or the facility device 30 of the exercise support system 10, and includes a training video display step that controls the display of training videos stored in the storage unit on the display unit; a detection step that uses a detection unit to detect the movements of a user exercising in accordance with the training videos displayed on the display unit; and a support video display step that controls the display of support videos generated based on the detection results by the detection unit in conjunction with the display of the training videos.

[0100] Such a program enables the realization of an in-home device 20 or facility device 30 of an exercise support system that can support more effective exercise than before, and encourage users to make exercise a habit, thereby increasing its continuation.

[0101] Furthermore, the system includes a communication step in which the detection results from the detection step are transmitted to the exercise support device 40a via a communication channel, and support video generated by the exercise support device 40a based on the transmitted detection results is acquired. In the support video display step, the support video acquired in the communication step is displayed on the display unit in conjunction with the display of the training video. This realizes a client program that operates in cooperation with the exercise support device 40a, which acts as a server device.

[0102] Furthermore, the present invention may be implemented as a program in a home device 20 or a facility device 30. The program is executed by a computer in the home device 20 or facility device 30 and includes the steps of acquiring exercise videos of athletes or instructors from television broadcasts or websites on the internet, generating a human body shape model from the acquired exercise videos and calculating muscle strength, generating training videos using the generated human body shape model and calculated muscle strength, and storing them in the first storage unit 21c or the second storage unit 31c. This allows for the generation of high-quality training videos without the time and cost required compared to outsourcing to a professional production company.

[0103] Furthermore, the present invention relates to an exercise support method using an exercise support system 10 comprising: an in-home device 20 that supports exercise training by a user at home; a facility device 30 that supports exercise training by a user in a facility; an exercise support device 40 connected to the in-home device 20 and the facility device 30 via a communication path; and a storage unit provided in any of the in-home device 20, the facility device 30, and the exercise support device 40 that holds exemplary training videos, wherein the method comprises: the in-home device 20 displays the training video stored in the storage unit on a first display unit such as a display 21b; the in-home device 20 uses a first detection unit such as a camera 21a to detect the movements of a user exercising in accordance with the training video displayed on the first display unit; and the in-home device 20 displays a support video for assisting the user's exercise, generated based on the detection results from the first detection unit, on the first display unit in conjunction with the display of the training video. The facility device 30 includes the steps of: displaying training video stored in the memory unit on the second display unit; detecting the movements of the user exercising in accordance with the training video displayed on the second display unit with higher accuracy than the first detection unit of the in-home device 20, using a second detection unit such as cameras 36a to 36d; calculating the difference between the user's movements detected by the second detection unit and the movements shown in the training video, and displaying a support video for assisting the user's exercise, generated based on the calculated difference, on the second display unit such as a projector 34 in conjunction with the display of the training video; acquiring difference data showing the difference calculated by the facility device 30, and generating a model training video based on the acquired difference data; and acquiring the training video generated by the exercise support device 40 via a communication channel and storing it in the memory unit.

[0104] As a result, information regarding the difference between the movements shown in the training video and the user's movements, obtained through high-precision sensing in the facility device 30, is fed back to the in-home device 20 via the exercise support device 40, realizing an exercise support system that promotes the habituation of exercise and improves continuity more effectively than conventional systems.

[0105] Although the exercise support system and exercise support method according to the present invention have been described above based on embodiments and modifications, the present invention is not limited to these embodiments and modifications. Within the scope of the present invention, various modifications that a person skilled in the art can conceive of may be applied to the embodiments and modifications, as well as other forms constructed by combining some of the components of the embodiments and modifications, are also included without departing from the spirit of the present invention.

[0106] For example, in the above embodiment, the training video generation unit 41 is provided in the exercise support device 40, but it may also be provided in the terminal device 21 of the in-home device 20. In that case, the terminal device 21 of the in-home device 20 acquires the difference data generated by the facility device 30 instead of the exercise support device 40, and generates a model training video based on the acquired difference data and stores it in the first storage unit 21c.

[0107] Furthermore, in the above embodiment, the facility device 30 is equipped with a floor load cell 37a and a wall load cell 37b, but these may also be provided in the in-home device 20. In that case, the user's pressing force data detected by the floor load cell and wall load cell provided in the in-home device 20 is uploaded to the exercise support device 40a, the emotion estimation unit 45 of the exercise support device 40a performs emotion estimation, and the data indicating the estimated emotion is downloaded to the in-home device 20 and used to adjust the load of the training video in the home.

[0108] Furthermore, the emotion estimation method is not limited to that described in the above embodiment. It may also be possible to learn the user's facial images under low or high exercise loads using deep learning, and then estimate the emotion by comparing the user's facial images with an emotion database. In this case, in addition to training a multilayer network with features, machine learning may be performed specifying features such as the degree of eye opening, the distance between eyebrows, frown lines, and mouth shape.

[0109] Furthermore, the exercise support devices 40 and 40a are not limited to a single unit configuration, but may be composed of multiple server devices distributed according to their processing functions. [Industrial applicability]

[0110] The present invention can be used as an exercise support system that assists users in their exercise using training videos, and in particular as an exercise support system including in-home devices and facility devices that can support exercise more effectively than conventional systems and encourage users to make exercise a habit, thereby increasing its continuation. [Explanation of symbols]

[0111] 10, 10a Exercise support system 20 In-home equipment 21 Terminal device 21a, 36a~36d Camera 21c 1st memory section 21d First control unit 24, 34 projectors 24a, 51 Support video 24b, 52 Training video 30 Facility Equipment 31a Second control unit 31c 2nd memory section 40, 40a Exercise support device

Claims

1. an in-home device that supports exercise training by a user at home; a facility device that supports exercise training by the user within the facility; an exercise support device connected to the home device and the facility device via a communication path; a storage unit that is provided in any one of the home device, the facility device, and the exercise support device and that stores training video as a model; Equipped with The home device a first display unit that displays an image; a first control unit that controls the first display unit to display the training video stored in the storage unit; a first detection unit that detects the movement of the user exercising in accordance with the training video displayed on the first display unit, the first control unit further controls the first display unit to display an assistance video for assisting the user in exercising, the assistance video being generated based on a detection result by the first detection unit, in conjunction with the display of the training video; The facility device includes: a second display unit that displays an image; a second control unit that controls the second display unit to display the training video stored in the storage unit; a second detection unit that detects the user's movements as they exercise in accordance with the training video displayed on the second display unit with higher accuracy than the first detection unit; the second control unit further calculates a difference between the user's movement detected by the second detection unit and the movement shown in the training video, and controls the second display unit to display an assistance video for assisting the user's exercise, the assistance video being generated based on the calculated difference, in conjunction with the display of the training video; the exercise support device acquires difference data indicating the difference calculated by the second control unit, and generates a model training video based on the acquired difference data; the in-home device acquires the training video generated by the exercise support device via the communication path and stores the training video in the storage unit; Exercise support system.

2. the storage units are provided as a first storage unit and a second storage unit in the home device and the facility device, respectively, and a first control unit of the home device controls the first display unit to display the training video stored in the first storage unit; a second control unit of the facility device performing control to display the training video stored in the second storage unit on the second display unit; the in-home device acquires the training video generated by the exercise support device via the communication path and stores the training video in the first storage unit; The exercise support system according to claim 1 .

3. the first display unit, the first storage unit, the first control unit, and the first detection unit constitute one mobile terminal; The exercise support system according to claim 2 .

4. the first display unit is a projector, the first storage unit, the first control unit, and the first detection unit constitute one mobile terminal connected to the projector via a communication path; The exercise support system according to claim 2 .

5. The second control unit further controls to provide at least one of an image and an audio that increases the user's motivation to exercise in the space where the user is present, in conjunction with the display of the training image. The exercise support system according to any one of claims 1 to 4.

6. the first detector is a single camera, the second detection unit is one or more cameras having at least one function of a wider angle of view and a higher frame rate than the first detection unit, the second display unit is a projector. The exercise support system according to any one of claims 1 to 5.

7. the exercise support device acquires exercise video of an athlete or an instructor from a television broadcast or a website on the Internet, generates a human body shape model from the acquired exercise video and calculates muscle strength, and generates the training video using the generated human body shape model and the calculated muscle strength. The exercise support system according to any one of claims 1 to 6.

8. the second control unit generates a human body geometric model of the user and calculates muscle strength based on the calculated difference, and causes the second display unit to display the generated human body geometric model and the calculated muscle strength as the support video. The exercise support system according to any one of claims 1 to 7.

9. The second detection unit includes a force sensor that detects a pressing force of the user against at least one of a floor surface and a wall surface of the facility. The exercise support system according to claim 8.

10. The second control unit corrects the calculated muscle force from the pressing force detected by the force sensor. The exercise support system according to claim 9.

11. the second control unit corrects a center of gravity position of the generated human body shape model based on the pressing force detected by the force sensor. The exercise support system according to claim 9.

12. the second detection unit includes a camera that captures an image of the user's face, The second control unit estimates the emotion of the user from the face of the user photographed by the second detection unit, and if a sense of relaxation indicated by the estimated emotion is greater than a threshold, changes the displayed training video to a training video with a higher exercise load, and if a sense of pain indicated by the estimated emotion is greater than a threshold, changes the displayed training video to a training video with a lower exercise load. The exercise support system according to any one of claims 1 to 11.

13. A program executed by a computer included in an in-home device in the exercise support system according to any one of claims 1 to 12, a training video display step of controlling the first display unit to display the training video stored in the storage unit; a detecting step of detecting, using the first detecting unit, the movement of the user exercising in accordance with the training video displayed on the first display unit; an assistance video display step of controlling the first display unit to display an assistance video generated based on a detection result by the first detection unit in conjunction with the display of the training video, program.

14. a communication step of transmitting a detection result in the detection step to the exercise support device via a communication path, and acquiring an support video generated by the exercise support device based on the transmitted detection result, In the support video display step, the support video acquired in the communication step is displayed on the first display unit in conjunction with the display of the training video. The program according to claim 13.

15. A program executed by a computer included in an in-home device or a facility device in the exercise support system according to any one of claims 1 to 12, acquiring an exercise video of an athlete or an instructor from a television broadcast or a website on the Internet, generating a human body shape model from the acquired exercise video and calculating muscle strength, generating a training video using the generated human body shape model and the calculated muscle strength, and storing the training video in the storage unit. program.

16. An exercise support method using an exercise support system including: a home device that supports exercise training by a user at home; a facility device that supports exercise training by the user in a facility; an exercise support device connected to at least the home device and the facility device via a communication path; and a storage unit that is provided in any one of the home device, the facility device, and the exercise support device and that stores a training video to serve as a model, a step of causing the home device to display the training video stored in the storage unit on a first display unit; a step in which the home device detects, using a first detection unit, a movement of the user exercising in accordance with the training video displayed on the first display unit; a step of causing the home device to display, on the first display unit, an assistance video for assisting the user in exercising, the assistance video being generated based on a detection result by the first detection unit, in conjunction with display of the training video; a step of causing the facility device to display the training video stored in the storage unit on a second display unit; a step in which the facility device uses a second detection unit to detect the movement of the user exercising in accordance with the training video displayed on the second display unit with higher accuracy than the first detection unit; a step in which the facility device calculates a difference between the user's movement detected by the second detection unit and the movement shown in the training video, and displays an assistance video for assisting the user's exercise, the assistance video being generated based on the calculated difference, on the second display unit in conjunction with the display of the training video; a step in which the exercise support device acquires difference data indicating the difference calculated by the facility device, and generates a model training video based on the acquired difference data; and a step in which the home device acquires the training video generated by the exercise support device via the communication path and stores the training video in the storage unit. Exercise support method.

17. 17. The exercise support method using the exercise support system according to claim 16, wherein the storage unit is provided as a first storage unit and a second storage unit in the in-home device and the facility device, respectively. a step of controlling the in-home device to display the training video stored in the first storage unit on the first display unit; a step of controlling the facility device to display the training video stored in the second storage unit on the second display unit; and a step of, by the in-home device, acquiring the training video generated by the exercise support device via the communication path and storing the training video in the first storage unit. The exercise support method according to claim 16.

Images