Information processing device, system, and program

The information processing apparatus and system provide real-time feedback and personalized notifications by analyzing operation and user images, enhancing training effectiveness in devices using electric motors for load application.

WO2026150671A1PCT designated stage Publication Date: 2026-07-16SONY GROUP CORP

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
SONY GROUP CORP
Filing Date
2025-11-18
Publication Date
2026-07-16

AI Technical Summary

Technical Problem

Existing training devices that utilize electric motors for applying load to a user's body lack effective mechanisms for providing appropriate information regarding training, such as real-time feedback and personalized notifications.

Method used

An information processing apparatus and system that includes a control unit generating notification information based on operation information of a load control unit and user images, using a training device with an operation unit connected to a string-like part, along with an imaging device that captures images (still images or moving images) and a load control unit that controls the load applied to the string-like part, and an output device that outputs this information.

Benefits of technology

Enables real-time feedback and personalized notifications during training, improving user engagement and training efficiency by providing accurate and timely information on user posture and training progress.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025040303_16072026_PF_FP_ABST
    Figure JP2025040303_16072026_PF_FP_ABST
Patent Text Reader

Abstract

[PROBLEM] To provide a mechanism capable of notifying more appropriate information on training. [SOLUTION] An information processing device including a control unit which, using a training device having an operating unit connected to a string-shaped part and a load control unit which pulls the string-shaped part and controls a load applied to the string-shaped part, generates notification information relating to training performed by a user on the basis of operation information of the load control unit and an image of the user, the operation information and the image being obtained when the user performs training that moves the operation unit.
Need to check novelty before this filing date? Find Prior Art

Description

Information Processing Apparatus, System, and Program

[0001] The present disclosure relates to an information processing apparatus, a system, and a program.

[0002] In recent years, training devices that apply a load to a user's body using the driving force of an electric motor or the like have been newly developed. In such a training device, the installation space is made more compact than a training device that applies a load to a user's body using weights. For example, Patent Document 1 discloses a training device that performs training by a user pulling a wire to which tension is applied by an electric motor.

[0003] U.S. Patent No. 9,050,486

[0004] With the development of such training devices as hardware, it is desirable that technologies related to information notification regarding training using the training device also develop.

[0005] Therefore, an object of the present disclosure is to provide a mechanism capable of notifying more appropriate information regarding training.

[0006] In order to solve the above problems, according to an aspect of the present disclosure, there is provided an information processing apparatus including: a control unit that generates notification information regarding training performed by a user based on operation information of a load control unit and an image of the user obtained when the user performs training of moving an operation unit using a training device having an operation unit connected to a string-like part and a load control unit that controls a load applied to the string-like part by pulling the string-like part.

[0007] Furthermore, in order to solve the above problems, according to another aspect of this disclosure, a system is provided comprising: a training device having an operating unit connected to a string-like part and a load control unit that pulls the string-like part to control the load applied to the string-like part; an imaging device that captures an image of a user using the training device; an information processing device that generates notification information regarding the training performed by the user based on the operation information of the load control unit and the image of the user obtained when the user performs training to move the operating unit using the training device; and an output device that outputs the generated notification information.

[0008] Furthermore, in order to solve the above problems, a program is provided to cause a computer to function as a control unit that generates notification information regarding the training performed by a user, based on the operation information of the load control unit and the user's image obtained when a user performs training to move the operation unit using a training device having an operating unit connected to a string-like part and a load control unit that pulls the string-like part to control the load applied to the string-like part.

[0009] This figure shows an example of the configuration of the training system 100 according to this embodiment. This figure shows a state in which a user is performing an incline press using the training device 1 according to this embodiment. This figure shows a state in which a user is performing a lat pulldown using the training device 1 according to this embodiment. This figure schematically shows the configuration of the drive device 5 and the string-like part 7 according to this embodiment. This figure shows an example of the functional configuration of the training system 100 according to this embodiment. This figure shows an example of UI screen D1 for selecting a training exercise. This figure shows an example of UI screen D2 for setting training parameters. This figure shows an example of UI screen D3 for real-time feedback. This figure shows a detailed configuration of the guide waveform WG. This figure shows an example of the overall view of the guide waveform WG. This figure shows an example of UI screen D4 for real-time feedback. This figure shows an example of UI screen D5 for real-time feedback. This figure shows an example of UI screen D6 for providing feedback on waveform analysis results. This figure shows an example of UI screen D7 for providing feedback on posture analysis results. This figure shows an example of a time chart related to analysis and feedback. This flowchart shows an example of the processing flow executed by the training system 100 according to this embodiment. This block diagram shows an example of the hardware configuration of the information processing device according to this embodiment. This figure shows an example of UI screen D8 for real-time feedback. This figure shows an example of UI screen D9 for real-time feedback.

[0010] Preferred embodiments of this disclosure will be described in detail below with reference to the attached drawings. In this specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0011] The explanation will be presented in the following order: 1. Example configuration of training system 100 2. Example functional configuration of training system 100 3. Control example 4. Operation processing example 5. Hardware configuration example 6. Supplementary information

[0012] <1. Example of the configuration of the training system 100> Below, an example of the configuration of the training system 100 according to one embodiment of the present disclosure will be described with reference to Figures 1 to 4.

[0013] Figure 1 shows an example of the configuration of the training system 100 according to this embodiment. As shown in Figure 1, the training system 100 comprises a training device 1, two UI (User Interface) devices 110 (110A and 110B), and three imaging devices 120 (120A to 120C). For example, the training system 100 acquires information about training performed by the user using the training device 1 using the training device 1 and the imaging devices 120, and provides notification information generated based on the acquired information to the user using the UI device 110.

[0014] The UI device 110 is the interface between the training system 100 and the user. The UI device 110 may be, for example, a tablet terminal. The UI device 110 may include various input devices such as buttons, a touch panel, a microphone, and a camera, which are used to receive information from the user. The UI device 110 may also include various output devices such as a display, a speaker, and a vibrator, which are used to output information to the user.

[0015] The two UI devices 110 are positioned in front of and behind the training device 1. This allows the user to easily access the UI devices 110 regardless of their posture while training.

[0016] The imaging device 120 is a device that captures images (still images or moving images). The imaging device 120 may be, for example, a 2D camera. The imaging device 120 is positioned and positioned so as to capture at least a portion, preferably the entire, of the user training using the training device 1 within its field of view.

[0017] The three imaging devices 120 are positioned in front of, behind, and to the side of the training device 1. Therefore, regardless of the user's posture during training, the training device 1 can prevent the user's body from being obscured and thus reduce occlusion.

[0018] The number of UI devices 110 in the training system 100 may be 1 or 3 or more, and the number of imaging devices 120 in the training system 100 may be 1, 2, or 4 or more.

[0019] The user can perform various exercises using the training device 1. Figure 1 shows the user performing a bench press using the training device 1. Figure 2 shows the user performing an incline press using the training device 1 according to this embodiment. Figure 3 shows the user performing a lat pulldown using the training device 1 according to this embodiment. As shown in Figures 1 to 3, the training device 1 is deformable according to the exercise.

[0020] The training device 1 may be transformable into a stored state with each part moved to its storage position, or into a usable state with each part extended. Figures 1 to 3 illustrate the training device 1 in the usable state. The configuration of the training device 1 will be described in detail below.

[0021] As shown in Figures 1 to 3, the training device 1 includes a seat 2. The seat 2 is an example of a support part that supports the user's body during training. The seat 2 is formed in a shape that has a longitudinal direction and a transverse direction as a whole, and supports the user's body. Of the seat 2, the surface that supports the user's body when the user is sitting on the seat 2 or lying on their back on the seat 2 will be referred to as the seat surface below.

[0022] In this specification, with the seat surface of seat 2 in a horizontal position, one side along the longitudinal direction of the seat surface of seat 2 is considered the front, and the other side the rear. In each drawing, the X-axis is shown along the front-to-back direction. The positive direction along the X-axis is the front, and the negative direction is the rear. The short direction of the seat surface of seat 2 is considered the left-to-right direction. In each drawing, the Y-axis is shown along the left-to-right direction. The positive direction along the Y-axis is to the right, and the negative direction is to the left. The thickness direction of seat 2, i.e., the direction perpendicular to the seat surface, is considered the up-and-down direction. That is, the direction from the seat surface to the back surface of seat 2 is considered down, and the direction from the back surface to the seat surface is considered up. In addition, in each drawing, the Z-axis is shown along the up-and-down direction. The positive direction along the Z-axis is up, and the negative direction is down.

[0023] The seat 2 is divided into a first seat 23 located on the front side and a second seat 24 located on the rear side. The postures of the first seat 23 and the second seat 24 can be controlled independently. For example, the first seat 23 may be rotatable around a rotation axis parallel to the Y-axis located on the rear end of the first seat 23. The first seat 23 may also be rotatable around a rotation axis parallel to the X-axis direction and / or parallel to the Z-axis direction. With such a configuration, the seat 2 can support the user in a posture that suits the user's body type, preferences, and training type. For example, as shown in Figures 1 to 3, different postures of the seat 2 may be adopted for different training types. The seat 2 may also be movable in the front-to-back, left-to-right, and up-and-down directions, and a position that suits the user's physique can be adopted. The training device 1 may have a drive unit that changes the position and posture of the seat 2, and the position and posture of the seat 2 may be controlled automatically.

[0024] The training device 1 includes a base plate 3. The base plate 3 is located below the seat 2. The base plate 3 is a component that contacts the floor surface below the seat 2 when the training device 1 is in use.

[0025] The training device 1 includes an extendable support section 43. The extendable support section 43 is a member configured to be extendable and retractable, and supports the sheet 2 from below. In particular, the lower end of the extendable support section 43 is fixed on the bottom plate 3, and the upper end is connected to the first sheet 23, supporting the first sheet 23 from below. The posture of the first sheet 23 changes when the length of the extendable support section 43 changes, and is fixed when the length of the extendable support section 43 is fixed. The extendable support section 43 only needs to be configured to be extendable and retractable and to have its length fixed, for example, it can be made of a cylinder. The posture control of the first sheet 23 can be achieved by controlling the length of the extendable support section 43.

[0026] The second sheet 24 may also be configured to allow changes in position and orientation, similar to the first sheet 23. The training device 1 may also include an extendable support section for supporting the second sheet 24.

[0027] The training device 1 includes a drive device 5. The drive device 5 is a device for pulling the string-like portion 7, which will be described later. The drive device 5 is located below the seat 2. For example, the drive device 5 is located below the second seat 24, i.e., at the rear end of the training device 1, and is fixed on the bottom plate 3. The drive device 5 has one or more electric motors 52 inside the housing 51 that function as load control units that pull the string-like portion 7 and control the load applied to the string-like portion 7 (more specifically, the load applied to the user via the string-like portion 7). In this embodiment, an example is shown in which two electric motors 52 are provided inside the housing 51. The devices that the drive device 5 has for pulling the string-like portion 7 are not limited to electric motors 52.

[0028] The training device 1 is equipped with a pair of overhangs 6. The pair of overhangs 6 are plate-shaped members configured to be movable between a stored position and an overhang position on the left and right sides of the base plate 3. The overhangs 6 are rotatable around a rotation axis parallel to the X-axis direction, which is provided at the boundary with the base plate 3. The stored position is when both ends of the pair of overhangs 6 are moved upward so that the overhangs 6 are parallel to the Z-axis direction and stored below the sheet 2. The overhang position is when both ends of the pair of overhangs 6 are moved left and right so that the overhangs 6 are parallel to the Y-axis direction and in contact with the floor surface. The overhangs 6 are moved to the overhang position when the training device 1 is in use, and to the stored position when the training device 1 is stored or moved.

[0029] The training device 1 includes a string-like section 7. The string-like section 7 is a component that transmits the load applied by the drive device 5 to the user. The configuration of the drive device 5 and the string-like section 7 will be described in detail with reference to Figure 4.

[0030] Figure 4 is a schematic diagram showing the configuration of the drive device 5 and the string-like portion 7 according to this embodiment. As shown in Figure 4, one end of the string-like portion 7 is connected to the output shaft 53 of the electric motor 52 of the drive device 5. When the electric motor 52 is driven, the output shaft 53 rotates, causing the string-like portion 7 to be wound up or unwound. In other words, it is possible to apply torque to the string-like portion 7 using the driving force of the electric motor 52.

[0031] An operating unit 71, which the user operates during training, is attached to the other end of the string-like portion 7. The user performs training while gripping, pinching, or supporting the operating unit 71. For example, the operating unit 71 may be configured as a grip, handle, or rope. When the user pulls the operating unit 71, the electric motor 52 applies torque in the direction of winding up the string-like portion 7, thereby applying a load to the user's body.

[0032] The operating unit 71 may be provided with an input unit 72. The input unit 72 receives information input from the user. The input unit 72 may be, for example, a button located on the thumb side of the user gripping the operating unit 71, and the user can press the button while operating the operating unit 71. The user can instruct the training device 1 to apply a load to the string-like part 7, stop the load, or increase or decrease the load by inputting information via the input unit 72.

[0033] The training device 1 may have a pair of electric motors 52. The training device 1 may also have a pair of string-like parts 7 and a pair of operating parts 71. Each of the pair of string-like parts 7 is connected to the output shaft 53 of a separate electric motor 52. Of the pair of string-like parts 7, one string-like part 7 extends to the right of the training device 1, and the other string-like part 7 extends to the left of the training device 1. The two operating parts 71 connected to these left and right-extending string-like parts 7 are, for example, grasped by the user's left and right hands and used for training parts of the left and right sides of the body. The training device 1 may have two of each combination of operating parts 71, string-like parts 7, and electric motors 52 as illustrated, or it may have one or three or more.

[0034] The training device 1 is equipped with a support point 8 on the extension side. The support point 8 on the extension side has a mechanism for changing the direction in which the string-like portion 7 extends. This mechanism is, for example, a pulley. Preferably, the support point 8 on the extension side is configured to have a pair of fixed support points 81 and a pair of movable support points 82.

[0035] A pair of fixed support points 81 are provided at both the left and right ends of the overhanging section 6 in the overhanging position. In the overhanging section 6 provided on the right side, the fixed support point 81 is provided at the right end and rear. In the overhanging section 6 provided on the left side, the fixed support point 81 is provided at the left end and rear.

[0036] A pair of movable pivot points 82 are provided so as to be movable in the front-rear direction at both the left and right ends of the protruding portion 6 in the protruding position, and in front of the pair of fixed pivot points 81. For example, rails may be provided at both the left and right ends of the protruding portion 6 in the protruding position, and the pair of movable pivot points 82 may slide while being held by the rails. By changing the position of the movable pivot points 82, the pulling angle in training where the string-like portion 7 is pulled via the movable pivot points 82 can be changed. Along with changing the position of the movable pivot points 82, the posture of the movable pivot points 82 (i.e., the tilt of the pulley) may also be changed. This makes it possible to make training more comfortable and efficient by changing the position of the movable pivot points 82 according to the user's body type, preferences, and training type. For example, as shown in Figures 1 to 3, different positions of the movable pivot points 82 may be used for different training types. The training device 1 may have a drive unit that changes the position of the movable pivot points 82, or the position of the movable pivot points 82 may be controlled automatically.

[0037] The training device 1 may be equipped with casters 9. The casters 9 are wheels used to move the training device 1 when it is stored. For example, the casters 9 may be provided at the rear end of the base plate 3. In this case, the casters 9 rotate around a pivot axis that extends in the left-right direction. The user can move the training device 1 by lifting and tilting the front of the training device 1 when it is stored, using the casters 9.

[0038] The training device 1 may include a rod 10. The rod 10 is a rod-shaped member. If the training device 1 has a pair of string-like parts 7, it includes a pair of rods 10. One end of the pair of rods 10 may be joined to the left and right sides of the back surface of the first sheet 23 at a distance from each other. When the pair of rods 10 are joined to the first sheet 23, the pair of rods 10 move in accordance with the rotation of the first sheet 23. The pair of rods 10 are movable between an unused position and an used position. Figures 1 and 2 show the state in which the rods 10 are in the unused position. The pair of rods 10 may be stored below the sheet 2 in the unused position. Figure 3 shows the state in which the rods 10 are in the used position. The rods 10 may be rotatably provided with the joint with the first sheet 23 as the axis of rotation, and move between the unused position and the used position by rotating. The training device 1 may also have a drive unit that changes the posture of the rods 10, and the posture of the rods 10 may be automatically controlled.

[0039] The rod 10 is equipped with a rod-side pivot point 11. The rod-side pivot point 11 has a mechanism for changing the direction in which the string-like portion 7 extends. This mechanism is, for example, a pulley. As shown in Figure 3, the rod-side pivot point 11 can change the direction of the string-like portion 7 that extends via the overhang-side pivot point 8. The rod-side pivot point 11 may be provided so as to be movable in the longitudinal direction of the rod 10. For example, the rod 10 may have a rail extending in the longitudinal direction of the rod 10, and the rod-side pivot point 11 may slide while being held on the rail. By changing the position of the rod-side pivot point 11, the pulling angle in training where the string-like portion 7 is pulled via the rod-side pivot point 11 can be changed. Along with the change in the position of the rod-side pivot point 11, the posture of the rod-side pivot point 11 (i.e., the tilt of the pulley) may also be changed. This allows the position of the rod-side pivot point 11 to be varied according to the user's body type, preferences, and training type, thereby improving the comfort and efficiency of training. The training device 1 may have a drive unit that changes the position of the rod-side pivot point 11, or it may automatically control the position of the rod-side pivot point 11.

[0040] The fulcrums through which the string-like portion 7 passes can be switched as appropriate. For example, the string-like portion 7 may be connected to the operating section 71 via a fixed fulcrum 81 and a movable fulcrum 82, as shown in Figures 1 and 2, or it may be connected to the operating section 71 via a fixed fulcrum 81 and a rod-side fulcrum 11, as shown in Figure 3. Of the fulcrums through which the string-like portion 7 passes, such as the movable fulcrum 82 shown in Figures 1 and 2, and the rod-side fulcrum 11 shown in Figure 3, the fulcrum closest to the operating section 71, i.e., the downstream fulcrum, is the fulcrum that changes the direction in which the string-like portion 7 extends from the operating section 71. The position of the downstream fulcrum determines the direction of the load applied to the operating section 71.

[0041] Specifically, the extension 6, or more precisely, the string-like section 7 with the extension 6 side pivot point 8 as its downstream pivot point, provides training exercises that apply a load to the user towards a position lower than the user's center of gravity, i.e., towards the ground. Examples of training exercises that apply a load to the user towards a position lower than the user's center of gravity, i.e., towards the ground, are the bench press shown in Figure 1, the incline press shown in Figure 2, and the squat. On the other hand, the rod 10, or more precisely, the string-like section 7 with the rod side pivot point 11 as its downstream pivot point, provides training exercises that apply a load to the user towards a position higher than or the same as the user's center of gravity. An example of a training exercise that applies a load to the user towards a position higher than or the same as the user's center of gravity is the lat pulldown shown in Figure 3. Of course, the rod 10 may also provide training exercises that apply a load towards a position lower than the user's center of gravity.

[0042] <2. Example of Functional Configuration of Training System 100> Figure 5 is a diagram showing an example of the functional configuration of the training system 100 according to this embodiment. As shown in Figure 5, the training system 100 includes a training device 1, a UI device 110, and an imaging device 120, in addition to a control device 130. A user terminal 200 is also involved in the training system 100.

[0043] (User Terminal 200) The user terminal 200 is a terminal device used by a user. The user terminal 200 may be a smartphone, a smartwatch, or the like, and may be carried by the user. The user terminal 200 can function as an interface between the user and the training system 100.

[0044] The user terminal 200 may include various input devices such as buttons, touch panels, microphones, cameras, etc., and receive input of information from the user through these. Also, the user terminal 200 may have various sensors such as an acceleration sensor, an angular velocity sensor, a pedometer, a biometric information sensor, etc. And the user terminal 200 can receive input of information from the user or detect the user's information during training or in daily life. For example, the user terminal 200 can acquire information indicating physical characteristics of the user such as height, weight, and physique, attribute information such as age and gender, the user's training purpose, dietary information, sleep information, exercise information performed without using the training system 100, and biometric information, etc.

[0045] Also, the user terminal 200 may include various output devices such as a display, a speaker, and a vibrator, etc., and output information to the user through these. For example, the user terminal 200 may output training feedback and the progress of the training course to the user. The output to the user may be performed via an AI personal trainer, which is a character that anthropomorphizes AI (Artificial Intelligence).

[0046] (Control Device 130) The control device 130 is an information processing device that controls the entire process related to training using the training system 100. As shown in FIG. 5, the control device 130 includes a control unit 131 and a storage unit 132.

[0047] The control unit 131 controls the operation of the entire training system 100. For example, the control unit 131 acquires information from each of the training device 1, the UI device 110, the imaging device 120, and the user terminal 200. Then, based on the acquired information, the control unit 131 transforms the training device 1, controls the load applied to the operation unit 71, or outputs information via the UI device 110 or the user terminal 200.

[0048] In particular, when the user performs training to move the operation unit 71, the control unit 131 generates notification information regarding the training performed by the user based on the operation information of the electric motor 52 and the user's image obtained. Then, the control unit 131 provides the generated notification information to the user. The notification information may include various types of information regarding training, such as information indicating the state of the user during training, feedback regarding training, or advice. The notification information may be output by the UI device 110 as at least any one of visual information, auditory information, and tactile information. Alternatively, the notification information may be output by other devices such as the user terminal 200.

[0049] The operation information of the electric motor 52 may include the winding amount of the string-like part 7, the load applied to the string-like part 7, and the time-series changes such as the speed and acceleration involved in the winding or unwinding of the string-like part 7. Note that the winding amount, speed, and acceleration of the string-like part 7 can be calculated based on the rotation amount of the output shaft 53. The load applied to the string-like part 7 can be calculated based on the torque applied to the string-like part 7. The user's image is an image captured by a plurality of imaging devices 120 from different angles respectively. By using these information, which is difficult to acquire during training using analog training equipment such as weights, especially the operation information of the electric motor 52 and the user's image synchronized with the operation information of the electric motor 52, the control unit 131 can generate appropriate notification information.

[0050] The control unit 131 estimates the position of the operating unit 71 based on the operation information of the electric motor 52. The position of the operating unit 71 here may be the three-dimensional coordinates of the operating unit 71, or the position of the operating unit 71 in the direction of the load. The position of the operating unit 71 in the direction of the load may be the straight-line distance from the furthest downstream fulcrum through which the string-like portion 7 passes to the operating unit 71. The position of the operating unit 71 can be estimated based on the amount of winding of the string-like portion 7 by the electric motor 52. User images may also be used to estimate the position of the operating unit 71. For example, the position of the operating unit 71 may be estimated based on the position of the operating unit 71 as seen in the user's image. As another example, the control unit 131 may correct the amount of winding of the string-like portion 7 by the electric motor 52 based on the deflection of the string-like portion 7 as seen in the user's image, and then estimate the position of the operating unit 71 based on the corrected winding amount. Furthermore, the operating unit 71 may be equipped with an inertial sensor, and the control unit 131 may estimate the position of the operating unit 71 based on its acceleration and angular velocity. The control unit 131 may then generate notification information based on the estimated position of the operating unit 71 and provide it to the user. UI screens D3 to D6, described later, are examples of notification information based on the estimated position of the operating unit 71.

[0051] Furthermore, the control unit 131 estimates the user's posture during training based on the user's image. For example, the control unit 131 may estimate the user's skeletal structure as the user's posture. The control unit 131 may then generate notification information based on the estimated user posture and provide it to the user. UI screen D7, described later, is an example of notification information based on the estimated user posture.

[0052] The control unit 131 may generate notification information based on information about other users. For example, the control unit 131 may generate notification information based on information indicating the user's physical characteristics such as height, weight, and build, as well as attribute information such as age and gender. As another example, the control unit 131 may generate notification information based on information obtained when the user previously trained using the training device 1, and on past training history. As yet another example, the control unit 131 may generate notification information based on the user's daily living situation, such as meal information, sleep information, and step count. With such a configuration, it becomes possible to generate personalized notification information for the user.

[0053] The control unit 131 may generate notification information during training and provide the generated notification information. That is, the control unit 131 may provide notification information in real time that provides feedback on the information obtained during the training. With this configuration, the user can perform the training while receiving feedback in real time. UI screens D3, D4, and D5, described later, are examples of notification information provided in real time during training.

[0054] The control unit 131 may generate notification information during training and provide the generated notification information after training, for example, during the interval. With this configuration, the user can receive feedback after training and review the training they just performed. UI screens D6 and D7, described later, are examples of notification information provided after training.

[0055] The storage unit 132 stores various information for the operation of the control unit 131. For example, the storage unit 132 may store user identification information and user information in association with each other.

[0056] (Training device 1) As shown in Figure 5, the training device 1 further comprises a sensor 101 and a drive unit 102.

[0057] Sensor 101 detects various information related to the training device 1. For example, sensor 101 may have a pressure sensor and may detect the pressure distribution applied to the sheet 2. The control unit 131 may then generate notification information to guide the user to correct their posture so that the pressure distribution applied to the sheet 2 becomes an appropriate pressure distribution. As another example, sensor 101 may have a biometric information sensor and may detect biometric information such as fingerprints, palm prints, and heart rate from the user's hand gripping the operation unit 71. The control unit 131 may then authenticate the user based on the user's biometric information and adjust training parameters such as the load applied to the string-like part 7. The training parameters will be explained in detail later. Sensor 101 may also have an acceleration sensor and an angular velocity sensor and may detect the acceleration and angular velocity of the operation unit 71.

[0058] The drive unit 102 generates a driving force to deform the training device 1 and drives each part of the training device 1. The deformation of the training device 1 includes at least one of the following: position and attitude control of the seat 2, position control of the movable pivot point 82, attitude control of the rod 10, and position control of the rod-side pivot point 11. That is, the drive unit 102 drives at least one of the seat 2, the movable pivot point 82, the rod 10, and the rod-side pivot point 11. The drive unit 102 may be an electric motor or a hydraulic cylinder, etc.

[0059] <3. Control Examples> The following describes specific examples of control performed by the training system 100. In the following, for the sake of simplicity, the training system 100 may be used as the subject when describing various processes. Unless otherwise specified, various information processing such as the generation of notification information is performed by the control unit 131, and various output processing such as the output of notification information is performed by the UI device 110.

[0060] (1) The login training system 100 performs the login process. The login process is a process for obtaining user information.

[0061] First, the training system 100 identifies the user. For example, the user may display a two-dimensional code containing the user's identification information on the user terminal 200 and have the imaging device 120 read it. As another example, the training system 100 may identify the user by biometric authentication based on the user's biometric information, or by facial recognition based on the user's facial image.

[0062] Next, the training system 100 acquires information about the identified user. For example, the training system 100 reads from the storage unit 132 information such as the user's height, weight, and physical characteristics such as build, attribute information such as age and gender, setup information and calibration information for the training device 1, and past training history performed using the training device 1, which are stored in association with the user's identification information. The setup information and calibration information will be explained in detail later.

[0063] When a user first uses the training system 100, they may input the above-mentioned information into the training system 100 via the UI device 110 or the user terminal 200. Alternatively, the above-mentioned information may be estimated based on information acquired by the training device 1 or the imaging device 120 while the user is performing training using the training system 100.

[0064] (2) Training type selection The training system 100 selects a training type. For example, the training system 100 accepts user input to select a training type. The training system 100 may also automatically select a training type based on past training history. The training system 100 may also automatically select a training type based on the user's training objectives. Examples of training objectives include health promotion aimed at maintaining training frequency, dieting aimed at reducing weight and body fat percentage, muscle strengthening aimed at increasing maximum muscle strength in a target area, and bulking up aimed at increasing maximum muscle strength in a target area and gaining weight.

[0065] A set of training consisting of one or more training exercises is also called a training course. The training system 100 may generate a training course by selecting one or more training exercises.

[0066] Figure 6 shows an example of a UI screen D1 for selecting a training type. The UI screen D1 shown in Figure 6 may be displayed by the UI device 110 after logging in but before starting training.

[0067] The training course display area D11 shows the ongoing training course. A training course may be planned over multiple days.

[0068] The training exercise selection field D12 accepts the selection of a training exercise and displays the selected exercise. Here, incline cable press, incline rowing, and squat are displayed. If the user has previous experience training these exercises, the training parameters from that time will also be displayed.

[0069] The training phase display area D13 shows the user's training phase. Training phases may include beginner, novice, intermediate, and advanced.

[0070] (3) Setup The training system 100 performs setup. Setup is an example of the setting process for the training device 1, and is a process that deforms the training device 1. The training system 100 deforms the training device 1 into a shape suitable for the selected training exercise.

[0071] The deformation of the training device 1 is achieved by controlling the position and / or orientation of at least one of the seat 2, the movable pivot point 82, the rod 10, and the rod-side pivot point 11. The deformation of the training device 1 may be performed automatically by the drive unit 102 or manually by the user. When the user manually deforms the training device 1, the training system 100 may provide the user with information to guide the deformation procedure, etc. When the user manually deforms the training device 1, the training system 100 may determine whether it has been deformed correctly based on various sensor information, operation information of the electric motor 52, or images captured by the imaging device 120, and may instruct the user to make corrections as necessary.

[0072] The training system 100 may perform setup based on the user's identification information. For example, setup information indicating the position and orientation of the seat 2, movable pivot point 82, rod 10, and rod-side pivot point 11, which shows the deformation of the training device 1, is stored in the training system 100 in association with the user's identification information and the type of training. Then, the training system 100 deforms the training device 1 based on the stored setup information when the user trains next time. That is, the training system 100 may deform the training device 1 to the same shape as when the user performed the same type of training in the past. Of course, the user may use the training device 1 as is after it has been deformed to the same shape as in the past, or they may deform it further. With such a configuration, it is possible to improve usability.

[0073] The training system 100 may be set up based on the user's physical characteristics. For example, the training system 100 may be set up based on the user's height, sitting height, torso length, or arm length. These physical characteristics may be manually entered by the user or recognized from the user's image. Such a configuration makes it possible to improve the training effect.

[0074] The training system 100 may perform setup based on the operation information of the electric motor 52 and the user's image obtained during training. For example, if the user's form breaks down or interference occurs between the user's body and the string-like part 7 during training, the training device 1 may be modified to resolve these issues during the next setup. Form breakdown can be detected by posture analysis, which will be described later. Interference between the user's body and the string-like part 7 can be detected by bending of the string-like part 7 recognized from the user's image, or by an abnormal increase or decrease in the load applied to the string-like part 7. In addition, interference between the user's body and the string-like part 7 can be detected by whether or not the position change of the operating part 71 recognized from the user's image matches the change in the amount of winding of the string-like part 7 by the electric motor 52. With such a configuration, it is possible to improve the training effect.

[0075] (4) The calibration training system 100 performs calibration. Calibration is an example of the setting process for the training device 1, and is a process for setting the user's range of motion.

[0076] The user performs training with a very light load using the training device 1 after setup. The training system 100 instructs the user to move the control unit 71 to its maximum extent in the concentric and eccentric directions, and sets the range of positional change of the control unit 71 observed at that time as the user's range of motion. The concentric direction is the direction in which a muscle contracts. The eccentric direction is the direction in which a muscle extends. During training, if the position of the control unit 71 exceeds or is likely to exceed the range of motion, the training system 100 may reduce the load applied to the string-like part 7. Setting the user's range of motion and controlling the load based on the range of motion are performed for each of the left and right control units 71. With this configuration, it is possible to improve user safety.

[0077] The training system 100 may perform calibration based on the user's identification information. For example, calibration information indicating the user's range of motion is stored in the training system 100 in association with the user's identification information, training type, and setup information. Then, the training system 100 sets the user's range of motion based on the stored calibration information during the user's next training session. That is, the training system 100 may set the range of motion to be the same as when the user previously performed the same type of training using the same training device 1, based on the calibration information. Of course, the stored calibration information may not be used, and calibration may be performed again.

[0078] The training system 100 may perform calibration based on the user's physical characteristics. For example, the training system 100 may perform calibration based on the user's height, sitting height, torso length, or arm length. These physical characteristics may be manually entered by the user or recognized from the user's image. Such a configuration makes it possible to improve the training effect.

[0079] (5) Setting training parameters The training system 100 sets training parameters for each training exercise. The training parameters may include load, number of sets, number of repetitions, and interval. The load is the weight applied to the user via the string-like part 7. The number of sets is the number of sets performed. A set is a unit that groups together a series of repetitions. The number of repetitions is the number of times the training is repeated in one set. The interval is the rest time provided between sets.

[0080] The training system 100 may set training parameters based on the user's identification information. For example, training parameters used in training sessions previously performed by the user are stored in the training system 100 in association with the user's identification information and the training type. The training system 100 may then reuse the stored training parameters for the user's next training session. That is, the training system 100 may set the same training parameters as when the user previously performed the same type of training. Of course, the user may use the same training parameters as before, or they may change them. Such a configuration makes it possible to improve usability.

[0081] Figure 7 shows an example of a UI screen D2 for setting training parameters. The UI screen D2 shown in Figure 7 can be displayed by the UI device 110 when setting training parameters for an incline cable press.

[0082] The load setting field D21 is for setting the load and displays a plus button to increase the load, a minus button to decrease the load, and the current setting value. By selecting the plus or minus button, the user can increase or decrease the load applied to the string-like part 7 during training.

[0083] The set number setting field D22 is for setting the number of sets to be performed. It displays a plus button to increase the number of sets, a minus button to decrease the number of sets, and the current setting value. Users can increase or decrease the number of sets by selecting the plus or minus button.

[0084] The rep count setting field D23 is for setting the planned number of reps. It displays a plus button to increase the number of reps, a minus button to decrease the number of reps, and the current setting value. The user can increase or decrease the number of reps by selecting the plus or minus button.

[0085] The interval setting field D24 is for setting the interval length. It displays a plus button to increase the interval length, a minus button to decrease the interval length, and the current setting value. The user can increase or decrease the interval length by selecting the plus or minus button.

[0086] The eccentric mode setting field D25 displays a toggle button to show and select whether eccentric mode is on or off. The user can select whether eccentric mode is on or off by selecting this toggle button. When eccentric mode is off, standard mode is selected. Standard mode is an operating mode where the load in the concentric direction and the load in the eccentric direction are the same. Eccentric mode is an operating mode where the load in the eccentric direction is greater than the load in the concentric direction. In other words, eccentric mode is an operating mode that enables negative training.

[0087] The companion video settings section D26 displays a toggle button to show and select whether to turn the companion video on or off. Users can select whether to turn the companion video on or off by selecting this toggle button. The companion video is a video that can be displayed during training, and is a video of a trainer performing exemplary training, that is, training using the training device 1 with ideal posture, ideal speed, and ideal timing.

[0088] (6) The real-time controlled training system 100 may control the training device 1 during the user's training based on the information obtained during the training.

[0089] The training system 100 may control training parameters based on information obtained during training. For example, the training system 100 may estimate the user's remaining strength based on the user's facial expressions during training and increase or decrease the load applied to the user. As another example, if the position of the operating unit 71 exceeds the user's range of motion, the training system 100 may gradually reduce the load applied to the operating unit 71. As yet another example, if the return speed (i.e., winding speed) of the string-like unit 7 exceeds a threshold, the training system 100 may limit the increase in the return speed of the string-like unit 7 to below a threshold.

[0090] The training system 100 may be dynamically calibrated based on information obtained during training. For example, the training system 100 may update the user's range of motion based on the range of movement of the control unit 71 during training.

[0091] (7) The real-time feedback training system 100 provides real-time feedback to the user during training based on information obtained during the training. For example, the training system 100 may generate notification information indicating the user's status based on the operation information of the electric motor 52 and the user's image obtained during the user's training, and provide it in real time.

[0092] Examples of real-time feedback include guided feedback, unguided feedback, and gamified feedback, as illustrated below.

[0093] (Guided Feedback) Figure 8 shows an example of a UI screen D3 for real-time feedback. The UI screen D3 shown in Figure 8 may be displayed by the UI device 110 while the user is performing an incline cable press. The user can train by following the guide displayed on the UI screen D3.

[0094] The real-time image display area D31 displays images of the user during training, captured by the imaging device 120, in real time. The user can refer to these images to check their posture during training.

[0095] The load display area D32 (D32L and D32R) displays the load applied to the left and right string-like sections 7. In particular, load display area D32L displays the load applied to the left string-like section 7, and load display area D32R displays the load applied to the right string-like section 7. Note that the load applied to the string-like sections 7 may fluctuate from the load set as a training parameter due to the effects of the acceleration of the operating unit 71 and friction between the string-like section 7 and the pivot point.

[0096] The position indicator objects D33 (D33L and D33R) indicate the positions of the left and right operation units 71. In particular, position indicator object D33L is a semicircle that indicates the position of the left operation unit 71. Position indicator object D33R is a semicircle that indicates the position of the right operation unit 71. It is desirable that position indicator objects D33L and D33R be displayed in different forms (e.g., color) to represent the difference between left and right. The horizontal position of position indicator object D33 on the UI screen D3 is fixed at the center. On the other hand, the vertical position of position indicator object D33 on the UI screen D3 corresponds to the position of the operation unit 71 and changes in accordance with the change in the position of the operation unit 71. That is, when the user lifts the operation unit 71 upwards, the position indicator object D33 moves upwards, and when the user lowers the operation unit 71 downwards, the position indicator object D33 moves downwards.

[0097] The guide waveform display area D34 displays a guide waveform WG, which is a waveform that guides the position change of the operation unit 71 and shows an exemplary time-series transition of the position of the operation unit 71. In other words, the guide waveform WG is a waveform that guides the position change of the position display object D33 and shows an exemplary time-series transition of the position of the position display object D33. The guide waveform WG flows from right to left on the UI screen D3. The user can perform training appropriately by moving the position of the operation unit 71 so that the position display object D33 matches the guide waveform WG.

[0098] The set count display field D35 shows the current number of sets as the numerator and the number of sets set as a training parameter as the denominator.

[0099] The rep count display field D36 shows the current rep count as the numerator and the rep count set as a training parameter as the denominator.

[0100] Here, the configuration of the guide waveform WG will be explained in more detail with reference to Figures 9 and 10.

[0101] Figure 9 shows the detailed configuration of the guide waveform WG. The horizontal axis of the guide waveform WG is time, and the vertical axis is amplitude. The amplitude of the guide waveform WG indicates the position of the operating unit 71 to be emulated. The guide waveform WG uses amplitude 0 as the baseline and increases or decreases the amplitude in the positive direction. The increase in amplitude in section P1 corresponds to the movement of pushing up the operating unit 71 in the incline press, i.e., the concentric movement of contracting and extending the muscle in the concentric direction. The maintenance of amplitude in section P2 corresponds to the movement of keeping the operating unit 71 pushed up in the incline press, i.e., the isometric movement of maintaining muscle contraction and extension. The decrease in amplitude in section P3 corresponds to the movement of returning the operating unit 71 in the incline press, i.e., the eccentric movement of contracting and extending the muscle in the eccentric direction. One wave in sections P1 to P3 corresponds to one movement (i.e., one rep) from pushing up the operating unit 71 to returning it to its original position. The interval P4 between waveforms corresponds to the interval between reps, or the interval between sets. Furthermore, the guide waveform WG may be displayed in various forms, such as opaque or semi-transparent. The guide waveform WG may also be displayed in different forms depending on the amplitude. For example, the portion of the guide waveform WG closer to the peak may be displayed in a darker color, while the portion closer to the baseline may be displayed in a lighter color.

[0102] Figure 10 shows an example of the overall structure of the guide waveform WG. As shown in Figure 10, the guide waveform WG may include waveforms of various amplitudes and periods, such as section P5 with long intervals between reps and small amplitude, section P6 with short intervals between reps and large amplitude, and interval section P7.

[0103] Guide waveforms (WG) can be automatically generated based on the training exercise and training parameters.

[0104] Furthermore, music may be played during training, i.e., when UI screen D3 is displayed, and the guide waveform WG may correspond to the characteristics of the music played during training. For example, the amplitude and period of the guide waveform WG may be set according to the tempo, part composition (melody, chorus, and interlude), etc. of the music being played. The training system 100 may also accept the selection of music to be played during training instead of setting training parameters, and may automatically set training parameters according to the selected music and generate the guide waveform WG. For example, the training system 100 may set one or more interval sections within a song, such as at the timing of an interlude. The training system 100 may also provide multiple sets of training within a song. With this configuration, it is possible to provide the user with a training experience that harmonizes with the music played during training.

[0105] When the training system 100 plays music during training, it may display a video related to the music being played on the UI screen D3 in sync with the music, either together with or in place of the user's image. An example of a video related to the music being played is a promotional video (PV) for the music being played. For example, the training system 100 displays a guide waveform WG that vibrates in time with the music on top of the video related to the music. With this configuration, the user can train in sync with the music and video.

[0106] Furthermore, the guide waveform WG may correspond to user information. For example, the amplitude of the guide waveform WG may be set according to the user's range of motion obtained through calibration. As another example, the amplitude and period of the guide waveform WG may be set according to the user's training objectives. Training parameters may be set based on the training objectives, and the guide waveform WG may be generated accordingly. With such a configuration, it becomes possible to provide the user with a personalized training experience.

[0107] Figures 8 to 10 show guide waveforms WG that oscillate in the positive direction from the baseline, corresponding to incline press, a training method that involves lifting from bottom to top. Guide waveforms WG that correspond to training methods that involve pushing from top to bottom may oscillate in the negative direction from the baseline.

[0108] Furthermore, in Figures 8 to 10, a single guide waveform WG common to both the left and right operation units 71 is set and displayed; however, different guide waveforms WG may be set and displayed for the left and right operation units 71, respectively.

[0109] (Unguided Feedback) Figure 11 shows an example of a UI screen D4 for real-time feedback. The UI screen D4 shown in Figure 11 can be displayed by the UI device 110 while the user is performing an incline cable press. The user can train freely while setting training parameters at any time on the UI screen D4.

[0110] The interval control button D41 is a button used to set the start or stop of an interval. By selecting the interval control button D41, the user can start or stop the interval.

[0111] The load display area D42 (D42L and D42R) displays the same information as the load display area D32 (D32L and D32R) shown in Figure 8.

[0112] The position indicator object D43 (D43L and D43R) displays the same information as the position indicator object D33 (D33L and D33R) shown in Figure 8.

[0113] The user waveform display area D44 displays user waveforms WU (WUL and WUR), which are waveforms showing the time-series progression of the position of the operation unit 71. In particular, user waveform WUL displays the time-series progression of the position of the operation unit 71 on the left side. User waveform WUR displays the time-series progression of the position of the operation unit 71 on the right side. From another perspective, user waveforms WU (WUL and WUR) display the trajectory of the position display object D43 (D43L and D43R). It is desirable that user waveforms WUL and WUR be displayed in different forms (e.g., color) to represent the difference between the left and right sides, and furthermore, it is desirable that they be displayed in the same form as the position display objects D43L and D43R. The user waveform WU flows from right to left on the UI screen D4, with the position display object D43 as its leading edge. The user can perform training while understanding the position of the operation unit 71 by referring to the user waveform WU.

[0114] The set count display field D45 shows the current number of sets.

[0115] The rep count display field D46 shows the current number of rep counts.

[0116] (Gamification Feedback) Figure 12 shows an example of a UI screen D5 for real-time feedback. The UI screen D5 shown in Figure 12 may be displayed by the UI device 110 while the user is performing an incline cable press. The user can train in a game-like manner by following the gamified guide displayed on the UI screen D5.

[0117] The status display area D51 displays the score and HP (Hit Points: health gauge). For example, the score increases when the position of the control unit 71 moves according to the guide waveform WG, and the HP decreases when the position of the control unit 71 deviates from the guide waveform WG.

[0118] The load display area D52 (D52L and D52R) displays the same information as the load display area D32 (D32L and D32R) shown in Figure 8.

[0119] The position indicator object D53 (D53L and D53R) displays the same information as the position indicator object D33 (D33L and D33R) shown in Figure 8.

[0120] The waveform display area D54 displays the guide waveform WG (WGL and WGR) and the user waveform WU (WUL and WUR). In particular, the guide waveform WGL shows the exemplary time-series transition of the position of the left operation unit 71, and the guide waveform WGR shows the exemplary time-series transition of the position of the right operation unit 71. The guide waveform WG flows from back to front on the UI screen D5. In conjunction with this, the user waveform WU flows from back to front on the UI screen D5, with the position display object D53 as its leading edge. The user can perform training appropriately by moving the position of the operation unit 71 so that the position display object D53 matches the guide waveform WG. The user can also check whether they are performing training appropriately based on the degree of agreement between the user waveform WU and the guide waveform WG.

[0121] The set number display field D55 displays the same information as the set number display field D35 shown in Figure 8.

[0122] The rep count display area D56 displays the same information as the rep count display area D36 shown in Figure 8.

[0123] The elapsed time display field D57 shows the elapsed time since the start of training.

[0124] The combo display area D58 displays the number of consecutive times (i.e., the number of waves) that the user waveform WU and the guide waveform WG match, as the combo count. Depending on the degree of match between the user waveform WU and the guide waveform WG (for example, the degree of match for each wave, and the combo count), the combo display area D58 may also display phrases such as "Perfect!", "Great!", or "Fever!".

[0125] (8) Post-training feedback The training system 100 analyzes the training results and provides feedback.

[0126] (Waveform Analysis and Feedback) The training system 100 performs waveform analysis based on the information obtained during training. The training system 100 then generates and outputs notification information that includes feedback based on the analysis results.

[0127] More specifically, the training system 100 evaluates the difference between the user waveform WU and the guide waveform WG and outputs notification information including the evaluation result. For example, for each rep (i.e., one waveform), the percentage of time differences between the user waveform WU and the guide waveform WG that fall within an acceptable range may be calculated. If this percentage is greater than or equal to a predetermined value, it is judged as a success; if it is less than the predetermined value, it is judged as a failure, and notification information including the number of successes and failures may be output. The waveform analysis result display field D62 of the UI screen D6, described later, is an example of such notification information. The training system 100 may also output an image of the user waveform WU and the guide waveform WG superimposed as notification information that visually shows the difference. The waveform display field D61 of the UI screen D6, described later, is an example of such notification information.

[0128] Furthermore, the training system 100 may evaluate the difference between the user waveform WU and the guide waveform WG for each of the left and right operation units 71. That is, the training system 100 may evaluate the difference between the user waveform WUL and the guide waveform WGL for the left operation unit 71, and the difference between the user waveform WUR and the guide waveform WGR for the right operation unit 71. The training system 100 may also output notification information that includes information indicating the difference between the user waveform WU and the guide waveform WG for each of the left and right operation units 71. The waveform display field D61 of the UI screen D6, which will be described later, is an example of such notification information.

[0129] Furthermore, the training system 100 may evaluate the difference during concentric movement, the difference during isometric movement, and the difference during eccentric movement, respectively. The training system 100 may also output notification information that includes at least one of the following: information indicating the difference during concentric movement, information indicating the difference during isometric movement, and information indicating the difference during eccentric movement. The waveform analysis result display section D62 of the UI screen D6, which will be described later, is an example of such notification information.

[0130] The following section, with reference to Figure 13, will explain a specific example of a UI screen for providing feedback on waveform analysis results after training.

[0131] Figure 13 shows an example of a UI screen D6 for providing feedback on waveform analysis results. The UI screen D6 shown in Figure 13 may be displayed by the UI device 110 during the interval after the user has finished training on the incline cable press (for example, after completing one set). The user refers to the UI screen D6 to receive feedback on the training they just performed.

[0132] Waveform display area D61 (D61L and D61R) displays the guide waveform WG and the user waveform WU superimposed. In particular, waveform display area D61L displays all waves of the user waveform WUL obtained during training superimposed on one wave of the guide waveform WGL. Waveform display area D61R displays all waves of the user waveform WUR obtained during training superimposed on one wave of the guide waveform WGR.

[0133] The waveform analysis result display area D62 (D62P and D62R) displays information indicating the waveform analysis results. Specifically, the waveform analysis result display area D62 displays information indicating the difference between the user waveform WU and the guide waveform WG. In particular, the waveform analysis result display area D62P displays the success frequency and success accuracy of the push-up movement (i.e., concentric movement). The success frequency is displayed with the number of successful reps (i.e., when the user waveform WU and the guide waveform WG matched) as the numerator and the number of reps set as the training parameter as the denominator. The success accuracy is displayed as a percentage of the success frequency. On the other hand, the waveform analysis result display area D62R displays the success frequency and success accuracy of the return movement (i.e., eccentric movement).

[0134] The AI ​​check mode setting field D63 displays a toggle button for displaying and selecting whether to turn the AI ​​check mode on or off. The user can select whether to turn the AI ​​check mode on or off by selecting this toggle button. When the AI ​​check mode is turned on, the training system 100 performs analysis and / or feedback using AI.

[0135] Furthermore, the training system 100 may utilize AI for waveform analysis. For example, the training system 100 may obtain analysis results by inputting the currently obtained training results into an AI that has been trained using learning data consisting of combinations of previously obtained training results and analysis results.

[0136] The training system 100 may utilize AI for feedback on waveform analysis results. For example, the training system 100 may input the analysis results into a text generation AI to generate and display or play a text explaining the analysis results.

[0137] (Posture Analysis and Feedback) The training system 100 performs posture analysis based on the information obtained during training. The training system 100 then generates and outputs notification information that includes feedback based on the analysis results.

[0138] More specifically, the training system 100 evaluates the difference between the user's posture during training and the exemplary posture, and generates notification information based on the evaluation results. At that time, the training system 100 estimates the movement of the user's skeleton during training based on the user's image. Skeletal estimation includes the estimation of joint positions and the estimation of the skeletons connecting the joints. Then, the training system 100 generates notification information based on the difference between the user's skeletal movement during training and the exemplary skeletal movement.

[0139] As an example, the training system 100 evaluates whether the inclination of the spine maintains an exemplary inclination (for example, whether a posterior tilt posture is maintained). As another example, the training system 100 evaluates whether the elbow joint of the arm pushing and pulling the operating unit 71 is moving along the direction of the load of the string-like part 7 (i.e., whether the arm is pushing and pulling straight against the load). As yet another example, the training system 100 evaluates whether the angle formed by the upper arm and forearm pushing and pulling the operating unit 71, and the range of motion of the arm are exemplary (i.e., whether the arm is fully extended and bent). As yet another example, the training system 100 evaluates whether the skeletons on both sides of the user's body are moving equally.

[0140] The exemplary skeletal movements may be set based on the training exercise, setup information, calibration information, and the user's physical characteristics. Alternatively, the exemplary skeletal movements may be set based on the movements of other users with similar physiques, or on the user's skeletal movements during past training sessions.

[0141] The following section, referring to Figure 14, will explain a specific example of a UI screen for providing feedback on posture analysis results after training.

[0142] Figure 14 shows an example of a UI screen D7 for providing feedback on posture analysis results. The UI screen D7 shown in Figure 14 may be displayed by the UI device 110 during the interval after the user has finished training on the incline cable press (for example, after completing one set). The user refers to the UI screen D7 to receive feedback on the training they just performed.

[0143] The first posture analysis result display area D71 displays the difference between the user's posture during training and the exemplary posture as an image. More specifically, the first posture analysis result display area D71 displays the image of the user during training superimposed with the estimated user's skeletal model BU. In particular, the user's skeletal model BU may include only a portion of the user's entire skeleton that does not match the movement of the exemplary skeleton. The first posture analysis result display area D71 may selectively display images obtained by the multiple imaging devices 120 that allow a wider range of the user's body parts with the superimposed skeletal model BU to be visible.

[0144] The second posture analysis results display area D72 displays the difference between the user's posture during training and the exemplary posture as text. In particular, the second posture analysis results display area D72 displays a checklist to help the user's posture match the exemplary posture, along with the degree of achievement for each item.

[0145] The AI ​​check mode setting section D73 displays a toggle button for displaying and selecting whether to turn the AI ​​check mode on or off. The user can select whether to turn the AI ​​check mode on or off by selecting this toggle button. When the AI ​​check mode is turned on, the UI screen D7 further displays the output obtained by inputting the posture analysis results into the AI. The training system 100 may also use AI for posture analysis and feedback of the posture analysis results.

[0146] (Analysis Timing) Figure 15 shows an example of a time chart related to analysis and feedback. As shown in Figure 15, the training system 100 performs waveform analysis and posture analysis based on information obtained during the user's training. The training system 100 then provides feedback of the results of the waveform analysis and posture analysis performed during the previous training session during the interval or while the finish screen is displayed after all training is completed. The training system 100 may also provide feedback of the waveform analysis results and posture analysis results for each training exercise.

[0147] Waveform analysis and posture analysis may be performed during the remainder of the training based on information obtained in the early stages of training. For example, if the number of sets set as a training parameter is three, the training system 100 may perform waveform analysis and posture analysis during the second and third sets based on information obtained in the first set. This configuration allows for sufficient time for analysis and enables feedback to be provided without delay after training.

[0148] (9) The training system 100 may set a training course based on the waveform analysis results and the posture analysis results. For example, the training system 100 may increase the number of training exercises if the analysis results are good, or place training exercises with poor analysis results at the beginning of a training course where the user is not yet fatigued. Furthermore, the training system 100 may set training parameters based on the waveform analysis results and the posture analysis results. For example, the training system 100 may increase the number of reps, sets, and / or load to raise the training intensity if the analysis results are good, and decrease the number of reps, sets, and / or load to lower the training intensity if the analysis results are poor. With such a configuration, a personalized training course can be proposed to the user.

[0149] The training system 100 may also provide a joint training mode. The joint training mode is an operating mode in which multiple users log in to the same training system 100 and take turns training using the same training device 1. With this configuration, it becomes possible to achieve efficient training, such as when one user takes a break after training and another user trains.

[0150] The training system 100 can detect the approach or contact of a person, child, or animal with the training device 1 based on images captured by the imaging device 120. If the training system 100 detects such an event, it may restrict the operation of the electric motor 52 and the automatic deformation of the training device 1.

[0151] The training system 100 may register the installation location of the training device 1. The training system 100 may also stop the operation of the training device 1 if its installation location deviates from the registered location. With this configuration, it is possible to prevent accidents by preventing the installation of the training device 1 by anyone other than a professional.

[0152] Due to its structure, which involves multiple pulleys, the load on the user changes depending on whether the string-like section 7 is being pulled or released due to friction. Specifically, the load on the user increases when the string-like section 7 is being pulled and decreases when it is being released. Therefore, the training system 100 may determine whether the string-like section 7 is being pulled or released based on the operation information of the electric motor 52, and may increase the torque applied by the electric motor 52 to the string-like section 7 when the string-like section 7 is being released. This configuration makes it possible to improve the perceived training experience.

[0153] The training system 100 may reduce the torque applied by the electric motor 52 to the string-like part 7 when the string-like part 7 is pulled during idle periods when training is not being performed, such as during intervals. With this configuration, the user can easily pull out the operating part 71. The training system 100 may also increase the torque applied by the electric motor 52 to the string-like part 7 when the pulling operation of the string-like part 7 is finished during idle periods. With this configuration, it is possible to eliminate or prevent the bending of the string-like part 7.

[0154] An SDK (Software Development Kit) may be provided for developing software to control the electric motor 52. However, while safety and other aspects should be ensured within the SDK, it is desirable that training methods and gamification methods be made available for development by external vendors.

[0155] <4. Example of Operation Process> Figure 16 is a flowchart showing an example of the processing flow executed by the training system 100 according to this embodiment.

[0156] As shown in Figure 16, first, the training system 100 performs a login process (step S102). For example, the user displays a two-dimensional code containing the user's information on the user terminal 200 and has the UI device 110 read it. The control device 130 then identifies the user based on the information stored in the two-dimensional code read by the UI device 110.

[0157] Next, the training system 100 selects a training exercise (step S104). For example, the UI device 110 displays the UI screen D1 shown in Figure 6 and accepts user input to select one or more training exercises.

[0158] Next, the training system 100 performs setup (step S106). For example, the control device 130 deforms the training device 1 according to the selected training exercise.

[0159] Next, the training system 100 performs calibration (step S108). For example, the control device 130 instructs the user to perform training with a very light load using the training device 1 after setup, and sets the user's range of motion based on the position change of the operating unit 71.

[0160] Next, the training system 100 sets the training parameters (step S110). For example, the UI device 110 displays the UI screen D2 shown in Figure 7 and accepts user input to set the training parameters.

[0161] Next, the training system 100 starts training (step S112). For example, the training device 1 starts applying a load to the string-like portion 7.

[0162] Next, the training system 100 displays a training screen (step S114). For example, the UI device 110 displays UI screen D3 shown in Figure 8, UI screen D4 shown in Figure 11, or UI screen D5 shown in Figure 12.

[0163] The training system 100 performs waveform analysis and posture analysis during training (step S116).

[0164] Next, the training system 100 terminates the training (step S118). For example, the control device 130 terminates the training when the number of completed reps reaches the number of reps set as a training parameter. Accordingly, the training device 1 stops applying load to the string-like portion 7.

[0165] Next, the training system 100 determines whether the training course has been completed (step S120). For example, the control device 130 determines that the training course has been completed when the number of sets performed for all training exercises selected in step S104 reaches the number of sets set as a training parameter.

[0166] If it is determined that the training course is not complete (step S120: NO), the training system 100 starts an interval (step S122).

[0167] Next, the training system 100 provides feedback (step S124). For example, the UI device 110 displays UI screen D6 shown in Figure 13 and UI screen D7 shown in Figure 14 in order.

[0168] Next, the training system 100 ends the interval (step S126). After that, the process returns to step S112.

[0169] If it is determined in step S120 that the training course has ended (step S120: YES), the training system 100 displays a finish screen (step S128). For example, the UI device 110 displays UI screen D6 shown in Figure 13 and UI screen D7 shown in Figure 14 in order, and then displays a UI screen indicating the end of the training course.

[0170] The process will then be completed.

[0171] <5. Hardware Configuration Example> Finally, the hardware configuration of the information processing device according to this embodiment will be described with reference to Figure 17. Figure 17 is a block diagram showing an example of the hardware configuration of the information processing device according to this embodiment. Note that the information processing device 900 shown in Figure 17 can, for example, realize the control device 130, UI device 110, or user terminal 200 shown in Figure 5. Information processing by the control device 130, UI device 110, or user terminal 200 according to this embodiment is realized through the cooperation of software and the hardware described below.

[0172] As shown in Figure 17, the information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, and a host bus 904a. The information processing device 900 also includes a bridge 904, an external bus 904b, an interface 905, an input device 906, an output device 907, a storage device 908, a drive 909, a connection port 910, and a communication device 911. The information processing device 900 may have processing circuits such as electrical circuits, a DSP, or an ASIC in place of, or together with, the CPU 901.

[0173] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation within the information processing unit 900 according to various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as appropriate during its execution. The CPU 901 may, for example, form a control unit 131.

[0174] The CPU 901, ROM 902, and RAM 903 are interconnected by a host bus 904a, which includes a CPU bus. The host bus 904a is connected to an external bus 904b, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 904. It is not necessary to configure the host bus 904a, bridge 904, and external bus 904b separately; these functions may be implemented on a single bus.

[0175] The input device 906 is implemented by a device into which information is input by the user, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever. The input device 906 may also be a remote control device using infrared or other radio waves, or an external device such as a mobile phone or PDA that is compatible with the operation of the information processing device 900. Furthermore, the input device 906 may include, for example, an input control circuit that generates an input signal based on the information input by the user using the above-mentioned input means and outputs it to the CPU 901. The user of the information processing device 900 can input various types of data or instruct processing operations on the information processing device 900 by operating this input device 906.

[0176] In addition, the input device 906 may be formed by a device that detects information about the user. For example, the input device 906 may include various sensors such as an image sensor (e.g., a camera), a depth sensor (e.g., a stereo camera), an acceleration sensor, a gyroscope, a geomagnetic sensor, a light sensor, a sound sensor, a distance sensor, and a force sensor. The input device 906 may also acquire information about the state of the information processing device 900 itself, such as the attitude and speed of the information processing device 900, and information about the surrounding environment of the information processing device 900, such as the brightness and noise around the information processing device 900. Furthermore, the input device 906 may include a GNSS module that receives GNSS signals from GNSS (Global Navigation Satellite System) satellites (e.g., GPS signals from GPS (Global Positioning System) satellites) and measures position information including the latitude, longitude, and altitude of the device. Regarding position information, the input device 906 may detect the position by transmitting and receiving data with Wi-Fi®, mobile phones, PHS, smartphones, etc., or by short-range communication.

[0177] The output device 907 is formed of a device capable of notifying the user of acquired information visually or audibly. Examples of such devices include display devices such as CRT displays, liquid crystal displays, plasma displays, EL displays, laser projectors, LED projectors, and lamps, as well as audio output devices such as speakers and headphones, and printers. The output device 907 outputs, for example, the results obtained from various processes performed by the information processing device 900. Specifically, the display device visually displays the results obtained from various processes performed by the information processing device 900 in various formats such as text, images, tables, and graphs. On the other hand, the audio output device converts the audio signal, consisting of reproduced audio data or sound data, into an analog signal and outputs it audibly.

[0178] The storage device 908 is a data storage device formed as an example of a storage unit of the information processing device 900. The storage device 908 can be implemented by, for example, a magnetic storage device such as an HDD, a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 908 may also include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. This storage device 908 stores programs executed by the CPU 901, various data, and various data acquired from external sources. The storage device 908 can, for example, form a storage unit 132.

[0179] The drive 909 is a reader / writer for storage media and is either built into or external to the information processing unit 900. The drive 909 reads information recorded on removable storage media such as magnetic disks, optical disks, magneto-optical disks, or semiconductor memory that are installed on it, and outputs it to the RAM 903. The drive 909 can also write information to removable storage media.

[0180] The connection port 910 is an interface for connecting to an external device, and is a connection port for an external device capable of data transmission via, for example, USB (Universal Serial Bus).

[0181] The communication device 911 is, for example, a communication interface formed by a communication device for connecting to the network 920. The communication device 911 is, for example, a communication card for wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB). Alternatively, the communication device 911 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication. This communication device 911 can, for example, send and receive signals to and from the Internet or other communication devices in accordance with a predetermined protocol such as TCP / IP.

[0182] Network 920 is a wired or wireless transmission path for information transmitted from devices connected to Network 920. For example, Network 920 may include public networks such as the Internet, telephone networks, and satellite communication networks, as well as various LANs (Local Area Networks) including Ethernet®, and WANs (Wide Area Networks). Network 920 may also include dedicated network lines such as IP-VPNs (Internet Protocol-Virtual Private Networks).

[0183] The above describes an example of a hardware configuration capable of realizing the functions of the information processing device 900 according to this embodiment. Each of the above components may be realized using general-purpose materials, or it may be realized using hardware specialized for the functions of each component. Therefore, it is possible to change the hardware configuration used as appropriate depending on the level of technology at the time of implementing this embodiment.

[0184] <6. Supplementary Information> Although preferred embodiments of the present disclosure have been described in detail with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person with ordinary skill in the art of the present disclosure may conceive of various modifications or alterations within the scope of the technical ideas described in the claims, and these will naturally also fall within the technical scope of the present disclosure.

[0185] (1) Another example of real-time feedback with modification guides is described below.

[0186] Figures 18 and 19 show examples of UI screens D8 and D9 for real-time feedback. UI screen D8 shown in Figure 18 may be displayed by the UI device 110 while the user is performing an incline cable press and before the load is applied. UI screen D9 shown in Figure 19 may be displayed by the UI device 110 while the user is performing an incline cable press and the load is being applied. That is, the screen displayed by the UI device 110 may transition from UI screen D8 to UI screen D9 as the load is applied.

[0187] Real-time image display areas D81 and D91 display the same information as real-time image display area D31 shown in Figure 8.

[0188] Load display fields D82 (D82L and D82R) and D92 (D92L and D92R) display the same information as load display field D32 (D32L and D32R) shown in Figure 8.

[0189] The position indicator objects D83 (D83L and D83R) and D93 (D93L and D93R) display the same information as the position indicator object D33 (D33L and D33R) shown in Figure 8.

[0190] Guide waveform display fields D84 and D94 display the same information as guide waveform display field D34 shown in Figure 8. However, the guide waveform WG is displayed in different ways depending on whether a load is applied or not. For example, the guide waveform WG may be displayed as a dashed line when no load is applied, as shown in Figure 8, and as a solid line when a load is applied, as shown in Figure 9.

[0191] The set number display fields D85 and D95 ​​display the same information as the set number display field D35 shown in Figure 8.

[0192] Input buttons D87 (D87-1 to D87-4) and D97 are UI buttons for accepting user input. The user can input desired instructions to the training system 100 by selecting and confirming the desired input buttons D87 and D97. The selection of input buttons D87 and D97 may be performed by operating the operation unit 71 (for example, by moving its position up, down, left, or right). Confirmation of the selected input buttons D87 and D97 may be performed by operating the input unit 72 (for example, by pressing a hardware button). Input buttons D87 and D97 may be displayed in different ways depending on whether they are selected or not. In particular, selected input buttons D87 and D97 may be displayed in a predetermined color, and it is desirable that the input unit 72 is also assigned this predetermined color. With this configuration, since the color of the hardware button and the color of the selected UI button match, the user can intuitively understand that they can confirm the selected UI button by pressing a button of the same color as the selected UI button.

[0193] The Load On Frame D98 shown in Figure 19 displays information indicating that a load has been applied. When a load has been applied, Load On Frame D98 surrounds the outer frame of UI screen D9 and displays text indicating that a load has been applied at the bottom of UI screen D9. On the other hand, as shown in Figure 18, Load On Frame D98 is not displayed when no load has been applied. With this configuration, users can easily understand whether or not a load has been applied based on whether or not Load On Frame D98 is displayed.

[0194] (2) In addition, the above describes an example in which the training system 100 estimates the position of the operating unit 71 and generates notification information based on the position of the operating unit 71, but the present disclosure is not limited to such an example. The training system 100 may also estimate the velocity, acceleration, force acting on the operating unit 71, and the vector direction of the force acting on the operating unit 71, and may generate notification information based on this estimated information. Pressure sensors may be provided on the operating unit 71, the fulcrum on the extension side 8, and the fulcrum on the rod side 11, and the load acting on the user (i.e., the operating unit 71) may be estimated based on the pressure acting on these parts. Furthermore, the vector direction of the force acting on the operating unit 71 corresponds to the orientation of the string-like portion 7 extending from the operating unit 71. Therefore, the training system 100 can estimate the vector direction of the force acting on the operating unit 71 based on the orientation of the string-like portion 7 as seen in the image captured by the imaging device 120.

[0195] The above describes an example in which the training device 1 has two independent operating parts 71 on the left and right sides, but the disclosure is not limited to such an example. For example, the training device 1 may have two string-like parts 7 on the left and right sides, and one operating part 71 such as a long shaft connected to the two string-like parts 7 on the left and right sides.

[0196] The imaging device 120 may be a stereo camera and may acquire depth information along with the user's image. When the imaging device 120 is configured as a stereo camera, occlusion caused by the user's body being obscured by the training device 1 can be removed. The training device 1 may also have a depth sensor such as a ToF (Time of Flight) sensor and may acquire depth information of the user performing the training. The training system 100 may then perform various analyses based on the depth information and generate notification information. For example, depth information may be used in posture analysis, or in position estimation of the operation unit 71. With such a configuration, it is possible to improve the accuracy of the analysis.

[0197] The series of processes performed by each device described herein may be implemented using software, hardware, or a combination of software and hardware. The programs constituting the software are pre-stored in a recording medium (more specifically, a non-temporary storage medium readable by a computer) provided inside or outside each device. Each program is then loaded into RAM (Random Access Memory) when executed by a computer controlling each device described herein, and executed by a processing circuit such as a CPU (Central Processing Unit). The recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, or flash memory. The computer program may also be distributed via a network, for example, without using a recording medium. The computer may be an application-specific integrated circuit (ASIC), a general-purpose processor that performs functions by loading software programs, or a computer on a server used for cloud computing. The series of processes performed by each device described herein may be centrally processed by a single computer or distributed among multiple computers. A method for executing the series of processes performed by each device described herein, which is performed by a computer, may also be provided. Furthermore, in each of the above embodiments, two or more communication means present in a single device may be physically implemented in a single medium.

[0198] Furthermore, the processes described herein using flowcharts or sequence diagrams do not necessarily have to be executed in the order shown. Some processing steps may be executed in parallel. Additional processing steps may be adopted, and some processing steps may be omitted.

[0199] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology relating to this disclosure may produce other effects that are obvious to those skilled in the art from the description herein, in addition to or instead of the effects described herein.

[0200] Furthermore, the following configurations also fall within the technical scope of this disclosure: (1) An information processing device comprising: a control unit that generates notification information regarding the training performed by a user based on operation information of the load control unit and an image of the user obtained when a user performs training to move the operation unit using a training device having an operation unit connected to a string-like part and a load control unit that pulls the string-like part to control the load applied to the string-like part; (2) The information processing device according to (1), wherein the notification information includes information indicating the position of the operation unit or information indicating the time-series progression of the position of the operation unit; (3) The information processing device according to (2), wherein the notification information includes information indicating the position of the operation unit or information indicating the time-series progression of the position of the operation unit and information indicating an exemplary time-series progression of the position of the operation unit; (4) The information processing device according to (3), wherein the information indicating an exemplary time-series progression of the position of the operation unit corresponds to the characteristics of music played during training; (5) The information processing device according to (3) or (4), wherein the information indicating an exemplary time-series progression of the position of the operation unit corresponds to user information. (6) The information processing device according to any one of (3) to (5), wherein the notification information includes information showing the difference between information showing the time-series progression of the position of the operating unit and information showing an exemplary time-series progression of the position of the operating unit. (7) The information processing device according to (6), wherein the notification information includes information showing the difference between information showing the time-series progression of the position of the operating unit and information showing an exemplary time-series progression of the position of the operating unit, and includes at least one of information showing the difference during concentric movement, information showing the difference during isometric movement, and information showing the difference during eccentric movement. (8) The information processing device according to any one of (2) to (7), wherein the training device includes a plurality of combinations of the operating unit, the string-like unit, and the load control unit, and the notification information includes information showing the positions of a plurality of the operating units, or information showing the time-series progression of the positions of a plurality of the operating units.(9) The training device includes two combinations of the operating unit, the string-like unit, and the load control unit, wherein the notification information is information showing the difference between information showing the position of the operating unit, or information showing the time-series progression of the position of the operating unit, and information showing an exemplary time-series progression of the position of the operating unit, and includes at least one of information showing the difference during concentric movement, information showing the difference during isometric movement, and information showing the difference during eccentric movement for each of the two operating units, as described in (8). (10) The notification information includes feedback regarding the user's posture during training, as described in any one of (1) to (9). (11) The control unit generates the notification information based on the difference between the skeletal movement during training estimated from the user's image and an exemplary skeletal movement, as described in (10). (12) The information processing apparatus according to any one of (1) to (11), wherein the control unit controls an output device to output the notification information generated by the user during training. (13) The information processing apparatus according to any one of (1) to (12), wherein the control unit controls an output device to output the notification information generated during training during the interval after training. (14) The information processing apparatus according to any one of (1) to (13), wherein the training device has a support part that supports the user's body during training, and a pivot point that changes the direction in which the string-like part extends from the operating part, and the control unit controls a setting process to set the position and posture of the support part and the pivot point according to the type of training. (15) The information processing apparatus according to (14), wherein the control unit controls the setting process based on the user's identification information. (16) The information processing apparatus according to (14) or (15), wherein the control unit controls the setting process based on the user's physical characteristics. (17) The information processing apparatus according to any one of (14) to (16), wherein the control unit controls the setting process based on the operation information of the load control unit and the user's image obtained during training.(18) A training device having an operating unit connected to a string-like portion and a load control unit that controls the load applied to the string-like portion by pulling the string-like portion; an imaging device that captures an image of a user using the training device; an information processing device that generates notification information regarding the training performed by the user based on the operation information of the load control unit and the user's image obtained when the user performs training to move the operating unit using the training device; and an output device that outputs the generated notification information. (19) A program to cause a computer to function as a control unit that generates notification information regarding the training performed by the user based on the operation information of the load control unit and the user's image obtained when the user performs training to move the operating unit using a training device having an operating unit connected to a string-like portion and a load control unit that controls the load applied to the string-like portion by pulling the string-like portion.

[0201] 1 Training device 10 Rod 11 Rod-side pivot point 2 Sheet 23 First sheet 24 Second sheet 3 Base plate 43 Telescopic support part 5 Drive device 51 Housing 52 Electric motor 53 Output shaft 6 Extension part 7 String-like part 71 Operation part 72 Input part 8 Extension part-side pivot point 81 Fixed pivot point 82 Movable pivot point 9 Caster 100 Training system 101 Sensor 102 Drive unit 110 UI device 120 Imaging device 130 Control device 131 Control unit 132 Memory unit 200 User terminal

Claims

1. An information processing device comprising: a control unit that generates notification information regarding the training performed by a user based on the operation information of the load control unit and an image of the user obtained when a user performs training to move the operation unit using a training device having an operation unit connected to a string-like part and a load control unit that pulls the string-like part to control the load applied to the string-like part.

2. The information processing apparatus according to claim 1, wherein the notification information includes information indicating the position of the operating unit, or information indicating the time-series progression of the position of the operating unit.

3. The information processing apparatus according to claim 2, wherein the notification information includes information indicating the position of the operating unit, or information indicating the time-series progression of the position of the operating unit, and information indicating a model time-series progression of the position of the operating unit.

4. The information processing apparatus according to claim 3, wherein the information showing the exemplary time-series progression of the position of the operating unit corresponds to the characteristics of the music played during training.

5. The information processing apparatus according to claim 3, wherein the information showing the exemplary time-series progression of the position of the operating unit corresponds to user information.

6. The information processing apparatus according to claim 3, wherein the notification information includes information showing the difference between information showing the time-series progression of the position of the operating unit and information showing an exemplary time-series progression of the position of the operating unit.

7. The information processing apparatus according to claim 6, wherein the notification information is information showing the difference between information showing the time-series progression of the position of the operating unit and information showing a model time-series progression of the position of the operating unit, and includes at least one of information showing the difference during concentric motion, information showing the difference during isometric motion, and information showing the difference during eccentric motion.

8. The training device includes a plurality of combinations of the operation unit, the string-like unit, and the load control unit, and the notification information includes information indicating the positions of the plurality of operation units, or information indicating the time-series progression of the positions of the plurality of operation units, as described in claim 2.

9. The training device includes two combinations of the operating unit, the string-like unit, and the load control unit, and the notification information is information showing the difference between information showing the position of the operating unit, or information showing the time-series progression of the position of the operating unit, and information showing an exemplary time-series progression of the position of the operating unit, and includes at least one of information showing the difference during concentric movement, information showing the difference during isometric movement, and information showing the difference during eccentric movement for each of the two operating units, the information processing device according to claim 8.

10. The information processing apparatus according to claim 1, wherein the notification information includes feedback regarding the user's posture during training.

11. The information processing apparatus according to claim 10, wherein the control unit generates the notification information based on the difference between the skeletal movement during training estimated from the user's image and the exemplary movement of the skeleton.

12. The information processing apparatus according to claim 1, wherein the control unit controls the output device to generate the notification information during training and output the generated notification information.

13. The information processing apparatus according to claim 1, wherein the control unit controls the output device to output the notification information generated during training during the interval after training.

14. The training device has a support part that supports the user's body during training, and a pivot point that changes the direction in which the string-like part extends from the operating part, and the control unit controls a setting process that sets the position and orientation of the support part and the pivot point according to the type of training, as described in claim 1.

15. The information processing apparatus according to claim 14, wherein the control unit controls the setting process based on the user's identification information.

16. The information processing apparatus according to claim 14, wherein the control unit controls the setting process based on the user's physical characteristics.

17. The information processing apparatus according to claim 14, wherein the control unit controls the setting process based on the operation information of the load control unit and the user's image obtained during training.

18. A training device having an operating unit connected to a string-like portion and a load control unit that pulls the string-like portion to control the load applied to the string-like portion; an imaging device that captures an image of a user using the training device; an information processing device that generates notification information regarding the training performed by the user based on the operation information of the load control unit and the image of the user obtained when the user performs training to move the operating unit using the training device; and an output device that outputs the generated notification information.

19. A program to cause a computer to function as a control unit that generates notification information regarding the training performed by a user, based on the operation information of the load control unit and the user's image obtained when a user performs training to move the operation unit using a training device having an operating unit connected to a string-like part and a load control unit that controls the load applied to the string-like part by pulling the string-like part.