Lesson system

Abstract

To provide a lesson system capable of further contributing to the improvement of a user.SOLUTION: The lesson system 1 includes a sensor sheet 21, a camera 22, and a lesson apparatus 10. An information acquisition part 110 of a lesson device 10 acquires specific information and non-specific information as information on a user on the basis of user action detection using a sensor sheet 21 and a camera 22 for the user performing an action. A target setting part 120 of a lesson device 10 determines an attainment target of a user from among a plurality of standard targets predetermined as candidates. The evaluation section 130 of the lesson apparatus 10 evaluates the user information acquired on the basis of the detected user's action. The instructing section 140 of the lesson apparatus 10 outputs, on the basis of an evaluation result of the evaluating section 130, an instruction content for causing at least one of the specific information and the non-specific information of the user to approach an arrival target.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The disclosed technology relates to a lesson system that detects user motion using a detection device to detect a user who is moving, and outputs instruction content according to an evaluation based on the detected user motion. [Background technology]

[0002] For example, in sports, improving the quality of a movement can lead to improvement. For example, Patent Document 1 discloses a technology that contributes to the improvement of a user's skill by using a camera to film the user in action and overlaying the filmed video with an ideal video for comparison. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-064095 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the information that can be extracted from the video captured while the user is moving may not necessarily contain all the information necessary for the user to improve. In other words, even if lessons are conducted based only on information obtained from a single detection device, for example, rapid improvement may not be expected.

[0005] The disclosed technology aims to provide a lesson system that can further contribute to the improvement of users' skills. [Means for solving the problem]

[0006] One aspect of the disclosed technology is a lesson system comprising an information acquisition unit that acquires information about a moving user based on user motion detection, which performs detection using a specific detection device and a non-specific detection device different from the specific detection device; a goal setting unit that determines a goal to be achieved by the user; an evaluation unit that evaluates the user information acquired based on the user motion detection; and a teaching unit that outputs teaching content for the user, wherein the information acquisition unit acquires specific information and non-specific information as user information from the specific detection device and the non-specific detection device, respectively, in response to the user motion detection, the goal setting unit determines the goal to be achieved from a plurality of standard goals that are predetermined as candidates, and the plurality of standard goals have different combinations of specific information and non-specific information, and the teaching unit outputs teaching content that will bring at least one of the user's specific information and non-specific information closer to the goal to be achieved, based on the evaluation results of the evaluation unit.

[0007] In this lesson system, based on the information acquired by each of the two detection devices, instructional content can be output that will bring the information acquired by at least one of the devices closer to the goal. Therefore, even if information cannot be detected by one detection device, it can be detected by the other detection device, and instruction related to that information can be provided. Therefore, the lesson system according to the above embodiment can further contribute to the user's improvement. [Effects of the Invention]

[0008] According to the disclosed technology, a lesson system is provided that can further contribute to the improvement of users' skills. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic configuration diagram of a lesson system according to an embodiment. [Figure 2] 10 is a flowchart showing the procedure of a lesson process executed in the lesson system. [Figure 3] 10 is a flowchart showing the procedure of an achievement determination process executed in the lesson process. [Figure 4] 10 is a flowchart showing the procedure of a goal setting process executed in the lesson process. [Figure 5] 10 is a flowchart showing the procedure of a way point creation process executed in the lesson process. [Figure 6] 10 is a flowchart showing the procedure of a teaching process executed in a lesson process. [Figure 7] FIG. 10 is a diagram for explaining specific examples of a destination goal and intermediate goals. [Figure 8] FIG. 10 is a diagram illustrating specific examples of achievement index values ​​and instruction contents. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments embodying the present disclosure will be described in detail with reference to the accompanying drawings. FIG. 1 shows a lesson system 1 according to this embodiment. The lesson system 1 can assist a user in improving their sports movements. Specifically, the lesson system 1 of this embodiment can assist a user in improving their golf swing.

[0011] The lesson system 1 includes a lesson device 10 and a detection device 20. The lesson device 10 is a device that can present instructional content that will help the user improve their golf game, based on information acquired from the user by the detection device 20.

[0012] The detection device 20 is a device that can detect user movements. User movement detection involves detecting a user who is moving. The lesson system 1 is equipped with multiple devices as the detection devices 20. Specifically, the lesson system 1 of this embodiment is equipped with a sensor sheet 21 and a camera 22 as the detection devices 20.

[0013] The sensor sheet 21 of this embodiment is a sheet-like pressure sensor, and is a device that can detect the distribution of surface pressure. A user according to this embodiment performs a golf swing while standing with both feet on the upper surface of the sensor sheet 21. As a result, the sensor sheet 21 can detect the distribution of surface pressure on the soles of the user's feet during the golf swing in user motion detection.

[0014] The camera 22 is a photographing device. The camera 22 can photograph the user making a golf swing. In user motion detection, the camera 22 can photograph an image of the user making a golf swing. The camera 22 is a detection device that can detect the user's motion by photographing. In the lesson system 1, the camera 22 photographs the user making a golf swing on the sensor sheet 21, so that the surface pressure distribution and a video (image) during the golf swing can be obtained simultaneously.

[0015] The lesson device 10 has a control unit 100, an operation IF 101, a communication IF 102, and a storage unit 150. The control unit 100 executes various processes in accordance with a program read from the storage unit 150 and based on operations by an operator. The operation IF 101 can accept operation inputs by the operator of the lesson device 10 and send the input information to the control unit 100. The operator of the lesson device 10 can be, for example, a user or an assistant who assists the user in lessons using the lesson system 1.

[0016] The communication IF 102 includes hardware for communicating with other devices via a network. The communication IF 102 may use a communication standard such as Ethernet (registered trademark), Wi-Fi (registered trademark), or USB. The lesson device 10 may include multiple communication IFs 102 compatible with multiple communication standards. The lesson device 10 can communicate with a user terminal, such as a smartphone owned by the user, via the communication IF 102. This allows the lesson device 10 to transmit instruction content to the user terminal, for example. It can also receive information input from the user terminal. The lesson device 10 can also communicate with a specific display, for example, via the communication IF 102. This allows the lesson device 10 to display a specific image on the display.

[0017] The storage unit 150 is a memory that stores various programs, including an operating system (OS), and various data. The buffer provided in the control unit 100 is also an example of memory. The storage unit 150 stores information related to golf swing instruction for the user. An example of the storage unit 150 is not limited to a ROM, RAM, HDD, etc. built into the lesson device 10, but may also be a storage medium that is readable and writable by the control unit 100.

[0018] The control unit 100 has an information acquisition unit 110, a goal setting unit 120, an evaluation unit 130, and an instruction unit 140. The control unit 100 in this embodiment can perform lesson processing to support the user in improving their golf swing. The lesson processing in this embodiment includes user action detection processing, reach determination processing, reach goal setting processing, intermediate goal creation processing, instruction processing, etc.

[0019] The information acquisition unit 110 is connected to each of the detection devices 20, and can perform user motion detection processing to acquire information detected by each of the detection devices 20 during user motion detection. The information acquisition unit 110 of this embodiment has a specific information acquisition unit 111 and a non-specific information acquisition unit 112. The specific information acquisition unit 111 and the non-specific information acquisition unit 112 can each acquire predetermined information through the user motion detection processing.

[0020] The specific information acquisition unit 111 is connected to the sensor sheet 21. In the user motion detection process, the specific information acquisition unit 111 can acquire information related to the surface pressure distribution detected by the sensor sheet 21. Furthermore, in the user motion detection process, the specific information acquisition unit 111 acquires predetermined specific information by calculation based on the acquired information related to the surface pressure distribution. The specific information is information that can be used to evaluate the user's motion and to determine the content of instructions to the user based on the evaluation.

[0021] Specifically, the specific information acquisition unit 111 of this embodiment can acquire, as the specific information, information related to the stability of the center position of the surface pressure distribution by calculation. In this embodiment, the stability of the center position of the surface pressure distribution can be acquired based on the movement of the center position of the surface pressure distribution during a predetermined period while the user's motion is being detected. In this embodiment, the period for acquiring the stability of the center position of the surface pressure distribution can be, for example, a predetermined period that is determined before and after a reference timing. In addition, in this embodiment, the stability of the center position of the surface pressure distribution may hereinafter be referred to as center of gravity stability.

[0022] The non-specific information acquisition unit 112 is connected to the camera 22. In the user motion detection process, the non-specific information acquisition unit 112 can acquire information related to an image captured by the camera 22. Furthermore, in the user motion detection process, the non-specific information acquisition unit 112 acquires predetermined non-specific information by calculation based on information related to the acquired captured image. The non-specific information is information that can be used to evaluate the user's motion and determine the content of instruction to the user based on the evaluation.

[0023] Specifically, the non-specific information acquisition unit 112 of this embodiment can acquire information on the user's torsion angle as non-specific information. The torsion angle is the angle of twist of the user's upper body relative to the lower body. In this embodiment, the camera 22 is positioned and angled so that it can capture an image of the front or back of the user in order to properly calculate the torsion angle. In this embodiment, the torsion angle at a predetermined reference timing can be acquired by measurement. The torsion angle can be acquired, for example, by performing bone detection on a video of the user and measuring an image at the reference timing based on the results of the bone detection.

[0024] That is, the information acquisition unit 110 can acquire at least one combination of specific information and non-specific information based on the detected user action. The information acquisition unit 110 of this embodiment acquires a combination of specific information and non-specific information that correspond to each other for the reference timing.

[0025] The goal setting unit 120 can set goals for the user. At least one set of specific information and non-specific information is set for each of the user's goals. The goal setting unit 120 of this embodiment has a final goal setting unit 121, an intermediate goal creation unit 122, and a next goal setting unit 123. The final goal setting unit 121 can perform final goal setting processing to set a final goal for the user. The final goal is a goal that the user ultimately aims for.

[0026] The way target creating unit 122 can perform a way target creating process that creates way targets for the user. The way targets are targets that are set on the assumption that the user will pass through before reaching the final target, and are targets that are closer to the current user than the final target. Specifically, the way targets are targets whose specific information and / or non-specific information are closer to the current user than the final target. The way target creating unit 122 of this embodiment can create multiple way targets in the way target creating process. Each of the multiple way targets created by the way target creating unit 122 has a different difference from the final target. The multiple way targets are targets that are preferably passed through in order of furthest from the final target on the way to reaching the final target.

[0027] The next goal setting unit 123 can perform a next goal setting process to set a next goal that is the next goal for the user. In the next goal setting process, the next goal setting unit 123 sets the next goal to one of the unreached goals between the reach goal set by the reach goal setting unit 121 and the intermediate goal created by the intermediate goal creation unit 122, which is closest to the current user. In this embodiment, the intermediate goal set as the next goal is called an intermediate goal. Therefore, the intermediate goal is a goal that is closer to the current user than the reach goal. When there are multiple unreached intermediate goals created by the intermediate goal creation unit 122, the next goal setting unit 123 can set the intermediate goal that is closest to the current user as the next intermediate goal.

[0028] The evaluation unit 130 can perform evaluation based on user information acquired based on user motion detection. That is, the evaluation unit 130 performs evaluation based on specific information and non-specific information. The evaluation unit 130 of this embodiment includes an achievement index value calculation unit 131 and an achievement determination unit 132.

[0029] The achievement index value calculation unit 131 can perform an achievement index value calculation process that calculates the degree of achievement of the user toward the next goal. In the achievement index value calculation process, the achievement index value calculation unit 131 can calculate index values ​​that indicate the degree of achievement of the specific information and non-specific information of the next goal, for each of the specific information and non-specific information.

[0030] Specifically, the achievement index value calculation unit 131 calculates a specific achievement index value that indicates the degree of achievement of the specific information by comparing the specific information of the user with the specific information of the next target. The specific achievement index value can be calculated, for example, based on the difference between the specific information of the user and the specific information of the next target. Furthermore, the achievement index value calculation unit 131 calculates a non-specific achievement index value that indicates the degree of achievement of the non-specific information by comparing the non-specific information of the user with the non-specific information of the next target. The non-specific achievement index value can be calculated, for example, based on the difference between the non-specific information of the user and the non-specific information of the next target.

[0031] The reach determination unit 132 can perform reach determination processing to determine whether or not the user has reached the next target. In the reach determination processing, the reach determination unit 132 of this embodiment performs reach determination to determine whether or not the user has reached the next target based on each index value calculated by the reach index value calculation unit 131. Note that the reach determination does not necessarily need to use the index values ​​calculated by the reach index value calculation unit 131, and the reach determination may be performed, for example, by comparing specific information and non-specific information acquired by user motion detection with specific information and non-specific information of the next target.

[0032] The instruction unit 140 can perform an instruction process that outputs instruction content to the user. In the instruction process, the instruction unit 140 of this embodiment can present instruction content based on the evaluation result of the evaluation unit 130. That is, the instruction unit 140 outputs instruction content based on the results of the achievement index value calculation process performed by the achievement index value calculation unit 131 and the achievement determination process performed by the achievement determination unit 132.

[0033] Various databases related to lesson processing are stored in the storage unit 150. Specifically, the storage unit 150 of this embodiment stores a standard goal DB 151, a attainment goal DB 152, an intermediate goal DB 153, a next goal DB 154, a judgment progress DB 155, and a teaching content DB 156.

[0034] The standard goal DB 151 is a database in which a plurality of standard goals are stored. The standard goals are candidates for the target goal. The target setting unit 121 of this embodiment sets the target to be reached by each user to one of the plurality of standard goals stored in the standard goal DB 151. Each of the plurality of standard goals differs from the other standard goals in at least one of specific information and non-specific information.

[0035] The goal DB 152 is a database that stores goals. The goal DB 152 stores the goals set by the goal setting unit 121 for each user.

[0036] The way point DB 153 is a database that stores way points. The way point DB 153 stores the way points for each user that are created by the way point creation unit 122.

[0037] The next goal DB 154 is a database that stores the next goal. The next goal DB 154 stores the next goal of each user that is set by the next goal setting unit 123.

[0038] The assessment progress DB 155 is a database that stores evaluation results based on user-specific information and non-specific information acquired during user motion detection. The assessment progress DB 155 stores a history of evaluation results previously performed by the evaluation unit 130 for each user. In this embodiment, the evaluation results include values ​​calculated in the achievement index value calculation process performed by the achievement index value calculation unit 131, and results of achievement determination performed by the achievement determination unit 132.

[0039] The instruction content DB 156 is a database in which a plurality of candidate instruction contents for the user are stored. The instruction unit 140 of this embodiment selects and presents instruction contents to the user from the plurality of candidate instruction contents stored in the instruction content DB 156 based on the evaluation results of the evaluation unit 130. All of the instruction contents are intended to bring at least one of the user's specific information and non-specific information closer to the next target. Therefore, the instruction contents are intended to bring at least one of the user's specific information and non-specific information closer to the target to be achieved.

[0040] Next, the lesson processing performed by the lesson device 10 will be described with reference to Figures 2 to 6. As shown in Figure 2, when the control unit 100 starts the lesson processing, it first performs a user action detection process (S101). The lesson processing can be started, for example, when a predetermined start input is input by the operation IF of the lesson device 10.

[0041] In the user motion detection process, detection by the sensor sheet 21 and shooting by the camera 22 begin. Then, the camera 22 shoots the user performing a golf swing on the sensor sheet 21. As a result, the specific information acquisition unit 111 and the non-specific information acquisition unit 112 respectively acquire the surface pressure distribution of the soles of the user's feet during the golf swing and a video of the user performing the golf swing.

[0042] Furthermore, in user motion detection, the specific information acquisition unit 111 acquires specific information. In this embodiment, the specific information acquisition unit 111 acquires, as specific information, information related to the stability of the center position of the surface pressure distribution (center of gravity stability) based on the surface pressure distribution of the soles of the user's feet during a golf swing. Furthermore, in user motion detection, the non-specific information acquisition unit 112 acquires non-specific information. In this embodiment, the non-specific information acquisition unit 112 measures and acquires, as non-specific information, a torsion angle based on a video of the user during a golf swing.

[0043] The specific information acquisition unit 111 and the non-specific information acquisition unit 112 of this embodiment can each acquire multiple combinations of specific information and non-specific information for different reference times in user motion detection. That is, they acquire combinations of specific information and non-specific information for multiple reference times.

[0044] That is, the specific information acquisition unit 111 can acquire initial specific information, mid-term specific information, and final specific information at the initial, middle, and final user motion detection periods. The non-specific information acquisition unit 112 can acquire initial non-specific information, mid-term non-specific information, and final non-specific information at the initial, middle, and final user motion detection periods. That is, in this embodiment, three combinations of specific information and non-specific information related to different timings in user motion detection are acquired.

[0045] In this embodiment, the initial period of user motion detection is when the shaft is tilted to 45° for the first time after the user starts a golf swing. The middle period of user motion detection is when the golf club head reaches its highest position at the top, and the final period of user motion detection is when the golf club head makes contact with the ball at impact. Each timing can be determined by analyzing the images captured by camera 22.

[0046] Following the detection of the user's motion, the control unit 100 determines whether or not the next goal is stored in the next goal DB 154 (S102). In this embodiment, if the user's motion is detected for the second time or later for the user, the next goal is stored. On the other hand, if the user's motion is detected for the first time for the user, the next goal is not stored.

[0047] If a next target is stored (YES in S102), the control unit 100 performs an achievement determination process (S103), an achievement target setting process (S104), and an intermediate target creation process (S105), and determines whether the next target has been updated in these processes (S106). If the next target has been updated (YES in S106), the control unit 100 returns to the achievement determination process (S103). On the other hand, if the next target has not been updated (NO in S106), the control unit 100 performs a guidance process (S107) and ends the lesson process. The achievement determination process (S103), the achievement target setting process (S104), the intermediate target creation process (S105), and the guidance process (S107) will be described in detail later.

[0048] If the next goal is not stored (NO in S102), the control unit 100 performs a final goal setting process (S104) and an intermediate goal creation process (S105), and determines whether the next goal has been changed (S106). If the next goal is not stored (NO in S102), the first next goal is set in the intermediate goal creation process (S105). That is, if the next goal is not stored (NO in S102), the next goal is updated (S106), and then the achievement determination process (S103), the final goal setting process (S104), and the intermediate goal creation process (S105) are performed. Then, the instruction process (S107) is performed, and the lesson process is completed.

[0049] In the reach determination process (S103), first, reach index value calculation process (S201) is performed as shown in Fig. 3. That is, the reach index value calculation unit 131 calculates a specific reach index value and a non-specific reach index value. The specific reach index value is calculated based on specific information acquired in the most recent user action detection process and specific information of the next target. The non-specific reach index value is calculated based on non-specific information acquired in the most recent user action detection process and non-specific information of the next target.

[0050] The reach index value calculation unit 131 of this embodiment calculates a specific reach index value and a non-specific reach index value for each of the reference timings of the initial user motion detection (when the shaft is at 45°), the middle user motion detection (when the top of the club), and the end user motion detection (when the impact occurs). Therefore, in this embodiment, for each target that can become the next target, a combination of specific information and non-specific information is defined for each of the initial user motion detection (when the shaft is at 45°), the middle user motion detection (when the top of the club), and the end user motion detection (when the impact occurs).

[0051] The initial specific reach index value, which is the specific reach index value at the beginning of user motion detection (when the shaft is at 45°), can be calculated based on the initial specific information acquired in the most recent user motion detection process and the initial specific information of the next target. The mid-term specific reach index value, which is the specific reach index value at the middle of user motion detection (when the top of the ball) can be calculated based on the middle specific information acquired in the most recent user motion detection process and the middle specific information of the next target. The final specific reach index value, which is the specific reach index value at the end of user motion detection (when the impact occurs), can be calculated based on the end specific information acquired in the most recent user motion detection process and the end specific information of the next target. The initial specific information, mid-term specific information, and final specific information are specific information about the beginning of user motion detection (when the shaft is at 45°), the middle of user motion detection (when the top of the ball), and the end of user motion detection (when the impact occurs), respectively.

[0052] Furthermore, the initial non-specific reach index value, which is the non-specific reach index value at the beginning of user motion detection (when the shaft is at 45°), can be calculated based on the initial specific information acquired in the most recent user motion detection process and the initial specific information of the next target. The mid-term non-specific reach index value, which is the non-specific reach index value at the middle of user motion detection (when the top of the ball) can be calculated based on the middle specific information acquired in the most recent user motion detection process and the middle specific information of the next target. The final non-specific reach index value, which is the non-specific reach index value at the end of user motion detection (when the impact occurs), can be calculated based on the end specific information acquired in the most recent user motion detection process and the end specific information of the next target. The initial non-specific information, the mid-term non-specific information, and the final non-specific information are non-specific information for the beginning of user motion detection (when the shaft is at 45°), the middle of user motion detection (when the top of the ball), and the end of user motion detection (when the impact occurs), respectively.

[0053] Next, an reach determination is performed to determine whether the user's action has reached the next target (S202). The reach determination unit 132 determines whether the next target has been reached based on the calculated specific reach index value and non-specific reach index value. Specifically, in this embodiment, if the calculated specific reach index value and non-specific reach index value are values ​​within a predetermined reach range, it is determined that the next target has been reached. On the other hand, if either the calculated specific reach index value or non-specific reach index value is not a value within the reach range, it is determined that the next target has not been reached.

[0054] If it is determined that the next target has been reached (YES in S202), the next target setting unit 123 performs the next target setting process (S203), the evaluation result is stored in the determination progress DB 155, and this process is terminated. On the other hand, if it is determined that the next target has not been reached (NO in S202), the next target setting process (S203) is not performed, the evaluation result is stored in the determination progress DB 155, and this process is terminated.

[0055] In the next goal setting process (S203), for example, if an intermediate goal (next goal) has been reached and there are still unreached route goals, the next goal setting unit 123 sets the route goal that is farthest from the final goal among the unreached route goals as the intermediate goal (next goal). Also, in the next goal setting process, for example, if the intermediate goal as the next goal has been reached in the current lesson process and there are no already unreached route goals, the next goal setting unit 123 sets the final goal as the next goal.

[0056] If the next goal reached in step S202 is the final goal, that is, if it is determined that the final goal has been reached, the lesson process may be terminated. Also, for example, if it is determined that the final goal has been reached, a standard goal different from the current final goal may be set as the next final goal.

[0057] In the final goal setting process (S104), as shown in Fig. 4, first, the final goal setting unit 121 determines whether or not a final goal is stored in the final goal DB 152 (S301). In this embodiment, the final goal is set in the first lesson process. Therefore, it is determined that a final goal is not stored in the first lesson process, but it is determined that a final goal is stored in the second or subsequent lesson processes.

[0058] If no target is stored (NO in S301), the target suitable for the user is determined from among the multiple standard targets (S302). Specifically, the target setting unit 121 determines the most suitable target from among the multiple standard targets stored in the standard target DB 151 based on information acquired about the user. The target setting unit 121 of this embodiment determines the most suitable target from among the multiple standard targets based on at least one of specific information and non-specific information acquired in the user motion detection process. This allows the target to be set based on the actual tendencies of the user's motion.

[0059] Next, the goal setting unit 121 selects a standard goal to be set as the goal (S303). For example, the standard goal determined to be suitable for the user (S302) can be used to select the standard goal to be set as the goal. Alternatively, for example, the standard goal determined to be suitable for the user (S302) may be presented to the user, etc., along with other standard goals, and the standard goal to be set as the goal may be selected based on a selection input by the user, etc. Then, the goal setting unit 121 stores the selected standard goal in the goal DB 152 as the goal (S304), and ends this process.

[0060] On the other hand, if a goal has already been stored (YES in S301), it is determined whether to change the goal (S305). Whether to change the goal can be determined, for example, based on past evaluation results stored in the determination progress DB 155. Specifically, for example, if the transition of specific information and non-specific information acquired based on multiple user motion detections indicates a tendency toward a standard goal different from the set goal, it can be determined that the goal should be changed. Also, for example, it can be determined that the goal should be changed based on a question to the user about whether to change the goal and an operation input requesting a change of the goal is made in response. On the other hand, if it is not determined that the goal should be changed, it can be determined that the goal should not be changed. If it is determined that the goal should be changed (YES in S305), the process proceeds to step S302. On the other hand, if it is determined that the goal should not be changed (NO in S305), this process ends.

[0061] In the way point creation process (S105), as shown in Fig. 5, first, the way point creation unit 122 determines whether or not a way point is stored in the way point DB 153 (S401). In this embodiment, the way point is created in the first lesson process. Therefore, it is determined that no way point is stored in the first lesson process, but it is determined that a way point is stored in the second or subsequent lesson processes.

[0062] If no way goal is stored (NO in S401), a new way goal is created (S402). Specifically, the way goal creation unit 122 acquires information about the goal by referring to the goal DB 152, and creates the way goal based on the specific information and non-specific information about the user and the goal acquired by user motion detection. The way goal differs from both the acquired user motion detection and the goal in at least one of the specific information and non-specific information. In this embodiment, the way goal creation unit 122 creates multiple way goals, each with a different difference from the goal in at least one of the specific information and non-specific information.

[0063] Next, the way target creation unit 122 stores the created way target in the way target DB 153 (S403), causes the next target setting unit 123 to perform a next target setting process (S404), and ends this process. In the next target setting process (S404), the next target setting unit 123 sets the way target that is farthest from the final target among the unreached way targets as the intermediate target that serves as the next target.

[0064] If the way point is stored (YES in S401), it is determined whether the way point needs to be corrected (S405). Whether the way point needs to be corrected can be determined, for example, from past evaluation results stored in the determination progress DB 155. For example, if the level of improvement of the user is different from that of a predetermined standard user in past achievement determinations performed based on multiple user motion detections, it can be determined that the way point needs to be corrected. Specifically, if the next goal is reached with fewer executions of the lesson process than a standard user and the user's level of improvement is faster than the standard, it can be determined that the way point needs to be corrected.

[0065] If the way targets need to be corrected (YES in S405), the way targets are corrected (S406). Specifically, for example, if the user's level of improvement is faster than average, the way target creation unit 122 corrects the number of way targets to be less than the number of way targets stored in the way target DB 153. Also, for example, if the user's level of improvement is slower than average, the way target creation unit 122 corrects the number of way targets to be more than the number of way targets stored in the way target DB 153. Also, for example, the specific information and non-specific information for each way target may be corrected based on the results of past arrival determinations. Next, the way target creation unit 122 updates the data stored in the way target DB 153 with the corrected way targets (S407), and proceeds to step S404.

[0066] On the other hand, if it is not determined that the correction of the way target is necessary, it can be determined that the correction of the way target is not necessary. If the correction of the way target is not necessary (NO in S405), this process ends.

[0067] In the instruction process (S107), first, an instruction content extraction process is performed (S501) as shown in Fig. 6. The instruction unit 140 of this embodiment selects an instruction content to be provided to the user from among a group of instruction content candidates stored in the instruction content DB 156 based on the evaluation result of the evaluation unit 130. The selection from the group of instruction content candidates stored in the instruction content DB 156 can be made based on the most recent evaluation result stored in the assessment progress DB 155.

[0068] The instruction content can be selected for each of the specific information and the non-specific information. In this embodiment, the specific information includes initial specific information, mid-term specific information, and final specific information, and the non-specific information includes initial non-specific information, mid-term non-specific information, and final non-specific information. In the instruction content extraction process, the instruction unit 140 can select instruction content for each of these six types of information. Note that the instruction unit 140 in this embodiment may not select instruction content for information that is determined to have reached the next target, for example.

[0069] Next, a priority determination process is performed (S502). In this embodiment, the instruction unit 140 assigns a priority to the instruction content for each piece of information selected in the instruction content extraction process. The priority can be assigned based on the most recent evaluation result stored in the assessment progress DB 155. In this embodiment, the priority is assigned based on the achievement index value stored in the assessment progress DB 155. In other words, the lower the degree of achievement indicated by the achievement index value, the higher the priority tends to be assigned.

[0070] Next, a teaching content output process is performed (S503). The teaching unit 140 of this embodiment outputs teaching contents based on priority. That is, for example, a plurality of teaching contents are arranged in order of priority and provided to the user. Alternatively, for example, only some of the teaching contents with high priority may be provided to the user. The teaching contents may be output, for example, by sending the teaching contents to a user terminal. Alternatively, for example, the teaching contents may be displayed on a display connected to the lesson device 10. Alternatively, for example, the teaching contents may be printed on paper using a printer connected to the lesson device 10 and provided.

[0071] Next, a specific example of the lesson system 1 according to this embodiment will be described. FIG. 7 shows specific examples of each goal, such as a goal to be reached. FIG. 7 shows an example in which the specific information acquired in user motion detection is the center of gravity stability at the time of impact, and the non-specific information is the twisting angle at the time of impact. FIG. 7 also shows the current position X, intermediate goal Y, and final goal Z. The current position X is information about the current user. In other words, the current position X is plotted as a combination of the specific achievement index value and the non-specific achievement index value calculated based on the user motion detection. In FIG. 7, the horizontal axis shows the specific achievement index value, and the vertical axis shows the non-specific achievement index value.

[0072] Note that Figure 7 shows an example in which the specific achievement index value and the non-specific achievement index value are calculated as a degree of achievement toward the target, with 100 being the perfect score. This is to make it easier to understand the positional relationship between the targets in Figure 7. However, in the lesson system 1 of this embodiment, the specific achievement index value and the non-specific achievement index value are calculated as values ​​indicating the degree of achievement toward the next target.

[0073] FIG. 7 shows a plurality of intermediate targets Y. Specifically, FIG. 7 shows intermediate targets Y1 and Y2 as intermediate targets Y. The intermediate targets Y1 and Y2 are, in that order, farthest from the destination target and closest to the current position X. Furthermore, a reachable range is set for each of the intermediate targets Y and destination target Z within which it can be determined that each target has been reached. FIG. 7 shows a reachable range YH1 of the intermediate target Y1, a reachable range YH2 of the intermediate target Y2, and a reachable range ZH of the destination target Z.

[0074] In the example of FIG. 7, the lesson system 1 first performs evaluation and guidance using the intermediate target Y1 as the next target, rather than the final target Z. The intermediate target Y as the next target is an intermediate target. After the current position based on the specific achievement index value and the non-specific achievement index value calculated based on the user's motion detection is plotted within the reach range YH1 for the intermediate target Y1, which is the next target, evaluation and guidance are performed using the intermediate target Y2 as the next target. Furthermore, after the current position based on the specific achievement index value and the non-specific achievement index value calculated based on the user's motion detection is plotted within the reach range YH2 for the intermediate target Y2, which is the next target, evaluation and guidance are performed using the final target Z as the next target.

[0075] In this way, in the lesson system 1 of this embodiment, rather than aiming to reach the final goal Z from the beginning, instruction is given to set the next goal as an intermediate goal that is closer to the current position X than the final goal Z. This allows the user to reach the final goal Z in stages, passing through intermediate goals that are closer to the current position X.

[0076] In other words, the lesson system 1 of this embodiment can provide instruction aimed at intermediate goals that are close to the user's current level. This allows the user to be presented with instruction content that is easy for the user to understand, helping the user to improve quickly. Furthermore, with the lesson system 1, the user is more likely to feel a sense of accomplishment because the next goal is approaching, which can increase the user's motivation for lessons.

[0077] Furthermore, in the lesson system 1 of this embodiment, as described above, the intermediate goal Y may be appropriately corrected based on past evaluation results, thereby appropriately supporting the user to improve quickly.

[0078] 7 shows an example of the time of impact (end of user motion detection). As described above, in the lesson system 1 of this embodiment, in addition to the time of impact (end of user motion detection), information is also acquired and evaluated when the shaft is at 45° (initial period of user motion detection) and when the top of the club (middle period of user motion detection). Therefore, evaluations are also performed based on information acquired by user motion detection when the shaft is at 45° (initial period of user motion detection) and when the top of the club (middle period of user motion detection), just like when the impact occurs (end of user motion detection).

[0079] FIG. 8 shows specific examples of achievement index values ​​and instructional content. FIG. 8 shows a specific achievement index value indicating the degree to which the center of gravity stability (specific information) has reached the next target, and a non-specific achievement index value indicating the degree to which the twist angle acquired as non-specific information has reached the next target, for each of the times when the shaft is at 45°, at the top, and at impact. In the example of FIG. 8, the achievement index value is a value obtained by scoring the degree to which the next target has been reached, with 100 points being the perfect score. Specifically, for example, the specific achievement index value at impact is less than 30 points, as shown in FIG. 8.

[0080] Furthermore, in the reach determination process in this specific example, if the reach index value is 90 points or more, it can be determined that the next target has been reached for that reach index value. Specifically, in the example of Figure 8, it can be determined that the next target has been reached for the non-specific reach index value when the shaft is at 45°. However, the next target has not been reached for the specific reach index value when the shaft is at 45°.

[0081] The overall index values ​​shown in FIG. 8 are values ​​for comprehensively comparing multiple calculated specific achievement index values ​​and non-specific achievement index values. FIG. 8 shows, as overall index values, a specific overall index value related to the specific achievement index values ​​and a non-specific overall index value related to the non-specific achievement index values. The specific overall index value is a calculated value calculated by a predetermined calculation based on multiple specific achievement index values. The specific overall index value of this embodiment is a value calculated by summing the specific achievement index values ​​when the shaft is at 45°, at the top, and at impact. The non-specific overall index value is a calculated value calculated by the same calculation as the specific overall index value based on multiple non-specific achievement index values. In other words, the non-specific overall index value of this embodiment is a value calculated by summing the non-specific achievement index values ​​when the shaft is at 45°, at the top, and at impact. In the example of FIG. 8, the specific overall index value is lower than the non-specific overall index value.

[0082] As shown in Figure 8, instruction content is selected for each of the specific information and non-specific information at the time of the shaft being 45°, at the top of the swing, and at the time of impact. The instruction content is selected according to the attainment index value from a group of multiple instruction content candidates that are preset for each of the specific information and non-specific information. Hereinafter, instruction content related to the specific information may be referred to as specific instruction content, and instruction content related to the non-specific information may be referred to as non-specific instruction content.

[0083] 8, in this embodiment, specific instruction contents are selected from candidate group A for specific information when the shaft is at 45°, candidate group B for specific information when the shaft is at the top, and candidate group C for specific information when the impact occurs. Non-specific instruction contents are selected from candidate group D for non-specific information when the shaft is at 45°, candidate group E for non-specific information when the shaft is at the top, and candidate group F for non-specific information when the impact occurs. Candidate groups A to F of instruction contents are stored in instruction content DB 156.

[0084] Specifically, for example, in the example of Figure 8 where the specific achievement index value at a shaft angle of 45° is 61 points or more and less than 90 points, instruction content A1 (move as if grabbing the ground with both toes) is selected as the specific instruction content from candidate group A. Also in the example of Figure 8, instruction contents B1, C1, D1, E1, and F1 are selected as other instruction contents from candidate groups B, C, D, E, and F, respectively, according to the achievement index value.

[0085] FIG. 8 shows the priority order for each instruction content. The priority order is assigned in descending order of priority. In the example of FIG. 8, as shown by the overall index value, when a plurality of specific attainment index values ​​and non-specific attainment index values ​​are comprehensively judged, the attainment index values ​​related to specific information tend to have a lower overall degree of attainment toward the next target than the attainment index values ​​related to non-specific information. In other words, in the example of FIG. 8, of the specific information and the non-specific information, it is the specific information that has a lower overall degree of attainment toward the next target. For this reason, the instruction unit 140 of this embodiment assigns a higher priority to the specific instruction content than to the non-specific instruction content.

[0086] In addition, the instruction unit 140 of this embodiment assigns a higher priority to a plurality of specific instruction contents, the lower the degree of achievement of the next target indexed by the specific achievement index value. Furthermore, the instruction unit 140 of this embodiment assigns a higher priority to a plurality of non-specific instruction contents, the lower the degree of achievement of the next target indexed by the non-specific achievement index value.

[0087] Then, the instruction unit 140 provides the user with each of the instruction contents A1, B1, C1, D1, E1, and F1 in order of priority. Specifically, the instruction unit 140 provides the user terminal with an image in which the instruction contents are arranged so that, for example, the instruction contents with higher priority are displayed at the top of the screen. This allows the user to check the instruction contents in order of priority. Therefore, the user can preferentially obtain instruction contents that can improve information that has a low degree of achievement toward the next goal.

[0088] The user in the example of FIG. 8 tends to receive a lower evaluation for center of gravity stability (specific information) than for torsion angle (non-specific information). Therefore, instruction content is preferentially acquired for the user regarding the center of gravity stability (specific information) with a lower evaluation. Therefore, the user can preferentially improve the center of gravity stability (specific information) with a lower evaluation. This allows the lesson system 1 to support the user's overall improvement.

[0089] Note that other methods may be adopted for providing instruction content by the instruction unit 140. That is, the instruction unit 140 may provide only some of the selected instruction content according to the priority order. In the example of FIG. 8, for example, the instruction unit 140 may not provide instruction content related to a non-specific achievement index value when the shaft is at 45°, which can be determined as having reached the next target. Also, for example, the instruction unit 140 may not select from the instruction content DB 156 instruction content that is not to be provided to the user.

[0090] Furthermore, the instructor 140 may provide different instruction content for one of the specific information and the non-specific information depending on the achievement index value of the other. That is, for example, instruction content for center of gravity stability at impact, which is specific information, may be changed depending on the achievement index value of the torsion angle at impact, which is non-specific information corresponding to the specific information. For example, if the specific information and the non-specific information have a relationship in which a change in one can affect the other, instruction content for improving the degree of achievement of one of the next targets may decrease the degree of achievement of the other of the next targets, which indicates a certain achievement index value. Therefore, in such a case, it is preferable to provide instruction content for improving the degree of achievement of one of the next targets that is less likely to decrease the degree of achievement of the other of the next targets.

[0091] As described above in detail, the lesson system 1 according to the embodiment includes the sensor sheet 21 and camera 22 as the detection device 20, and the lesson device 10. The control unit 100 of the lesson device 10 includes an information acquisition unit 110, a goal setting unit 120, an evaluation unit 130, and an instruction unit 140. The information acquisition unit 110 acquires specific and non-specific information as user information about a moving user based on user motion detection using the sensor sheet 21 and camera 22. The goal setting unit 120 determines the user's goal from multiple standard goals that are predefined as candidates. The multiple standard goals have different combinations of specific and non-specific information. The evaluation unit 130 evaluates the user information acquired based on the user motion detection. The instruction unit 140 outputs instruction content that will bring at least one of the user's specific and non-specific information closer to the goal based on the evaluation result of the evaluation unit 130. This lesson system 1 uses the sensor sheet 21 and camera 22, which can detect two different types of acquired information. Therefore, even if information is difficult to detect using one of the detection devices, the sensor sheet 21 or the camera 22, it can be properly detected by the other detection device, and instruction can be given regarding that information. Specifically, in this embodiment, the stability of the center of gravity during a user's movement, which is difficult to accurately detect using the camera 22, can be detected using the sensor sheet 21, and instruction regarding that center of gravity stability can be given appropriately. Also, in this embodiment, the twisting angle during a user's movement, which cannot be detected by the sensor sheet 21, can be detected by the camera 22, and instruction regarding that twisting angle can be given appropriately. Thus, a lesson system 1 that can further contribute to the user's improvement has been realized.

[0092] The above-described embodiments are merely examples and do not limit the present disclosure in any way. Therefore, the present disclosure can be naturally improved and modified in various ways without departing from the spirit and scope of the present disclosure.

[0093] For example, the two detection devices can be a combination of a specific detection device and a non-specific detection device that can acquire different information when detecting user motion. That is, in the above embodiment, an example was described in which a sheet-like pressure sensor capable of measuring the distribution of the user's plantar pressure was used as the specific detection device, and a camera capable of capturing an image of the user was used as the non-specific detection device. However, other combinations of detection devices can also be used. In many sports, improving information related to the center of gravity, body rotation, and its axis tends to lead to improvement. Therefore, a combination that can appropriately acquire information related to these is likely to appropriately contribute to improvement in sports. In addition to golf, sports to which the lesson system according to the above embodiment can be applied include baseball, tennis, and the like.

[0094] In the above embodiment, an example was described in which a sensor sheet was used to acquire center of gravity stability as specific information, and a camera was used to acquire torsion angle as non-specific information. However, the specific information and non-specific information acquired from the two detection devices are not limited to the examples in the above embodiment and can be changed as appropriate. Specifically, for example, a camera may be used to acquire a forward lean angle as non-specific information. The forward lean angle is the inclination angle of the axis of the upper body relative to the vertical direction. In the above embodiment, an example was described in which one sensor sheet was used and the user performed an operation with both feet placed on the upper surface of the sensor sheet. However, two sensor sheets may be used and the user may perform an operation with one foot placed on each upper surface of the sensor sheet.

[0095] For example, in the above embodiment, the goal setting unit was described as determining the most appropriate goal from among multiple standard goals based on the specific information and non-specific information acquired in the user motion detection process. However, for example, the goal setting unit may acquire information related to the user's physical characteristics and select a goal from among multiple standard goals based on that information. Furthermore, for example, the goal setting unit may select a goal from among multiple standard goals by combining information acquired about the user.

[0096] In the above embodiment, an example has been described in which three combinations of specific information and non-specific information are acquired for different reference times. However, the number of combinations of specific information and non-specific information to be acquired is not limited to three, and may be, for example, one.

[0097] Furthermore, for example, in the above embodiment, an example was described in which the detection device and the lesson device directly send and receive information. However, for example, a server that manages the detection information from the detection device may be provided, and information may be transmitted between the detection device and the lesson device via the server over a network. In other words, the hardware configurations and database configurations that store each piece of information specifically described in the above embodiment are merely examples, and any configuration that can realize each process may be used. In other words, for example, a camera installed in a user terminal may be used as the camera used to acquire non-specific information.

[0098] The above-mentioned disclosed technology also includes the following means 1 to 7. [Means 1] an information acquisition unit that acquires information about a user's actions based on user action detection that performs detection using a specific detection device and a non-specific detection device different from the specific detection device; a goal setting unit that sets a goal to be achieved by the user; an evaluation unit that evaluates user information acquired based on the user action detection; an instruction unit that outputs instruction content to a user; The information acquisition unit In response to the detection of the user's action, specific information and non-specific information are acquired as user information from the specific detection device and the non-specific detection device, respectively; The goal setting unit The target to be achieved is determined from a plurality of standard targets that are predetermined as candidates; The plurality of standard targets have different combinations of the specific information and the non-specific information, The leadership team: A lesson system that outputs instructional content that brings at least one of the specific information and the non-specific information of the user closer to the goal based on the evaluation results of the evaluation unit.

[0099] [Means 2] The lesson system according to means 1, the specific detection device is a sheet-like pressure sensor capable of measuring the distribution of the user's sole pressure, A lesson system in which the non-specific detection device is a camera capable of capturing an image of the user.

[0100] [Means 3] The lesson system according to means 1 or 2, The goal setting unit Based on a comparison between the specific information and the non-specific information of the user and the specific information and the non-specific information of the goal, the specific information and the non-specific information of an intermediate goal, which is a goal closer to the current user information than the goal, may be set; The evaluation unit When the user's action is detected with the intermediate goal set, the lesson system evaluates the user by comparing the specific information and non-specific information of the user with the specific information and non-specific information of the intermediate goal.

[0101] [Means 4] The lesson system according to means 3, The evaluation unit When the user's action is detected while the intermediate goal is set, a reach determination can be performed to determine whether the intermediate goal has been reached by comparing the specific information and the non-specific information of the user with the specific information and the non-specific information of the intermediate goal, The goal setting unit creating a plurality of intermediate goals with different differences from the final goal for at least one of the specific information and the non-specific information; Among the plurality of created intermediate goals, the intermediate goal that is closest to the current user information is set as the intermediate goal; The lesson system may correct the intermediate goal based on a record of the judgment result of the past arrival judgment.

[0102] [Means 5] A lesson system according to any one of means 1 to 4, The evaluation unit As an index value indicating the degree of attainment of the next goal, which is the next goal, a specific attainment index value is calculated as the index value for the specific information by comparing the specific information of the user with the specific information of the next goal, and a non-specific attainment index value is calculated as the index value for the non-specific information by comparing the non-specific information of the user with the non-specific information of the next goal; The leadership team: A lesson system that provides instructional content relating to information relating to one of the specific achievement index value and the non-specific achievement index value that indicates a low degree of achievement of the user toward the next goal with priority over instructional content relating to information relating to the other.

[0103] [Means 6] A lesson system according to any one of means 1 to 5, The evaluation unit As an index value indicating the degree of attainment of the next goal, which is the next goal, a specific attainment index value is calculated as the index value for the specific information by comparing the specific information of the user with the specific information of the next goal, and a non-specific attainment index value is calculated as the index value for the non-specific information by comparing the non-specific information of the user with the non-specific information of the next goal; The leadership team: A lesson system that provides different instructional content for one of the specific information and the non-specific information depending on the index value for the other.

[0104] [Means 7] A lesson system according to any one of means 1 to 6, The goal setting unit A lesson system that provides one of the plurality of standard goals as the most appropriate goal to be achieved based on at least one of the specific information and the non-specific information of the user. [Explanation of symbols]

[0105] 1: Lesson System 21: Sensor sheet 22: Camera 100: Control unit 110: Information acquisition department 111: Specific information acquisition department 112:Non-specific information acquisition department 120: Goal Setting Section 121: Achievement goal setting section 122: Route goal creation section 123: Next goal setting section 130: Evaluation section 131: Reach index value calculation unit 132:Achievement determination section 140: Guidance Department

Claims

1. an information acquisition unit that acquires information about a user's actions based on user action detection that performs detection using a specific detection device and a non-specific detection device different from the specific detection device; a goal setting unit that sets a goal to be achieved by the user; an evaluation unit that evaluates user information acquired based on the user action detection; an instruction unit that outputs instruction content to a user; The information acquisition unit In response to the detection of the user's action, specific information and non-specific information are acquired as user information from the specific detection device and the non-specific detection device, respectively; The goal setting unit The target to be achieved is determined from a plurality of standard targets that are predetermined as candidates; The plurality of standard targets have different combinations of the specific information and the non-specific information, The leadership team: A lesson system that outputs instructional content that brings at least one of the specific information and the non-specific information of the user closer to the goal based on the evaluation results of the evaluation unit.

2. The lesson system according to claim 1, the specific detection device is a sheet-like pressure sensor capable of measuring the distribution of the user's sole pressure, A lesson system in which the non-specific detection device is a camera capable of capturing an image of the user.

3. The lesson system according to claim 1 or 2, The goal setting unit Based on a comparison between the specific information and the non-specific information of the user and the specific information and the non-specific information of the goal, the specific information and the non-specific information of an intermediate goal, which is a goal closer to the current user information than the goal, may be set; The evaluation unit When the user's action is detected with the intermediate goal set, the lesson system evaluates the user by comparing the specific information and non-specific information of the user with the specific information and non-specific information of the intermediate goal.

4. The lesson system according to claim 3, The evaluation unit When the user's action is detected while the intermediate goal is set, a reach determination can be performed to determine whether the intermediate goal has been reached by comparing the specific information and the non-specific information of the user with the specific information and the non-specific information of the intermediate goal, The goal setting unit creating a plurality of intermediate goals with different differences from the final goal for at least one of the specific information and the non-specific information; Among the plurality of created intermediate goals, the intermediate goal that is closest to the current user information is set as the intermediate goal; The lesson system may correct the intermediate goal based on a record of the judgment result of the past arrival judgment.

5. The lesson system according to claim 1 or 2, The evaluation unit As an index value indicating the degree of attainment of the next goal, which is the next goal, a specific attainment index value is calculated as the index value for the specific information by comparing the specific information of the user with the specific information of the next goal, and a non-specific attainment index value is calculated as the index value for the non-specific information by comparing the non-specific information of the user with the non-specific information of the next goal; The leadership team: A lesson system that provides instructional content relating to information relating to one of the specific achievement index value and the non-specific achievement index value that indicates a low degree of achievement of the user toward the next goal with priority over instructional content relating to information relating to the other.

6. The lesson system according to claim 1 or 2, The evaluation unit As an index value indicating the degree of attainment of the next goal, which is the next goal, a specific attainment index value is calculated as the index value for the specific information by comparing the specific information of the user with the specific information of the next goal, and a non-specific attainment index value is calculated as the index value for the non-specific information by comparing the non-specific information of the user with the non-specific information of the next goal; The leadership team: The lesson system may provide different instruction contents for one of the specific information and the non-specific information depending on the index value for the other.

7. The lesson system according to claim 1 or 2, The goal setting unit A lesson system that provides one of the plurality of standard goals as the most appropriate goal to be achieved based on at least one of the specific information and the non-specific information of the user.

Images