Tip presentation device, tip presentation method, and tip presentation program

Abstract

A tip presentation device according to the present invention has a myoelectric data input unit, a muscle synergy analysis unit, a prompt input unit, a tip extraction unit, and a tip presentation unit. The myoelectric data input unit receives input of myoelectric data. The muscle synergy analysis unit analyzes muscle synergy from the myoelectric data inputted into the myoelectric data input unit. The prompt input unit receives input of a prompt for a large language model. The tip extraction unit uses the large language model to extract a tip for physical activity from the results of the analysis of muscle synergy by the muscle synergy analysis unit and the prompt inputted into the prompt input unit. The tip presentation unit presents the tip for physical activity extracted by the tip extraction unit.

Description

Tip presentation device, tip presentation method, and tip presentation program

[0001] The present invention relates to a tip presentation device, a tip presentation method, and a tip presentation program.

[0002] Using a wearable electromyographic sensor to simultaneously measure multiple muscle activities during sports allows for analysis of muscle synergies (coordinated muscle movements). Muscle synergy analysis has been conducted for many sports, including walking, golf, and baseball. Furthermore, muscle synergy analysis has also been conducted for piano playing, and as in Non-Patent Document 1, performance can be improved by extracting playing tips based on the differences in muscle synergies between experts and beginners and providing feedback.

[0003] Niijima, Arinobu, et al. "Muscle synergies learning with electrical muscle stimulation for playing the piano." Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 2022.

[0004] It is difficult for anyone other than a data analysis expert to perform muscle synergy analysis, extract exercise tips, and utilize them to improve performance. The main reasons for this include the need to be familiar with the names and functions of muscles, the need to interpret the differences in muscle synergies between beginners and experts from graphs of muscle synergy analysis results, and the need to verbalize exercise tips based on differences in muscle synergies.

[0005] The present invention has been made in light of the above-mentioned circumstances, and its object is to provide a tips presentation device, a tips presentation method, and a tips presentation program that present exercise tips in a way that is easy to understand even for non-experts in data analysis.

[0006] One aspect of the present invention is a tip suggestion device. The tip suggestion device has an electromyographic data input unit, a muscle synergy analysis unit, a prompt input unit, a tip extraction unit, and a tip suggestion unit. The electromyographic data input unit receives electromyographic data. The muscle synergy analysis unit analyzes muscle synergies from the electromyographic data input to the electromyographic data input unit. The prompt input unit receives a prompt for a large-scale language model. The tip extraction unit extracts exercise tips using the large-scale language model from the muscle synergy analysis results by the muscle synergy analysis unit and the prompt input to the prompt input unit. The tip suggestion unit presents the exercise tips extracted by the tip extraction unit.

[0007] One aspect of the present invention is a method for presenting tips, which includes receiving electromyographic data, analyzing muscle synergies from the electromyographic data, receiving prompts for a large-scale language model, extracting exercise tips from the muscle synergy analysis results and the prompts using the large-scale language model, and presenting the extracted exercise tips.

[0008] One aspect of the present invention is a tip suggestion program that causes a computer to execute at least some of the functions of the components of the tip suggestion device.

[0009] According to the present invention, there are provided a tips presentation device, a tips presentation method, and a tips presentation program that present exercise tips in a manner that is easy to understand even for non-specialists in data analysis.

[0010] Fig. 1 is a block diagram showing a functional configuration of a tip presentation device according to an embodiment. Fig. 2 is a block diagram showing a hardware configuration of the tip presentation device according to an embodiment. Fig. 3 is a flowchart showing a flow of processing executed by the tip presentation device according to an embodiment. Fig. 4 is a diagram showing two examples of muscle synergies of an expert when putting in golf. Fig. 5 is a diagram showing two examples of muscle synergies of an average beginner when putting in golf.

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] (Functional Configuration) First, the functional configuration of the tip presentation device 10 according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the functional configuration of the tip presentation device 10 according to the embodiment. The tip presentation device 10 according to the embodiment is a device that presents exercise tips based on muscle activity in a form that is easy to understand even for non-experts in data analysis.

[0013] The knack suggestion device 10 includes an electromyographic data input unit 11 , a muscle synergy analysis unit 12 , a prompt input unit 13 , a knack extraction unit 14 , and a knack suggestion unit 15 .

[0014] The myoelectric data input unit 11 receives myoelectric data. The myoelectric data is data obtained by measuring the electrical activity of muscles. The myoelectric data captures the electrical signals generated when muscles contract. For example, the myoelectric data includes myoelectric data of a beginner and myoelectric data of an expert in exercise.

[0015] The muscle synergy analysis unit 12 analyzes muscle synergies from the myoelectric data input to the myoelectric data input unit 11. The muscle synergy analysis unit 12 calculates the percentage of maximum voluntary contraction (%MVC) using a signal processing technique, and then analyzes muscle synergies using non-negative matrix factorization (NMF). %MVC is a percentage that represents the proportion of actual muscle activity to the maximum voluntary contraction. NMF also analyzes the myoelectric data to extract muscle synergies, which are patterns of enhanced muscle movement of multiple muscles.

[0016] The prompt input unit 13 receives prompts for a large language model (LLM). The LLM is an artificial intelligence model that is trained based on a huge amount of text data and generates natural language using techniques such as deep learning. For example, the prompts include an explanation of the muscle synergy analysis results, an explanation of the level and knowledge of the person to whom tips are to be imparted, instructions for extracting and verbalizing exercise tips, etc.

[0017] The tips extraction unit 14 extracts exercise tips using an LLM from the muscle synergy analysis results by the muscle synergy analysis unit 12 and the prompts input to the prompt input unit 13. In one example, the tips extraction unit 14 has an LLM. In another example, the tips extraction unit 14 has a function of communicating with a network and extracts exercise tips using an LLM on the network. For example, the LLM extracts exercise tips based on the muscle synergy analysis results and the prompts, and generates a verbalized text based on the differences between the muscle synergy analysis results of an expert and a beginner.

[0018] The tips presenting unit 15 presents exercise tips extracted by the tips extracting unit 14. For example, the tips presenting unit 15 displays text generated by the LLM based on a prompt from the analysis result of muscle synergies.

[0019] (Hardware Configuration) The tip presentation device 10 is configured by, for example, a computer. Examples of the computer include a personal computer, a server computer, a tablet, and the like.

[0020] An example of the hardware configuration of the computer 100 that constitutes the tip presentation device 10 will be described below with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the hardware configuration of the computer 100 that constitutes the tip presentation device 10.

[0021] The computer 100 includes a control device 120 , an input device 140 , and an output device 150 .

[0022] The control device 120 controls the entire computer 100. The control device 120 includes a processor 121, a read only memory (ROM) 122, a random access memory (RAM) 123, and an auxiliary storage device .

[0023] The processor 121, ROM 122, RAM 123, auxiliary storage device 124, input device 140, and output device 150 are electrically connected to one another via a bus 130, and can transmit and receive data.

[0024] The processor 121 is configured by a general-purpose hardware processor including, for example, a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), etc. The processor 121 executes various functions of the computer 100 by executing programs deployed in the RAM 123.

[0025] The ROM 122 is a non-volatile memory that constitutes part of the main storage device. The ROM 122 non-temporarily stores a startup program required to start up the computer 100. The processor 121 loads the startup program in the ROM 122 into the RAM 123 and executes it to start up the computer 100. The ROM 122 is configured, for example, from an erasable programmable read-only memory (EPROM), and is capable of storing various startup settings in addition to the startup program.

[0026] The RAM 123 is a volatile memory that constitutes part of the main storage device. The RAM 123 temporarily stores programs required for processing by the processor 121 and data required for executing the programs. In other words, the RAM 123 functions as a work area for the processor 121.

[0027] The auxiliary storage device 124 is configured with non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The auxiliary storage device 124 can non-temporarily store various programs executed by the processor 121 and data required to execute the programs. The processor 121 executes various functions of the computer 100 by loading the programs in the auxiliary storage device 124 into the RAM 123 and executing them.

[0028] The input device 140 is a device for a user to input information or instructions, and accepts input of information or instructions. The input device 140 includes a keyboard, a pointing device, etc. The pointing device includes a mouse, a trackpad, a touchscreen, etc. The input device 140 also includes a sensor. The sensor includes a position sensor, a camera, etc.

[0029] The output device 150 is a device that outputs information to provide information to a user. The output device 150 is, for example, a display device that displays characters, images, etc. on a screen. For example, the output device 150 is a liquid crystal display, an organic EL display, a plasma display, etc. The output device 150 is also, for example, an audio output device that includes a speaker or the like that outputs audio.

[0030] The input device 140 and the output device 150 may be configured as an input / output device having the functions of both. Such an input / output device may be configured as, for example, a touch panel display.

[0031] The input device 140 may also include a device that inputs information or data from the outside. For example, the input device 140 may include a wired or wireless interface or receiving device.

[0032] The output device 150 may also include a device that outputs information or data to the outside. For example, the output device 150 may include a wired or wireless interface or transmission device.

[0033] The input device 140 may also include a device that reads data from a computer-readable recording medium 160 that non-temporarily records data such as a program. For example, the recording medium 160 includes disks such as flexible disks, optical disks (CD-ROM, CD-R, DVD-ROM, DVD-R, etc.), magneto-optical disks (MO, etc.), semiconductor memories, etc. The input device 140 includes drives, readers, etc. for these.

[0034] The program stored in the auxiliary storage device 124 is provided to the computer 100, for example, via the recording medium 160. Alternatively, the program may be stored on a server on a network and provided to the computer 100 by downloading it.

[0035] For example, when the computer 100 starts up, the processor 121 executes a startup program in the ROM 122 to start up the operating system (OS). Under the control of the OS, the processor 121 monitors input instructions, connections to external devices, etc. Also, under the control of the OS, the processor 121 sets up a program area and a data area in the RAM 123.

[0036] In response to an instruction to start a program, processor 121 reads the program from auxiliary storage device 124 into the program area of ​​RAM 123, and also reads data necessary for executing the program from auxiliary storage device 124 into the data area of ​​RAM 123. Processor 121 calculates the data in the data area in accordance with the program and writes the calculation results into the data area.

[0037] Through these operations, the processor 121, RAM 123, and auxiliary storage device 124 work together to execute at least a portion of the functions of the control device 120. Furthermore, the control device 120, input device 140, and output device 150 work together to execute at least a portion of the functions of the computer 100.

[0038] The programs non-temporarily stored in the auxiliary storage device 124 include a program that causes the processor 121 to execute at least some of the functions of the control device 120. In other words, the processor 121 executes this program to execute at least some of the functions of the control device 120.

[0039] For example, the programs non-temporarily stored in the auxiliary storage device 124 include a tip presentation program that causes the computer 100 to execute at least some of the functions of the tip presentation device 10. When the processor 121 executes the tip presentation program, the control device 120, in cooperation with the input device 140 and the output device 150, executes at least some of the functions of the tip presentation device 10.

[0040] The input device 140 constitutes the myoelectric data input unit 11 and the prompt input unit 13. The output device 150 constitutes the tips presentation unit 15. The processor 121 of the control device 120 executes the tips presentation program, thereby executing the functions of the muscle synergy analysis unit 12 and the tips extraction unit 14. Furthermore, if the tips extraction unit 14 has a function for communicating with a network, the control device 120 cooperates with the output device 150 of the transmitting device and the input device 140 of the receiving device to implement the functions of the tips extraction unit 14.

[0041] (Example of Operation of the Tip Presentation Device) Next, an example of operation of the tip presentation device 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of operation of the tip presentation device 10. Here, an example of extracting tips on how to use both arms when putting in golf will be described.

[0042] In S1, in order to extract exercise tips, myoelectric data of a beginner golfer and an expert golfer is input to the myoelectric data input unit 11. For example, the myoelectric data is myoelectric data of the flexor digitorum superficialis, extensor pollicis longus, biceps brachii, triceps brachii, and deltoid muscles acquired by a total of 10 myoelectric sensors, five of which are attached to each arm of the beginner and the expert golfer. The myoelectric data is also acquired by hitting the ball a certain number of times with a putter. The myoelectric data input unit 11 passes the input myoelectric data to the muscle synergy analysis unit 12.

[0043] In S2, the muscle synergy analysis unit 12 analyzes muscle synergies from the EMG data input to the EMG data input unit 11. First, the muscle synergy analysis unit 12 calculates %MVC based on a general EMG signal processing technique. Next, the muscle synergy analysis unit 12 performs muscle synergy analysis using NMF from the time-series data of %MVC of the 10 muscles to extract spatial components. The muscle synergy analysis unit 12 outputs the muscle synergy analysis results to the knack extraction unit 14. Examples of the analysis results by the muscle synergy analysis unit 12 are shown in FIGS. 4 and 5. FIG. 4 shows two examples of muscle synergies of an expert golfer when putting. FIG. 5 shows two examples of average muscle synergies of a beginner golfer when putting.

[0044] In S3, a prompt for the LLM is input to the prompt input unit 13. The prompt input unit 13 outputs the input prompt to the knack extracting unit 14. An example of a prompt for the LLM is shown below.

[0045] "The graph you have entered is the result of a muscle synergy analysis performed while hitting a golf putt. Two muscle synergies were set and activity was sensed for a total of 10 muscles, five in each arm. After calculating %MVC, muscle synergy analysis was performed using NMF and the spatial components were extracted. This graph shows data from an expert and a beginner. Please compare these and extract the tips of the expert. Also, please explain how to use your body in a way that is easy to understand for beginner golfers. Please explain the basics of golf putting together with the results of this muscle synergy analysis. However, we assume that beginners are not familiar with the names of muscles."

[0046] In S4, the trick extraction unit 14 extracts putting tips using the LLM from the muscle synergy analysis results obtained by the muscle synergy analysis unit 12 and the prompts input to the prompt input unit 13. To this end, the trick extraction unit 14 inputs data on the muscle synergy analysis results and the prompts to the LLM. The LLM generates text verbalizing putting tips based on differences in muscle synergies, based on the input data on the muscle synergy analysis results and the prompts. The trick extraction unit 14 outputs the text indicating putting tips generated by the LLM to the trick presentation unit 15.

[0047] In S5, the tip presentation unit 15 presents the putting tips extracted by the tip extraction unit 14. For example, the tip presentation unit 15 presents text indicating putting tips generated by the LLM. An example of text indicating putting tips generated by the LLM is shown below.

[0048] "From this data, we can analyze the differences in muscle activity between experts and beginners when putting in golf. In particular, the muscle synergy analysis of experts is very balanced compared to beginners, and we can see that there is less over-reliance on specific muscles. When putting in golf, the basics start with a stable stance. Your feet should be shoulder-width apart, and your weight should be evenly distributed on both feet. From this stable position, you move the putter head mainly by moving your shoulders, not your arms or wrists. The key is to use the upper body (mainly the shoulder area) to swing the club with a consistent rhythm and flow. The data from experts shows that the triceps, deltoids, and extensor digitorum communis are activated appropriately. We can see that the muscles are activated in the right direction. This means that experts use their shoulders and arms with proper form to perform smooth strokes. Specifically, the appropriate use of these muscles prevents excessive force and unnecessary wrist movement, allowing the putter head to move steadily and straight. A good explanation for beginners would be, "Avoid exerting too much force on any one part of your body. Think of your upper body as one large block and use that block to perform your stroke. Pay particular attention to the muscles in your shoulders and back, and try to keep your wrists as still as possible. Imagine the movement of the putter starting and ending at your shoulders." Furthermore, for beginners aiming for the well-balanced muscle activity seen in the data from experts, it's important to be conscious of how you use your muscles when moving your body during practice. In particular, avoiding excessive force and practicing to perform controlled strokes in a relaxed state is the fastest way to improve.

[0049] (Effects) As described above, according to the embodiment, instead of presenting the muscle synergy analysis results as they are, prompts including explanations of measurement conditions, the level of the subject to whom tips are to be conveyed, etc. are input into a large-scale language model in addition to the muscle synergy analysis results, thereby extracting and verbalizing exercise tips. This makes it possible to present exercise tips in a form that is easy for the subject to understand. In other words, a technology is provided that presents exercise tips based on muscle activity in a way that is easy for even non-experts in data analysis to understand.

[0050] (Other) In the embodiment, an example has been described in which the tip presentation device 10 is configured as a computer having a processor and a storage device, the storage device stores a tip presentation program, and the processor executes the tip presentation program to perform the functions of the tip presentation device 10. However, the tip presentation program may also cause the processor to perform part of the functions of the tip presentation device 10, that is, the tip presentation program may cause the processor to perform the functions of the tip presentation device 10 in combination with a program already stored in the computer. Furthermore, the tip presentation program may also cause the processor to perform the functions of the tip presentation device 10 in combination with hardware such as a programmable logic device (PLD), field programmable gate array (FPGA), or graphic processing unit (GPU).

[0051] The embodiments of the present invention have been described above with reference to the drawings. However, the above embodiment is merely an example of a configuration that embodies the present invention. That is, it is clear that the present invention is not limited to the above embodiment. Therefore, addition, omission, substitution, and other modifications of components may be made within the scope of the technical concept of the present invention.

[0052] In short, the present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected elements from the disclosed elements. For example, if the problem can be solved and the desired effect can be obtained even if some elements are deleted from all elements shown in the embodiments, the configuration from which these elements are deleted can be extracted as an invention.

[0053] DESCRIPTION OF SYMBOLS 10... Tip suggestion device 11... Myoelectric data input unit 12... Muscle synergy analysis unit 13... Prompt input unit 14... Tip extraction unit 15... Tip suggestion unit 100... Computer 120... Control device 121... Processor 122... ROM 123... RAM 124... Auxiliary storage device 130... Bus 140... Input device 150... Output device 160... Recording medium

Claims

1. A tips presentation device comprising: a myoelectric data input unit to which myoelectric data is input; a muscle synergy analysis unit to analyze muscle synergies from the myoelectric data input to the myoelectric data input unit; a prompt input unit to which prompts for a large-scale language model are input; a tips extraction unit to extract exercise tips using the large-scale language model from the muscle synergy analysis results by the muscle synergy analysis unit and the prompts input to the prompt input unit; and a tips presentation unit to present the exercise tips extracted by the tips extraction unit.

2. The tip suggestion device according to claim 1, wherein the muscle synergy analysis unit calculates the percentage of maximum voluntary contraction using a signal processing technique, and then analyzes muscle synergies using non-negative matrix factorization.

3. The tip presentation device according to claim 1, wherein the myoelectric data input to the myoelectric data input unit includes myoelectric data of a beginner and myoelectric data of an expert.

4. The tip presentation device according to claim 1, wherein the tip extraction unit has a large-scale language model.

5. The tip presentation device according to claim 1, wherein the tip extraction unit has a function of communicating with a network and extracts exercise tips using a large-scale language model on the network.

6. The tip presentation device according to claim 1, wherein the prompts to the large-scale language model include instructions to extract and verbalize exercise tips, and the large-scale language model extracts and verbalizes the exercise tips to generate text.

7. A method for presenting tips, comprising: receiving electromyographic data; analyzing muscle synergies from the electromyographic data; receiving prompts for a large-scale language model; extracting exercise tips from the muscle synergy analysis results and the prompts using the large-scale language model; and presenting the extracted exercise tips.

8. A tip suggestion program that causes a computer having a processor and a storage device to execute at least some of the functions of the components of the tip suggestion device according to claim 1.

Images