Device for use in exercise and muscle memory training and tracking

Abstract

To provide a wearable device that detects motion data and provides feedback based on comparison information or other analysis.SOLUTION: An accelerometer, a processing device, and a feedback apparatus, wherein the processing device is configured to receive data from the accelerometer and compare motion indicated by the data of the accelerometer with pre-stored motion; Wherein the feedback device is calibrated to issue a notification to a user of the feedback device about at least one aspect of the user's motion, wherein the feedback device compares the captured user's motion in the received data of a less-than-full-speed practice motion with the same motion previously stored at full speed to issue the notification.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to Taiwan Patent Application No. 113127548, filed on July 23, 2024, the contents of which are incorporated herein by reference in their entirety.

[0002] The present invention relates to training and physical therapy, and in particular to training movements and muscles to follow exemplary paths, such as paths prescribed by a doctor or therapist, ideal movement paths in sporting activities, or methods that can effectively use tracking and / or feedback of muscles or other movements. [Background technology]

[0003] Currently, there are many devices used to study and evaluate movements. For example, imaging is commonly used in physical therapy to teach patients how to perform certain movements that are beneficial for their rehabilitation. Athletes constantly watch images or videos to analyze and improve their movements, such as their posture when kicking a football or hitting a baseball. Summary of the Invention

[0004] The inventors of the present invention recognized a need for improved motion tracking and feedback to patients or athletes. In one embodiment, the present invention provides a wearable device that detects motion data and provides feedback based on comparative information or other analysis.

[0005] An important feature of the present invention is its ease of operation. The present invention includes an electronic device with an accelerometer, which is highly efficient and can detect motion and provide direct and immediate feedback to the user. For example, the feedback can be realized by sound (e.g., high / low, left / right, etc.).

[0006] A muscle memory device (MMD) is a device that can record muscle movements and provide feedback to the user using the recorded movements, and is preferably designed to be the size of a pocket or wristwatch (or smaller).

[0007] Muscle memory devices use gyroscopes to measure angular velocity about three axes (x, y, and z), and the resulting data can determine the orientation of an object (e.g., the device, a user's hands, and feet) in three-dimensional space. Accelerometers can measure acceleration (changes in velocity) along a single axis, and multiple accelerometers can be used simultaneously. Magnetometers can detect the Earth's magnetic field to determine movement, orientation, and direction, and can be used in combination with accelerometers and gyroscopes to determine the absolute orientation of a device.

[0008] In one embodiment, a power button activates the device, making it powered and ready for use. When the selector switch is moved to the record position, the muscle memory device can record and save the user's movements to storage. When the selector switch is moved to the play position, the device can stop recording the user's movements and compare them with the images to analyze the user's movements.

[0009] While the functionality of the present invention includes removing irrelevant operational data before and after an operation has begun, in some embodiments the device will recognize the operation the user is about to perform and retain data relevant to the operation before the operation begins.

[0010] In analysis mode, after the user performs an action, if the result is a match (the user's action matches the image), the device will emit a distinct beep (or a prompt sound, or no sound). If the result is not a match, the device will emit a different beep. A prompt sound or alarm indicating a non-matching result may sound more urgent and encourage the user to make a change. In one embodiment, the device may emit voice prompts such as "pull up," "down," etc. Because these sounds are generated in real time, the user will have real-time feedback during or at least after each action to know whether the action was successful.

[0011] Wireless capabilities (e.g., Bluetooth) allow the muscle memory device to connect to a smartphone, server, network, or other device (including other muscle memory devices). When the muscle memory device is connected to a smartphone, recorded data (e.g., all data or exercise / movement specific data) can be stored on the mobile phone. An individual's exercises or movements may be stored on the smartphone or uploaded to the muscle memory device's storage. The smartphone can provide a platform for applications to implement the above functions, select exercises and / or movements, and determine adjustments to various movements that may be required (e.g., faster, slower, varying intensity, etc.).

[0012] This application allows the user to store multiple recorded actions and also allows the user to select actions that have been recorded and / or downloaded.

[0013] Via the flash switch on the right side of the device (or at the playback key position), the user can determine the action they want to practice (recreate). Via the flash switch on the left side of the device (or at the record key position), the user can record more actions. The user can freely choose whether or not to connect to a smartphone when using the device. When not connected to a smartphone, the user can select from multiple stored actions. For example, the third recorded action can be selected by rotating the selection switch three times. In one embodiment, the device is equipped with an additional switch with multiple key positions to select multiple actions that may be recorded.

[0014] In another embodiment, the functions of the selector switch and power button are integrated into a single button. For example, pressing the button can activate the muscle memory device, while holding the button for a predetermined period of time (e.g., three seconds or more) can turn it off. Mode switching can be accomplished by holding the button for another predetermined period of time (e.g., two seconds to toggle between record and playback modes). If the muscle memory device contains multiple programs, pressing another button for different lengths of time can cycle through the programs (e.g., momentarily pressing the button changes programs, thereby switching between Recorded Program 1 (forehand), Recorded Program 2 (backhand), and any other programs that may exist). In one example, the muscle memory device indicates program switching by emitting one or a series of beeps (e.g., one beep to switch to Program 1, two beeps to switch to Program 2, etc.).

[0015] The application can be used to download pre-recorded movements (e.g., movements of an expert table tennis player, movements of a tennis player, and other movements that an expert player needs to demonstrate). Programming, physical, and / or wireless connection to the muscle memory device can also provide a method for directly downloading movements. For example, movements can be selected using a website and then automatically downloaded to the muscle memory device.

[0016] The muscle memory device records the user's movement statistics, and the user can upload the statistics and their movements or share them via social media. After all data for any given movement has been memorized, the movement is intuitively displayed on the smartphone screen, allowing the user to evaluate / review the movement, clearly seeing, for example, how the muscle memory device moves in space.

[0017] Muscle memory devices are used not only to act on specific exercises, but also to achieve ideal movements for sports, muscle training, physical therapy, etc. In one embodiment, a physical therapist, doctor, or coach can upload movements directly to a patient's or athlete's muscle memory device. The expert's application or computer program can maintain a set of recommended or predetermined movements and allow the expert to input alerts, notifications, documents, or emails (including any explanations or notes the expert wishes to convey to the user). Features of the present invention include automatically entering billing items into the patient's or athlete's account, i.e., movement uploads, and fees for having the expert review, discuss, or analyze the movements.

[0018] The present invention can assist in training table tennis serving movements, kicking soccer in a specific manner determined by the user, and walking in a specific manner determined by the user, and can assist the user in performing various muscle movement trainings determined by the user. All movements are performed by the user. The device does not claim to contribute to the healing of physical injuries and is not responsible for the results caused by improper use. However, if some movements, such as those specified by a doctor or physical therapist, are useful in the rehabilitation process, these movements are certainly effective.

[0019] The user can determine the appropriate movement they wish to perform, and the device will help them perfect that particular movement through repeated practice. Similar to walking, we do not consciously think, "I lift my right leg, then move it forward, then lower it, then repeat with my left leg." We perform these movements unconsciously, and our muscles are trained to perform them without us having to think "how" to do them. Continued use of the muscle memory device helps train any recorded movement.

[0020] In various embodiments, the muscle memory device aids in the completion of specific movements in a manner that aids in muscle regeneration after injury. There are multiple movements that can be used in physical therapy. If recorded accurately, the user can perform these movements using the muscle memory device and receive real-time feedback, making it an adjunct to physical therapy (or drug-free muscle strengthening).

[0021] In another embodiment, the present invention provides a motion analysis method that compares motion to an ideal range. The present invention includes an application on a mobile phone, computer, or other electronic device. After receiving motion data, the application compares it to a standard and provides real-time or near-real-time feedback signals to the user to immediately inform them whether their motion is correct or off-track. This feedback may include audio alerts, vibrations, electrical signals, etc.

[0022] The present invention includes multiple types and instances of feedback for adjusting or calibrating movements. For example, in one embodiment, the present invention retrieves stored and / or real-time data and displays on a smartphone a caricature or image of a movement performed by a user, along with indicia of the difference between that movement and an ideal movement. The difference indicia may include highlighting body parts or portions that are outside of movement tolerances when the caricature or image shows the movement (e.g., a replay of the user's movement with additional indicia).

[0023] The indicia may include movement patterns and arrows that contribute to ideal movement prompts. For example, such patterns or arrows may be labeled at key joints before a malfunction occurs, thereby allowing the user to mentally prepare for where the movement is going wrong before seeing the highlighted malfunction.

[0024] The differential indication can directly and effectively correspond to the audio or vibration feedback received as the user performs the action. Such a look-back scheme can provide a dual prompt and reinforce correct behavior. In another embodiment, as the user looks back at the caricature or playback image (with or without visual indicators of correct or incorrect behavior), the device repeats the vibration or provides audio feedback to indicate another association between correct behavior and required adjustment.

[0025] In one embodiment, the feedback is audio, with the audio primarily relating to the action being performed. The present invention includes methods for recognizing actions and comparing them to actions stored in a database.

[0026] Some devices and methods can be readily implemented by coding in a conventional computer or a networked computer, and the results can be displayed on an output device connected to any conventional computer or networked computer, or transmitted to a remote device for output or display. Additionally, any components of the present invention depicted as computer programs, data sequences and / or control signals can be represented as electronic signals propagating (or transmitted) at any frequency in any medium, including, but not limited to, radio broadcast and copper wire, fiber optic cable, coaxial cable transmission, etc. [Brief explanation of the drawings]

[0027] [Figure 1] 1 is a schematic diagram showing a muscle memory device according to one embodiment of the present invention, with a band mounted thereon. [Figure 2] FIG. 2 is a block diagram of components and communications according to one embodiment of the present invention. [Figure 3] FIG. 2 is a schematic diagram of software and programming according to one embodiment of the present invention. [Figure 4] 1 is a photograph of a prototype electronic device arranged to implement the functionality of a muscle memory device according to one embodiment of the present invention. [Figure 5] 1 is a schematic diagram of an exercise apparatus incorporating a muscle memory device according to one embodiment of the present invention. [Figure 6] 1 is a schematic diagram of an assembly of a muscle memory device according to one embodiment of the present invention. [Figure 7] 1 is a flowchart of an operation comparison process according to an embodiment of the present invention. [Figure 8] 3A-3C are schematic diagrams of screenshots of an application according to an embodiment of the present invention; [Figure 9] 1 is a schematic diagram of a muscle memory device according to one embodiment of the present invention. [Figure 10] 1 is a schematic diagram of the internal elements of a muscle memory device according to one embodiment of the present invention. [Figure 11]1 is a schematic diagram of the internal elements of a muscle memory device according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0028] In these figures, identical or corresponding parts are designated by the same reference numerals. Figure 1 shows a muscle memory device (MMD) 100 in one embodiment of the present invention. Tracking sensors are attached to a band 110 that can be worn on the wrist, foot, or other part of the patient or athlete. In another embodiment, the muscle memory device 100 may include an adhesive, allowing it to be attached directly to different locations on the user's skin.

[0029] The muscle memory device 100 may be configured to operate in different ways. In one embodiment, the muscle memory device 100 operates as a motion tracking and alert system. For example, the muscle memory device 100 is programmed to identify physical therapeutic motions and alert the user at predetermined points during the motion. If the user's motion exceeds the appropriate range for the ongoing therapeutic motion, an immediate alert is generated, and if the user deviates from the range of motion to the point where the motion becomes inaccurate, an immediate alert is generated and the user is prompted.

[0030] For example, if a user is instructed to perform a motion such as a rotation-leg lift (e.g., a small clockwise rotation followed by a counterclockwise rotation while lifting the leg), a prompt or audible alarm may be triggered if the user does not lift the leg high enough. Similarly, if the user does not rotate during a leg lift, a prompt or audible alarm may be triggered. As described in more detail below, the same type of prompt or audible alarm may be applied to other areas, such as sports movements, components of sports devices, and the practice of specialized movements in different areas. Prompts or audible alarms may also be triggered by movements other than incorrect movements. For example, if deemed appropriate, extra extension outside of the prescribed movement may be encouraged (even if the extra extension is unnecessary). Such prompts and / or other feedback may be provided by lighting. For example, an LED lamp mounted on or below the muscle memory device 100 may provide light feedback 702B, for example, and may have functionality described further below.

[0031] 2 is a block diagram of component communication 200 in one embodiment of the present invention. An inertial measurement unit 210 incorporated into muscle memory device 100 detects motion of each axis and provides motion data to a motherboard 220 having a central processing device and programming to implement the present invention. Also included is a compass (or north needle), GPS, or other device used for determining direction. The programming may include inertial measurements, data storage of averages or samples of one or more movements of various physical therapy or exercise movements (e.g., actual movements or training exercises), and a program that compares the user's movements with the stored movements.

[0032] For example, in one embodiment, stored movements may be stored at a predetermined number of samples per second based on position, velocity, and acceleration. Sample mode matches real-time data from the inertial measurement unit 210 and compares in real time to determine whether the user's current movement is accurate or deviates from the corresponding sample or samples; if a deviation occurs, a prompt / alarm sounds (e.g., via piezo 230) to remind the user to correct or improve their movement. Once the movement is sufficiently corrected, the prompt / alarm ceases.

[0033] In one embodiment, the alert can be customized depending on the action. For example, the alert can prompt the appropriate action or corrective measures required. When using audio alerts, if the user's action is high to low and the stored action is low to high (or generally speaking, if the user's action is up instead of down), the alert can be a low to high tone, i.e., an audio prompt as to how the action should be taken.

[0034] The muscle memory device 100 may include a selection switch 240, which reverses the motion by switching from left-handed (or left-side) motion to right-handed (or right-side) motion. Switching from left-handed motion to right-handed motion may be achieved by mathematically transforming the stored motion from a first visual angle to a second visual angle (or vice versa). In one embodiment, the stored motion may be tailored to the specific circumstances of an individual user. For example, for patients or trainees wearing prosthetic limbs, the stored data may include data that accounts for non-standard motions with the prosthetic limb. The stored motion may also be tailored to the user's body type (e.g., height, girth, etc.). Thus, the present invention includes a mechanism for tailoring motions (e.g., specialized motions downloaded from a network) to fit the physical characteristics of an individual user.

[0035] Multiple movements or exercises can be stored in the muscle memory device 100. The selection switch 240 can be configured to select different movements or numbers from different locations (e.g., wrist or ankle). The selection switch 240 can also be used to place the muscle memory device 100 in a recording mode. In this mode, a physical therapist, instructor, or coach records the movements that the user is to perform.

[0036] FIG. 2 further illustrates communication between the central processing unit of muscle memory device 100 and input / output device 250. Input / output device 250 may be configured to communicate with a network or specific devices (e.g., mobile device 280, robot 260, fitness device 275, visual display 270 corresponding to fitness device 275, or other devices). Fitness device 275 is similar to a peloton fitness device. In the illustrated embodiment, the communication device connects to a cloud server for data storage, program processing, or other tasks, and / or communicates via the cloud server with mobile device 280 (where it may be further processed or selected by an application, as described herein), robot 260 (e.g., a table tennis robot receiving commands or data to make a ball-hitting decision), mechanical devices such as a peloton device, and educational or fitness displays (e.g., areas displayed on fitness device 275). Such communications may include command modifications. Such commands may modify interactions from a virtual coach associated with any device or modify interaction data determined by virtual coach programming (which itself may be determined to be transmitted from cloud 255 to the device).

[0037] Such cloud communication can also provide feedback to other devices, platforms (e.g., Roblox), or applications, where a user's progress or consistency in using muscle memory device 100 can be tracked for later use in the application or platform (e.g., a user's progress on a Peloton-like device could translate into more points or rank-ups in a cycling-related game on the Roblox platform). The device may also be directly connected to a platform, game, or application on the platform, allowing the game or game's display items to adjust in real time based on the user's performance in matching movements. While the figures show communication via a cloud server, similar effects can be achieved via direct communication or directly connected devices over any network.

[0038] 3 illustrates software and programming 300 in one embodiment of the present invention. Contrast data 310 (e.g., stored, recorded, or downloaded movements / exercises) can be recorded using muscle memory device 100 or other devices. This contrast data 310 can be downloaded from a doctor, therapist, or sports enthusiast website over a network.

[0039] Software 320 may be downloaded executable software, firmware, other electronic devices, or coding types. This software 320 reviews data from inertial measurement unit 210, compares user actions to pre-recorded actions, and sets alarms appropriately. Software 320 can selectively perform other functions described herein. Software 320 may also include other additional functions (e.g., selection 326 for selecting some of actions 322, selection 326 for changing feedback application communication regarding tolerances when selecting some of actions 324, and other functions 328 described herein).

[0040] Local data 330 may include, for example, buffers of content such as inertial measurement unit data, session data, etc. Input / output communications 340 may include any data programming or data to be sent to or received from other components, and / or information protocols for wireless communication (e.g., Bluetooth). Such protocols may be used for other implementations, retrieval of enhanced functionality and additional data or programming, e.g., downloaded movements or exercises, updates, etc. Other local data 330 may include tolerances for comparison of stored movements with different portions of user movements, preferences for feedback or combinations of feedback, and / or how feedback is displayed, as described in more detail below.

[0041] Figure 4 is a photograph of a prototype electronic device arranged to implement the functionality of a muscle memory device 400 in one embodiment of the present invention. As shown in Figure 4, the present invention can be used in an architecture including a motherboard 405 (e.g., a Bluefruit feather board), an inertial measurement unit 404, a power switch 403, a piezoelectric element 402, and a switch 401. The muscle memory device 400 shown in Figure 4 is a prototype of the present invention, and implements the functionality of the present invention by running software 320 on the motherboard 405 and communicating with the inertial measurement unit 404 and the piezoelectric element 402.

[0042] FIG. 5 is a schematic diagram of an exercise apparatus 500 including the muscle memory device 400 in one embodiment of the present invention. A housing 510 encases the muscle memory device prototype (muscle memory device 400) such that the hardware is enclosed (thereby concealing the electronics). In one embodiment, ideally, muscle memory device 400 has minimal or no controllable features (e.g., a non-replaceable battery or self-powered power source, automatic switches, and Bluetooth-downloaded actions). In the embodiment shown in FIG. 5, only the power button and flash switch (e.g., switch 401) are operable and located within user-interactive locations. It is preferable to limit their functionality to simplify the design and facilitate ease of operation. Nevertheless, additional features may be added to existing switches (e.g., a double-press button to change programs, multi-position switches, etc.), and these features may be included in other embodiments.

[0043] The housing 510 may be attached to an apparatus such as a sports device, where the muscle memory device 400 is positioned to function by recording and / or comparing various ball striking actions of a user, such as various forms of serves and returns.

[0044] Also shown in Figure 5 are a user-accessible power button 520, a selection switch 530, and a piezoelectric port 540 (speaker). A power port (not shown) may also be provided for charging a battery (although in various alternatives other power sources may be used, such as a solar panel (which may be mounted along the handle of the device) or an internal motion-based power generator, which may achieve coordination with activities having a large amount of motion).

[0045] 6 is a diagram illustrating an accessory device 600 for muscle memory device 400, in accordance with one embodiment of the present invention. As shown in FIG. 6, accessory device 600 includes a threaded attachment member 620 that attaches to exercise apparatus 500 and a corresponding threaded coupling 610 that attaches to housing 510 of muscle memory device 400.

[0046] The threaded attachment members 620 can be attached to any number of surfaces (or internal to the device). The muscle memory device 400 itself can have any number of different attachment members. The attachment locations vary and include a small attachment seat under a ping pong racket, a small attachment seat under a tennis racket, and a wristband (e.g., band 110 in FIG. 1) that can be connected to the muscle memory device 100.

[0047] The attachment members may include shoe attachment members (e.g., two bands on the side of the shoe) that are attached to the shoe. The muscle memory device can then be attached to the attachment seats. The muscle memory device may be secured to the shoe or other device with an adhesive. For example, in retail packaging, the muscle memory device preferably includes attachment members for use on one or more surfaces (e.g., flat surfaces, rounded surfaces) and attachment seats that can be interchanged or adapted to different surfaces (e.g., flexible or soft pad attachment seats that can be adapted to irregular surfaces).

[0048] A variety of other attachment devices can be used for each mounting seat that accommodates the muscle memory device, including adhesives, screws, latches, hook and ring bands (eg, Velcro's Magic Felt product), and the like.

[0049] FIG. 7 is a flowchart of a motion comparison process 700 according to one embodiment of the present invention. In step 710, the device reads inertial measurement unit data. The inertial measurement unit is a multi-axis inertial measurement unit, capable of providing position, acceleration, and velocity in three-dimensional space. The inertial measurement unit may also provide other data, depending on the platform selected to implement the muscle memory device. Additional hardware or devices (e.g., altitude, latitude / longitude, data from other devices, other muscle memory devices on the same user or other users, etc.) may provide further additional functionality and corresponding data.

[0050] In one embodiment, the present invention uses wireless communication to handle coordinated operations, such as operations between a command station and a receiver. In such an embodiment, a 5G chip (not shown) is installed on or connected to the motherboard to transmit real-time data to a remote server and coordinate the timing, response, and individual operations of synchronized operations.

[0051] Decision block 730 determines whether the data provided by the inertial measurement unit is a selected or stored motion. This determination may require additional or previous inertial measurement unit data periods. These periods may be stored in local storage, such as memory (RAM). In one embodiment, the current movement is identified one by one and compared with several previous inertial measurement unit data periods to determine whether each inertial measurement unit data period matches the selected or stored motion. (Note that matching the selected or stored motion does not necessarily mean a perfectly accurate motion (it may be within a tolerance, or it may be outside of that range)). If the motion / movement is not recognized, the program loops back to the next inertial measurement unit data period. Recognition may be performed for a specific portion of the user's intended motion.

[0052] Upon receiving enough IMU cycles to recognize a motion, a comparison function is initiated in step 740. Step 740 can be implemented in any manner to determine whether the received IMU data matches or is within a predetermined tolerance of a stored motion or movement. For example, the IMU sample values ​​can be directly compared to a respective motion database with a similar sample set. Each motion can be broken down into multiple segments, such as the natural segments of a swing (e.g., retreat, approach, impact, and follow-up motion), and a dedicated comparison exemplar program can be invoked for each segment. In one embodiment, the stored or recorded motion is fitted to a curve, and each corresponding IMU sample is compared to the corresponding position on the curve + / - a tolerance. Either method can be implemented to identify whether the current motion segment passes or fails. If it fails, an alarm system is activated (step 750). If it passes, the program returns to the next IMU sample.

[0053] In each embodiment, the device performs a more detailed analysis of the collected inertial measurement data to determine how much or in what direction the user's movement is problematic. If a direction is problematic, an alert of a particular tone or frequency is generated. For example, an increase or decrease in volume or frequency indicates whether the user's movement is getting worse or better. This comparison may be made over a selected portion of the movement.

[0054] In other embodiments, the alert is prompted in the form of a different tone related to the amount of deviation from the desired motion, with the tone only appearing during a particular recognized portion of the motion. If desired, a single prompt tone can be provided before a particular portion of the motion for continuity, and can be configured to the user's preference.

[0055] In one embodiment, the muscle memory device can be stored in different positions (e.g., a fitness trajectory for a standing position) to execute multiple different motion plans. When the user is located in a fitness trajectory position, the muscle memory device is activated to evaluate a specific motion to be performed in this standing position (e.g., select a motion to be compared or a subset of stored motions depending on the user's position).

[0056] As mentioned above, some embodiments of the present invention include 5G communications, which may be deployed in multiple ways. In one embodiment, 5G communications can be transmitted directly from the muscle memory device to a remote server via the 5G network. All functions of the muscle memory device and / or a pre-connected smartphone can be performed by the remote server, which can then transmit application signals, such as haptic feedback and alerts, to the muscle memory device. In such an embodiment, the smartphone function can be eliminated (but is not required). Alternatively, the smartphone can serve as a hub for transmitting 5G communications (e.g., the muscle memory device communicates with the smartphone, which then transfers information over the 5G network). The smartphone can still be used to interface with the muscle memory device and with external databases and programs (e.g., APIs) to conveniently display results, videos, statistics, and the like in a user-defined format.

[0057] In an ultra-low latency 5G environment, such communications could create a haptic network experience. As described herein, tonal changes can guide a user to adjust their movements to their ideal movements. Such guidance is improved in environments where the haptic experience is more robust. Examples include electrical stimulation (e.g., activating skin-contacting electrodes on a muscle memory device), rotating miniature physical gyroscopes (e.g., additional gyroscopes within the muscle memory device or separate gyroscope assemblies / cuffs), and / or other devices that can guide, influence, suggest, assist, or modify a user's movements to adjust to their ideal movements.

[0058] Such other devices may include Internet of Things (IoT) devices connected to or near the user. The IoT devices may be publicly or accessible. In one embodiment, additional audio is provided to the user via remotely connected IoT speakers. These speakers are activated to provide dynamic or spatialized audio (e.g., Barco Auro, DTS:X, or other audio technologies such as Dubio Surround).

[0059] In one embodiment, the present invention creates a muscle memory device with a haptic network experience in an ultra-low latency environment (e.g., 5G). Here, gyroscope readings from the muscle memory device are transmitted over an ultra-low latency network to a remote server, which compares and analyzes these readings with the movements to identify and evaluate the movements. The remote server can return signals to confirm various analytical information. These may be encouraging sounds, buzzers, or audio to indicate successful completion of a movement, or haptic feedback to confirm that the movement exceeded expectations. Such audio / haptic feedback can be configured to help guide the user to perform the desired movement. In one embodiment, the present invention includes a muscle memory device that interacts with a remote server solely via a network. The user's smartphone or other device (e.g., a computer / website) communicates with the user, transmits information from the user to the remote server, and receives / displays information about content such as performance from the remote server.

[0060] Communications sent to and received from devices such as muscle memory devices, remote servers, and smartphones conform to or are compatible with one or more standards, including 3GPP TS22.261. Devices (e.g., IoT services, user devices (UEs), etc.) that communicate with the muscle memory device, remote server, or smartphone are similarly compatible. These devices may include IoT, virtual reality (VR), controllers, and full coverage services provided as needed. These devices, or variations thereof, are flexible and can meet customized data collection or feedback needs. Such devices include driver programs that operate with 3GPP or other standards (including motion, video, navigation, and audio). In various embodiments, the key is to use the muscle memory device over a scalable and customizable network. Muscle memory devices must have appropriate key performance indicators (KPIs) (e.g., latency, reliability, data rate, etc.) to utilize 5G systems for real-time (or near-real-time) support and improve the user experience.

[0061] The present invention involves maintaining relevant data of user actions and classifying different users into groups or levels corresponding to various actions (e.g., ranking them based on the degree of match between a tennis player's backhand action and a typical professional backhand action, and ranking players based on the consistency between one or more particular actions and the actions of professional players).

[0062] The present invention further includes maintaining data on user responses to various alerts, haptic feedback, or other feedback provided, and overall performance improvements each user makes in response to the type of feedback received. The present invention includes identifying more effective feedback devices and feedback devices that are more effective for particular users, and updating training mechanisms and / or feedback based on the results of all users.

[0063] FIG. 8 is a screenshot of an application 800 in one embodiment of the present invention. Radio buttons 810 are programmed for use in selecting movements. Here, movements such as climb, swing, and kick are shown. The selection may include any number of other options, including the fitness tracking program described above, gym passes, recorded movements (which may include custom name options), and downloaded movements. The programs may include program variations, such as variations A, B, and C of Program 1. This avoids repetitive strain and maintains additional flexibility by providing the user with the same exemplar program with slightly different movements.

[0064] Radio buttons 820 provide additional variation regarding intensity. Other functions can be selected through the radio buttons 820 and other user interface types. The application 800 can further provide access to details 835 for stored movements or timelines, visual combination timelines, graphs, or other visualization formats (including video). The user interface can also select one or more portions of the movement to apply to the analysis, comparison, and feedback described herein. Various other preferences can be set, such as volume, tolerance, and / or a tone to play when not rating. Button 830 is then pressed to begin loading the selected movement or portion thereof.

[0065] Muscle memory devices can be applied to a variety of activities, including automated exercise tracking in gyms in the form of various scales, recording exercise, and personal identification as wristbands. Inertial measurement units and other electronics can be automatically programmed to meet a user's preferred settings at training stations. Muscle memory devices may also be programmed to provide alerts to trainers, gym managers, or others when conditions exceed expected limits (e.g., a movement is not performed as planned, a difficult situation is detected, a fall occurs, etc.), such as when a heavy object is dropped.

[0066] The present invention identifies an initial mode of user motion, prescribes an intended ball striking action, and compares the executed ball striking action with one or more stored ball striking actions in real time or near real time. The initial mode may be determined by analyzing user data and / or big data sets collected for multiple users (e.g., big data analytics).

[0067] In this invention, a performance range (e.g., from the same person or multiple trainers, experts, organizations, therapists, big data analysis ranges, etc.) consisting of boundaries of different performances of the same movement multiple times is created, and the user's performance is compared to the performance range. This analysis may include dividing each movement into multiple segments and applying a range to each segment.

[0068] In one embodiment, the trainer's, expert's, or other user's movements are fitted to a curve, and accelerometer and position data are applied to this curve. Accelerometer readings that exceed the curve by a certain amount, percentage, and / or predetermined reading trigger a prompt / alarm. The volume of the alarm can be varied depending on the deviation from the curve, e.g., increased (large deviation) or decreased (small deviation). In another example, the frequency of the alarm sound or the frequency of a switch's intermittent movement can be varied depending on the extent to which the curve is exceeded. Returning back onto the curve (or within tolerance) mutes the alarm, possibly generating a special shut-off / off sound. For example, the determination and comparison is made by the muscle memory device's electronics and transmitted to a smartphone or other device for storage, display, and / or further analysis. Thus, the present invention encompasses variable alarms, where the variable alarms are indicative of characteristics of the movements being performed.

[0069] While the present invention can be implemented in a variety of ways as would be understood by one of ordinary skill in the art based on the disclosure herein, the inventors have discovered an efficient architecture that provides motion analysis in a muscle memory device and then transmits the motion analysis and / or other data to a remote device, such as a computing device, smartphone, or other device, for further analysis or display (e.g., data, statistics, and / or simulations).

[0070] The detection of the motion can be done in various ways. For example, Equation 1 shows an example of test code for determining a backhand motion when using a muscle memory device as a table tennis coach.

[0071] formula 1 JPEG2026017522000002.jpg78170Equation 1 shows a test case of a user performing a predetermined backhand motion. The table shows a test case in which the user initiates the motion and the muscle memory device detects values ​​from the accelerometer to check whether the backhand motion was successfully performed. As shown in Equation 1, the muscle memory device detects values ​​from a gyroscope (e.g., multiple gyroscopes, e.g., different gyroscopes installed on different axes) and checks whether they relate to a predetermined value for the backhand motion.

[0072] In one embodiment, multiple gyroscope values ​​are tested in real time in a similar manner at or near the same time to evaluate multiple motions. The motions may include backhands, forehands, and any variations of these motions (e.g., upper cut backhand topspin, lower cut backhand bottomspin, X-cut backhand far-base backdrive, and sideways backhand flat shot, all of which may be assigned values ​​as some of the available motions). In one embodiment, the assigned values ​​may share comparison values ​​where possible, or may be implemented with individual comparison values ​​for each motion instance. For each motion instance, the stored values ​​may include a range of acceptable values, such as a maximum or minimum value, a percentage, etc.

[0073] In one embodiment, a percentage is used. The percentage varies depending on the embodiment. This allows for some actions requiring higher accuracy or precision to have a relatively low percentage change range relative to the corresponding instance when compared. For example, a subsequent action may result in more change than the previous example.

[0074] In one embodiment, the change range decreases with each instance before contact (low percentage tolerance) and decreases sharply after contact; the change range can vary continuously, but change more quickly at key points (e.g., just before and just after contact). The change range (or tolerance) can vary from one value to another, or can be set in steps, and each step can have a different length or value / number of data points.

[0075] In this example, "delay(200)" is a predetermined delay in milliseconds between recording / testing values ​​for a particular motion period (running 5 times per second). Because Equation 1 is a test, the test / inspection does not need to be performed quickly, and the number of tests per second can be easily modified so that when a user observes a motion being performed, the motion can be copied with successive values, even if the direction and / or acceleration of the motion changes rapidly, and no particular value is significantly higher or lower than its neighboring values, and the test can be run at a frequency of 300 times per second or more.

[0076] Equation 2 provides a further example.

[0077] formula 2 As shown in Equation 2, a typical test would first test for a forehand, then test for a backhand. A forehand test involves reading data from one or more axes of the IMU. For example, the x-axis of the IMU might be read first and tested for a value indicating a right-to-left swing (e.g., >5). If the value read is the expected value for a forehand on that axis, the other axis is tested. In this example, a value < -3 (combined with the appropriate x-axis value) on the y-axis clearly indicates a forehand.

[0078] The present invention includes testing a specific motion along multiple axes of the first marker. The multiple axes may be the x and y axes shown in Equation 2, or a series of different x, y, and / or z axes at different spatial orientations. The initial motion for each shot (and the overall motion for the entire shot) is provided by the user, coach, or downloaded in accordance with the present disclosure. The user or coach can extract the initial motion from practice motions. In one embodiment, the present invention identifies motion along a finite number of axes, and then processes axes in a larger number of different directions to evaluate this specific motion.

[0079] If the forehand test fails, the program tests the backhand. The test values ​​may include the same values ​​read from the previous inertial measurement unit or may be newly read values. In at least one embodiment, some of the inertial measurement unit test values ​​are shared between tests and some are newly read values.

[0080] The example of Equation 2 is an initial test for specific hitting motions (forehand and backhand). The test may be expanded to various other hitting motions and subclasses of hitting motions (e.g., topspin forehand shots, underspin forehand shots, etc.). In one embodiment, the "if then else" structure is expanded to any number of motions. In another embodiment, a programmable test loop repeatedly reads different groups of parameters that identify different motions for each individual test, and if the test does not pass, the next motion is tested. In one embodiment, the first test is the most common motion, so testing the most common motion first avoids unnecessary testing. In one embodiment, the muscle memory device tracks the motions the user practices or uses and adjusts the programming so that the most common motions are tested first.

[0081] Additionally, additional demo programs are implemented to evaluate specific hitting motions and provide real-time feedback as you practice hitting the ball. The "delay(200)" is used for testing purposes, while the functional device runs the test at a faster speed (e.g., 5ms, 1ms or less; depending on hardware capabilities).

[0082] Such additional demo programs may be programmed with a similar architecture, for example, to read inertial measurement unit values ​​at predetermined time intervals and / or segments of motion and compare these segments of motion to a range of expected values ​​for that motion at that time, which may be from recorded practice motions, downloaded materials, etc.

[0083] The ble.println command can enable Bluetooth communication between the muscle memory device and a computing device (e.g., a smartphone application). The command recognizes the action (ball strike) as a forehand or backhand. However, the control device can use this command to generate an auditory or vibration feedback signal. The test results can also be sent to a smartphone (or other computing device), and the functions discussed herein (including viewing the action, simulating the action, highlighting necessary corrections, etc.) can be realized based on the results. The smartphone can also send the data for further analysis or storage, which can be searched by others for further comparison, analysis, or improvement.

[0084] These examples provide communication between the muscle memory device and the smartphone, depending on the needs or desires of various smartphone (or other external computing device) functions. All data, including raw data, muscle memory device pre-processed data, muscle memory device processed data, or a combination thereof, can be transmitted to activate various external functions (e.g., smartphone display).

[0085] In one embodiment, the muscle memory device does not require a smartphone at all and has a simple user interface. For example, the muscle memory device is programmed to identify a group of movements, evaluate each movement, and provide feedback directly to the user from the muscle memory device. In one example, if the identified movement is larger than expected (e.g., too fast), a high-pitched tone or high-frequency buzzer is emitted, and if it is too slow, a low-pitched tone or low-frequency buzzer is emitted. Feedback can be achieved through an "if / then / else" programming structure.

[0086] In addition to the muscle memory device, the present invention also includes the collection, integration, and analysis of data from different devices connected to the 5G network. This data includes observations of training, matches, treatments, or other footage captured using the muscle memory device's camera. Such data can be collected by bystanders, therapists, and other individuals using their cell phone cameras, surveillance cameras, and other sources. This data is not limited to video but may also include audio, social media content, data from IoT devices, and more. In some cases, the speed of collection and transmission is sufficient to provide near-real-time performance or other analysis results, and data such as performance replays can be provided to enhance the user experience. The user can view the replay in an app or on a computer monitor, including actual video and feedback similar to that provided when performing the movement.

[0087] Playback typically occurs on a smartphone or computer and involves split-screen playback. One side provides a video of the entire movement (e.g., the user's upper body or entire body), while the other side provides a close-up of the body part that most impacts movement quality (e.g., the hand or wrist). The muscle memory device may be displayed in the video. For example, it may light up, be highlighted, or otherwise indicate when the muscle memory device beeps during a movement. In one embodiment, the muscle memory device can beep at the user's wrist during playback, allowing the user to more clearly identify key points in the movement they are viewing and any movements they need to correct.

[0088] The present invention involves using IoT data from different devices. This data can be merged into a database or other storage on a cloud server or on the user's smartphone, computer, etc. This data can be processed, correlated, and correlated and entered into an application interface to look for modes or conditions that positively or negatively influence the user's training, therapy, or other activities. This data can be very useful for users to plan athletic events or activities.

[0089] Although the present invention has been described herein with reference to a motherboard inertial measurement unit circuit board implementation, the devices and programs of the present invention may be applied to other devices, including existing platforms with operational position sensing and processing capabilities.

[0090] A smartphone or an Apple watch can be configured as a muscle memory device as long as it executes an appropriate program (e.g., application) to capture and analyze movements according to the teachings of the present invention. Also, the muscle memory device may take the form of a smartwatch or other device.

[0091] In one embodiment, the muscle memory device is implemented in different devices such as a wristband and / or shoes. Audio prompts can be sent to a speaker or earpiece (e.g., an IIC device) to guide and / or provide feedback to the user. Collected data can be transmitted to the user's smartphone, and different data streams can be combined in parallel or adjacent rows (e.g., graphs or statistical data, number / percentage of correct movements, degree of change, degree of average deviation, etc.).

[0092] In one embodiment, muscle memory devices are used by individual team members, a subset of team members, and / or in combination with opposing team members. For example, muscle memory devices are attached to soccer players' shoes. Each muscle memory device communicates with a central collection point, which can communicate with a smartphone or other computing device. Data may be collected by a network of receivers at different locations on the sidelines of the field, at goal posts, or on mobile devices (e.g., worn on the court's belt) on the field. The data can be analyzed and provided to coaches in graphical format for evaluation. Displaying this data can demonstrate or confirm cooperation between players and provide data for coach evaluation. This data may be provided along with action footage illustrating the corresponding data.

[0093] In the preferred embodiment of the present invention shown in the drawings, specific terminology has been employed for clarity. However, the present invention is not limited to such selected specific terminology, and each specific component includes all technical equivalents that operate in a similar manner. For example, when describing an accelerometer, compass (or north needle), or other component, any other device (whether listed herein or not) having the same or similar function or capability may be substituted. The inventors also recognize that newly developed technologies not currently known may be substituted for the components described above without departing from the scope of the present invention. All other items, including, but not limited to, smartphones, motherboards, operating equipment, accessory mechanisms, training programs, operations, etc., should be considered to be all available equivalents.

[0094] The present invention includes an apparatus comprising an accelerometer, a processing device configured to receive data from the accelerometer and compare movements indicated in the accelerometer data with stored movements, and a feedback device configured to inform a user of the apparatus of at least one aspect of user movement, the device further including a wireless connection between the accelerometer and the processing device for transmitting data and feedback signals from the accelerometer to the feedback device.

[0095] The accelerometer and feedback device may be attached to a wrist / ankle band and / or the accelerometer may be attached to the motion equipment or the accelerometer may be embedded in a smartwatch.

[0096] The feedback device may include multiple feedback points, each of which can be activated independently to represent a motion error identified by the accelerometer data. Different variations in ideal motion result in different feedback.

[0097] The device can calculate at least one element of the user's motion, including the amount of deviation from ideal motion. The change can be communicated to the user via feedback of volume and frequency information (selecting at least one of both). The amount of change can include a change in at least one of the position and speed of a predetermined portion of the motion. The reference motion can include at least one of the user's motion recorded on the device, motion recorded by a coach or trainer on a similar device, and motion pre-recorded and downloaded to the device.

[0098] The present invention provides a method for analyzing motion data, including the steps of receiving accelerometer data, identifying relevant motions in the accelerometer data, comparing the relevant motions with a reference motion, and transmitting a feedback indication of the comparison results. The comparing step includes comparing up / down (e.g., x-axis), left / right (e.g., y-axis), and forward / backward (e.g., z-axis) motions with the reference motion, and selecting at least one (the axis notation may be different). The comparing step may include feeding the accelerometer data back into an equation representing the reference motion. The equation may include an allowable motion error tolerance limit and determines whether to transmit a negative feedback signal.

[0099] The comparing step includes comparing data points of the accelerometer data with synchronized accelerometer data points corresponding to a reference motion. The feedback may include an audible or vibratory notification indicating incorrect motion, and may include an audible alarm that emits a high tone if motion is too high and a low tone if motion is too low.

[0100] The inventors have recognized that when providing feedback, the volume and other parameters of the feedback can be modified or changed, and the provided feedback is provided simultaneously with the action being evaluated. In one example, the feedback can vary in volume based on the amount of deviation between the action being performed and the memorized action being copied. For example, if a user's action is essentially accurate at the start, then the deviation becomes more pronounced, and finally ends with a subsequent action that is an excellent match of the memorized action with the subsequent action, when the user performs the subsequent action in accordance with the action, the volume of the feedback will initially be low, rapidly increase as the action progresses, and gradually decrease (effectively stop) as the user performs the subsequent action. In this way, the main portion of the feedback occurs entirely while the user is performing the action, and the feedback stops before the action is completed because the action is completed correctly (or within a predetermined range of acceptable action deviations).

[0101] The method may further include communicating with a remote device operated by a specialist and receiving or downloading predetermined or suggested actions from the remote device.

[0102] The method may further include recording accelerometer data during the model motion and using the recorded data to determine whether subsequent motions are similar to the model motion within a predetermined range. In one example, the remote device may be an automated device designed to throw, serve, or perform any function of an automated device (e.g., a table tennis robot, a ball throwing device, etc.). Using a table tennis robot as an example, a user may test motions loaded into the device by programming or providing a series of specifically designed ball-hitting motions to the robot. The robot (or robot controller) may receive communications regarding the user's performance and, depending on the amount or type of feedback received by the user, may improve serve speed, spin, or other characteristics, or even modify parameters for weak spots.

[0103] Improved techniques and methods are needed to effectively capture and accurately evaluate the movements and other processes described herein, which in some embodiments are outlined as digital guide devices. Processing speed and accuracy can be improved by highlighting and capturing movements and using them as timestamps (e.g., timestamps only). The timestamps can be recorded by an inertial measurement unit within a specific time period. This time period can be a period after the start of the movement and can be identified in various ways. For example, a series of timestamps indicating similar paths (e.g., the start of the movement) can be compared to previously recorded movements (which themselves can be timestamps).

[0104] In this case, the inertial measurement unit records and tracks all the information it can, including velocity, acceleration, position, rotation, pitch, yaw, and all the data points collected over time, which means it can record all of the above values ​​hundreds of times per second.

[0105] The device is configured (by programming or electronics) to utilize these data points and the overall data structure (recorded by the inertial measurement unit) to perform calculations and feedback specific to the present invention and the situations and purposes targeted by the present invention.

[0106] In various embodiments, by pressing a device button, a user can record the timestamps and data structures that the inertial measurement unit is collecting (pressing the button again to stop the recording, which can also be completed by a third party device such as a mobile phone), and pressing the button again stops the recording. For example, the inertial measurement unit may repeatedly timestamp motion, acceleration, and / or position information that occurs in rapid succession and store it in a data structure. This is a recording function of the device, and the motion / path record can be a collection of data points.

[0107] The data structure may be transmitted as an argument or an application interface parameter called by the sub-demo program, or directly from one device to another (e.g., from the device to the ping-pong robot or another computing device (e.g., a smartphone) for further analysis, prediction, etc.). Such a configuration allows for more efficient management and use of operational data and parameters.

[0108] The data structure may further include one or more reference points. For example, when a user selects a practice motion, the data structure may include one or more timestamps recorded as start and / or stop positions to highlight the portion of the motion to be practiced or studied. The data structure may also include weighting points to identify portions of the motion that require more rigorous weighting in any analysis. For example, a motion may include three or more portions, such as a preparatory portion, an impact portion, and a follow-up portion. Each portion may be weighted differently. The weighting value may represent an allowable error or error range, such as a percentage deviation from the recorded parameters. For example, in one embodiment, the preparatory portion may have a 20% allowable deviation, the impact portion may have a 5% allowable deviation, and the follow-up portion may have a 30% allowable deviation. Deviations may be set as a combination of velocity and position differences, typically evaluated separately and each with an associated feedback type (e.g., different parameters, different feedback types), or parameters may be evaluated in combination with the same feedback type at the same time (e.g., varying depending on the amount of deviation from the reference motion).

[0109] Each portion of the movement may be automatically divided into multiple portions, or the user may use the application or other programs described herein to divide the movement into desired portions. Such applications may also allow the user to associate a tolerance percentage or other metric with each segment or portion of the movement. The application may allow the user to select other parameters of the variables and set variable values ​​for any comparison or type or amount of feedback (e.g., select or set desired settings for each segment or the entire movement, feedback during the movement, and / or coaching after the movement).

[0110] Of course, this device can provide real-time feedback based on a comparison of movements, but now the device is updating the actual way feedback is provided in a more efficient way. When the user presses a button (which can be a single press, a long press, or two or three presses) and holds it for about one second, training mode is entered, after which the device compares the currently performed movement with previously recorded movements. However, any changes will be reflected in the feedback. Feedback does not have to be provided during the movement itself. For example, because the user may initially deviate from the original path, the device can simultaneously provide multiple forms of feedback, such as voice, voice commands, and vibration (which may together indicate a single movement deviation or deviations in multiple different aspects of the movement). However, if the user is on the correct path (e.g., within a specified tolerance) of the original movement in a subsequent portion of the movement, the feedback is stopped, thereby informing the user that this portion of the movement is correct.

[0111] The feedback function may also be "reversed," i.e., when performing practice movements, if the user's movements are correct, they may get some feedback (perhaps a very soft voice), which reliably lets the user know that they are correct (rather than no feedback at all). Such positive reinforcement can create an effect similar to that of a real coach.

[0112] The movements / actions (or data points) recorded during a movement constitute the entire record completed using this device. However, only certain parts of this movement / movement are actually relevant. The movement to get into the correct position, the preparatory movements, and the subsequent movements are not always part of the movement the user is trying to practice. The user can select (on their mobile phone) a "trimmed" movement to include only the relevant parts they are trying to practice. However, based on the preparatory and subsequent movements, feedback can be given to the user to get into the "right position" so that they can start the movement correctly. While any form of feedback is acceptable, audio feedback is most preferred, instructing the user on how to get into the correct position and preparation, and when to actually start the ideal movement they want to practice.

[0113] Although "irrelevant" movements are trimmed and / or not used to evaluate the considered movement, they can provide information about the movement. Especially when evaluated over time, this can improve the accuracy of the considered movement and provide more accurate predictions. Preliminarily, preparatory movements, postures, etc., may themselves need to be refined and may themselves be directly evaluated movements. Even if preparatory movements or postures are not directly evaluated, recorded information about these movements and positions may be evaluated or otherwise used, or may provide preliminary information about the user's readiness or statistical / instructional feedback. For example, by evaluating such movements in the background and comparing them with examples of success and failure during training or a match, a device can obtain information about the user (e.g., poker tells). For example, if a user's posture begins to lean to the left, it can be determined that the user is highly unlikely to be able to accurately complete a movement, such as a reverse rotation return. These "tells" can be fed back to a robot or other device practicing with the user, or the user can be notified of these "tells." This can then be resolved or utilized to benefit the user. Various embodiments may involve utilizing these tells to determine automatic serve characteristics or other automatic practice devices. These tells may be represented by device feedback. For example, if the user's posture is leaning to the left or right, a short pulse (e.g., pre-feedback) may alert the user. For example, a robot may be programmed to recognize this and serve the ball more to the right if the user actively leans to the left (or if the user begins to lean). Relevant information may be provided to the user before and after using these techniques.

[0114] In one embodiment, the muscle memory device performs all the analysis and packages an abbreviated set of instructions for the robot. This set of instructions may include the change parameters of the previous hit. For example, "+10LS" means to increase left turn by 10%. Such instructions can arrive any time after the hit and / or before the next hit. (For example, each time the robot changes the way it hits the ball, the changed parameters are added to the next similar hit, but this is just an example; the changed parameters may apply to different hits or only to the exact same hit.)

[0115] In one embodiment, a tell is identified and based thereon, changed parameters are sent to the robot to be applied to the next hit that is yet to occur. The tell-based change parameters may, for example, be useful in explaining to the user the disadvantage of the tell (the change parameters make the return shot more difficult) and / or in providing the user with an advantage of the tell motion (the change parameters make the return shot easier). The change parameters and return shot motion, combined with feedback from the device during the hit, are expanded (deviation more from the recorded motion) or contracted (closer to the recorded motion) during the hit, thereby explaining the effectiveness of the user in mimicking the recorded motion.

[0116] In one embodiment, the following steps may be taken:

[0117] S100: Identify the tell using a muscle memory device based on information such as the user's posture, ready position, pre-ready, during-ready, and post-ready movements, and predictive analysis.

[0118] S200: Information about the tell and / or change information that explains the hitting method that changes depending on the tell is prepared.

[0119] S300: Transmit the change information to the robot or automation device.

[0120] S400: In a robot or device, change any of the parameters of the device's position, speed, angle, force, vibration, video playback, interactive guide, rotation or other ball, feedback or other function.

[0121] S500: Identify differences between user actions and recorded or planned actions in real time.

[0122] S600: Provide feedback to the user as the action occurs (e.g., provide feedback that changes as the action occurs, indicating the extent to which the user deviates from the recorded or planned action; instructional feedback that changes as the action occurs and "tells" the device how the user will perform the action based on tell and predictive analysis based on past user actions).

[0123] The tell may be a combination of information such as user movement, posture, etc., and physiological feedback (e.g., eye movement, heart rate, blood pressure, etc.). The physiological data may be provided by sensors built into the device, or may be provided by a separate and / or independent device.

[0124] In one embodiment, this equipment is a Peloton-like (on-the-job or pre-recorded) online instructional training device. The feedback may be the angular position of your feet on the pedals, the strength of your hands on the handlebars, or may be combined with existing Peloton-like data (such as cadence and rotational speed).

[0125] In one embodiment, a power equation can be utilized to identify tells and / or create a device response strategy. Also, in some embodiments, when teaching with an interactive, AI, or static coach, the changed parameters can notify the "coach" that there is a tell, and the "coach" can then issue instructions (e.g., center of gravity off the left leg, extend the ankle, maintain left lean, etc.).

[0126] In one example, the device identifies the tell and alerts other programs (e.g., coaching programs) to the tell, thereby providing coaching to correct the user's errors or reinforce the user's good behavior. In another example, when a user performs an action (e.g., riding a bicycle, hitting a ping-pong ball, etc.), the device modifies the coaching response based on the tell or notifies a live coach of information about the tell. For example, in a program with one or more typical coaching responses, the typical response is changed to a response based on the tell modification. In one embodiment, the muscle memory device activates a combination of two or more (or all) of the coaching responses, ball strike changes (or other mechanical actions), and feedback. The feedback varies in intensity, tone, vibration, etc. depending on the degree of deviation between the user's action and the memorized action.

[0127] In one embodiment, tells are not identified by the device, but rather the device provides the behavioral data to a connected AI analytics or machine learning environment, which then derives tell information from the behavioral data and then transmits any identified tells (or any predictive analytics related to the analysis of the user's subsequent behavior) to a robot or other device.

[0128] Thus, in various embodiments, analytics regarding user performance can be utilized. User performance can be determined by comparing movements to stored movements over time (e.g., multiple practice movements), and this information can be fed back to another device, such as a serving machine, treadmill, bicycle (e.g., Peloton), rowing machine, or other device, to modify one or more parameters of the device. For example, in a cycling training session, the comparison can identify that the user is having difficulty maintaining posture, and the data can be used to provide guidance to keep the user on flat terrain rather than climbing unnecessary hills (in this case, a coach such as a Peloton might interact with the user via a display terminal). Similar determinations can be made for any training device that can be programmed to resolve issues identified by movement comparison, informing the user of areas for improvement in combination with external auxiliary guidance or interpretation. For example, a wearable device can be configured to capture a user's movements and transmit the captured movement data, information about the captured movement, comparison to stored movements, and / or comparison information to a remote device interacting with the user. The transmitted data can alter parameters of the remote device, such as speed, direction, or other quantities. In one alternative, the information is transmitted to a remote intelligent or human coach, which transmits coaching commands related to the compared movements to the user via a network or video feed.

[0129] Even if a user hasn't used the device for a while and suddenly decides to practice again, there's no need to worry because the device records previous movements. The history records may be stored on the device or on a remote server (e.g., a cloud server). Based on the history records, the device can calculate past movement patterns and the most likely current movement situation (the most likely path or movement). This prediction may be based on the most relevant parts of the movement, the entire movement and / or posture, other parts such as preparatory movements, or a combination of any of the above. Based on these previous errors and deviations, the device then provides instructional feedback. It can not only guide the user with commands such as "left, right, fast," but also quickly summarize previous trends, points to note, things to pay attention to, and how to accurately correct them. This information can be presented in audio format or displayed on a smartphone screen, eliminating redundancy and tedium. For example, the device can analyze the movement history using a small number of keywords to directly identify the problem (e.g., any one or more known trends, including being too slow, leaning to the left, insufficient wingspan, acceleration, standing to the left, etc.).

[0130] Another type of additional feedback is overall feedback after a movement is completed, and the user receives real-time feedback while practicing. The third type of feedback is overall feedback received after the user practices and performs a movement (the first and second are real-time audio and vibration feedback). Here, the entire movement performed by the user can be summarized, not just with audio and vibration, but with a comprehensive summary and audio and visual / textual explanations on the mobile phone. In this way, the additional benefit of a real coach (or a realistic virtual coach) can be provided, helping students correct their posture in real life and providing feedback based on their performance and execution. In one embodiment, comprehensive coaching feedback is provided. The comprehensive coaching feedback can be comments about the movement (e.g., a voice message saying, "Your starting movement was a little high, but you completed the movement correctly"). In one embodiment, the coaching feedback includes what the user did wrong and what the user did well, thereby providing some positive feedback and corrections. Positive feedback can be given during each coaching feedback or can be included randomly, making it more effective as a reinforcement tool. Positive feedback may be provided when the user begins to perform an action correctly but only a few times (or not at all), or simple positive feedback may be provided when the device identifies that the user has fully grasped the action. Thus, in embodiments, by collecting data on the user's proficiency with some or all of the identifiable actions, appropriate positive feedback can be provided without providing the user with excessive or unnecessary feedback.

[0131] In one embodiment, a user's proficiency in various actions is connected to or otherwise communicated with an online gaming platform such as Roblox (or an independent game) and used to unlock stages, weapons, or other items. A similar approach can be applied to other activity-based platforms. For example, an off-road coach provides devices to his team, and the device's tracked data, such as distance, passes, and time, can be used to unlock stages, weapons, or other items in the corresponding off-road game environment (e.g., off-road skills or endurance are equivalent to additional ammunition, better weapons, or stages in a shooter game). The last suggestion in parentheses is to transfer skills or tasks in the physical world to points or progress in the virtual world. These virtual worlds may be unrelated to the real-world activities being tracked (although some synergy can be expected even if there is some common connection between the real-world activities and the virtual world (e.g., actual soccer training and virtual soccer in a game environment)). Thus, in one embodiment, tracking a user's actions and recording the user's improvement and progress toward their goals (e.g., compared to memory behavior) can provide incentives for such progress in a game environment that may or may not be action-related, which can encourage the user to perfect their actions and further their game progress.

[0132] Alternatively, if a user prefers shorter coaching sessions (only teaching what went wrong), positive feedback can be turned off. In one embodiment, the positive and other feedback provided may be tracked and stored in a data structure associated with the action. Such feedback may be used for predictions or reporting and transmitted to other device programs or applications along with the action. In one embodiment, the feedback is sent to a platform. The platform distributes the feedback and / or various other data on social media or a club platform / application, or automatically sends an associated caricature in an email signature line or subject line. In one embodiment, the platform distributes an exemplary caricature (e.g., a caricature of the user) of performing the action according to parameters or other data contained in the data structure. The caricature may be a dynamic GIF depicting the action and may include highlights of areas where the action exceeded an acceptable error. Such a caricature may be an overall or average value of the user's best, worst, last, series of actions (e.g., from start to finish, or other combination), and recent actions.

[0133] In various embodiments, secondary feedback or "warnings" can function by seriously criticizing a user for repeating the same mistakes without improving. Such warnings can be given if the user does not improve during a practice session or series of practices, or if they do not improve over a predetermined period of time. The feedback can be more critical of the "worst" parts of the user's mistakes. In one example, the criticism can increase steadily or exponentially, to ensure that the user tends to be at least relatively accurate throughout their movements.

[0134] Over time, the device collects user motion information and can stop or control tells by pointing out tells that the user is leaking, and after identifying and controlling the tells, can be used to help the user outsmart opponents in tournaments. In one embodiment, feedback provided to the remote device (e.g., a table tennis robot) explicitly points out or provides tells (which may be in the form of raw or processed data) and instructs the robot to smash, spin, or serve to correct or utilize the tells to help teach relevant weaknesses.

[0135] Examining and comparing trajectories for trajectory feedback and overall feedback on a mobile phone can be challenging. However, in various embodiments, this feedback can be simplified. Here, the mobile phone essentially displays a spherical indicator indicating the device's position and provides feedback based on G-force feedback (e.g., a G-force map of the driver's experience while driving). By simply highlighting the sides and edges of the mobile phone in different colors (from red to green, with varying intensities), feedback is easily provided based on the user's current imperfections and deviations from their original ideal behavior.

[0136] This can be achieved by the device itself. When the user wears the device, light effect indications on the device by highlighting different aspects of the device constitute another form of feedback that a muscle memory device can provide. For example, users with hearing loss can also benefit from the device. An embodiment of the above can be a singly controllable LED (e.g., micro-LED) strip light in a linear or multidimensional array. The feedback can be lighting up one or more LEDs, lighting up an LED pattern, and / or manipulating a movable object (e.g., an arrow) along the edge of the device. Using very small but bright LEDs is desirable and most effective. For example, the LEDs can constitute a display on which an image (e.g., a motor stylus) can be played and areas needing improvement highlighted.

[0137] In one embodiment, these and other changes can be implemented as a directional device, such as a compass or a north needle (e.g., always pointing north). The device can also visually prompt the user by "illuminating" the correct direction of the movement, indicating that "when moving from top to bottom, the light will turn green and indicate which direction to move." Such light effect instructions can also be used as a three-step teaching method, instructing the user to execute the correct movement path while completely ignoring the desired movement speed. Practicing the movement speed is not paramount, and the focus should be on the correct path of the original movement. After learning the correct path of the movement, the user can work on improving the movement execution speed. For example, if a user moves slowly while looking at the device but performs the movement in real time, the same light effect may appear in real time at a faster speed. In one embodiment, the device can identify slow movements based on the movement and slow speed, recalibrate the movement, and copy and / or insert a timestamp of the actual movement to prepare a "stretched" reference movement for comparison. In other embodiments, the device does not copy the timestamps, but increments the time of each timestamp to match any speed changes the user may experience throughout their operation, and rather than issuing time or speed alerts, the device matches the user's time; these alerts are normally generated in normal operating mode.

[0138] Thus, in various embodiments, the device actually guides the user in using proper movement skills without significant interference from sounds and vibrations, thereby making it easier for the user to achieve this goal by practicing slow movements rather than focusing on the challenges of speed, fast movements, and rotations, etc. However, in general, users should gradually become familiar with basic movements before introducing more difficult and precise techniques.

[0139] Figure 9 shows the design of a muscle memory device, which can be worn on the wrist or ankle via a wristband. The device can be placed in a dedicated pocket on clothing, preferably fixed so that it is stationary relative to the body part being measured, but can also be placed loose in the pocket. The device can also be attached to equipment such as a bat, shoes, racket, glove (e.g., baseball glove), etc. The device can be attached by adhesive, Velcro, or screws, or other attachment methods such as buckles, buttons, etc.

[0140] The muscle memory device's external design includes a switch button 901 and a light-effect feedback indicator 902, which can be operated as described above. For example, visual feedback is provided during the execution of a movement, and the light-effect feedback indicator 902 is also used to start, stop, and confirm the execution status of the recording device. In one embodiment, the light-effect feedback indicator 902 (and / or any one of the audio and / or vibration feedback) may be reduced, thereby providing feedback for only a certain portion of the movement. This can be very useful when a user is training or practicing to focus on only a certain aspect of a hitting position or movement. In this case, the recorded movement is limited to a selected portion of the movement, and only partial feedback for this movement is provided. This can be achieved by programming the selected portion of the movement through a connected application or other means. The device can identify the movement being considered using the ready position and the initial portion of the movement and provide feedback while the user is performing the selected portion of the movement.

[0141] Thus, a user can use an application that has access to multiple stored movements, any of which can be uploaded to the device. The user can view a timeline of movements in the application, highlight the portion of the movement they want to practice, and configure the device to provide feedback only for that portion of the movement. In one embodiment, the feedback appears only while the user is performing the desired portion of the movement and not at other times. In another embodiment, a steady tone or other feedback is continuously emitted before the beginning of the selected movement, and the feedback changes as described above during the selected movement. In another embodiment, a steady tone or other feedback is continuously emitted before the beginning of the selected movement, and then a second tone appears, remaining steady if the user's movement is within the acceptable deviation range of the recorded movement. However, if the acceptable deviation range is exceeded, the tone changes depending on the magnitude of the deviation. In this way, the user is informed of which portion of the movement the device is monitoring and can focus the user's attention.

[0142] In one embodiment, different segments of a movement (or selected portions of a movement) have different degrees of tolerance for deviation. For example, in table tennis, the movement before contact with the ball may have a wide tolerance range, the moment of contact with the ball may have a second, relatively higher tolerance range, and the subsequent movement portion may have a third, relatively lower tolerance range. In this case, the feedback may be less sensitive for the movement portion with the larger tolerance range.

[0143] Figure 9 shows alignment marks 903 and a battery charging connector 904. Figure 10 shows the vibration device (vibration motor 1005) and audio (acoustic feedback speaker 1006) feedback devices mounted on the device. In Figure 11, a switch button 1101, an inertial measurement unit sensor 1102, a plate-shaped light-emitting diode 1103, and a central processing unit 1104 are also mounted on the motherboard.

[0144] Some aspects of the embodiments can be readily implemented by a general-purpose or special-purpose digital computer or microprocessor, which can be programmed according to the teachings herein, with programming instructions readily understandable to those familiar with computer technology.

[0145] A skilled programmer, following the teachings herein, can readily produce appropriate software coding, which will be readily understandable to those familiar with software technology. Following this specification, one skilled in the art will be able to implement the functions of the present invention by designing application specific integrated circuits or interconnecting conventional component circuits in an appropriate network, which will be readily apparent to those skilled in the art.

[0146] The present invention includes a computer program product, which is a storage medium storing instructions. The instructions can control a computer to execute any of the programs of the present invention. Storage media include, but are not limited to, any type of disk (including floppy disks, minidisks (MD), optical disks, DVDs, HD-DVDs, Blu-ray, CD-ROMs, CD or DVD RW+ / -), microdrives, magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices (including flash memory, memory modules), magnetic or optical cards, SIM cards, MEMS, nanosystems (including molecular memory ICs), RAID devices, remote data storage / archives / libraries, or any type of media or device adapted for storing instructions and / or data.

[0147] The present invention may be stored on any computer-readable medium. The present invention includes associated software for controlling the hardware of a general-purpose or special-purpose computer or microprocessor and for enabling the computer or microprocessor to utilize the results of the present invention and interact with a human user or other devices. Such software includes, but is not limited to, device drivers, operating systems, and user applications. Finally, the computer-readable medium further includes software for carrying out the present invention, as described in the various embodiments and claims.

[0148] The programming (software) of the general purpose / special purpose computer or microprocessor includes software modules for implementing the instructions of the present invention, including but not limited to recording operational data, analyzing operational data, comparing operational data, issuing alarms / sounds (including voice), and displaying, storing, or transmitting results of the programs of the present invention.

[0149] The present invention consists of any element, component, or feature described herein. The present invention can also be used without any element, whether or not explicitly disclosed herein. Obviously, many modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that the present invention may be practiced otherwise than as specifically described herein. [Explanation of symbols]

[0150] 100: Muscle memory device 110: Band 702B: Lamp feedback 200: Component communication 210: Inertial Measurement Unit 220: Motherboard 230: Piezoelectric element 240:Selection switch 250: Input / output device 255: Cloud 260:Robot 270: Visual Display 275: Fitness devices 280: Mobile devices 300: Software and Programming 310:Comparative data 320: Software 322: Operation 324: Operation 326:Select 328: Function 330: Local data 340: Input / output communication 400: Muscle Memory Device 401: Switch 402: Piezoelectric element 403: Power switch 404: Inertial Measurement Unit 405: Motherboard 500: Exercise equipment 510: Housing 520: Power button 530:Selection switch 540: Piezoelectric port 600: Accessory device 610: Corresponding threaded joint 620: Screw fittings 700: Operation comparison process 710: Step 730: Decision block 740: Step 750: Step 800:Application 810: Radio button 820: Radio button 830: Button 835:Detail 901: Switch button 902: Light Effect Feedback Indicator 903: Alignment mark 904: Battery charging connector 1005: Vibration motor 1006: Audio feedback speaker 1101: Switch button 1102: Inertial Measurement Unit Sensor 1103: Plate-shaped light-emitting diode 1104: Central processing unit

Claims

1. an accelerometer, a processing device, and a feedback device; the processing device is configured to receive data from the accelerometer and compare motion indicated by the accelerometer data with pre-stored motions; the feedback device is configured to provide a notification to a user of the feedback device regarding at least one aspect of the user's performance; Here, the feedback device is a device used for training and tracking motor and muscle memory that issues the notification by comparing the user's captured movements in the received data of practice movements at less than full speed with the same movements previously stored at full speed.

2. 10. The device for use in training and tracking movement and muscle memory of claim 1, wherein the feedback device includes a visual representation for indicating the direction in which the user should move.

3. 3. The device for use in training and tracking exercise and muscle memory of claim 2, wherein the visual representation means includes a group of lights that light up in the exact direction the user should move.

4. 3. The device used for training and tracking exercise and muscle memory of claim 2, wherein the visualization means includes a group of lamps having colors that indicate the direction the user should move.

5. 3. A device for use in training and tracking movement and muscle memory according to claim 2, which evaluates the user's movements without taking into account the speed of the movements.

6. 2. The device for use in training and tracking exercise and muscle memory of claim 1, configured to compare stored movements with movements currently being performed by a user wearing the device, wherein the comparison takes into account any speed differences between the stored movements and movements currently being performed by the user so that both are performed at the same speed.

7. 7. The device used for training and tracking exercise and muscle memory of claim 6, wherein the stored movements include full speed movements, the full speed movements including a set of accelerometer data points spanning the entire stored movement, and adding, deleting or inserting one of the data points adjusts one of the stored movements or the running movement to compensate for speed so that movements can be compared in similar respects.

8. 8. A device for use in training and tracking movement and muscle memory according to claim 7, wherein adding, deleting or inserting is performed at different speeds in different parts of the movement.

9. an accelerometer, a processing device, and a communication device; the processing device is configured to receive data from the accelerometer and compare motion indicated by the accelerometer data with pre-stored motions; A device used for training and tracking motor and muscle memory, wherein the communication device is configured to transmit an indication of the user's proficiency in movements relative to pre-stored movements to an online gaming platform.

10. 10. The device used for training and tracking exercise and muscle memory of claim 9, wherein the online gaming platform activates one or more features of one or more games on the platform depending on the user's level of proficiency.

11. 11. The device used for training and tracking motor and muscle memory of claim 10, wherein the features include one or more stages in one or more games, weapons, tools, keys or other items.

Images