Abnormal gait intervention and correction method, device, electronic device and medium based on rhythmic auditory stimulation

Abstract

The present application discloses a method, device, electronic device and medium for intervention and correction of abnormal gait based on rhythmic auditory stimulation, which relates to the field of smart medical technology. The method includes: when the target subject undergoes abnormal gait intervention treatment based on rhythmic audio, the inertial data of the target subject's feet are collected in real time; a first preset time length is used as a time interval, and a temporary gait cycle rhythm is calculated based on the inertial data within each first preset time length to obtain multiple temporary gait cycle rhythms; a second preset time length is used as a time interval, and a real-time gait cycle rhythm is calculated based on at least two temporary gait cycle rhythms according to the second preset time length, wherein the second preset time length is greater than the first preset time length; the rhythm of the rhythmic audio is dynamically adjusted according to the real-time gait cycle rhythm, and rehabilitation treatment of abnormal gait is performed based on the rhythm of the adjusted rhythmic audio. This solution can scientifically, accurately and reasonably set the rhythm of the audio, which is conducive to improving the intervention effect of abnormal gait.

Description

Technical Field

[0001] The present application relates to the field of computer technology, specifically to the field of smart medical technology, and in particular to methods, devices, electronic equipment, and media for intervention and correction of abnormal gait based on rhythmic auditory stimulation. Background Art

[0002] Rhythmic Auditory Stimulation (RAS) is a neurorehabilitation technique based on music therapy. By providing rhythmic stimulation (such as music and beats) to the motor center, RAS encourages patients with impaired neurological function to align their movement patterns with an external rhythm, thereby improving motor function. RAS is widely used in neurorehabilitation to improve gait and motor function, particularly in patients with Parkinson's disease, stroke sequelae, and cerebral palsy. The core principle of RAS lies in its ability to activate the auditory and motor centers of the brain. Through rhythmic stimulation, RAS controls lower limb muscle movement, adjusts gait patterns, and thus improves gait ability. This technique utilizes the brain's natural response to rhythm, known as the rhythmic entrainment mechanism, to synchronize the patient's motor system with the externally supplied rhythm, thereby improving movement coordination and efficiency.

[0003] 1. Existing music-based gait intervention methods do not accurately analyze the gait cycle rhythm. Due to the difference in the return rate of the left and right foot sensors, the calculated rhythm differs greatly from the actual rhythm, resulting in unreasonable rhythm settings and poor intervention effects.

[0004] 2. Inability to provide real-time feedback and dynamic adjustment. Existing gait intervention methods are unable to accurately monitor gait data in real time, making it impossible to dynamically optimize the program based on the patient's performance and effectively adjust the rhythm. As a result, the rhythm during training is either lower than the patient's current rhythmic ability, resulting in no improvement, or the rhythm is significantly higher than the patient's current rhythmic ability, causing the patient to lose focus and easily fatigue, which affects their self-confidence, resulting in poor intervention compliance and the inability to intervene for a long time. Summary of the Invention

[0005] In response to the technical problems in the existing technology of gait intervention that the intervention treatment rhythm cannot be dynamically and effectively adjusted and the intervention effect is poor, a method, device, electronic equipment and medium for abnormal gait intervention correction based on rhythmic auditory stimulation are provided.

[0006] According to a first aspect, a method for intervention and correction of abnormal gait based on rhythmic auditory stimulation is provided, comprising:

[0007] During the process of abnormal gait intervention treatment of the target subject according to the rhythmic audio, inertial data of both feet of the target subject are collected in real time;

[0008] Taking a first preset time length as a time interval, calculating a temporary gait cycle rhythm according to the inertial data within each first preset time length, to obtain a plurality of temporary gait cycle rhythms;

[0009] Using a second preset time length as a time interval, and calculating a real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset time length, wherein the second preset time length is greater than the first preset time length;

[0010] The rhythm of the rhythmic audio is dynamically adjusted according to the real-time gait cycle rhythm, so that the adjusted rhythm of the rhythmic audio is in sync with the current real-time gait cycle rhythm, and rehabilitation treatment of the abnormal gait of the target object is performed based on the adjusted rhythm of the rhythmic audio.

[0011] According to a second aspect, a device for intervening and correcting abnormal gait based on rhythmic auditory stimulation is provided, comprising:

[0012] a data acquisition unit, configured to acquire inertial data of both feet of the target subject in real time during the process of the target subject undergoing abnormal gait intervention treatment based on rhythmic audio;

[0013] a first gait rhythm calculation unit, configured to calculate a temporary gait cycle rhythm based on the inertial data within each first preset time period using a first preset time period as a time interval, to obtain a plurality of temporary gait cycle rhythms;

[0014] a second gait rhythm calculation unit, configured to use a second preset duration as a time interval, and calculate a real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset duration, wherein the second preset duration is greater than the first preset duration;

[0015] A rhythm adjustment unit is used to dynamically adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm, so that the rhythm of the adjusted rhythmic audio is in sync with the current real-time gait cycle rhythm, and to perform rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

[0016] According to a third aspect, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a method such as any embodiment of the abnormal gait intervention and correction method based on rhythmic auditory stimulation.

[0017] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method of any embodiment of the abnormal gait intervention and correction method based on rhythmic auditory stimulation is implemented.

[0018] According to the solution of the present application, it is proposed to collect the inertial data of both feet of the target object in real time during the process of abnormal gait intervention treatment based on rhythmic audio, and then calculate the temporary gait cycle rhythm within each first preset time period based on the real-time inertial data of both feet, and dynamically calculate the real-time gait cycle rhythm based on multiple temporary gait cycle rhythms according to the second preset time period. The real-time gait cycle rhythm is not directly calculated based on the inertial data returned by the sensor, but is obtained by comprehensive calculation based on multiple temporary gait cycle rhythms. It can effectively avoid the problem of inaccurate calculated rhythm caused by the difference in the return rate of the left and right foot sensors, and the real-time gait cycle rhythm is more accurate. It can reflect the current gait performance of the target object, which is conducive to improving the accuracy of the real-time gait cycle rhythm; finally, the rhythm of the rhythmic audio is dynamically adjusted according to the accurate real-time gait cycle rhythm, so that the rhythm of the rhythmic audio can be dynamically and effectively optimized and adjusted according to the current gait performance of the target object, so that the rhythm of the adjusted rhythmic audio is in sync with the current real-time gait cycle rhythm of the target object, thereby scientifically, accurately and reasonably setting the rhythm of the rhythmic audio, and then conducting rehabilitation treatment of the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio, which is conducive to improving the rehabilitation treatment and intervention effect of abnormal gait. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Other features, objects and advantages of the present application will become more apparent upon reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0020] Figure 1 is a flow chart of an embodiment of an abnormal gait intervention and correction method based on rhythmic auditory stimulation according to the present application;

[0021] Figure 2 is a schematic diagram of an application scenario of the abnormal gait intervention and correction method based on rhythmic auditory stimulation according to the present application;

[0022] Figure 3 1 is a schematic structural diagram of an embodiment of an abnormal gait intervention and correction device based on rhythmic auditory stimulation according to the present application;

[0023] Figure 4 This is a block diagram of an electronic device used to implement the abnormal gait intervention and correction method based on rhythmic auditory stimulation according to an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following description of exemplary embodiments of the present application is made in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding. These details should be considered as merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0025] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0026] refer to Figure 1 , shows a process 100 of an embodiment of an abnormal gait intervention and correction method based on rhythmic auditory stimulation according to the present application. The abnormal gait intervention and correction method based on rhythmic auditory stimulation includes the following steps:

[0027] Step 101 : While the target subject is undergoing abnormal gait intervention treatment based on rhythmic audio, inertial data of both feet of the target subject are collected in real time.

[0028] Step 102 : Taking a first preset time length as a time interval, calculating a temporary gait cycle rhythm according to the inertial data within each first preset time length, and obtaining a plurality of temporary gait cycle rhythms.

[0029] Step 103 : Using a second preset duration as a time interval, and calculating a real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset duration, wherein the second preset duration is greater than the first preset duration.

[0030] Step 104: Dynamically adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm so that the adjusted rhythm of the rhythmic audio is in sync with the current real-time gait cycle rhythm, and perform rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

[0031] In this embodiment, the execution subject of the abnormal gait intervention and correction method based on rhythmic auditory stimulation can be a terminal device (such as a mobile phone, IPD, etc.) or a server. The server plays the adjusted rhythmic audio to the target object through the terminal device, playback device, etc.

[0032] In some optional implementations of this embodiment, the above-mentioned inertial data may be data collected by an IMU (inertial sensor). During abnormal gait intervention and rehabilitation treatment, the target subject wears an IMU on the left and right feet respectively.

[0033] In some optional implementations of this embodiment, in order to calculate an accurate and true gait cycle rhythm, the present application proposes first calculating multiple temporary gait cycle rhythms, and then calculating the real-time gait cycle rhythm based on the multiple temporary gait cycle rhythms. For example, the method for calculating the temporary gait cycle rhythm is as follows:

[0034] Calculating a temporary gait cycle rhythm according to the inertial data within each first preset time period includes:

[0035] In descending order of the inertial data collection time, extracting multiple consecutive frames of inertial data with speed data less than a speed threshold from the inertial data within each first preset time period (e.g., 4 seconds, 5 seconds, etc., the specific time period can be determined according to actual needs);

[0036] Calculating the respective stationary periods of the left and right feet based on the multiple frames of inertial data, and calculating the respective movement periods of the left and right feet based on the start and end times of the respective stationary periods. Determining the duration from the time the left foot begins to be stationary to the time the right foot begins to be stationary after taking a step as the duration of the right foot movement period, and determining the duration from the time the right foot begins to be stationary to the time the left foot begins to be stationary after taking a step as the duration of the left foot movement period.

[0037] The durations of all the right foot movement cycles within the first preset time length are averaged to obtain the average right foot movement cycle duration, the durations of all the left foot movement cycles within the first preset time length are averaged to obtain the average left foot movement cycle duration, the average right foot movement cycle duration and the average left foot movement cycle duration are averaged, and the obtained average is determined as the step duration, the number of the step durations within the preset time length is determined, and the number is used as the temporary gait cycle rhythm within the first preset time length.

[0038] For example, the continuous gait data frames (i.e., the above-mentioned inertial data) transmitted back by the inertial sensor are cached in a first container in the order of the time when the data was generated. At fixed time intervals (i.e., the above-mentioned first preset duration), multiple frames of inertial data with speed data (such as angular velocity, acceleration, etc.) less than a speed threshold and continuous are obtained from the first container. Based on the analysis of the multiple frames of inertial data, multiple stationary periods corresponding to the left and right feet are obtained (for example, taking the left foot as an example, the time or duration from the start of the left foot landing to the landing of the right foot after taking a step is a stationary period of the left foot). Based on the start time and end time of the stationary periods corresponding to the left and right feet, the movement periods corresponding to the left and right feet are respectively calculated (for example, taking the left foot as an example, there is a stationary period before and after a movement period, the end time of the previous stationary period is the start time of the movement period, and the start time of the next stationary period is the end time of the movement period). The duration from the start of the left foot being still to the start of the right foot being still after taking a step is determined as the duration of the movement period of the right foot. The duration from the time the right foot starts to be still to the time the left foot starts to be still after taking a step is determined as the duration of the left foot movement cycle, the duration of all the right foot movement cycles within the first preset time length is averaged to obtain the average right foot movement cycle duration, the duration of all the left foot movement cycles within the first preset time length is averaged to obtain the average left foot movement cycle duration, the average of the average right foot movement cycle duration and the average left foot movement cycle duration is averaged, and the obtained average is determined as the step duration, and the number of the step durations included in the preset time length (such as 30 seconds, 1 minute, 2 minutes, etc., the specific time length can be determined according to actual needs) is judged, and the number is used as a temporary gait cycle rhythm (also called a temporary rhythm sample) within the first preset time length, for example, the preset time length is 1 minute, and the step duration is 2 seconds, then 1 minute includes 30 step durations, and the 30 is the temporary gait cycle rhythm), and the temporary rhythm sample is cached in the second container. Subsequently, the actual rhythm (ie, the real-time gait cycle rhythm) is obtained based on the plurality of temporary rhythm samples according to a time interval of a second preset duration.

[0039] In specific implementation, when calculating temporary rhythm samples, incomplete motion / non-motion data at the beginning of the data that does not reach the number of continuous frames can be eliminated; abnormal data within the cycle can also be eliminated, such as multiple complete right foot motion cycles (from right foot lifting to landing) within the left foot static cycle, and multiple complete left foot motion cycles (from left foot lifting to landing) within the right foot static cycle.

[0040] In a specific implementation, to address the problem of inconsistent valid frame numbers between the left and right foot sensors after cleaning and filtering continuous frames of gait data due to inherent sensor error, a method is proposed to perform gait data frame completion during the calculation of a temporary gait cycle rhythm. For example, based on the multiple frames of inertial data, the time from the first foot (which can be the left or right foot) landing to the second foot landing and before the second foot steps again is determined as a group of left and right foot static periods (i.e., a group of left and right foot static periods includes a left foot static period and a right foot static period during consecutive steps of the left and right feet). Within each group of left and right foot static periods, the difference between the second foot landing time and the first foot landing time is used as the first foot static period within the group of left and right foot static periods. If the difference is a negative number, the first foot static period within the group of left and right foot static periods is determined to be an incorrect static period.

[0041] For the static period of the first leg, a supplementary static period is inserted at the end time of the static period of the first leg preceding the incorrect static period. The start time of the supplementary static period is the end time of the static period of the previous first leg, and the end time of the supplementary static period is the time from the start time to the end of the multiple frames of inertial data and does not exceed the start time of the static period of the first leg following the incorrect static period.

[0042] For example, determine which foot starts the first static period of the left foot or the right foot. If the left foot starts the first static period earlier, the completion order is left first and then right; otherwise, the completion order is right first and then left.

[0043] Take left first and right later as an example:

[0044] Left first, then right, that is, from the time the left foot touches down to the time the right foot steps down and before the right foot steps again, this period is considered a group of left and right foot static periods; all the static periods of the left and right feet are grouped in this one-to-one correspondence (i.e., one left foot static period corresponds to one right foot static period); after grouping, the time difference within each group of left and right foot static periods is subtracted from the time the left foot touches down to obtain the time difference within the left and right foot static periods (this difference is the left foot static period). If the difference is a negative number, it means that there is a problem with the left foot static period within this group of left and right foot static periods (i.e., the incorrect static period mentioned above). For the static period of the walking foot, a static period needs to be inserted before this incorrect static period. The start time of the inserted period (i.e., the completed static period) is the end time of the left foot static period before the incorrect static period, and the end time of the inserted period is the time from the start time of the inserted period to the end of the number of consecutive frames of static detection (i.e., the multiple frames of inertial data mentioned above), and it does not exceed the start time of the next left foot static period after the incorrect static period. After the insertion period, it is necessary to re-group the left and right foot static periods starting from the insertion position, and then continue the analysis until the subsequent processing is completed.

[0045] In some optional implementations of this embodiment, in order to further improve the accuracy and authenticity of the real-time gait cycle rhythm, it is proposed to set different weights for temporary gait cycle rhythms in different time periods to dynamically and in real time calculate the real-time gait cycle rhythm that can reflect the current gait performance. For example, according to the second preset time length, the real-time gait cycle rhythm is calculated based on at least two of the temporary gait cycle rhythms, including:

[0046] According to the time sequence, if the ordinal number of the current second preset time length is less than or equal to the preset ordinal number, different weights are set for all the temporary gait cycle rhythms between the current second preset time length and the first second preset time length, and a weighted sum is performed based on all the temporary gait cycle rhythms and the corresponding weights to obtain the real-time gait cycle rhythm corresponding to the current second preset time length;

[0047] According to the chronological order, if the sequence number of the current second preset time length is greater than the preset sequence number, the same weight is set for all the temporary gait cycle rhythms between the current second preset time length and the second preset time length of the preset sequence number, and a weighted sum is performed based on all the temporary gait cycle rhythms and the corresponding weights to obtain the real-time gait cycle rhythm corresponding to the current second preset time length.

[0048] For example, M represents the second preset duration (for example, it can be 10, 20 seconds, etc., and the specific duration can be determined according to actual needs). At the Mth second after the start of the gait intervention, at least two temporary gait cycle rhythms are analyzed based on the collected gait data (inertial data) of the target object. At the Mth second, the current real-time gait cycle rhythm is calculated based on the at least two temporary gait cycle rhythms and with different weights to adjust the most suitable beat and music rhythm, and the beat or music starts to play at this time. At the 2Mth and 3Mth seconds after the start of the gait intervention, the real-time gait cycle rhythm at the current moment is analyzed based on all temporary gait cycle rhythms between the current moment and the start moment of the gait intervention and with different weights, such as, , S is the real-time gait cycle rhythm, sp1 is the first temporary gait cycle rhythm, para1 is the weight of the first temporary gait cycle rhythm, spN is the Nth temporary gait cycle rhythm, and paraN is the weight of the Nth temporary gait cycle rhythm. At 4M seconds, 5M seconds, and so on after the start of the gait intervention, the target subject's gait is considered to have stabilized. The real-time gait cycle rhythm at the current moment is then determined by applying the same weight to all temporary gait cycles between the current moment and 3M seconds (3M is the second preset duration, 3 being the preset number), calculating the value of S = (sp1 + ... + spN) / N.

[0049] In some optional implementations of this embodiment, in order to achieve that different weights of different temporary gait cycle rhythms can reflect the stability of gait in the corresponding period, different weights are set for all the temporary gait cycle rhythms between the current second preset time length and the first second preset time length, including:

[0050] According to the time sequence of the plurality of temporary gait cycle rhythms, the weight of the temporary gait cycle rhythm that is earlier in the time sequence is lower, and the weight of the temporary gait cycle rhythm that is later in the time sequence is higher.

[0051] Specifically, different weights of the multiple temporary gait cycle rhythms are calculated using the following formula:

[0052]

[0053] Among them, para i is the weight of the temporary gait cycle rhythm of the i-th time sequence, and a is the preset basic weight, such as , i is the temporal order of the temporary gait cycle rhythm, i is a positive integer starting from 0, b is the weight increment, , N is the total number of all temporary gait cycle rhythms involved in the calculation.

[0054] In some optional implementations of this embodiment, in order to dynamically and effectively adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm, so that the adjusted rhythm of the rhythmic audio is in sync with the current gait, the rationality and effectiveness of the rhythmic audio setting are improved, and thereby the rehabilitation treatment and intervention effect of abnormal gait are improved, for example, the rhythm of the rhythmic audio is dynamically adjusted according to the real-time gait cycle rhythm, including:

[0055] If the ordinal number of the second preset duration is less than or equal to the preset ordinal number, setting the real-time gait cycle rhythm corresponding to the second preset duration as the rhythm of the rhythmic audio;

[0056] If the sequence number of the current second preset time length is greater than the preset sequence number, then the number of temporary gait cycle rhythms that are greater than or equal to the rhythm of the current rhythmic audio is determined among all the temporary gait cycle rhythms between the current second preset time length and the second preset time length of the preset sequence number, and the proportion of this number in all the temporary gait cycle rhythms is regarded as the matching ratio; when the matching ratio is greater than or equal to the first preset ratio, the rhythm of the current rhythmic audio is increased according to the first preset amplitude between the upper limit rhythm and the lower limit rhythm of the rhythmic audio; when the matching ratio is less than or equal to the second preset ratio, the rhythm of the current rhythmic audio (the rhythm of the rhythmic audio is the number of beats within the preset time length or the number of accents of the music within the preset time length) is reduced according to the second preset amplitude between the upper limit rhythm and the lower limit rhythm of the rhythmic audio; when the matching ratio is less than the first preset ratio and greater than the second preset ratio, the rhythm of the current rhythmic audio is maintained unchanged, and the first preset ratio is greater than the second preset ratio.

[0057] The following describes the abnormal gait intervention and correction method based on rhythmic auditory stimulation, using a specific example of abnormal gait intervention treatment. For example, the method includes the following steps:

[0058] 1. The patient (target subject) wears inertial sensors on their left and right feet.

[0059] 2. Open the installed mobile app and wait for the software to automatically connect to the inertial sensor.

[0060] 3. Choose beat mode or music mode according to the patient's preference.

[0061] 4. Click the start button and the patient begins walking according to the beat pattern or music pattern to intervene and correct abnormal gait.

[0062] In this process, the continuous gait data frames sent back by the sensor are cached in the first container in the order of the time when the data is generated, and the speed data (such as angular velocity, acceleration, etc.) is less than the speed threshold and multiple frames of continuous inertial data are obtained from the first container at fixed time intervals (i.e., the first preset time length mentioned above). Based on the analysis of the multiple frames of inertial data, multiple static periods corresponding to the left and right feet are obtained (for example, taking the left foot as an example, the time or duration from the start of the left foot landing to the landing of the right foot after taking a step is a static period of the left foot). According to the start time and end time of the static period corresponding to the left and right feet, the motion periods corresponding to the left and right feet are calculated respectively (for example, taking the left foot as an example, there is a static period before and after a motion period, the end time of the previous static period is the start time of the motion period, and the start time of the next static period is the motion period). The end time of the movement cycle), the time length from the start of the left foot being still to the start of the right foot being still after taking a step is determined as the time length of the right foot movement cycle, the time length from the start of the right foot being still to the start of the left foot being still after taking a step is determined as the time length of the left foot movement cycle, the time lengths of all the right foot movement cycles within the first preset time length are averaged to obtain the average right foot movement cycle time length, the time lengths of all the left foot movement cycles within the first preset time length are averaged to obtain the average left foot movement cycle time length, the average right foot movement cycle time length and the average left foot movement cycle time length are averaged, the obtained average is determined as the step time length, the number of the step time lengths included in the preset time length is determined, the number is used as the temporary gait cycle rhythm (also called temporary rhythm sample) within the first preset time length, and the temporary rhythm sample is cached in the second container. Subsequently, the actual rhythm (i.e., the real-time gait cycle rhythm) is derived based on multiple temporary rhythm samples according to the time interval of the second preset time length. The calculation process of the temporary rhythm sample sp:

[0063] A. Set the stillness detection threshold (i.e., speed threshold) and the number of consecutive frames for stillness detection (i.e., multiple frames of inertial data);

[0064] B. Find the motion / non-motion (i.e., stillness) periods corresponding to the left and right feet based on the stillness detection threshold and the number of consecutive frames.

[0065] C. Eliminate incomplete motion / non-motion data at the beginning of the data that does not reach the number of consecutive frames;

[0066] D. Abnormal data within a cycle are eliminated: multiple complete right foot movement cycles (from foot lift to foot landing) within a left foot static cycle, and multiple complete left foot movement cycles (from foot lift to foot landing) within a right foot static cycle;

[0067] E. If there are normal static gaits that are not recorded due to the threshold being too high or the number of consecutive frames being insufficient, then the unrecorded gaits will be completed;

[0068] Gait completion process:

[0069] 1) Determine the start time of the first static period of the left and right feet. If the left foot's first static period starts earlier, the completion order is not left first then right; otherwise, the completion order is right first then left.

[0070] 2) Take left first and right second as an example:

[0071] Left first, then right, that is, from the time the left foot touches down to the time the right foot steps down and before the right foot steps again, this period is considered a group of left and right foot static periods; all the static periods of the left and right feet are grouped in this one-to-one correspondence (i.e., one left foot static period corresponds to one right foot static period); after grouping, the time difference within each group of left and right foot static periods is subtracted from the time the left foot touches down to obtain the time difference within the left and right foot static periods (this difference is the left foot static period). If the difference is a negative number, it means that there is a problem with the left foot static period within this group of left and right foot static periods (i.e., the incorrect static period mentioned above). For the static period of the walking foot, a static period needs to be inserted before this incorrect static period. The start time of the inserted period (i.e., the completed static period) is the end time of the left foot static period before the incorrect static period, and the end time of the inserted period is the time from the start time of the inserted period to the end of the number of consecutive frames of static detection (i.e., the multiple frames of inertial data mentioned above), and it does not exceed the start time of the next left foot static period after the incorrect static period. After the insertion period, it is necessary to re-group the left and right foot static periods starting from the insertion position, and then continue the analysis until the subsequent processing is completed.

[0072] 5. M seconds after the start of gait intervention, at least two temporary gait cycle rhythms are analyzed based on the collected gait data (inertial data) of the target subject. At the Mth second, the current real-time gait cycle rhythm is calculated based on the at least two temporary gait cycle rhythms and with different weights to adjust the most suitable beat and music rhythm. At this time, the beat or music begins to play.

[0073] 6. 2M and 3M seconds after the start of the gait intervention, the real-time gait cycle rhythm at the current moment is calculated based on all temporary gait cycle rhythms between the current moment and the start of the gait intervention, and the most suitable beat and music rhythm are adjusted. At this time, the beat or music that is already playing is frequency-modulated.

[0074] Subsequently, at the 4Mth second, 5Mth second, and so on, all temporary gait cycle rhythms between the current moment and the 3Mth moment (3M is the second preset duration of the preset sequence number, and 3 is the preset sequence number) are analyzed with the same weight to obtain the real-time gait cycle rhythm of the current moment.

[0075] The actual rhythm S is obtained based on multiple temporary rhythm samples

[0076] Calculation method for Mth second, 2Mth second, and 3Mth second:

[0077] After the gait intervention begins, the user's current real-time gait cycle rhythm will be analyzed based on the number of temporary rhythm samples sp at the Mth second, 2Mth second, and 3Mth second respectively. During each analysis, a calculation weight will be assigned to the temporary rhythm sample sp according to its ranking. The higher the ranking, the lower the weight of the temporary rhythm sample, and the later the ranking, the higher the weight of the temporary rhythm sample. Considering that the user's gait will gradually stabilize after the intervention, different weights are assigned to analyze a rhythm that is closer to the user's actual rhythm. The weight para of each temporary rhythm sample sp is calculated as follows:

[0078]

[0079] Among them, parai is the weight of the temporary gait cycle rhythm of the i-th time sequence, a is the preset basic weight, , i is the temporal order of the temporary gait cycle rhythm, i is a positive integer starting from 0, b is the weight increment, , N is the total number of all temporary gait cycle rhythms involved in the calculation

[0080] Real-time gait cycle rhythm .

[0081] 7. Calculation method for real-time gait cycle rhythm at 4M seconds and 5M seconds after the start of gait intervention:

[0082] Starting from 3M seconds, every time N temporary rhythm samples sp are accumulated, analysis is performed (the weight of each temporary rhythm sample sp is equal during the analysis process) to obtain the latest real-time gait cycle rhythm and update the music beat.

[0083] At this time, the real-time gait cycle rhythm S=(sp1+...+spN) / N.

[0084] Dynamically adjust the current beat (frequency change) or music (switch music with corresponding beat or change the frequency of current music) according to the calculated actual rhythm (real-time gait cycle rhythm). The gait rhythm of the foot with a faster frequency between the left and right feet (i.e., the number of steps of the faster foot within the preset time length) is used as the upper limit of the maximum frequency of the rhythm of the rhythmic audio, and the lower limit of the rhythm of the rhythmic audio is preset (such as set to 40); if the ordinal number of the current second preset time length is less than or equal to the preset ordinal number, the real-time gait cycle rhythm corresponding to the current second preset time length is set as the rhythm of the rhythmic audio, that is, for the Mth, 2Mth, and 3Mth seconds, the calculated real-time gait cycle rhythm is directly set as the rhythm of the rhythmic audio; if the ordinal number of the current second preset time length is greater than the preset ordinal number (such as the 4Mth, 5Mth seconds...etc.), then the number of temporary gait cycle rhythms greater than or equal to the rhythm of the current rhythmic audio is determined from all the temporary gait cycle rhythms between the current second preset time length and the second preset time length of the preset ordinal number, and the proportion of this number in all the temporary gait cycle rhythms is regarded as the matching ratio; when the matching ratio is greater than or equal to the first preset ratio, the number of temporary gait cycle rhythms in the rhythmic audio is determined. When the matching ratio is less than or equal to the second preset ratio, the rhythm of the current rhythmic audio is increased according to the first preset amplitude. When the matching ratio is less than or equal to the second preset ratio, the rhythm of the current rhythmic audio (the rhythm of the rhythmic audio is the number of beats within a preset duration or the number of accents of the music within a preset duration) is reduced according to the second preset amplitude. When the matching ratio is less than the first preset ratio and greater than the second preset ratio, the rhythm of the current rhythmic audio is maintained unchanged. The first preset ratio is greater than the second preset ratio. If the matching ratio is greater than 80% (the first preset ratio), the higher the matching ratio, the greater the n% amplitude (i.e., the first preset amplitude, the size of n can be set according to the matching ratio) of the rhythmic audio to be increased. If the matching ratio is between 60% and 80%, the current rhythm is maintained. If the matching ratio is less than 60% (the second preset ratio), the rhythm of the rhythmic audio is reduced by 1% (i.e., the second preset amplitude). In specific implementation, the above-mentioned abnormal gait intervention and correction method based on rhythmic auditory stimulation can accurately and effectively intervene and correct according to the user's real-time gait level, reducing the user's learning cost and greatly improving the user's acceptance. It has the following advantages:

[0085] 1. Gait frame rate data resampling technology uses temporary rhythm samples to address the problem of inaccurate calculated rhythm due to differences in return rates between left and right foot sensors.

[0086] 2. A specialized gait data frame completion method addresses the problem of sensor-based compensation thresholds. This problem, caused by cleaning and filtering continuous gait data frames, results in inconsistent valid frame counts for the left and right foot sensors, leading to deviations in gait rhythm calculations.

[0087] 3. Through real-time dynamic adjustment of the algorithm, it solves the problems of no intervention effect or easy fatigue during the patient's gait intervention process, shortened gait intervention time, and unclear effect improvement.

[0088] Continue to see Figure 2 , Figure 2 FIG. 1 is a schematic diagram of an application scenario of the abnormal gait intervention and correction method based on rhythmic auditory stimulation according to this embodiment. Figure 2 In the application scenario, the execution subject 201 collects the inertial data 202 of the target object's two feet in real time during the process of the target object undergoing abnormal gait intervention treatment based on rhythmic audio. The execution subject 201 uses the first preset time length as the time interval, calculates the temporary gait cycle rhythm based on the inertial data within each of the first preset time lengths, and obtains multiple temporary gait cycle rhythms 203. The execution subject 201 uses the second preset time length as the time interval, and calculates the real-time gait cycle rhythm 204 based on at least two of the temporary gait cycle rhythms according to the second preset time length, wherein the second preset time length is greater than the first preset time length. The execution subject 201 dynamically adjusts the rhythm of the rhythmic audio 205 according to the real-time gait cycle rhythm, so that the adjusted rhythm of the rhythmic audio is in sync with the current real-time gait cycle rhythm, and performs rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

[0089] Further references Figure 3 As an implementation of the methods shown in the above figures, the present application provides an embodiment of an abnormal gait intervention and correction device based on rhythmic auditory stimulation. Figure 1 Corresponding to the method embodiment shown, in addition to the features described below, the device embodiment may also include Figure 1 The device can be applied to various electronic devices.

[0090] like Figure 3As shown, the abnormal gait intervention and correction device 300 based on rhythmic auditory stimulation of this embodiment includes: a data acquisition unit 301, a first gait rhythm calculation unit 302, a second gait rhythm calculation unit 303 and a rhythm adjustment unit 304. Among them, the data acquisition unit 301 is configured to collect the inertial data of the target object's two feet in real time during the process of the target object undergoing abnormal gait intervention treatment based on rhythmic audio; the first gait rhythm calculation unit 302 is configured to use a first preset time length as a time interval, and calculate a temporary gait cycle rhythm based on the inertial data within each first preset time length to obtain multiple temporary gait cycle rhythms; the second gait rhythm calculation unit 303 is configured to use a second preset time length as a time interval, and calculate the real-time gait cycle rhythm based on at least two temporary gait cycle rhythms according to the second preset time length, wherein the second preset time length is greater than the first preset time length; the rhythm adjustment unit 304 is configured to dynamically adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm, so that the rhythm of the adjusted rhythmic audio is in sync with the current real-time gait cycle rhythm, and perform rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

[0091] In this embodiment, the specific processing of the data acquisition unit 301, the first gait rhythm calculation unit 302, the second gait rhythm calculation unit 303 and the rhythm adjustment unit 304 of the abnormal gait intervention correction device 300 based on rhythmic auditory stimulation and the technical effects thereof can be referred to respectively. Figure 1 The relevant descriptions of step 101, step 102, step 103 and step 104 in the corresponding embodiment are not repeated here.

[0092] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0093] like Figure 4 , is a block diagram of an electronic device according to an abnormal gait intervention correction method based on rhythmic auditory stimulation according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0094] like Figure 4As shown, the electronic device includes: one or more processors 401, a memory 402, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 4 A processor 401 is taken as an example.

[0095] Memory 402 is the non-transitory computer-readable storage medium provided in this application. The memory stores instructions executable by at least one processor, causing the at least one processor to execute the abnormal gait intervention and correction method based on rhythmic auditory stimulation provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions for causing a computer to execute the abnormal gait intervention and correction method based on rhythmic auditory stimulation provided in this application.

[0096] The memory 402 is a non-transitory computer-readable storage medium that can be used to store non-transitory software programs, non-transitory computer executable programs and modules, such as the program instructions / modules corresponding to the abnormal gait intervention correction method based on rhythmic auditory stimulation in the embodiment of the present application (for example, the attached Figure 3 The processor 401 executes the non-transient software programs, instructions, and modules stored in the memory 402 to execute various functional applications and data processing of the server, thereby implementing the abnormal gait intervention and correction method based on rhythmic auditory stimulation in the above-mentioned method embodiment.

[0097] The memory 402 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and application programs required for at least one function; the data storage area may store data created based on the use of an electronic device for an abnormal gait intervention and correction method based on rhythmic auditory stimulation, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 402 may optionally include a memory remotely located relative to the processor 401, and these remote memories may be connected to the electronic device for the abnormal gait intervention and correction method based on rhythmic auditory stimulation via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0098] The electronic device of the abnormal gait intervention correction method based on rhythmic auditory stimulation may further include: an input device 403 and an output device 404. The processor 401, the memory 402, the input device 403 and the output device 404 may be connected via a bus or other means. Figure 4 The bus connection is taken as an example.

[0099] The input device 403 can receive input digital or character information and generate key signal input related to user settings and function control of the electronic device for the rhythmic auditory stimulation-based abnormal gait intervention and correction method. Input devices such as a touch screen, keypad, mouse, trackpad, touchpad, indicator stick, one or more mouse buttons, trackball, joystick, and the like can be used. The output device 404 can include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibration motors). The display device may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

[0100] Various implementations of the systems and techniques described herein can be realized in digital electronic circuitry, integrated circuitry, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpreted on a programmable system comprising at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0101] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a magnetic disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0102] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0103] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0104] Computer systems may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The client and server relationship arises through computer programs running on the respective computers and having a client-server relationship to each other.

[0105] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0106] The units involved in the embodiments described in this application can be implemented by software or hardware. The units described can also be set in a processor. For example, it can be described as: a processor includes a data acquisition unit, a first gait rhythm calculation unit, a second gait rhythm calculation unit, and a rhythm adjustment unit. In some cases, the names of these units do not constitute a limitation on the units themselves. For example, the data acquisition unit can also be described as a "unit for collecting inertial data."

[0107] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently and not be assembled into the device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the device, the device causes the device to: collect inertial data of the target object's feet in real time during the process of abnormal gait intervention treatment based on rhythmic audio; use a first preset time as a time interval, calculate a temporary gait cycle rhythm based on the inertial data within each first preset time, and obtain multiple temporary gait cycle rhythms; use a second preset time as a time interval, and calculate a real-time gait cycle rhythm based on at least two temporary gait cycle rhythms according to the second preset time, wherein the second preset time is greater than the first preset time; dynamically adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm, so that the adjusted rhythm of the rhythmic audio is in sync with the current real-time gait cycle rhythm, and perform rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

[0108] The above description is merely a preferred embodiment of the present application and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of the invention herein is not limited to technical solutions formed by a specific combination of the aforementioned technical features. It also encompasses other technical solutions formed by any combination of the aforementioned technical features or their equivalents, without departing from the aforementioned inventive concept. For example, a technical solution formed by replacing the aforementioned features with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A rhythm determination method for intervention and correction of abnormal gait based on rhythmic auditory stimulation, the method comprising: During the process of the target subject performing abnormal gait intervention and correction according to the rhythmic audio, inertial data of both feet of the target subject are collected in real time; Taking a first preset time length as a time interval, calculating a temporary gait cycle rhythm according to the inertial data within each first preset time length, to obtain a plurality of temporary gait cycle rhythms; Using a second preset time length as a time interval, and calculating a real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset time length, wherein the second preset time length is greater than the first preset time length; The rhythm of the rhythmic audio is dynamically adjusted according to the real-time gait cycle rhythm, so that the rhythm of the rhythmic audio after adjustment is in sync with the current real-time gait cycle rhythm.

2. The method according to claim 1, wherein Calculating a temporary gait cycle rhythm according to the inertial data within each first preset time period includes: Extracting, from the inertial data within each first preset time period, a plurality of consecutive frames of inertial data having speed data less than a speed threshold, in descending order of the inertial data collection time; Calculating the respective stationary periods of the left and right feet based on the multiple frames of inertial data, and calculating the respective movement periods of the left and right feet based on the start and end times of the respective stationary periods. Determining the duration from the time the left foot begins to be stationary to the time the right foot begins to be stationary after taking a step as the duration of the right foot movement period, and determining the duration from the time the right foot begins to be stationary to the time the left foot begins to be stationary after taking a step as the duration of the left foot movement period. The durations of all the right foot movement cycles within the first preset time length are averaged to obtain the average right foot movement cycle duration, the durations of all the left foot movement cycles within the first preset time length are averaged to obtain the average left foot movement cycle duration, the average right foot movement cycle duration and the average left foot movement cycle duration are averaged, and the obtained average is determined as the step duration, the number of the step durations within the preset time length is determined, and the number is used as the temporary gait cycle rhythm within the first preset time length.

3. The method according to claim 2, wherein: Also includes: According to the multiple frames of inertial data, the time from the first foot landing to the second foot stepping and continuing until the second foot steps again is determined as a set of left and right foot static periods; In each set of left and right foot static periods, the difference between the second foot landing time and the first foot landing time is used as the static period of the first foot in the set of left and right foot static periods. If the difference is a negative number, the static period of the first foot in the set of left and right foot static periods is determined to be an incorrect static period. For the static period of the first leg, a supplementary static period is inserted at the end time of the static period of the first leg preceding the incorrect static period. The start time of the supplementary static period is the end time of the static period of the previous first leg, and the end time of the supplementary static period is the time from the start time to the end of the multiple frames of inertial data and does not exceed the start time of the static period of the first leg following the incorrect static period.

4. The method according to any one of claims 1 to 3, wherein Calculating the real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset time period includes: According to the time sequence, if the ordinal number of the current second preset time length is less than or equal to the preset ordinal number, different weights are set for all the temporary gait cycle rhythms between the current second preset time length and the first second preset time length, and a weighted sum is performed based on all the temporary gait cycle rhythms and the corresponding weights to obtain the real-time gait cycle rhythm corresponding to the current second preset time length; According to the chronological order, if the sequence number of the current second preset time length is greater than the preset sequence number, the same weight is set for all the temporary gait cycle rhythms between the current second preset time length and the second preset time length of the preset sequence number, and a weighted sum is performed based on all the temporary gait cycle rhythms and the corresponding weights to obtain the real-time gait cycle rhythm corresponding to the current second preset time length.

5. The method according to claim 4, wherein Setting different weights for all the temporary gait cycle rhythms between the current second preset time length and the first second preset time length respectively includes: According to the time sequence of all the temporary gait cycle rhythms, the weight of the temporary gait cycle rhythm that is earlier in the time sequence is lower, and the weight of the temporary gait cycle rhythm that is later in the time sequence is higher.

6. The method according to claim 5, wherein: The different weights of all the temporary gait cycle rhythms are calculated by the following formula: Among them, para i is the weight of the temporary gait cycle rhythm of the i-th time sequence, a is the preset basic weight, i is the time sequence number of the temporary gait cycle rhythm, i is a positive integer starting from 0, b is the weight increment, , N is the total number of all temporary gait cycle rhythms involved in the calculation.

7. The method according to claim 4, wherein: Dynamically adjusting the rhythm of the rhythmic audio according to the real-time gait cycle rhythm includes: If the ordinal number of the second preset duration is less than or equal to the preset ordinal number, setting the real-time gait cycle rhythm corresponding to the second preset duration as the rhythm of the rhythmic audio; If the sequence number of the current second preset time length is greater than the preset sequence number, then the number of temporary gait cycle rhythms that are greater than or equal to the rhythm of the current rhythmic audio is determined among all the temporary gait cycle rhythms between the current second preset time length and the second preset time length of the preset sequence number, and the proportion of this number in all the temporary gait cycle rhythms is regarded as the matching ratio; when the matching ratio is greater than or equal to the first preset ratio, the rhythm of the current rhythmic audio is increased according to the first preset amplitude between the upper limit rhythm and the lower limit rhythm of the rhythmic audio; when the matching ratio is less than or equal to the second preset ratio, the rhythm of the current rhythmic audio is reduced according to the second preset amplitude between the upper limit rhythm and the lower limit rhythm of the rhythmic audio; when the matching ratio is less than the first preset ratio and greater than the second preset ratio, the rhythm of the current rhythmic audio is maintained unchanged, and the first preset ratio is greater than the second preset ratio.

8. A device for intervention and correction of abnormal gait based on rhythmic auditory stimulation, comprising: a data acquisition unit, configured to acquire inertial data of both feet of the target subject in real time during the process of the target subject undergoing abnormal gait intervention treatment based on rhythmic audio; a first gait rhythm calculation unit, configured to calculate a temporary gait cycle rhythm based on the inertial data within each first preset time period using a first preset time period as a time interval, to obtain a plurality of temporary gait cycle rhythms; a second gait rhythm calculation unit, configured to use a second preset duration as a time interval, and calculate a real-time gait cycle rhythm based on at least two of the temporary gait cycle rhythms according to the second preset duration, wherein the second preset duration is greater than the first preset duration; A rhythm adjustment unit is used to dynamically adjust the rhythm of the rhythmic audio according to the real-time gait cycle rhythm, so that the rhythm of the adjusted rhythmic audio is in sync with the current real-time gait cycle rhythm, and to perform rehabilitation treatment for the abnormal gait of the target object based on the adjusted rhythm of the rhythmic audio.

9. An electronic device comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images