A method, system, medium and device for intelligent projection monitoring of sports rehabilitation process

Abstract

The present invention relates to the technical field of intelligent rehabilitation process analysis, and more specifically, to a method, system, medium and device for intelligent monitoring of sports rehabilitation process projection. The scheme includes setting the positions of key monitoring points, setting the positions of video cameras and inertial sensors; forming information collection of the action process according to a preset action sequence, and forming online collection information; forming the action amplitude analysis results of key points according to the action records of the online collection information; forming the comprehensive recovery degree and sub-item recovery degree corresponding to the preset action sequence according to the action amplitude analysis results; completing video data extraction, and performing 3D projection, and performing holographic projection display; transmitting the holographic projection to the data analysis center, and performing online projection display according to the comprehensive recovery degree and the sub-item recovery degree. The scheme deploys a variety of high-precision sensing equipment, combines real-time data preprocessing and synchronous transmission, and uses low-dimensional space feature projection and visualization to visualize the analysis.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent rehabilitation process analysis, and more specifically, to a method, system, medium and device for intelligent monitoring of sports rehabilitation process projection. Background Art

[0002] In the field of rehabilitation analysis, the method of studying intelligent monitoring of the projection of the sports rehabilitation process is to accurately capture the biomechanical data of the patient during the movement through high-tech sensors and data analysis software, and use algorithms to project complex data into an easy-to-understand low-dimensional space for visualization. The significance of this monitoring method is to provide clinicians with real-time and objective motor function evaluation, optimize rehabilitation plans, and provide patients with intuitive feedback to enhance their enthusiasm for participating in rehabilitation. The importance is reflected in the ability to significantly improve rehabilitation efficiency, reduce subjective bias, personalize rehabilitation plans, and adjust treatment plans in a timely manner, ultimately helping patients recover faster and improve their quality of life.

[0003] Before the advent of the technology of the present invention, the existing projection intelligent monitoring methods for the movement rehabilitation process mainly relied on camera systems, wearable sensors and manual recording to collect patient movement data, and relied on the subjective judgment of professionals to analyze these data. The difficulty of these technologies lies in accurately capturing and processing large amounts of complex biomechanical data, and effectively converting these high-dimensional data into information that clinicians and patients can understand. The key points include improving the accuracy and real-time performance of data acquisition, developing efficient data processing algorithms to automatically identify movement features, and creating intuitive visualization tools to facilitate the interpretation and application of data. In addition, ensuring the ease of use, reliability and cost-effectiveness of the system so that it can be widely deployed in clinical settings is also an important technical challenge. Summary of the invention

[0004] In view of the above problems, the present invention proposes a projection intelligent monitoring method and system for the sports rehabilitation process, which deploys a variety of high-precision sensing devices on the patient, combines real-time data preprocessing and synchronous transmission, and uses low-dimensional spatial feature projection and visualization to visualize the analysis.

[0005] According to a first aspect of an embodiment of the present invention, a method for intelligent projection monitoring of a sports rehabilitation process is provided.

[0006] In one or more embodiments, preferably, the method for intelligently monitoring a sports rehabilitation process through projection includes:

[0007] Set the locations of key monitoring points, video cameras and inertial sensors;

[0008] According to the preset action sequence, information collection of the action process is formed to form online collection information;

[0009] According to the online information collection action record, the action amplitude analysis results of key points are formed;

[0010] According to the results of the movement range analysis, the comprehensive recovery degree and sub-item recovery degree corresponding to the preset movement sequence are formed;

[0011] Complete video data extraction, perform 3D projection to form a 3D model, and perform holographic projection display based on the 3D model;

[0012] The holographic projection is transmitted to a data analysis center, and an online projection display is performed according to the comprehensive recovery degree and the sub-item recovery degree.

[0013] In one or more embodiments, preferably, the setting of the positions of key monitoring points, the setting of the positions of video cameras and inertial sensors specifically include:

[0014] Pre-select several key monitoring points according to physician or patient needs;

[0015] Install inertial sensors at key monitoring points;

[0016] The sensors used collect information from key monitoring points online;

[0017] For the motion process, dynamic video is collected through video cameras in four directions.

[0018] In one or more embodiments, preferably, the information collection of the action process formed according to the preset action sequence to form online collection information specifically includes:

[0019] Set a preset action sequence, and play the corresponding action on a preset screen according to the action sequence;

[0020] During the playing action, the inertial sensor and the video sensor are used for online collection to form the online collection information.

[0021] In one or more embodiments, preferably, the motion amplitude analysis result of the key points formed according to the online information collection action record specifically includes:

[0022] During the playback of each action, several corresponding key monitoring points are pre-set for each action;

[0023] A preset motion direction vector is set for each key monitoring point, and the projection distance on the preset motion direction vector is calculated for each key monitoring node during each movement;

[0024] Use the first calculation formula to calculate the single fluctuation amplitude;

[0025] The first calculation formula is:

[0026] DF=max(ST)÷YZ

[0027] Among them, max() is the maximum value function of the projection distance on the preset motion direction vector during the motion process generated during the playback of each preset action, DF is the single fluctuation amplitude, ST is the projection distance on the preset motion direction vector during the motion process, and YZ is the preset maximum distance.

[0028] In one or more embodiments, preferably, the step of forming a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis result specifically includes:

[0029] Get the preset action sequence and store it in table form as an action table;

[0030] For each action, the comprehensive recovery degree is calculated using the second calculation formula;

[0031] For each moment, extract the projection distance on the preset motion direction vector corresponding to the expected moment, and use the third calculation formula to form the motion recovery degree of the key monitoring point corresponding to the current moment and the current action;

[0032] According to the action table, the comprehensive recovery degree and the sub-item recovery degree are displayed respectively, and the sub-item recovery degree is the action recovery degree of the key monitoring point corresponding to the current moment and the current action;

[0033] The second calculation formula is:

[0034] ZHF=Σi=ni=1(DF)÷n

[0035] Among them, ZHF is the comprehensive recovery degree, i is the number of several key monitoring points corresponding to the preset current action, and n is the total number of several key monitoring points corresponding to the preset current action;

[0036] The third calculation formula is:

[0037] DFF=STtime÷YZ

[0038] Among them, STtime is the maximum value function of the projection distance on the preset motion direction vector of the key monitoring point corresponding to the current moment and the current action, and DFF is the motion recovery degree of the key monitoring point corresponding to the current moment and the current action.

[0039] In one or more embodiments, preferably, the step of extracting video data, performing 3D projection to form a 3D model, and performing holographic projection display according to the 3D model specifically includes:

[0040] Four sets of videos are formed for the entire movement process;

[0041] Ensure that the four sets of videos can be captured synchronously to ensure consistency in perspective and time;

[0042] After cropping, correction and format conversion, the 3D model was created from the four sets of videos using the software tool Cinema 4D;

[0043] Map the processed video as a texture onto the corresponding 3D model;

[0044] With the help of a 45° glass screen, a holographic projection device is used to project the 3D model onto the holographic medium.

[0045] In one or more embodiments, preferably, the holographic projection is transmitted to a data analysis center, and online projection display is performed according to the comprehensive recovery degree and the item recovery degree, specifically including:

[0046] Mark the 3D models one by one according to the action table;

[0047] and marking the position of each key monitoring point in the 3D model;

[0048] The physician selects the corresponding 3D model online for display according to the action table and the corresponding comprehensive recovery degree and sub-item recovery degree based on personalized needs.

[0049] According to a second aspect of an embodiment of the present invention, a projection intelligent monitoring system for a sports rehabilitation process is provided.

[0050] In one or more embodiments, preferably, the sports rehabilitation process projection intelligent monitoring system includes:

[0051] The sensor setting module is used to set the positions of key monitoring points, video cameras and inertial sensors;

[0052] An action recording module is used to collect information about the action process according to a preset action sequence to form online collected information;

[0053] A motion analysis module, used to form motion amplitude analysis results of key points based on the online information collection motion records;

[0054] A recovery analysis module, used to form a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis results;

[0055] An associated display module is used to complete video data extraction, perform 3D projection to form a 3D model, and perform holographic projection display based on the 3D model;

[0056] The associated display module is used to transmit the holographic projection to the data analysis center and perform online projection display according to the comprehensive recovery degree and the sub-item recovery degree.

[0057] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.

[0058] According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, comprising a memory and a processor, wherein the memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement any one of the methods described in the first aspect of the embodiment of the present invention.

[0059] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0060] In the solution of the present invention, the data collected by different sensors are synchronized to the central processing unit in real time through wireless transmission to ensure the timeliness and continuity of the data. Real-time data transmission reduces the risk of data delay and loss, allowing doctors and patients to obtain feedback information in a timely manner.

[0061] In the solution of the present invention, high-dimensional biomechanical data is projected into a low-dimensional space and intuitively displayed through a graphical interface. This method simplifies the interpretation process of complex data, making it easier for doctors and patients to understand the results of motor function assessment.

[0062] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description, claims, and drawings.

[0063] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0065] Figure 1 The present invention is a flowchart of a method for intelligent projection monitoring of a sports rehabilitation process according to an embodiment of the present invention.

[0066] Figure 2The present invention is a flowchart of setting the positions of key monitoring points, video cameras and inertial sensors in a projection intelligent monitoring method for a sports rehabilitation process according to an embodiment of the present invention.

[0067] Figure 3 It is a flow chart of online information collection in a method for projection intelligent monitoring of a sports rehabilitation process in one embodiment of the present invention, which collects information about the action process according to a preset action sequence.

[0068] Figure 4 It is a flow chart of the motion amplitude analysis results of key points formed according to the online information collection action records in a projection intelligent monitoring method for a sports rehabilitation process in one embodiment of the present invention.

[0069] Figure 5 It is a flow chart of forming a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis result in a projection intelligent monitoring method for a sports rehabilitation process in one embodiment of the present invention.

[0070] Figure 6 It is a flowchart of completing video data extraction, performing 3D projection to form a 3D model, and performing holographic projection display based on the 3D model in a projection intelligent monitoring method for a sports rehabilitation process according to an embodiment of the present invention.

[0071] Figure 7 It is a flowchart of a method for intelligent projection monitoring of a sports rehabilitation process according to an embodiment of the present invention, which transmits a holographic projection to a data analysis center and performs online projection display according to the comprehensive recovery degree and the sub-item recovery degree.

[0072] Figure 8 It is a structural diagram of a projection intelligent monitoring system for a sports rehabilitation process according to an embodiment of the present invention.

[0073] Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. DETAILED DESCRIPTION

[0074] In some of the processes described in the specification and claims of the present invention and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0075] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0076] In the field of rehabilitation analysis, the method of studying intelligent monitoring of the projection of the sports rehabilitation process is to accurately capture the biomechanical data of the patient during the movement through high-tech sensors and data analysis software, and use algorithms to project complex data into an easy-to-understand low-dimensional space for visualization. The significance of this monitoring method is to provide clinicians with real-time and objective motor function evaluation, optimize rehabilitation plans, and provide patients with intuitive feedback to enhance their enthusiasm for participating in rehabilitation. The importance is reflected in the ability to significantly improve rehabilitation efficiency, reduce subjective bias, personalize rehabilitation plans, and adjust treatment plans in a timely manner, ultimately helping patients recover faster and improve their quality of life.

[0077] Before the advent of the technology of the present invention, the existing projection intelligent monitoring methods for the movement rehabilitation process mainly relied on camera systems, wearable sensors and manual recording to collect patient movement data, and relied on the subjective judgment of professionals to analyze these data. The difficulty of these technologies lies in accurately capturing and processing large amounts of complex biomechanical data, and effectively converting these high-dimensional data into information that clinicians and patients can understand. The key points include improving the accuracy and real-time performance of data acquisition, developing efficient data processing algorithms to automatically identify movement features, and creating intuitive visualization tools to facilitate the interpretation and application of data. In addition, ensuring the ease of use, reliability and cost-effectiveness of the system so that it can be widely deployed in clinical settings is also an important technical challenge.

[0078] In the embodiment of the present invention, a method, system, medium and device for intelligent monitoring of sports rehabilitation process projection are provided. The solution deploys a variety of high-precision sensor devices on the patient, combines real-time data preprocessing and synchronous transmission, and uses low-dimensional space feature projection and visualization to visualize the analysis.

[0079] According to a first aspect of an embodiment of the present invention, a method for intelligent projection monitoring of a sports rehabilitation process is provided.

[0080] Figure 1 The present invention is a flowchart of a method for intelligent projection monitoring of a sports rehabilitation process according to an embodiment of the present invention.

[0081] In one or more embodiments, preferably, the method for intelligently monitoring a sports rehabilitation process through projection includes:

[0082] S101, setting the positions of key monitoring points, and setting the positions of video cameras and inertial sensors;

[0083] S102, collecting information about the action process according to a preset action sequence to form online collected information;

[0084] S103, forming a motion amplitude analysis result of a key point according to the online information collection action record;

[0085] S104, forming a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis result;

[0086] S105, completing video data extraction, performing 3D projection to form a 3D model, and performing holographic projection display according to the 3D model;

[0087] S106, transmitting the holographic projection to a data analysis center, and performing online projection display according to the comprehensive recovery degree and the sub-item recovery degrees.

[0088] In an embodiment of the present invention, first, a variety of high-precision sensing devices are deployed on the patient, which can accurately capture the patient's motion data, including joint angles, muscle activity, and force output. The data collected by different sensors are synchronized to the central processing unit in real time through wireless transmission. This step ensures the timeliness of the data, allows continuous monitoring, and reduces data loss and delay. Advanced signal processing technology is used to filter, denoise, and normalize the raw data to clearly and accurately reflect the patient's actual movement conditions and lay a good foundation for subsequent analysis. Machine learning and pattern recognition algorithms are used to extract key biomechanical features from the processed data, such as motion smoothness, coordination, and motion rhythm, in order to facilitate a more in-depth evaluation of motor function. High-dimensional feature data is projected into low-dimensional space, principal component analysis is used to simplify the data structure, and a graphical interface is used to intuitively display it, so that both doctors and patients can easily understand the rehabilitation process. Finally, a 3D display is set up according to the monitoring data and visualization results, and the personalized rehabilitation plan is dynamically adjusted.

[0089] Figure 2 The present invention is a flowchart of setting the positions of key monitoring points, video cameras and inertial sensors in a projection intelligent monitoring method for a sports rehabilitation process according to an embodiment of the present invention.

[0090] like Figure 2 As shown, in one or more embodiments, preferably, the setting of the positions of key monitoring points, the setting of the positions of video cameras and inertial sensors specifically include:

[0091] S201. Preselect several key monitoring points according to the needs of the physician or the patient;

[0092] S202, installing inertial sensors at key monitoring points;

[0093] S203, using sensors to collect information from key monitoring points online;

[0094] S204: For the motion process, dynamic video is collected by using video cameras in four directions.

[0095] In an embodiment of the present invention, when setting the positions of key monitoring points and the positions of video cameras and inertial sensors, firstly, several key monitoring points are pre-selected according to the needs of doctors or patients. These monitoring points are usually located at key parts of the human body, such as joints, muscle groups, etc., so as to accurately capture important data during the movement. Then, inertial sensors are installed at these key monitoring points, which can collect the motion information of each monitoring point in real time, including parameters such as acceleration, angular velocity and direction. In order to fully record the patient's movement process, video cameras in four directions are used to collect dynamic videos. These four cameras are arranged in the four directions of the patient's front, back, left, and right, respectively, to ensure that the patient's movement can be captured from different angles. Through this multi-angle video acquisition, more complete and three-dimensional motion data can be provided, which is helpful for subsequent analysis and evaluation. For example, assuming that a patient is undergoing knee rehabilitation training, inertial sensors can be installed at key positions of his knee, thigh and calf, and four video cameras can be arranged around the patient. When the patient lifts his leg, the inertial sensor will record the motion data of the knee, thigh and calf in real time, and the video cameras in four directions will capture the entire movement process synchronously. In this way, doctors can comprehensively evaluate the patient's movement status and rehabilitation progress through comprehensive analysis of sensor data and video data.

[0096] Figure 3 It is a flow chart of online information collection in a method for projection intelligent monitoring of a sports rehabilitation process in one embodiment of the present invention, which collects information about the action process according to a preset action sequence.

[0097] like Figure 3 As shown, in one or more embodiments, preferably, the information collection of the action process formed according to the preset action sequence forms the online collection information, specifically including:

[0098] S301, setting a preset action sequence, and playing corresponding actions on a preset screen according to the action sequence;

[0099] S302: During the playing action, collect data online through an inertial sensor and a video sensor to form the online collection information.

[0100] In an embodiment of the present invention, when information collection of an action process is formed according to a preset action sequence, a preset action sequence is first set. These actions can be specific movements in rehabilitation training, such as leg lifting, knee bending, etc. Then, according to this action sequence, the corresponding actions are played on a preset screen. For example, assuming that the patient needs to perform a series of rehabilitation actions, such as leg lifting, knee bending, etc., each action will be displayed on the screen in sequence, and the patient will be guided to perform the corresponding action. During the playback of the action, information is collected online through inertial sensors and video sensors. Inertial sensors are installed at key parts of the patient, such as knees, thighs and calves, and the motion data of these parts are recorded in real time, including parameters such as acceleration, angular velocity and direction. At the same time, video cameras in four directions capture the patient's motion process from different angles, providing all-round visual data. This online acquisition method ensures the real-time and continuity of the data, so that doctors and patients can obtain feedback information in a timely manner. By comprehensively analyzing sensor data and video data, the patient's motion state and rehabilitation progress can be comprehensively evaluated. For example, when the patient performs a leg lifting action, the inertial sensor records the motion data of the knee, thigh and calf, and the video camera synchronously captures the entire action process. In this way, doctors can more accurately judge the patient's recovery status and optimize the rehabilitation plan by comprehensively analyzing these data.

[0101] Figure 4 It is a flow chart of the motion amplitude analysis results of key points formed according to the online information collection action records in a projection intelligent monitoring method for a sports rehabilitation process in one embodiment of the present invention.

[0102] like Figure 4 As shown, in one or more embodiments, preferably, the motion amplitude analysis result of the key points formed according to the online information collection action record specifically includes:

[0103] S401, during each action playback, pre-setting a number of corresponding key monitoring points for each action;

[0104] S402, setting a preset motion direction vector for each key monitoring point, and calculating the projection distance on the preset motion direction vector during each motion process for each key monitoring node;

[0105] S403, calculating a single fluctuation amplitude using a first calculation formula;

[0106] The first calculation formula is:

[0107] DF=max(ST)÷YZ

[0108] Among them, max() is the maximum value function of the projection distance on the preset motion direction vector during the motion process generated during the playback of each preset action, DF is the single fluctuation amplitude, ST is the projection distance on the preset motion direction vector during the motion process, and YZ is the preset maximum distance.

[0109] In an embodiment of the present invention, when the motion amplitude analysis results of key points are formed according to the online information collection action record, first, during each action playback, a number of corresponding key monitoring points are pre-set for each action. These monitoring points are usually located at key parts of the human body, such as joints, muscle groups, etc., so as to accurately capture important data during the movement process. Then, a preset motion direction vector is set for each key monitoring point, and the projection distance on the preset motion direction vector during each movement is calculated for each key monitoring node. The single fluctuation amplitude is calculated using the first calculation formula. For example, assuming that a patient is undergoing knee joint rehabilitation training, inertial sensors can be installed at key positions of the knee, thigh and calf, and four video cameras are arranged around the patient. When the patient performs a leg-lifting action, the inertial sensor will record the motion data of the knee, thigh and calf in real time, and the video cameras in four directions will synchronously capture the entire action process. Through this multi-angle data collection, more complete and three-dimensional motion data can be provided, which is helpful for subsequent analysis and evaluation.

[0110] Figure 5 It is a flow chart of forming a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis result in a projection intelligent monitoring method for a sports rehabilitation process in one embodiment of the present invention.

[0111] like Figure 5 As shown, in one or more embodiments, preferably, the comprehensive recovery degree and sub-item recovery degree corresponding to the preset action sequence are formed according to the action amplitude analysis result, specifically including:

[0112] S501, obtaining a preset action sequence and storing it in a table form as an action table;

[0113] S502, for each action, calculating the comprehensive recovery degree using the second calculation formula;

[0114] S503, for each moment, extract the expected corresponding projection distance on the preset motion direction vector, and use the third calculation formula to form the action recovery degree of the key monitoring point corresponding to the current moment and the current action;

[0115] S504, displaying the comprehensive recovery degree and the sub-item recovery degree respectively according to the action table, wherein the sub-item recovery degree is the action recovery degree of the key monitoring point corresponding to the current moment and the current action;

[0116] The second calculation formula is:

[0117] ZHF=Σi=ni=1(DF)÷n

[0118] Among them, ZHF is the comprehensive recovery degree, i is the number of several key monitoring points corresponding to the preset current action, and n is the total number of several key monitoring points corresponding to the preset current action;

[0119] The third calculation formula is:

[0120] DFF=STtime÷YZ

[0121] Among them, STtime is the maximum value function of the projection distance on the preset motion direction vector of the key monitoring point corresponding to the current moment and the current action, and DFF is the motion recovery degree of the key monitoring point corresponding to the current moment and the current action.

[0122] In an embodiment of the present invention, when the comprehensive recovery degree and sub-item recovery degree corresponding to the preset action sequence are formed according to the result of the action amplitude analysis, the preset action sequence is first obtained and an action table is formed. This table lists all the rehabilitation actions that the patient needs to perform, and each action corresponds to a set of key monitoring points. For each action, the comprehensive recovery degree is calculated using the second calculation formula; for each moment, the projection distance on the preset motion direction vector corresponding to the expected corresponding is extracted, and the action recovery degree of the key monitoring point corresponding to the current moment and the current action is formed using the third calculation formula; is the maximum value function of the projection distance on the preset motion direction vector of the key monitoring point corresponding to the current moment and the current action, and according to the action table, the comprehensive recovery degree and sub-item recovery degree are displayed respectively. The comprehensive recovery degree reflects the overall recovery of the patient after completing the entire action sequence, while the sub-item recovery degree shows the recovery progress of each specific action. For example, assuming that a patient is undergoing knee rehabilitation training, inertial sensors can be installed at key positions of the knee, thigh and calf, and four video cameras can be arranged around the patient. When the patient performs a leg lift, the inertial sensor will record the motion data of the knee, thigh and calf in real time, and the video cameras in four directions will capture the entire action process synchronously. This multi-angle data collection can provide more complete and three-dimensional motion data, which is helpful for subsequent analysis and evaluation.

[0123] Figure 6 It is a flowchart of completing video data extraction, performing 3D projection to form a 3D model, and performing holographic projection display based on the 3D model in a projection intelligent monitoring method for a sports rehabilitation process according to an embodiment of the present invention.

[0124] like Figure 6As shown, in one or more embodiments, preferably, the video data extraction is completed, 3D projection is performed to form a 3D model, and holographic projection display is performed according to the 3D model, specifically including:

[0125] S601, forming four groups of videos for the entire movement process;

[0126] S602, ensuring that the four sets of videos can be captured synchronously to ensure consistency in viewing angle and time;

[0127] S603, after cropping, correction and format conversion, a 3D model is established based on the four sets of videos using the software tool Cinema 4D;

[0128] S604, mapping the processed video as a texture onto the corresponding 3D model;

[0129] S605. With the aid of a 45° glass screen, use a holographic projection device to project the 3D model onto a holographic medium.

[0130] In an embodiment of the present invention, after completing the video data extraction, performing 3D projection to form a 3D model, and then performing holographic projection display according to the 3D model, four sets of videos are first formed for the entire movement process. These videos capture the patient's movement from four directions, front, back, left, and right, respectively, to ensure that all important angles and time points can be captured synchronously, and to ensure consistency in perspective and time. Next, a 3D model is established based on these four sets of videos using the software tool Cinema 4D through cropping, correction, and format conversion. Cinema 4D is a professional 3D modeling, animation, and rendering software that can help convert multi-angle video data into an accurate three-dimensional model. Then, the processed video is mapped as a texture to the corresponding 3D model, so that the model not only has shape information, but also contains rich surface details and color information. Finally, with the help of a 45° glass screen, a holographic projection device is used to project the 3D model onto a holographic medium. The 45° glass screen is a specially designed transparent screen that can reflect light at a 45-degree angle, thereby achieving a high-quality holographic projection effect. Holographic projection equipment uses lasers or other light sources to project three-dimensional models onto holographic media to form realistic three-dimensional images. For example, if a patient is undergoing knee rehabilitation training, inertial sensors can be installed at key locations of the patient's knees, thighs, and calves, and four video cameras can be placed around the patient. When the patient lifts his legs, the inertial sensors will record the movement data of the knees, thighs, and calves in real time, while the video cameras in four directions will capture the entire movement process synchronously. Through the above steps, these video data are converted into 3D models and displayed using holographic projection technology. Doctors can observe the patient's movements from different angles and evaluate their rehabilitation progress.

[0131] Figure 7It is a flowchart of a method for intelligent projection monitoring of a sports rehabilitation process according to an embodiment of the present invention, which transmits a holographic projection to a data analysis center and performs online projection display according to the comprehensive recovery degree and the sub-item recovery degree.

[0132] like Figure 7 As shown, in one or more embodiments, preferably, the holographic projection is transmitted to a data analysis center, and online projection display is performed according to the comprehensive recovery degree and the sub-item recovery degree, specifically including:

[0133] S701, marking the 3D models one by one according to the action table;

[0134] S702, and marking the position of each key monitoring point in the 3D model;

[0135] S703: The physician selects the corresponding 3D model online for display according to the action table and the corresponding comprehensive recovery degree and sub-item recovery degree based on personalized needs.

[0136] In an embodiment of the present invention, when the holographic projection is transmitted to the data analysis center and the online projection display is performed according to the comprehensive recovery degree and the sub-item recovery degree, the 3D model is first marked one by one according to the action table. This action table lists all the rehabilitation actions that the patient needs to perform, and each action corresponds to a set of key monitoring points. In this way, it can be ensured that the position of each action in the 3D model is accurately marked. Next, the position of each key monitoring point in the 3D model is marked. These key monitoring points are usually located in important parts of the human body, such as joints, muscle groups, etc., so as to accurately capture important data during the movement. Through this marking method, the specific position and movement trajectory of each action can be clearly displayed. According to personalized needs, the physician selects the corresponding 3D model online for display according to the action table and the corresponding comprehensive recovery degree and sub-item recovery degree. The comprehensive recovery degree reflects the overall recovery of the patient after completing the entire action sequence, while the sub-item recovery degree shows the recovery progress of each specific action. For example, assuming that a patient is undergoing knee rehabilitation training, inertial sensors can be installed at key positions of the knee, thigh and calf, and four video cameras are arranged around the patient. When the patient lifts his legs, the inertial sensor records the movement data of the knee, thigh and calf in real time, while the video cameras in four directions synchronously capture the entire movement process. Through the above steps, these video data are converted into a 3D model and displayed using holographic projection technology.

[0137] According to a second aspect of an embodiment of the present invention, a projection intelligent monitoring system for a sports rehabilitation process is provided.

[0138] Figure 8It is a structural diagram of a projection intelligent monitoring system for a sports rehabilitation process according to an embodiment of the present invention.

[0139] In one or more embodiments, preferably, the sports rehabilitation process projection intelligent monitoring system includes:

[0140] The sensor setting module 801 is used to set the positions of key monitoring points, video cameras and inertial sensors;

[0141] The action recording module 802 is used to collect information about the action process according to a preset action sequence to form online collected information;

[0142] The motion analysis module 803 is used to form a motion amplitude analysis result of key points according to the online information collection motion record;

[0143] The recovery analysis module 804 is used to form a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis result;

[0144] The associated display module 805 is used to complete the video data extraction, perform 3D projection to form a 3D model, and perform holographic projection display according to the 3D model;

[0145] The associated display module 806 is used to transmit the holographic projection to the data analysis center and perform online projection display according to the comprehensive recovery degree and the sub-item recovery degree.

[0146] In the embodiment of the present invention, a system suitable for different structures is realized through a series of modular designs. The system can achieve closed-loop, reliable and efficient execution through collection, analysis and control.

[0147] According to a third aspect of an embodiment of the present invention, there is provided a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described in any one of the first aspect of the embodiment of the present invention is implemented.

[0148] According to a fourth aspect of an embodiment of the present invention, an electronic device is provided. Fig. 9 It is a structural diagram of an electronic device in one embodiment of the present invention. Fig. 9The electronic device shown is a general-purpose sports rehabilitation process projection intelligent monitoring device, which includes a general-purpose computer hardware structure, which at least includes a processor 901 and a memory 902. The processor 901 and the memory 902 are connected via a bus 903. The memory 902 is suitable for storing instructions or programs executable by the processor 901. The processor 901 can be an independent microprocessor or a collection of one or more microprocessors. Thus, the processor 901 executes the instructions stored in the memory 902 to execute the method flow of the embodiment of the present invention as described above to realize the processing of data and the control of other devices. The bus 903 connects the above-mentioned multiple components together, and at the same time connects the above-mentioned components to the display controller 904 and the display device and the input / output (I / O) device 905. The input / output (I / O) device 905 can be a mouse, a keyboard, a modem, a network interface, a touch input device, a somatosensory input device, a printer, and other devices known in the art. Typically, the input / output (I / O) device 905 is connected to the system through an input / output (I / O) controller 906.

[0149] The technical solution provided by the embodiments of the present invention may have the following beneficial effects:

[0150] In the solution of the present invention, the data collected by different sensors are synchronized to the central processing unit in real time through wireless transmission to ensure the timeliness and continuity of the data. Real-time data transmission reduces the risk of data delay and loss, allowing doctors and patients to obtain feedback information in a timely manner.

[0151] In the solution of the present invention, high-dimensional biomechanical data is projected into a low-dimensional space and intuitively displayed through a graphical interface. This method simplifies the interpretation process of complex data, making it easier for doctors and patients to understand the results of motor function assessment.

[0152] It should be understood by those skilled in the art that the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer-usable program codes.

[0153] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0154] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0155] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0156] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A projection intelligent monitoring method for sports rehabilitation process, characterized in that: The method includes: Set the locations of key monitoring points, video cameras and inertial sensors; According to the preset action sequence, information collection of the action process is formed to form online collection information; According to the online information collection action record, the action amplitude analysis results of key points are formed; According to the results of the movement range analysis, the comprehensive recovery degree and sub-item recovery degree corresponding to the preset movement sequence are formed; Complete video data extraction, perform 3D projection to form a 3D model, and perform holographic projection display based on the 3D model; Transmitting the holographic projection to a data analysis center, and performing online projection display according to the comprehensive recovery degree and the sub-item recovery degree; The motion amplitude analysis results of key points formed according to the online information collection action records specifically include: During the playback of each action, several corresponding key monitoring points are pre-set for each action; A preset motion direction vector is set for each key monitoring point, and the projection distance on the preset motion direction vector is calculated for each key monitoring node during each movement; Use the first calculation formula to calculate the single fluctuation amplitude; The first calculation formula is: DF=max(ST)÷YZ Wherein, max() is the maximum value function of the projection distance on the preset motion direction vector during the motion process generated during the playback of each preset action, DF is the single fluctuation amplitude, ST is the projection distance on the preset motion direction vector during the motion process, and YZ is the preset maximum distance; The comprehensive recovery degree and sub-item recovery degree corresponding to the preset action sequence are formed according to the action amplitude analysis result, specifically including: Get the preset action sequence and store it in table form as an action table; For each action, the comprehensive recovery degree is calculated using the second calculation formula; For each moment, extract the projection distance on the preset motion direction vector corresponding to the expected moment, and use the third calculation formula to form the motion recovery degree of the key monitoring point corresponding to the current moment and the current action; According to the action table, the comprehensive recovery degree and the sub-item recovery degree are displayed respectively, and the sub-item recovery degree is the action recovery degree of the key monitoring point corresponding to the current moment and the current action; The second calculation formula is: ZHF=Σi=ni=1(DF)÷n Among them, ZHF is the comprehensive recovery degree, i is the number of several key monitoring points corresponding to the preset current action, and n is the total number of several key monitoring points corresponding to the preset current action; The third calculation formula is: DFF=STtime÷YZ Among them, STtime is the maximum value function of the projection distance on the preset motion direction vector of the key monitoring point corresponding to the current moment and the current action, and DFF is the motion recovery degree of the key monitoring point corresponding to the current moment and the current action.

2. A method for intelligent projection monitoring of a sports rehabilitation process as claimed in claim 1, characterized in that: The steps of setting the positions of key monitoring points, video cameras and inertial sensors specifically include: Pre-select several key monitoring points according to physician or patient needs; Install inertial sensors at key monitoring points; Use sensors to collect information from key monitoring points online; For the motion process, dynamic video is collected through video cameras in four directions.

3. The method for intelligent projection monitoring of a sports rehabilitation process according to claim 1, characterized in that: The information collection of the action process according to the preset action sequence to form online collection information specifically includes: Set a preset action sequence, and play the corresponding action on a preset screen according to the action sequence; During the playing action, the inertial sensor and the video sensor are used for online collection to form the online collection information.

4. The method for intelligent projection monitoring of a sports rehabilitation process according to claim 1, characterized in that: The step of extracting video data, performing 3D projection to form a 3D model, and performing holographic projection display according to the 3D model specifically includes: Four sets of videos are formed for the entire movement process; Ensure that the four sets of videos can be captured synchronously to ensure consistency in perspective and time; After cropping, correction and format conversion, the 3D model was created from the four sets of videos using the software tool Cinema 4D; Map the processed video as a texture onto the corresponding 3D model; With the help of a 45° glass screen, a holographic projection device is used to project the 3D model onto the holographic medium.

5. The method for intelligent projection monitoring of a sports rehabilitation process according to claim 1, characterized in that: The transmitting of the holographic projection to the data analysis center and performing online projection display according to the comprehensive recovery degree and the sub-item recovery degree specifically includes: Mark the 3D models one by one according to the action table; and marking the position of each key monitoring point in the 3D model; The physician selects the corresponding 3D model online for display according to the action table and the corresponding comprehensive recovery degree and sub-item recovery degree based on personalized needs.

6. A projection intelligent monitoring system for sports rehabilitation process, characterized in that: The system is used to implement the method according to any one of claims 1 to 5, and the system comprises: The sensor setting module is used to set the positions of key monitoring points, video cameras and inertial sensors; An action recording module is used to collect information about the action process according to a preset action sequence, thereby forming online collected information; A motion analysis module, used to form motion amplitude analysis results of key points based on the online information collection motion records; A recovery analysis module, used to form a comprehensive recovery degree and a sub-item recovery degree corresponding to a preset action sequence according to the action amplitude analysis results; An associated display module is used to complete video data extraction, perform 3D projection to form a 3D model, and perform holographic projection display based on the 3D model; The associated display module is used to transmit the holographic projection to the data analysis center and perform online projection display according to the comprehensive recovery degree and the sub-item recovery degree.

7. A computer-readable storage medium storing computer program instructions, characterized in that: The computer program instructions implement the method according to any one of claims 1 to 5 when executed by a processor.

8. An electronic device, comprising a memory and a processor, characterized in that: The memory is used to store one or more computer program instructions, wherein the one or more computer program instructions are executed by the processor to implement the method according to any one of claims 1-5.

Images