Multi-source data fusion sarcopenia detection system and method

Abstract

The embodiment of the invention relates to a sarcopenia detection system and method based on multi-source data fusion, and the method comprises the steps: detecting the moving process of a test target in a first step speed test region, so as to obtain first moving test information; detecting to obtain grip test information of the test target; detecting the moving process of the test target in the second step speed test area to obtain second moving test information; detecting the standing and sitting process of the test target on the standing and sitting chair in the standing and sitting test area to obtain standing and sitting test information; detecting the moving process of the test target in the third step speed test area to obtain third moving test information; and obtaining a sarcopenia detection result based on the first mobile test information, the second mobile test information, the third mobile test information, the standing and sitting test information and the grip strength test information. According to the embodiment of the invention, the richness of the mobile test data is increased, and the accuracy of analyzing and screening the early sarcopenia is effectively improved.

Description

Technical Field

[0001] Multiple embodiments of this specification relate to the technical field of sarcopenia detection, and specifically to a sarcopenia detection system and method that integrates multi-source data. Background Art

[0002] Sarcopenia, that is, muscle loss, is a condition in which the muscle mass, strength, and function of the human body gradually decline with age. It may lead to difficulties in movement, a decrease in quality of life, and even an increased risk of falls and fractures. Currently, the detection methods for sarcopenia mainly include grip strength tests, sit-to-stand tests, and gait speed tests. Although these methods are simple, they have certain limitations.

[0003] For a long time, the detection of sarcopenia has mainly relied on medical staff to make manual judgments based on the results of the above three tests. However, this method is highly subjective and is easily affected by the experience of the assessors. In recent years, with the development of technology, some studies have begun to attempt to analyze and screen for sarcopenia by building models. These models have improved the accuracy of detection to a certain extent.

[0004] However, for early-stage sarcopenia patients, even if their grip strength test results, sit-to-stand test results, and gait speed test results are input into the model, the model may still output normal results. That is, the current method of analyzing and screening for early-stage sarcopenia through models is still prone to misdiagnosis.

[0005] Therefore, it has become an urgent task to find a method that can effectively analyze and screen for early-stage sarcopenia. Summary of the Invention

[0006] Embodiments of this specification provide a sarcopenia detection system and method that integrates multi-source data, which can effectively analyze and screen for early-stage sarcopenia.

[0007] The technical solution is as follows: In a first aspect, embodiments of this specification provide a sarcopenia detection system that integrates multi-source data, including a first mobile test area, a grip strength test area, a second mobile test area, a sit-to-stand test area, and a third mobile test area that are sequentially arranged for a test target to pass through in sequence and perform corresponding tests; a grip strength tester is arranged in the grip strength test area, and a sit-to-stand chair for the test target to perform sit-to-stand is arranged in the sit-to-stand test area; the sarcopenia detection system further includes a motion detection module and an evaluation module; The motion detection module is configured to detect the movement process of the test target in the first gait speed test area to obtain first mobile test information; The motion detection module is further configured to detect the movement process of the test target in the second gait speed test area to obtain second mobile test information; The motion detection module is further configured to detect the movement process of the test target within the third walking speed test area to obtain third movement test information; The motion detection module is further configured to detect the sitting-up process of the test target on the sitting-up chair within the sitting-up test area to obtain sitting-up test information; The grip strength tester detects and obtains the grip strength test information of the test target; The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sitting-up test information, and the grip strength test information.

[0008] As a preferred solution, the motion detection module includes an image acquisition unit, an image processing unit, and a test information acquisition unit; The image acquisition unit captures the movement process of the test target within the first walking speed test area to obtain a first set of movement images corresponding to different timestamps during the movement process of the test target within the first walking speed test area. Each first set of movement images includes first movement images captured from different shooting perspectives; The image processing unit respectively obtains the whole-body spatial contour information and the whole-body key point spatial position information of the test target corresponding to different timestamps during the movement process of the test target within the first walking speed test area based on the first set of movement images corresponding to different timestamps during the movement process of the test target within the first walking speed test area; The test information acquisition unit obtains the first movement test information based on the whole-body spatial contour information and the whole-body key point spatial position information of the test target corresponding to different timestamps during the movement process of the test target within the first walking speed test area.

[0009] As a preferred solution, the image acquisition unit also captures the movement process of the test target within the second walking speed test area to obtain a second set of movement images corresponding to different timestamps during the movement process of the test target within the second walking speed test area. Each second set of movement images includes second movement images captured from different shooting perspectives; The image processing unit also respectively obtains the upper-body spatial contour information and the upper-body key point spatial position information of the test target corresponding to different timestamps during the movement process of the test target within the second walking speed test area based on the second set of movement images corresponding to different timestamps during the movement process of the test target within the second walking speed test area; The test information acquisition unit also obtains the second movement test information based on the upper-body spatial contour information and the upper-body key point spatial position information of the test target corresponding to different timestamps during the movement process of the test target within the second walking speed test area.

[0010] As a preferred solution, the image acquisition unit also captures the movement process of the test target in the third gait test area to obtain a third set of movement images corresponding to different timestamps during the movement process of the test target in the third gait test area. Each third set of movement images includes third movement images captured from different shooting perspectives; The image processing unit also respectively obtains the spatial contour information of the lower limbs of the human body and the spatial position information of the key points of the lower limbs of the human body corresponding to different timestamps during the movement process of the test target in the third gait test area based on the third set of movement images corresponding to different timestamps during the movement process of the test target in the third gait test area; The test information acquisition unit also obtains the third movement test information based on the spatial contour information of the lower limbs of the human body and the spatial position information of the key points of the lower limbs of the human body corresponding to different timestamps during the movement process of the test target in the third gait test area.

[0011] As a preferred solution, the image acquisition unit also captures the sitting-up process of the test target on the sitting-up chair in the sitting-up test area to obtain the sitting-up motion images corresponding to different timestamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area; The image processing unit also respectively obtains the target height information corresponding to different timestamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area based on the sitting-up motion images corresponding to different timestamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area; The test information acquisition unit also obtains the sitting-up test information based on the target height information corresponding to different timestamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area.

[0012] As a preferred solution, the first movement test information includes first upper limb movement information and first lower limb movement information; The second movement test information includes second upper limb movement information; The third movement test information includes second lower limb movement information; The evaluation module obtains the sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the second upper limb movement information, the second lower limb movement information, the sitting-up test information, and the grip strength test information.

[0013] As a preferred solution, the evaluation module includes a first comparison unit, a second comparison unit, and an evaluation unit; The first comparison unit obtains the upper limb movement comparison information based on the first upper limb movement information and the second upper limb movement information; The second comparison unit obtains lower limb movement comparison information based on the first lower limb movement information and the second lower limb movement information; The evaluation unit obtains a sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the upper limb movement comparison information, the lower limb movement comparison information, the sit-to-stand test information, and the grip strength test information.

[0014] As a preferred solution, the sarcopenia detection system further includes a dimension acquisition module; The dimension acquisition module obtains upper limb dimension information and lower limb dimension information based on the human body's whole-body space contour information and the human body's whole-body key point space position information corresponding to different timestamps during the movement of the test target in the first walking speed test area, the human body's upper limb space contour information and the human body's upper limb key point space position information corresponding to different timestamps during the movement of the test target in the second walking speed test area, and the human body's lower limb space contour information and the human body's lower limb key point space position information corresponding to different timestamps during the movement of the test target in the third walking speed test area; The evaluation module obtains a sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-to-stand test information, the grip strength test information, the upper limb dimension information, and the lower limb dimension information.

[0015] As a preferred solution, the movement detection module includes a first movement track and a second movement track respectively arranged on both sides of the setting routes of the first movement test area, the grip strength test area, the second movement test area, the sit-to-stand test area, and the third movement test area. The movement detection module further includes a photographing device arranged on the first movement track and the second movement track; The photographing device includes a first erection mechanism and a second erection mechanism both erected between the first movement track and the second movement track and both slidable on the first movement track and the second movement track to move along the setting routes of the first movement test area, the grip strength test area, the second movement test area, the sit-to-stand test area, and the third movement test area; The photographing device further includes a plurality of first photographing modules with adjustable heights arranged on the first erection mechanism and capable of photographing the test target from different photographing perspectives; The photographing device further includes a plurality of second photographing modules with adjustable heights arranged on the second erection mechanism and capable of photographing the test target from different photographing perspectives.

[0016] In a second aspect, an embodiment of this specification provides a sarcopenia detection method for multi-source data fusion. Based on the sarcopenia detection system for multi-source data fusion described in the first aspect of the above embodiment, it includes: In a third aspect, an embodiment of this specification provides an electronic device, including a processor and a memory; the processor is connected to the memory; the memory is used to store executable program code; the processor runs a program corresponding to the executable program code by reading the executable program code stored in the memory to execute the steps described in the second aspect of the above embodiment.

[0017] In a fourth aspect, an embodiment of this specification provides a computer storage medium, which stores multiple instructions, and the instructions are suitable for being loaded and executed by a processor to execute the steps described in the second aspect of the above embodiment.

[0018] The beneficial effects brought by the technical solutions provided by some embodiments of this specification at least include: It can be understood that for early sarcopenia patients, a single mobility test may show a normal state. After a grip strength test and then a mobility test, it may also show a normal state. After a sit-to-stand test and then a mobility test, it may also show a normal state. However, there are usually abnormal situations in the changes between multiple mobility test results of early sarcopenia patients in different states. For example, for some people, their walking speed, stride length, arm swing speed, and arm swing amplitude during exercise are larger than those of normal people. Therefore, for these people, even if they have sarcopenia and are in the early stage, their walking speed, stride length, arm swing speed, and arm swing amplitude during exercise may still be in a normal state. But for early sarcopenia patients, the changes in arm swing speed and arm swing amplitude before and after the grip strength test are usually larger than those of normal people, and the changes in walking speed and stride length before and after the sit-to-stand test are usually also larger than those of normal people. Therefore, three mobility test areas are set before the grip strength test area, between the grip strength test area and the sit-to-stand test area, and after the sit-to-stand test area. The first mobility test area is the mobility test area in the normal state, the second mobility test area is the mobility test area affected by the grip strength test, and the third mobility test area is the mobility test area affected by the sit-to-stand test, thereby increasing the richness of mobility test data and effectively improving the accuracy of analysis and screening for early sarcopenia.

[0019] It can be understood that the grip strength test has a greater impact on the upper limb movement of the test target, and the sit-to-stand test has a greater impact on the lower limb movement of the test target. Therefore, in the sarcopenia detection system provided in the embodiments of this specification, the human body's whole-body spatial contour information and the spatial position information of the key points of the human body corresponding to different timestamps during the movement of the test target in the first speed test area are obtained; the human upper limb spatial contour information and the spatial position information of the key points of the human upper limb corresponding to different timestamps during the movement of the test target in the second speed test area are obtained; the human lower limb spatial contour information and the spatial position information of the key points of the human lower limb corresponding to different timestamps during the movement of the test target in the third speed test area are obtained; and then the change in the movement test results of the upper limb of the test target before and after the grip strength test and the change in the movement test results of the lower limb of the test target before and after the sit-to-stand test can be obtained respectively. And the targeted information acquisition also reduces the amount of image processing for the second movement test area and the third movement test area, thereby improving the sarcopenia detection efficiency.

[0020] To increase the followability, comprehensiveness, and pertinence of image shooting, the motion detection module includes a first moving track and a second moving track respectively arranged on both sides of the setting routes of the first movement test area, the grip strength test area, the second movement test area, the sit-to-stand test area, and the third movement test area. The motion detection module also includes a shooting device arranged on the first moving track and the second moving track; the shooting device includes a first erection mechanism and a second erection mechanism that are both erected between the first moving track and the second moving track and can slide on the first moving track and the second moving track to move along the setting routes of the first movement test area, the grip strength test area, the second movement test area, the sit-to-stand test area, and the third movement test area; the shooting device further includes a plurality of first shooting modules with adjustable heights arranged on the first erection mechanism for shooting the test target from different shooting perspectives; the shooting device further includes a plurality of second shooting modules with adjustable heights arranged on the second erection mechanism for shooting the test target from different shooting perspectives. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0022] Figure 1 It is a schematic diagram of a sarcopenia detection system with multi-source data fusion provided by the embodiments of this specification.

[0023] Figure 2It is a schematic flowchart of a sarcopenia detection method for multi-source data fusion provided by an embodiment of this specification.

[0024] Figure 3 It is a schematic structural diagram of an electronic device provided by an embodiment of this specification.

[0025] In the figure: 1. First moving track; 2. Second moving track; 3. First erection mechanism; 31. First shooting module; 4. Second erection mechanism; 41. Second shooting module; 5. Test target; 6. Grip strength tester; 7. Sit-to-stand chair; 300. Electronic device; 301. Processor; 302. Communication bus; 303. User interface; 304. Network interface; 305. Memory. Detailed implementation manners

[0026] Next, the technical solutions in the embodiments of this specification will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of this specification.

[0027] The terms "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings of this specification are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes unlisted steps or units, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0028] The following description provides examples and does not limit the scope, applicability or examples set forth in the claims. Changes can be made to the functions and arrangements of the described elements without departing from the scope of the content of this specification. Various processes or components can be appropriately omitted, substituted or added to each example. For example, the described method can be executed in a different order from the described order, and various steps can be added, omitted or combined. In addition, the features described in some examples can be combined into other examples.

[0029] Referring to Figure 1 as shown Figure 1 It is a schematic diagram of a sarcopenia detection system for multi-source data fusion provided by an embodiment of this specification. The sarcopenia detection system can at least include a first moving test area, a grip strength test area, a second moving test area, a sit-to-stand test area, and a third moving test area that are sequentially arranged for the test target 5 to pass through and perform corresponding tests in sequence; a grip strength tester 6 is arranged in the grip strength test area, and a sit-to-stand chair 7 for the test target 5 to perform sit-to-stand is arranged in the sit-to-stand test area; the sarcopenia detection system further includes a motion detection module and an evaluation module. The motion detection module is used to detect the movement process of the test target 5 in the first pace test area to obtain the first movement test information; The motion detection module is also used to detect the movement process of the test target 5 in the second pace test area to obtain the second movement test information; The motion detection module is also used to detect the movement process of the test target 5 in the third pace test area to obtain the third movement test information; The motion detection module is also used to detect the sitting-up process of the test target 5 on the sit-up chair 7 in the sit-up test area to obtain the sit-up test information; The grip strength tester 6 detects and obtains the grip strength test information of the test target 5; The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-up test information, and the grip strength test information.

[0030] It can be understood that for early sarcopenia patients, a single movement test may show a normal state, a movement test after a grip strength test may also show a normal state, and a movement test after a sit-up test may also show a normal state. However, there are usually abnormal situations in the changes between the multiple movement test results of early sarcopenia patients in different states. For example, for some people, their pace, stride, arm swing speed, and arm swing amplitude during exercise are larger than those of normal people. Therefore, for these people, even if they have sarcopenia and are in the early stage, their pace, stride, arm swing speed, and arm swing amplitude during exercise may still be in a normal state. However, for early sarcopenia patients, the changes in arm swing speed and arm swing amplitude before and after the grip strength test are usually larger than those of normal people, and the changes in pace and stride before and after the sit-up test are usually also larger than those of normal people. Therefore, three movement test areas are set before the grip strength test area, between the grip strength test area and the sit-up test area, and after the sit-up test area. The first movement test area is the movement test area in the normal state, the second movement test area is the movement test area affected by the grip strength test, and the third movement test area is the movement test area affected by the sit-up test, thereby increasing the richness of movement test data and effectively improving the accuracy of analyzing and screening for early sarcopenia.

[0031] For the evaluation module, it can be obtained by training a neural network model. Before training, it is necessary to pre-acquire a data set, and divide the data set into a model training set and a model test set according to a ratio of 7:3 for model training and verification respectively, and multiple metrics are used to evaluate and verify the model. The main model evaluation metrics include accuracy, recall, mean average precision (mAP), etc. Each sample in the data set includes corresponding first movement test information, second movement test information, third movement test information, sit-to-stand test information, grip strength test information, and sarcopenia detection results.

[0032] In an embodiment of the present specification, the sarcopenia detection system may further include a basic information entry module. The basic information entry module is used to enter the basic information of the test target 5, such as age, gender and other information. The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-to-stand test information, the grip strength test information, and the basic information of the test target 5.

[0033] In an embodiment of the present specification, the motion detection module includes an image acquisition unit, an image processing unit, and a test information acquisition unit; The image acquisition unit takes pictures of the moving process of the test target 5 in the first walking speed test area to obtain a corresponding first moving image set at different time stamps during the moving process of the test target 5 in the first walking speed test area. Each first moving image set includes first moving images taken from different shooting perspectives; The image processing unit respectively obtains the whole-body spatial contour information and the whole-body key point spatial position information of the test target 5 at different time stamps during the moving process in the first walking speed test area based on the corresponding first moving image sets at different time stamps during the moving process of the test target 5 in the first walking speed test area; The test information acquisition unit obtains the first movement test information based on the whole-body spatial contour information and the whole-body key point spatial position information of the test target 5 at different time stamps during the moving process in the first walking speed test area.

[0034] It can be understood that by photographing the test target 5 from multiple different shooting perspectives, moving images of the test target 5 under different shooting perspectives can be obtained. Further, a three-dimensional space model of the test target 5 can be reconstructed based on the moving images obtained from multiple different perspectives, and then the whole-body spatial contour information of the human body of the test target 5 can be obtained. Similarly, the spatial position information of the whole-body key points of the human body can be obtained based on the moving images obtained from multiple different perspectives. The spatial position information of the whole-body key points of the human body can include, but is not limited to, the spatial position information of the elbow key points, the spatial position information of the upper arm key points, the spatial position information of the forearm key points, the spatial position information of the thigh key points, the spatial position information of the knee key points, the spatial position information of the lower leg key points, the spatial position information of the sole key points, etc. Finally, the first movement test information can be obtained based on the whole-body spatial contour information of the human body and the spatial position information of the whole-body key points of the human body corresponding to different timestamps during the movement of the test target 5 in the first speed test area. The first movement test information can include, but is not limited to, movement speed information, movement amplitude information, etc.

[0035] It should be noted that a more specific explanation of the motion detection module will be further elaborated in the corresponding embodiments below.

[0036] In an embodiment of the present specification, the image acquisition unit also photographs the movement process of the test target 5 in the second speed test area to obtain a second set of moving images corresponding to different timestamps during the movement process of the test target 5 in the second speed test area. Each second set of moving images includes second moving images obtained by photographing from different shooting perspectives; The image processing unit also respectively obtains the upper-body spatial contour information and the spatial position information of the upper-body key points of the test target 5 corresponding to different timestamps during the movement process of the test target 5 in the second speed test area based on the second set of moving images corresponding to different timestamps during the movement process of the test target 5 in the second speed test area; The test information acquisition unit also obtains the second movement test information based on the upper-body spatial contour information and the spatial position information of the upper-body key points of the test target 5 corresponding to different timestamps during the movement process of the test target 5 in the second speed test area.

[0037] It should be noted that the testing principle of the second-step speed testing area is the same as that of the first-step speed testing area above. Both are based on the moving images captured from different shooting perspectives to obtain the corresponding spatial information of the test target 5. The difference is that for the test in the second-step speed testing area, only the human upper limb spatial contour information and the spatial position information of the key points of the human upper limb corresponding to different timestamps during the movement of the test target 5 in the second-step speed testing area are obtained. It can be understood that the grip strength test has a greater impact on the upper limb movement of the test target 5. Therefore, in the sarcopenia detection system provided in the embodiments of this specification, the human body's full-body spatial contour information and the spatial position information of the key points of the human body corresponding to different timestamps during the movement of the test target 5 in the first-step speed testing area are obtained; the human upper limb spatial contour information and the spatial position information of the key points of the human upper limb corresponding to different timestamps during the movement of the test target 5 in the second-step speed testing area are obtained; and then the change in the movement test results of the upper limb of the test target 5 before and after the grip strength test can be obtained. And the targeted information acquisition also reduces the amount of image processing for the second moving test area, thereby improving the sarcopenia detection efficiency.

[0038] In an embodiment of this specification, the image acquisition unit also captures the movement process of the test target 5 in the third-step speed testing area to obtain a third set of moving images corresponding to different timestamps during the movement of the test target 5 in the third-step speed testing area. Each third set of moving images includes third moving images captured from different shooting perspectives; The image processing unit also respectively obtains the human lower limb spatial contour information and the spatial position information of the key points of the human lower limb corresponding to different timestamps during the movement of the test target 5 in the third-step speed testing area based on the third set of moving images corresponding to different timestamps during the movement of the test target 5 in the third-step speed testing area; The test information acquisition unit also obtains the third moving test information based on the human lower limb spatial contour information and the spatial position information of the key points of the human lower limb corresponding to different timestamps during the movement of the test target 5 in the third-step speed testing area.

[0039] It should be noted that the testing principle of the third-step speed testing area is the same as that of the first-step speed testing area above. Both are based on the moving images captured from different shooting perspectives to obtain the corresponding spatial information of the test target 5. The difference is that for the test in the third-step speed testing area, only the human lower limb spatial contour information and the spatial position information of the key points of the human lower limb corresponding to different timestamps during the movement of the test target 5 in the third-step speed testing area are obtained.

[0040] It can be understood that the sit-to-stand test has a greater impact on the lower limb movement of the test target 5. Therefore, in the sarcopenia detection system provided in the embodiments of this specification, the human body's whole-body spatial contour information and the spatial position information of the whole-body key points corresponding to different timestamps during the movement of the test target 5 in the first speed test area are obtained; the human body's lower limb spatial contour information and the spatial position information of the lower limb key points corresponding to different timestamps during the movement of the test target 5 in the third speed test area are obtained; and then the change in the movement test results of the lower limbs of the test target 5 before and after the sit-to-stand test can be obtained. And the targeted information acquisition also reduces the amount of image processing for the third movement test area, thereby improving the sarcopenia detection efficiency.

[0041] Based on the above, in an embodiment of this specification, the first movement test information includes first upper limb movement information and first lower limb movement information; The second movement test information includes second upper limb movement information; The third movement test information includes second lower limb movement information; The evaluation module obtains the sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the second upper limb movement information, the second lower limb movement information, the sit-to-stand test information, and the grip strength test information.

[0042] The first upper limb movement information may include, but is not limited to, the first upper limb movement speed information, the first upper limb movement amplitude information, etc.

[0043] The first lower limb movement information may include, but is not limited to, the first lower limb movement speed information, the first lower limb movement amplitude information, etc.

[0044] The second upper limb movement information may include, but is not limited to, the second upper limb movement speed information, the second upper limb movement amplitude information, etc.

[0045] The second lower limb movement information may include, but is not limited to, the second lower limb movement speed information, the second lower limb movement amplitude information, etc.

[0046] Furthermore, the evaluation module includes a first comparison unit, a second comparison unit, and an evaluation unit; The first comparison unit obtains the upper limb movement comparison information based on the first upper limb movement information and the second upper limb movement information; The second comparison unit obtains the lower limb movement comparison information based on the first lower limb movement information and the second lower limb movement information; The evaluation unit obtains the sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the upper limb movement comparison information, the lower limb movement comparison information, the sit-to-stand test information, and the grip strength test information.

[0047] The upper limb movement comparison information may, but is not limited to, include upper limb movement speed change information, upper limb movement amplitude change information, etc.

[0048] The lower limb movement comparison information may, but is not limited to, include lower limb movement speed change information, lower limb movement amplitude change information, etc.

[0049] In an embodiment of the present specification, the image acquisition unit further photographs the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area to obtain the sitting-up motion images corresponding to different timestamps during the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area; The image processing unit further obtains the target height information corresponding to different timestamps during the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area based on the sitting-up motion images corresponding to different timestamps during the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area; The test information acquisition unit further obtains the sitting-up test information based on the target height information corresponding to different timestamps during the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area.

[0050] It can be understood that by testing the time required for the test target 5 to complete a certain number of sitting-ups, or recording the number of sitting-ups that can be completed within a certain time, it can be used to evaluate the muscle health status of the test target 5 and serve as a reference index for the diagnosis of sarcopenia.

[0051] Therefore, for the sitting-up test, only the target height information corresponding to different timestamps during the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area needs to be obtained, and then based on the change situation of the target height information of the test target 5, the time required for the test target 5 to complete a certain number of sitting-ups or the number of sitting-ups that the test target 5 can complete within a certain time, that is, the sitting-up test information, can be obtained.

[0052] It can be understood that different limb dimensions of the test target 5 have a certain degree of influence on its movement, sitting-up, and grip strength. Therefore, in an embodiment of the present specification, the sarcopenia detection system further includes a dimension acquisition module; The dimension acquisition module obtains upper limb dimension information and lower limb dimension information based on the human body's full-body spatial contour information and the spatial position information of the human body's full-body key points corresponding to different timestamps during the movement of the test target 5 in the first quick test area, the upper limb spatial contour information and the spatial position information of the human body's upper limb key points corresponding to different timestamps during the movement of the test target 5 in the second quick test area, and the lower limb spatial contour information and the spatial position information of the human body's lower limb key points corresponding to different timestamps during the movement of the test target 5 in the third quick test area; The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-to-stand test information, the grip strength test information, the upper limb dimension information, and the lower limb dimension information.

[0053] Refer to Figure 1 As shown, the motion detection module includes a first moving track 1 and a second moving track 2 respectively arranged on both sides of the setting routes of the first moving test area, the grip strength test area, the second moving test area, the sit-to-stand test area, and the third moving test area. The motion detection module further includes a photographing device arranged on the first moving track 1 and the second moving track 2; The photographing device includes a first erection mechanism 3 and a second erection mechanism 4 both erected between the first moving track 1 and the second moving track 2 and both slidable on the first moving track 1 and the second moving track 2 to move along the setting routes of the first moving test area, the grip strength test area, the second moving test area, the sit-to-stand test area, and the third moving test area; The photographing device further includes a plurality of first photographing modules 31 with adjustable heights arranged on the first erection mechanism 3 and capable of photographing the test target 5 from different photographing perspectives; The photographing device further includes a plurality of second photographing modules 41 with adjustable heights arranged on the second erection mechanism 4 and capable of photographing the test target 5 from different photographing perspectives.

[0054] It can be understood that in an embodiment of this specification, when the test target 5 conducts a movement test in the first movement test area, the first erection mechanism 3 and the second erection mechanism 4 slide to the starting end and the ending end of the first movement test area respectively through the first movement track 1 and the second movement track 2, and adjust the heights of the first shooting module 31 and the second shooting module 41 to the waist height position of the test target 5, so as to better shoot the whole test target 5; when the test target 5 conducts a movement test in the second movement test area, the first erection mechanism 3 and the second erection mechanism 4 slide to the starting end and the ending end of the second movement test area respectively through the first movement track 1 and the second movement track 2, and adjust the heights of the first shooting module 31 and the second shooting module 41 to a height position above the waist of the test target 5, so as to better shoot the upper limb part of the test target 5; when the test target 5 conducts a movement test in the third movement test area, the first erection mechanism 3 and the second erection mechanism 4 slide to the starting end and the ending end of the third movement test area respectively through the first movement track 1 and the second movement track 2, and adjust the heights of the first shooting module 31 and the second shooting module 41 to a height position below the waist of the test target 5, so as to better shoot the lower limb part of the test target 5.

[0055] Therefore, in an embodiment of this specification, the motion detection module further includes a control module, and the control module is used to control the sliding positions of the first erection mechanism 3 and the second erection mechanism 4 on the first movement track 1 and the second movement track 2 according to the position information of the test target 5; the control module is further used to adjust the heights of the first shooting module 31 and the second shooting module 41 according to the position information of the test target 5 and the height information of the test target 5.

[0056] In an embodiment of this specification, both the first shooting module 31 and the second shooting module 41 include a TOF camera unit and an RGB camera unit. The TOF camera unit is used to measure the depth information of the scene. The RGB camera unit is used to capture the color image of the scene, providing rich color and texture details, so that the reconstructed three-dimensional model is more accurate.

[0057] Refer to Figure 2 As shown, this specification also provides a sarcopenia detection method for multi-source data fusion. Based on the multi-source data fusion sarcopenia detection system described in any of the above embodiments, it can at least include: Step 202: Detect the movement process of the test target 5 in the first gait test area to obtain the first movement test information; Step 204: Detect and obtain the grip strength test information of the test target 5; Step 206: Detect the movement process of the test target 5 in the second gait test area to obtain the second movement test information; Step 208: Detect the sitting-up process of the test target 5 on the sitting-up chair 7 in the sitting-up test area to obtain sitting-up test information; Step 210: Detect the movement process of the test target 5 in the third speed test area to obtain third movement test information; Step 212: Obtain a sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sitting-up test information, and the grip strength test information.

[0058] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the sarcopenia detection method, since it is basically similar to the embodiment of the sarcopenia detection system, the description is relatively simple. For the relevant parts, reference can be made to the corresponding description in the embodiment of the sarcopenia detection system.

[0059] Please refer to Figure 3 the schematic structural diagram of an electronic device provided by the embodiment of this specification shown in

[0060] As Figure 3 shown, the electronic device 300 may include: at least one processor 301, at least one network interface 304, a user interface 303, a memory 305, and at least one communication bus 302.

[0061] Among them, the communication bus 302 can be used to realize the connection and communication of the above components.

[0062] Among them, the user interface 303 may include buttons. Optionally, the user interface may further include a standard wired interface and a wireless interface.

[0063] Among them, the network interface 304 may include, but is not limited to, a Bluetooth module, an NFC module, a Wi-Fi module, etc.

[0064] Among them, the processor 301 may include one or more processing cores. The processor 301 connects various parts within the entire electronic device 300 through various interfaces and lines. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 305, and by calling the data stored in the memory 305, it executes various functions of the electronic device 300 and processes data. Optionally, the processor 301 may be implemented in at least one hardware form of DSP, FPGA, or PLC. The processor 301 may integrate one or a combination of several of CPU, GPU, and modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 301 and may be implemented separately by a single chip.

[0065] Among them, the memory 305 may include RAM and may also include ROM. Optionally, the memory 305 includes a non-transitory computer-readable medium. The memory 305 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 305 may include a program storage area and a data storage area. Among them, the program storage area can store instructions for implementing the operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area can store the data involved in the above-mentioned various method embodiments. Optionally, the memory 305 may also be at least one storage device located far from the aforementioned processor 301. The memory 305, as a computer storage medium, may include an operating system, a network communication module, a user interface module, and a sarcopenia detection application program. The processor 301 can be used to call the sarcopenia detection application program stored in the memory 305 and execute the steps of the sarcopenia detection method mentioned in the foregoing embodiments.

[0066] The embodiments of this specification also provide a computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When they run on a computer or a processor, they cause the computer or the processor to execute one or more of the steps in the above-mentioned sarcopenia detection method embodiments. If the various component modules of the above-mentioned electronic device are implemented in the form of software functional units and sold or used as independent products, they can be stored in the computer-readable storage medium.

[0067] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of this specification are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired manner (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a Digital Versatile Disc (DVD)), or a semiconductor medium (such as a Solid State Disk (SSD)), etc.

[0068] Those of ordinary skill in the art can understand that all or part of the processes in the above embodiments of the method can be completed by instructing relevant hardware through a computer program. This program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. The foregoing storage media include: various media such as ROM, RAM, magnetic disks, or optical discs that can store program codes. Without conflict, the technical features in this embodiment and the implementation solutions can be combined arbitrarily.

[0069] The above-described embodiments are merely described in terms of the preferred embodiments of this specification, and do not limit the scope of this specification. Without departing from the design spirit of this specification, various deformations and improvements made by those of ordinary skill in the art to the technical solutions of this specification shall fall within the protection scope determined by the claims of this specification.

Claims

1. A multi-source data fusion sarcopenia detection system, characterized in that: It includes a first moving test area, a grip test area, a second moving test area, a sit-up test area, and a third moving test area, which are sequentially provided for the test target to pass through and perform corresponding tests; the grip test area is provided with a grip tester, and the sit-up test area is provided with a sit-up chair for the test target to sit up; the sarcopenia detection system also includes a motion detection module and an evaluation module; The motion detection module is used to detect the movement process of the test target in the first speed test area to obtain the first movement test information; The motion detection module is further used to detect the movement process of the test target in the second pace test area to obtain second movement test information; The motion detection module is further used to detect the movement process of the test target in the third pace test area to obtain third movement test information; The motion detection module is also used to detect the sitting-up process of the test target on the sitting-up chair in the sitting-up test area to obtain the sitting-up test information; The grip strength tester detects and obtains grip strength test information of a test target; The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-up test information, and the grip strength test information.

2. The multi-source data fusion sarcopenia detection system according to claim 1, characterized in that: The motion detection module includes an image acquisition unit, an image processing unit, and a test information acquisition unit; The image acquisition unit shoots the movement process of the test target in the first speed test area to obtain first moving image sets corresponding to different time stamps during the movement of the test target in the first speed test area, each first moving image set including first moving images captured at different shooting angles; The image processing unit obtains the whole body spatial contour information and the whole body key point spatial position information of the test target at different time stamps in the process of the test target moving in the first speed test area based on the first moving image sets corresponding to different time stamps in the process of the test target moving in the first speed test area; The test information acquisition unit acquires the first movement test information based on the human body spatial contour information and the human body key point spatial position information corresponding to different time stamps during the movement of the test target in the first speed test area.

3. The multi-source data fusion sarcopenia detection system according to claim 2, characterized in that: The image acquisition unit further photographs the movement process of the test target in the second pace test area to obtain second moving image sets corresponding to different time stamps during the movement of the test target in the second pace test area, each second moving image set including second moving images photographed at different shooting angles; The image processing unit also obtains the upper limb spatial contour information and the upper limb key point spatial position information of the test target corresponding to different timestamps in the process of the test target moving in the second pace test area based on the second moving image sets corresponding to different timestamps in the process of the test target moving in the second pace test area; The test information acquisition unit also acquires the second movement test information based on the human upper limb spatial contour information corresponding to different time stamps during the movement of the test target in the second pace test area and the human upper limb key point spatial position information.

4. The multi-source data fusion sarcopenia detection system according to claim 3, characterized in that: The image acquisition unit further photographs the movement process of the test target in the third pace test area to obtain third moving image sets corresponding to different time stamps during the movement of the test target in the third pace test area, each third moving image set including third moving images photographed at different shooting angles; The image processing unit further obtains the spatial contour information of the lower limbs of the human body and the spatial position information of the key points of the lower limbs of the human body corresponding to different time stamps during the movement of the test target in the third pace test area based on the third moving image sets corresponding to different time stamps during the movement of the test target in the third pace test area; The test information acquisition unit also acquires the third movement test information based on the spatial contour information of the human lower limbs and the spatial position information of key points of the human lower limbs corresponding to different time stamps during the movement of the test target in the third pace test area.

5. The multi-source data fusion sarcopenia detection system according to claim 2, characterized in that: The image acquisition unit further photographs the test subject's sitting-up process on the sitting-up chair in the sitting-up test area, so as to obtain the sitting-up motion images corresponding to different time stamps during the test subject's sitting-up process on the sitting-up chair in the sitting-up test area; The image processing unit further obtains target height information corresponding to different time stamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area based on the sit-up motion images corresponding to different time stamps during the sitting-up process of the test target on the sitting-up chair in the sitting-up test area; The test information acquisition unit also acquires the sit-up test information based on the target height information corresponding to different time stamps during the sit-up process of the test target on the sit-up chair in the sit-up test area.

6. The multi-source data fusion sarcopenia detection system according to claim 4, characterized in that: The first movement test information includes first upper limb movement information and first lower limb movement information; The second movement test information includes second upper limb movement information; The third movement test information includes second lower limb movement information; The evaluation module obtains the sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the second upper limb movement information, the second lower limb movement information, the sit-up test information, and the grip strength test information.

7. The multi-source data fusion sarcopenia detection system according to claim 6, characterized in that: The evaluation module includes a first comparison unit, a second comparison unit, and an evaluation unit; The first comparison unit acquires upper limb movement comparison information based on the first upper limb movement information and the second upper limb movement information; The second comparison unit acquires lower limb movement comparison information based on the first lower limb movement information and the second lower limb movement information; The evaluation unit obtains the sarcopenia detection result based on the first upper limb movement information, the first lower limb movement information, the upper limb movement comparison information, the lower limb movement comparison information, the sit-up test information, and the grip strength test information.

8. The multi-source data fusion sarcopenia detection system according to claim 4, characterized in that: The sarcopenia detection system also includes a dimension acquisition module; The dimension acquisition module acquires upper limb dimension information and lower limb dimension information based on the human body whole-body spatial contour information and the human body whole-body key point spatial position information corresponding to different time stamps during the test target's movement in the first pace test area, the human body upper limb spatial contour information and the human body upper limb key point spatial position information corresponding to different time stamps during the test target's movement in the second pace test area, and the human body lower limb spatial contour information and the human body lower limb key point spatial position information corresponding to different time stamps during the test target's movement in the third pace test area; The evaluation module obtains the sarcopenia detection result based on the first movement test information, the second movement test information, the third movement test information, the sit-up test information, the grip strength test information, the upper limb dimension information and the lower limb dimension information.

9. The multi-source data fusion sarcopenia detection system according to claim 4, characterized in that: The motion detection module includes a first moving track and a second moving track respectively arranged along the two sides of the setting route of the first moving test area, the grip strength test area, the second moving test area, the sit-up test area, and the third moving test area, and the motion detection module also includes a shooting device arranged on the first moving track and the second moving track; The photographing device includes a first mounting mechanism and a second mounting mechanism, both of which are mounted between a first moving track and a second moving track and can slide on the first moving track and the second moving track to move along the set routes of the first moving test area, the grip test area, the second moving test area, the sit-up test area, and the third moving test area; The photographing device further comprises a plurality of first photographing modules which are arranged on the first mounting mechanism and are height-adjustable and can photograph the test target from different photographing angles; The photographing device also includes a plurality of second photographing modules which are arranged on the second mounting mechanism and have adjustable heights and can photograph the test target from different photographing angles.

10. A multi-source data fusion sarcopenia detection method, based on a multi-source data fusion sarcopenia detection system according to any one of claims 1 to 9, characterized in that: include: Detecting the movement process of the test target in the first speed test area to obtain first movement test information; Detect and obtain grip strength test information of the test target; Detecting the movement process of the test target in the second pace test area to obtain second movement test information; Detecting the sit-up process of the test object on the sit-up chair in the sit-up test area to obtain sit-up test information; Detecting the movement process of the test target in the third pace test area to obtain third movement test information; Based on the first movement test information, the second movement test information, the third movement test information, the sit-up test information, and the grip strength test information, the sarcopenia test result is obtained.

Images