The invention provides a comprehensive solution for a medical ultrasonic
image diagnosis task, which comprises two innovative parts, namely a CAPT parameter efficient
fine tuning method based on a
convolution adapter and embedded prompt tuning and a model lightweight method based on evolution
pruning. Aiming at double challenges of scarcity of data and difficulty in model
adaptation in the field of medical ultrasonic images, on one hand, the CAPT method introduces a
convolution module into a traditional adapter to enhance the fine-grained
feature extraction capability by fusing adapter tuning and prompt tuning mechanisms, and dynamically generates a prompt vector embedded with attention calculation by using adapter learning context information; the adaptability and the
small sample generalization ability of the Transform model in an ultrasonic image classification task are obviously improved; on the other hand, aiming at a model edge deployment requirement, designing an evolution
pruning algorithm, taking DenseNet-121 as a basic framework, inheriting parent strong
neuron connection by adopting an
asexual reproduction mechanism, and through a channel importance evaluation method for
coupling a BN layer scaling factor and a weight L1 norm and in combination with a sparse
evolution strategy guided by environmental constraint, constructing a model edge deployment model. And the classification precision is maintained, and meanwhile, the
model parameters and the calculated amount are greatly compressed. The two technologies respectively break through the technical bottlenecks of
medical image diagnosis from two dimensions of parameter efficient
fine tuning and model structured
pruning, the former improves the adaptability of the model field through
feature extraction optimization, and the latter balances network lightweight and performance stability by means of an
evolutionary algorithm. And an innovative technical path is provided for efficient deployment of an ultrasonic image auxiliary diagnosis
system in a data limited scene and an
edge computing environment.