The invention provides a scientific and technological
attack effectiveness evaluation method and device based on a large
language model, and is suitable for multi-dimensional comprehensive evaluation of scientific research projects under the background of a novel power
system. The method comprises the following steps: firstly, constructing an evaluation
index system covering dimensions such as
technical innovation,
technical feasibility, economic benefit and environmental influence, and collecting expert text evaluation of each project under each index; text semantic features are extracted through a BERT model,
sentiment analysis is carried out in combination with a large
language model, satisfaction scores are quantified, and an evaluation
decision matrix is constructed; and calculating the index weight by using a CRITIC method, and finally carrying out comprehensive scoring and sorting on the projects in combination with a grey relational degree-ideal
point method. According to the scheme, the problems that a traditional expert scoring method is high in subjectivity and low in information
utilization rate are effectively solved, the objectivity, accuracy and scientificity of an
evaluation result are improved, and intelligent and data-driven decision support is provided for scientific research
project management and
resource allocation.