1801 results about "Semantic representation" patented technology

The present invention relates to the technical field of big data processing, and discloses a multi-source heterogeneous data fusion and processing method based on big data, including the following steps: data preprocessing, cleaning, complementing and feature extraction of multi-source heterogeneous data, providing standardized and high-quality input for subsequent processing; dynamic knowledge graph modeling, constructing a dynamic knowledge graph based on the semantic relationship of multi-source data, and generating a unified semantic representation; cross-modal alignment and deep fusion, semantically aligning multi-modal data, and generating a unified comprehensive representation through deep fusion of features; real-time stream processing, dynamically updating and processing real-time updated stream data to achieve real-time fusion of data; adaptive optimization, dynamically adjusting fusion strategy parameters, and improving the adaptability and robustness of the fusion strategy. The present invention realizes efficient fusion, real-time processing and semantic consistency expression of multi-source heterogeneous data through dynamic knowledge graph modeling, cross-modal alignment, real-time stream processing and adaptive optimization.

The present invention provides a method and system for extracting and analyzing long text information and association based on a large model, which relates to the technical field of natural language processing, including determining sliding window parameters based on semantic density values ​​to divide long text into blocks, extracting feature vectors of text blocks and calculating semantic relevance, and constructing a hierarchical clustering feature matrix to merge text blocks to obtain semantic fragments. Afterwards, the semantic fragments are syntactically analyzed to construct a semantic dependency tree, and the semantic network is extracted and the entity relationship strength value is calculated to construct a semantic association graph. Finally, the node features are extracted using a pre-trained large model, the semantic representation is fused through a hierarchical attention mechanism, the features are enhanced by propagating an adaptive graph network, and candidate paths are generated through a hierarchical decision network, the optimal path is selected, and the associated path and probability distribution are output. The present invention can effectively extract key information from long texts and analyze the association relationship between entities, thereby improving the accuracy and efficiency of information extraction.

The invention relates to the technical field of intelligent decision making, in particular to a simulation system intelligent decision making method and system based on a knowledge graph and federated learning, and the method comprises the steps that each simulation node constructs a knowledge graph sub-graph based on local dynamic data, and multi-modal semantic representation is generated through space-time modeling and event chain reasoning; the federal center initializes a simulation decision model architecture and issues the simulation decision model architecture to each node; each node uses a local knowledge graph to train a time sequence diagram network, extracts an equipment degradation path and abnormal propagation characteristics, and uploads gradient parameters in combination with homomorphic encryption; the federation center fuses the multi-node model through a dynamic weight aggregation algorithm to generate a global decision model; and driving knowledge graph evolution based on real-time data, and performing causal reasoning and decision optimization on an event chain through a federal model. According to the method, the problem of insufficient dynamic decision adaptability in a multi-source data island and privacy sensitive scene in a simulation system is solved.

The invention relates to the technical field of knowledge graph construction, and discloses a knowledge graph construction method and system based on a large language model technology. The method comprises the following steps: receiving a multi-source heterogeneous data stream, and completing semantic space mapping and cross-modal feature fusion to generate a unified semantic representation vector set; constructing an initial knowledge graph skeleton; performing incremental optimization on the skeleton, and performing entity relationship disambiguation and conflict detection; and iteratively updating the knowledge representation, and outputting a target knowledge graph meeting semantic consistency. The system comprises a data receiving module, a semantic fusion module, a skeleton construction module, an optimization module and a knowledge updating module. According to the method, multi-source heterogeneous data is effectively processed, the accuracy, the dynamic updating capability and the semantic consistency of the knowledge graph are improved, and the method has wide application prospects in the fields of intelligent question answering, information retrieval and the like.

The invention provides an intelligent Internet of Things public security management and control system and method based on multi-source data fusion, and belongs to the technical field of Internet of Things security. According to the system, unified collection and standardized processing of multi-source data are achieved by recognizing a system operation scene and loading corresponding model parameters and response strategies, and a unified semantic representation structure is constructed. And the system executes anomaly detection at an edge node, completes risk scoring and grading alarm judgment in combination with a semantic structure and anomaly feature information, and generates a control response instruction based on strategy matching. Meanwhile, dynamic optimization of the scoring model and identity authentication, behavior auditing and data compliance export in the operation process are supported. The system has intelligent identification, adaptive analysis and response closed loop capabilities, and improves the precision and credibility of public security management in the Internet of Things environment.

The invention relates to an intelligent question-answering system optimization method and device based on a knowledge graph, and the method comprises the steps: obtaining original knowledge data of a target knowledge domain, and constructing a knowledge graph structure model; extracting term information of entity nodes in the knowledge graph structure model, and constructing an entity term set; receiving a natural language question input by a user, executing a semantic understanding operation based on the standardized expression set to obtain a structured question semantic representation, and matching the question semantic representation with the case training set to obtain context semantic features; constructing a cue word template, and executing a query instruction generation operation to obtain a target query statement of the graph database; submitting the target query statement to a graph database to execute data retrieval operation, and obtaining query result data corresponding to the question semantic representation; and performing personalized rendering processing on the query result data based on the user portrait information to generate final question and answer return content. The method has the effect of improving the query accuracy.

The invention discloses a large model enhanced code security detection method. The method comprises the following steps: dynamically associating CVE vulnerability features with code semantic representation through a knowledge graph construction module; extracting vulnerability features from a CVE vulnerability library by utilizing a knowledge graph construction module, and dynamically associating the vulnerability features with code semantics; based on the CodeQL standard, a query language is generated by adopting a large model and input into CodeQL for AST analysis, and code structure features are extracted; the large model generates a query language meeting the CodeQL standard, codes are analyzed through CodeQL, and key structure features are extracted; integrating a static analysis tool chain to carry out multi-dimensional credible verification on model output; integrating an SAST tool and a symbolic execution tool, and verifying the model output from different dimensions; and summarizing and fusing detection results of the enhancement layers, and determining a final detection result by adopting a decision optimization method. According to the method, through technical fusion and dynamic optimization, the problems of rule stiffness, one-sided detection and low result credibility are systematically solved.

The invention provides a multi-agent task collaboration method, device and equipment and a storage medium, and the method comprises the steps: carrying out the deep fusion and unified semantic coding of a collected multi-modal data set through a multi-modal large language model, and obtaining a high-dimensional cross-modal feature embedding and semantic representation file, the task requirement mapping module is used for enabling local task requirements of multiple agents to correspond to cross-modal semantics to obtain task requirement semantic mapping, and task division and time arrangement are carried out; when multiple agents execute tasks, key data and operation results are sampled in real time and compared with high-dimensional semantic representation, a concept offset detection result is obtained, and when it is detected that the concept drifts progressively, the multi-modal large language model is dynamically adjusted. According to the method, the communication and cooperation efficiency among multiple agents is enhanced by using a large language model, and task allocation and collaborative decision are optimized through task demand semantic mapping; and concept drift detection and a dynamic adjustment mechanism are introduced, so that the long-term adaptability in a complex dynamic environment is improved.

The invention relates to a multi-data standard definition conflict resolution method based on a large model and a knowledge graph, and belongs to the field of public data governance and data standardization. The method comprises the following steps: extracting and preprocessing a multi-data standard definition; defining semantic representation and large model analysis: performing semantic analysis on the definition of each data item by using a large model, and generating a semantic embedding vector and a key feature; knowledge graph construction and entity alignment: constructing a knowledge graph containing all data items, and connecting data item nodes with similar semantics in different standards by adopting an entity alignment algorithm to form a candidate alignment relationship; conflict detection and type identification: aiming at the aligned data item definition, comparing attributes and values, identifying definition conflict points, and classifying and marking conflict types; and carrying out conflict resolution and unified definition generation by using a globally optimized conflict resolution algorithm. According to the method, the problems of data islands and semantic conflicts caused by inconsistent data standard definitions in the prior art are solved.

The embodiment of the invention relates to the technical field of video processing, and particularly discloses a video timestamp event identification and reasoning method based on a multi-modal large model. According to the embodiment of the invention, an input video is processed, and visual information and text information are extracted; performing interaction and fusion on the visual information and the text information to generate a video event semantic representation; and performing event identification on the semantic representation of the video event to obtain an event timestamp mark and event logical reasoning. According to the method, deep fusion and semantic association understanding of multi-modal information such as vision and texts can be realized, the problem that a traditional method is insufficient in semantic consistency and feature expression ability among modals is solved, and deep fusion of multi-modal features and accurate understanding of semantic association are realized; and the frame-level time information can be used as a visual code and a text feature to perform visual text feature alignment, and then video-level modeling is performed, so that the problem that a traditional model cannot directly capture an accurate time frame when a visual event occurs is solved.

The invention discloses an intelligent legal data processing method and system based on big data, and the method comprises the steps: S1, constructing a legal data collection framework, and carrying out the unified coding and representation of different data forms through a multi-modal fusion technology; s2, performing hierarchical semantic analysis on the cross-domain legal clauses to generate a high-dimensional semantic representation vector with context sensing capability; s3, performing node embedding, association analysis and reasoning optimization on the constructed legal knowledge graph to generate a dynamically updated multi-domain legal association network; s4, mapping and optimization among terms are realized through semantic comparison and multi-level rule verification; s5, performing modeling analysis on the dynamic trend and the potential risk factors of the legal data, and outputting a risk prediction and early warning strategy of the legal event; and S6, improving cross-data-source cooperative computing capability and data analysis efficiency through a distributed optimization strategy. The method has the advantages of high semantic understanding depth, high risk prediction accuracy and high privacy protection and cooperative computing efficiency.

The invention discloses an intelligent monitoring management method and system based on archive digitization, and relates to the technical field of data management, and the method comprises the steps: collecting and preprocessing multi-source archive data, employing a multi-mode BERT model to carry out the feature fusion of different data sources, and generating a unified semantic representation; semantic labeling is performed on archive data through a multi-label classification model, a semantic graph of archive content is constructed by using a graph database, an association relationship between archives is represented, a semantic index tree is constructed based on the semantic graph, and rapid positioning and calling of the archive content are optimized; and recording the change of each file version, positioning the change position based on a semantic index tree, identifying the semantic change of the file through a semantic difference comparison algorithm, recording hash, carrying out granularity division on the file content through the semantic boundary of each level of node in the index tree, and generating a user access strategy. According to the invention, dynamic perception and risk early warning of user behaviors are realized, and the intellectualization and safety of the archive management system are effectively improved.

The invention provides a digital human interaction control method and device fusing emotion semantics and logical reasoning and a storage medium. The method comprises the following steps: analyzing multi-modal input data of a user, constructing emotion-semantics joint representation, and generating a logic decision path; and through a cognitive fusion module, emotion-semantic representation and a logic decision path are fused, and an interaction response adapting to emotion and logic consistency is generated. The system optimizes an emotion semantic model and a logical reasoning rule on line according to user feedback and interaction history, and real-time interaction of emotion dynamic and logical rules is achieved. The system can dynamically adjust the logic decision path based on the multi-mode emotional state of the user, and improves the naturalness and situation adaptability of interaction. A dynamic time warping algorithm and a factorization machine are introduced to process a multi-modal feature fusion problem, and the accuracy and robustness of emotional state recognition are improved. The online optimization mechanism enables the model and the rule to be evolved continuously, and reasoning errors are corrected automatically through user feedback, so that error circulation is avoided.

The invention relates to a drug-disease relationship prediction method and system based on a dual-channel fusion knowledge graph. The method comprises the following steps: S1, constructing a biomedical fusion knowledge graph; s2, constructing a drug-disease sub-graph based on the biomedicine fusion knowledge graph; s3, constructing a dual-channel adaptive fusion feature module, and embedding a drug-disease sub-graph; s4, performing enhanced splicing on the drug-disease sub-graphs in the dual-channel fusion knowledge graph pre-embedded network, importing an edge-node iterative updating learning mechanism, training a spliced sub-graph relation perception learning network, and obtaining enhanced sub-graph feature embedding; and S5, utilizing the trained enhanced subgraph features to embed, calculate and output the prediction probability of the drug-disease relationship. According to the method, the semantic representation capability of the knowledge graph and the topological modeling advantages of the graph neural network are integrated, and efficient and accurate prediction of the drug-disease relationship is realized through multi-modal feature interaction, sub-graph enhancement and a dynamic sub-graph learning mechanism.

The invention discloses a self-adaptive learning question answering system and method based on multi-modal interaction, and particularly relates to the technical field of self-adaptive learning question answering. By constructing a modal recognition and preprocessing module, standardization and structuralization of multi-modal input of texts, voices, images and the like are realized; establishing a cross-round modal memory map through time sequence coding and map modeling; dynamically updating a user portrait in combination with user interaction history and current modal characteristics; in the question and answer generation process, current input, a user portrait and a historical graph are fused, intermediate semantic representation is generated through a context enhancement module, and the intermediate semantic representation is combined with a knowledge base to generate answers; meanwhile, a modal confidence degree dynamic evaluation mechanism is introduced, and weights are distributed according to the input quality, the user adaptation degree and the context correlation; and finally, incremental optimization is carried out on the graph structure, the user portrait and the question and answer strategy through a user feedback driving system, and multi-round, multi-mode and self-adaptive intelligent question and answer interaction is realized.

The invention relates to a multi-modal named entity recognition method based on cross-modal guide interactive fusion, which comprises the following steps: constructing a data set, designing a cross-modal contrast aggregation mechanism, respectively extracting image features and text features, and constructing a contrast learning mechanism to screen out image features with high association degree with text semantics for dynamic aggregation; a DINO model is introduced to extract image features, a dynamic similarity matching method is constructed, a dynamic similarity matching weight is generated based on text features and an image feature correlation matrix, a dynamic gating mechanism is utilized to adaptively select image features related to text feature context, and a cross-modal fusion and guide interaction strategy is constructed. Outputting an enhanced semantic representation vector, and mapping the semantic representation vector after multi-modal fusion into a final entity tag sequence by adopting a conditional random field decoder to complete entity recognition; the method has the advantage of remarkably improving the robustness and accuracy of multi-modal entity recognition.

The invention provides a non-performing asset cross-scene question and answer framework based on a knowledge graph, and relates to the field of artificial intelligence and legal science and technology, and the framework comprises a framework, a knowledge fusion layer is provided with a multi-source data access module which is used for obtaining heterogeneous data of a law and regulation database, a judicial case library, an enterprise financial statement system and an asset transaction platform; configuring a legal entity analysis engine, and converting the unstructured legal text into an entity-relationship-attribute triple which can be represented by a knowledge graph based on an ontology mapping technology; setting a financial data standardization component, and converting the financial data in different formats into unified semantic representation through a predefined financial index mapping rule; the knowledge fusion layer of the framework can integrate multi-source heterogeneous data such as laws and regulations, financial data, business processes and the like through a multi-source data access module, a legal entity analysis engine, a financial data standardization component and the like.

The invention provides an enhanced generation method based on question matching retrieval, and belongs to the field of matching generation, and the method comprises the following steps: S1, a semantic feature coding stage: carrying out real-time feature extraction and vector space mapping on a natural language query input by a user by adopting a deep neural network model, generating high-dimensional distributed representation with semantic representation capability; s2, a knowledge base intelligent retrieval stage: executing multi-dimensional semantic matching in the vectorized knowledge base based on an approximate nearest neighbor search algorithm, and screening out a candidate knowledge set highly related to query semantics through a similarity measurement function; s3, retrieval matching results are automatically associated to the structured knowledge base through the established semantic-knowledge mapping relation, the preprocessed standardized response content is directly obtained, and the response content adopts a multi-modal data organization form and comprises a structured data entity and retains a rich text expression form.

The invention relates to the technical field of shopping guide, in particular to a multi-mode user intention understanding and personalized shopping guide generation method and system, and the method integrates vision, voice and touch screen data to construct a commodity and user intention knowledge graph. Through a cross-modal contrast learning architecture and deep feature learning of user intentions, precise commodity matching and sorting are realized; and in combination with a knowledge-enhanced semantic alignment model, generating a personalized recommendation verbal skill, and making a shopping guide strategy by using a sequence-to-sequence neural network. Complementary information among different modal data can be captured, a unified semantic representation space can be learned, and the accuracy of user intention understanding is greatly improved; the system breaks through the technical barriers, significantly improves the intelligent shopping guide capability of the e-commerce platform, rebuilds the shopping experience of the user, shows huge commercial value, and injects new power for industry development.

The invention discloses an airport intelligent service question answering method and system based on AI, relates to the technical field of artificial intelligence, and comprises the steps of performing combined modeling by using a time sequence and a multi-head attention mechanism, extracting key behavior characteristics, fusing intention recognition and behavior prediction, and improving the answer reasoning accuracy. The method comprises the following steps: selecting a semantic knowledge base, constructing deep semantic representation and accurately matching the deep semantic representation with the semantic knowledge base, extracting high-weight phrases in combination with a sliding window mechanism, generating unique semantic fingerprints by utilizing a Karp-Rabin hash function, improving the speed and accuracy of answer matching, and performing fuzzy control and redundant information elimination on candidate answers by adopting a rough set tolerance model. Semantic similarity judgment is carried out according to the intersection and union set proportion between the upper and lower approximate sets, the problems of semantic drift and repeated candidates in traditional matching are effectively relieved, and through reinforcement learning and A / B testing, the question and answer strategy is continuously optimized, and the response effect of the system and the user satisfaction degree are enhanced.

The invention discloses a speech recognition and natural language processing integration method and system, and the method comprises the steps: carrying out the multi-modal data fusion according to a speech signal of a user, context text information and environment sensor data, and obtaining a fused multi-modal feature vector; inputting the multi-modal feature vector into a speech recognition model based on an adaptive deep neural network, and performing speech-to-text processing to obtain text output; inputting the text output into a semantic analysis model based on a graph neural network, and performing context semantic analysis and user intention recognition to obtain semantic representation of the user intention and a confidence score of the semantic representation; and according to the semantic representation and the confidence score thereof, dynamically adjusting parameters of the speech recognition model and the semantic analysis model by using a feedback optimization technology based on reinforcement learning, and generating a model optimization strategy. According to the embodiment of the invention, the accuracy of speech recognition and the semantic comprehension capability of natural language processing can be improved.

The invention discloses a multi-agent dynamic arrangement method based on multi-modal analysis and adaptive retrieval, and relates to the technical field of artificial intelligence and information retrieval. Comprising the steps of S1, converting a text, an image, structured data and voice content input by a user into a unified multi-mode semantic representation, S2, converting the unified multi-mode semantic representation into a specific execution process, and S3, automatically scheduling a reasoning agent, a knowledge obtaining agent and an execution agent according to DAG nodes, task elements and available resources, and obtaining the task elements and the execution agent according to the reasoning agent, the knowledge obtaining agent and the execution agent. S4, after task process construction and agent arrangement are completed, dynamic retrieval, evidence convergence and strategy optimization are carried out on information requirements related to a user task, so that a reasoning agent obtains complete knowledge support with consistent context, and S5, knowledge evidence is combined with a task process, so that the task process is completed. The method comprises the following steps: step S6, implementing problem solving, strategy generation and task closed-loop execution through a reasoning agent, step S6, performing actual operation on a target task by an execution agent according to an executable instruction sequence output by the reasoning agent, and outputting a result, and step S7, performing result verification according to an output result returned by the execution agent, and the correctness, integrity and consistency of an output result are examined through rule verification, model evaluation and evidence alignment.

The invention provides a multi-feature fusion rumor detection method, system and device based on knowledge distillation, and mainly solves the problems that an existing model is high in calculation overhead, insufficient in feature fusion and insufficient in emotion utilization. The method comprises the steps of firstly obtaining multi-dimensional data such as social media original texts and comments; extracting deep semantic representation by using a pre-training model, and analyzing comment emotion features in combination with a hybrid neural network; then, features such as semantics, emotions, emoticons and populations are input into a hierarchical gating interactive fusion network (GIFN), and weights are dynamically adjusted to achieve effective fusion of multi-granularity features; in order to reduce complexity, a knowledge distillation framework is designed: a deep GIFN is used as a teacher network to generate a soft label, and a lightweight student network (LSTM) is guided to perform training. According to the trained student model, the parameter quantity is remarkably reduced, meanwhile, good detection performance is kept, the student model can be conveniently deployed in an actual content auditing system or edge equipment, and social content rumors can be efficiently recognized and judged.

The invention discloses a multi-modal entity and relation extraction method and system based on cross-modal alignment and fusion, and the method comprises the steps: carrying out the processing and coding of an input text and an image, and obtaining a plurality of types of image and text features; performing feature alignment on the fine-grained and coarse-grained text features and the pixel-level image representation by taking the semantic representation of the image as an anchor point, and mapping the image and the text features to the same semantic space; performing multi-granularity feature fusion through text-guided dynamic gating aggregation, visual prefix cross-modal fusion and cross-modal image-text matching, modeling association between noun phrases and image objects in a text while increasing feature complementarity, and obtaining multi-granularity multi-modal feature representation; fusing multi-granularity multi-modal features through entity guidance attention gating, and gathering visual information related to a text entity to obtain final multi-modal fusion representation; according to the multi-modal fusion representation, task prediction of multi-modal named entity recognition and multi-modal relation extraction is carried out.

The invention provides an intelligent agent tool calling knowledge optimization method based on empirical path graph evolution, which comprises the following steps: when an intelligent agent successfully completes a task for the first time, recording an intelligent agent tool calling sequence, input and output parameters and an execution result, generating a structured calling log, the calling log is converted into a standardized calling path knowledge unit; performing structured representation and semantic representation on the calling path knowledge unit, storing the structured representation in a graph database, and storing the semantic representation in a vector database; task intentions, tool entities and calling paths are used as heterogeneous nodes, an experience path knowledge graph is constructed, the experience path knowledge graph is used for recording the multi-dimensional relation among tasks, paths and tools, execution performance attributes and feedback attributes are added to path nodes in the graph, and agent tool calling knowledge optimization is completed. And the purpose of improving the tool calling efficiency and robustness of the intelligent agent in the multi-task environment is achieved.

The invention discloses an electronic medical record automatic quality control system and method based on a large language model, and the method comprises the steps: extracting medical record data from a medical information system, and carrying out the data preprocessing; and performing deep semantic analysis on the medical text by utilizing a large language model, and extracting key diagnosis and operation information. And performing semantic representation on the medical terms by fine tuning the pre-training language model and combining with a multi-layer attention mechanism. And constructing an ICD coding knowledge graph, and calculating the semantic similarity between the diagnosis terms and the ICD coding terms in the electronic medical record by using an embedded vector technology to realize automatic matching. And according to a predefined quality control rule, automatically checking the electronic medical record through the logic expression, and generating a quality control report and an improvement suggestion. And finally, visually displaying quality control and coding results, and outputting a quality control report. The electronic medical record quality control efficiency and accuracy are improved, and standardization and automation of quality control work are achieved.

The invention relates to the technical field of machine vision, and discloses a machine vision-oriented cross-modal image-text analysis method, which comprises the following steps of: partitioning an input image to generate an image block sequence; inputting the image block sequence into a visual converter for multi-scale feature extraction, and generating target visual features; encoding the input text to generate a target text feature; inputting the target visual features and the target text features into a deep reconstruction bottleneck network for compression alignment, and generating a cross-modal compression vector; and inputting the cross-modal compression vector into a large language model to generate cross-modal decoding information, so that cross-modal redundant information can be effectively filtered, compact shared semantic representation can be learned, the information integrity of the compression process is ensured through bidirectional reconstruction verification, cross-modal semantic alignment is realized, and the method has the advantages of high efficiency and high reliability. Omnibearing cross-modal content generation from the whole to details is achieved, and the requirements of different application scenes are met.

The invention discloses a multi-modal natural language understanding and generating system and method. The method comprises the following steps: constructing a cross-modal pre-training module, training a multi-modal encoder, and establishing a cross-modal association mapping space; mixing prompt fine tuning is carried out, and a complete blank filling template is constructed; according to the intention reasoning network, extracting multi-round dialogue intention representation of the user, and retrieving an external knowledge base for fine-grained reasoning; constructing a unified semantic representation framework, embedding the text, the image and the voice into a unified space, and generating a query vector of multi-modal intention perception; and the knowledge query module based on key value memory generates entity-level multi-modal replies and optimizes the semantic comprehension and generation capability of the dialogue model. According to the method, the multi-modal information understanding and generating capacity is improved, deep association and understanding of image and text information are achieved, downstream task adaptability is enhanced, task completion accuracy and efficiency are improved, unified semantic representation of the multi-modal information is achieved, and support is provided for information retrieval and utilization.

The invention relates to an intelligent shooting method for scene understanding and script analysis driven by a large science and technology movie and television model, and belongs to the technical field of machine vision. The method comprises the steps that script text features are extracted and decomposed to obtain plot development, emotional fluctuation and artistic style information, a reference film and television work with the maximum overall matching score is selected based on a decomposition result, and an optimal shooting strategy vector is extracted; analyzing the shot scene to generate visual features; fusing the text features and the visual features to obtain a multi-modal semantic representation, and generating a dynamic scene-task knowledge graph according to the optimized multi-modal semantic representation so as to generate a shot scheduling strategy; the shooting process is tracked, the shooting sequence and the lens application mode are monitored in real time, and when it is detected that the shooting sequence deviates, lens connection deviates or visual expression does not conform to expectation, an intelligent optimization mechanism is triggered; and when the deviation exceeds a set threshold value, a manual intervention prompt is given out. The shooting cost can be reduced, and the manufacturing efficiency can be improved.

The invention relates to the technical field of artificial intelligence, can be applied to the field of medical health, and discloses a navigation method, device and equipment in an unexplored environment and a medium. Analyzing a pre-trained large language model into a structured semantic representation at least comprising target entity information, spatial constraint information and contextual intention information; inputting the target entity into a pre-trained large language model to generate a standardized task description question, inputting the standardized task description question and real-time environment image data into a pre-trained visual language question and answer model, and outputting a semantic answer result about whether the target entity exists or not; and if yes, generating a navigation strategy through a pre-trained large language model based on the structured semantic representation, and controlling the robot to execute a navigation action through a preset path planning algorithm. The method does not need to depend on an environmental map and scene training, realizes navigation in an unexplored environment by utilizing cooperation of a large language model and a visual language question and answer model, solves the problem of strong dependency of a traditional scheme on prior data, and has good generalization ability and environmental adaptability.