24574results about "Energy efficient computing" patented technology

The invention discloses an NL2SQL optimization method and device based on a large model, equipment and a medium, and relates to the technical field of artificial intelligence, the method comprises the following steps: constructing a target metadata knowledge base, and obtaining an initial natural language query request; determining each target entity corresponding to the initial natural language query request, and determining missing target SQL elements in the initial natural language query request based on each target entity; generating a first cue word based on the initial natural language query request, the target SQL element and the target metadata knowledge base, and complementing the target SQL element based on the first cue word by utilizing the target large model to obtain a target natural language query request; and generating a plurality of candidate SQL statements corresponding to the target natural language query request by using the target large model, verifying each candidate SQL statement, and determining a target SQL statement from each candidate SQL statement based on a verification result. According to the method, the accuracy of the NL2SQL can be improved by utilizing a large model.

The invention provides a multi-source heterogeneous data integration and governance-oriented data weaving method, which comprises the following steps of: performing data acquisition from an accessed multi-source heterogeneous data source to generate an original multi-source heterogeneous data stream; performing standardization processing on the original multi-source heterogeneous data stream to generate a standardized multi-source heterogeneous data set; performing active content scanning processing on the standardized multi-source heterogeneous data set to determine business metadata, and performing consanguinity tracking processing on the business metadata to generate enhanced business metadata; calling a domain ontology framework to carry out standardized constraint on the enhanced service metadata to obtain standardized service metadata without cross-data source semantic ambiguity, and carrying out implicit association mining processing on the standardized service metadata based on a graph neural network to generate a semantic knowledge graph containing core entities and relationships; and performing logic abstraction processing on the distributed data resources according to the semantic knowledge graph to generate a unified data access interface.

The invention discloses a knowledge base enhancement generation method and system based on hybrid retrieval and fact verification. The method comprises the following steps: receiving an original query of a user; performing intention analysis and rewriting on the query, identifying an intention type and generating a sub-query adapted to retrieval; executing mixed retrieval of vector retrieval, keyword retrieval and selectable knowledge graph retrieval based on the sub-query, and recalling related knowledge fragments; performing deduplication clustering, fact conflict recognition processing and correlation reordering on the knowledge fragments; according to the intention type and the reordered knowledge fragment, dynamically selecting a prompt template to construct an enhanced prompt; and sending the enhanced prompt into the large language model, and generating a target response with the reference source. According to the method, knowledge recall comprehensiveness is improved through mixed retrieval, knowledge reliability is ensured through fact verification, generation logicality is enhanced in combination with dynamic prompt construction, and response accuracy and credibility are improved.

This invention relates to a gait emotion recognition method, system, storage medium, and computer device based on spatiotemporal graph convolution. The method includes the following steps: S1, data augmentation by reversing the temporal direction of gait; S2, obtaining deep emotion features and prior emotion features respectively through a spatiotemporal graph convolutional network and prior feature statistical methods; S3, performing nonlinear mapping on the prior emotion features using a feature mapping layer; S4, inputting the fused features of the deep emotion features and prior emotion features into an emotion classifier to obtain the emotion category. The feature mapping layer of this invention achieves more effective feature fusion by performing nonlinear mapping on prior features; it also introduces causal temporal convolution to replace general temporal convolution, effectively extracting fine-grained temporal features by enhancing temporal correlation and cross-period feature fusion. Furthermore, a walking direction recognition auxiliary task is designed to accelerate the training and convergence speed of the model, enhancing the ability to extract temporal-dependent features and the performance of emotion recognition.

The invention discloses an AI model automatic deployment platform based on a containerization technology, which relates to the technical field of automatic deployment of an artificial intelligence model, and comprises a container construction and intelligent configuration module, a transmission and cache management module, a security and multi-version warehouse module, a resource scheduling and optimization module and a deployment and interface management module, the container construction and intelligent configuration module adopts a three-layer mirror image construction strategy of a base layer, a framework layer and a model layer. According to the invention, all the modules cooperate to form a closed loop, after the container construction module generates an incremental packet and the incremental packet is subjected to security signature verification, the transmission module distributes the incremental packet according to network quality, the resource scheduling module dynamically adjusts bandwidth and quota, and the deployment module starts the container and monitors the container in real time. The problems of efficiency, safety and resource optimization of model deployment in an edge environment are solved, and cross-platform compatibility and service continuity are improved.

The invention relates to the technical field of data center intelligent management, in particular to a data center construction and intelligent operation and maintenance management system, which comprises a dynamic environment sensing module, a heterogeneous equipment protocol adaptation module, a multi-dimensional resource dynamic scheduling module, a hidden fault prediction module and an energy efficiency optimization execution module. Physical environment data such as temperature gradient, current harmonic component and optical fiber strain rate are acquired by deploying a multi-mode sensor, and an environment characteristic matrix is constructed; standard semantic mapping of the heterogeneous protocol is realized by using a semantic slot migration algorithm; establishing a resource topological graph based on the hypergraph neural network and dynamically updating the resource topological graph; a dual-channel space-time convolutional network is adopted to realize fault prediction; and combining the fault probability matrix to generate a dynamic tuning strategy of dimensions such as cooling, electric power, network and the like, and forming closed-loop optimization control. According to the invention, integrated collaboration of multi-source information fusion, equipment intelligent control and energy efficiency adaptive optimization is realized, and the intelligence, reliability and energy efficiency level of data center operation and maintenance are improved.

The invention relates to the technical field of intelligent recommendation, and discloses a hybrid retrieval RAG-based resource recommendation method and system, and the method comprises the steps: collecting resource text data, and constructing a vector library and a tag library; expanding the user question based on the language model to obtain a plurality of semantic extension questions; performing intention recognition, judging whether the user question is a resource recommendation question, and if yes, determining a target classification type; screening the data according to the field definition in the tag library to obtain a candidate knowledge fragment set; obtaining candidate vectors, mapping the user question and the semantic extension question into query vectors, calculating the similarity between the query vectors and each candidate vector, and selecting knowledge supplement content; and performing resource splicing on all the knowledge supplement contents to generate resource recommendation answers. According to the method, a structured label screening mechanism and a semantic vector fine arrangement mechanism are fused, and the problems of recall redundancy, matching deviation and the like caused by the fact that an existing RAG system only depends on semantic similarity retrieval are solved.

The invention discloses a computing power scheduling method and system based on dynamic load prediction and resource priority ranking. The computing power scheduling method comprises the following steps: collecting historical load data, task submission data and resource state data of each node in a computing power cluster; on the basis of the preprocessed multi-dimensional load feature data set, constructing an improved hybrid prediction model, optimizing model parameters through training, and predicting the load change trend of each computing power node in a future preset time period by using the trained model to obtain a node load prediction result; extracting a service level protocol parameter, a resource demand type and historical execution efficiency data of a to-be-scheduled task, and establishing a multi-dimensional resource priority evaluation index system; according to the computing power scheduling method, the problems of low resource utilization rate and high task response delay caused by low load prediction precision and mismatching of resource allocation and task priority in a traditional computing power scheduling method are solved, and the overall operation efficiency and service quality of a computing power cluster are improved.

The invention provides a fragment data cross-modal label generation system and method based on deep transfer learning. The method comprises the following steps: extracting first high-dimensional feature vectors in different modes; mapping the first high-dimensional feature vectors of different modals into the same semantic space through a cross-modal comparison loss function to realize multi-modal alignment and fusion to obtain second high-dimensional feature vectors; labeling semantic tags corresponding to the second high-dimensional feature vectors based on the fragmented data components by adopting a small sample transfer learning algorithm; a multi-channel Hash encoder is adopted, a self-adaptive encoding strategy is called according to different modal data combinations, and the second high-dimensional feature vector is encoded into a multi-channel binary Hash code; in combination with an incremental graph neural network, the binary hash codes and the corresponding semantic tags are dynamically expanded into the historical knowledge graph; matched fine-grained tags are established for semantic differentiation features of different entity combinations in the target knowledge graph, and a cross-modal tag tree is obtained by combining three-matrix hierarchical construction.

The invention relates to the technical field of data processing, and discloses a cross-border e-commerce commodity recommendation system and method based on multi-source data fusion. The system comprises an acquisition module for performing data acquisition to obtain a cross-border unified data warehouse and federal learning cooperation data; the classification module performs text classification processing to obtain a user preference analysis result and an interpretable attention mark; a quantization module carries out quantization processing to obtain a cross-border selection feature matrix; the fusion module carries out weighted fusion processing to obtain a basic comprehensive score and a weight convergence detection result; the evaluation module performs risk evaluation processing to obtain risk probability distribution and cross-border compliance evaluation results; and the sorting module carries out real-time processing through lightweight preprocessing and a flow-type calculation pipeline to obtain a comprehensive score sorting list of cross-border selected products. The problem that a traditional cross-border e-commerce product selection method cannot effectively integrate multi-source heterogeneous data and cannot analyze user feedback text semantic information is solved.

The invention relates to the technical field of multi-modal information processing, and provides a deep semantic collaborative fusion method for heterogeneous multi-modal data. The invention provides a dynamic adaptive fusion framework aiming at the problems that a modal interaction mechanism is rigid and semantic modeling is shallow in the prior art. The method comprises the following steps: carrying out feature coding and alignment on text, audio and video modal data to generate unified-dimension single-modal representation; dynamic interaction is realized through an enhanced multi-head gating fusion module, and double-path features are generated; and carrying out cross-modal depth modeling on the basis of a stacked Transform encoder, and outputting final fusion semantics. Wherein the multi-head attention path calculates cross-modal mapping by taking a text as a query vector and taking an audio / video as a key value vector; the gating path generates a dynamic weight through cosine similarity and a learnable temperature parameter; and the dual-path adaptive fusion adopts a balance factor alpha weighted combination. According to the method, the multi-modal data fusion precision and the system robustness are improved, and the method is suitable for government affair service, man-machine interaction and other scenes.

The invention discloses a cloud computing resource optimization method based on intelligent scheduling, and belongs to the technical field of cloud computing resource processing. The method comprises the steps of obtaining real-time operation data of target data in a data optimization detection range, collecting historical resource scheduling records and task execution logs, and constructing a multi-dimensional resource state data set; according to the method, multi-objective optimization, simulation verification and reinforcement learning feedback in the step S5 are carried out, a perception-prediction-scheduling-monitoring-optimization closed-loop mechanism is constructed, the resource utilization rate, the response time and the energy consumption cost of a multi-objective optimization function are balanced, and a particle swarm optimization algorithm is combined with simulation verification to generate a global optimal strategy; and reinforcement learning dynamically adjusts model parameters by taking the execution deviation as a reward signal, continuously updates a resource perception dimension and a prediction model, realizes continuous iterative upgrade of a resource optimization effect, and performs optimization processing on cloud computing resource optimization based on intelligent scheduling.

The invention discloses a multi-path recall mixed retrieval method and system based on intelligent dynamic weight distribution, and aims to solve the problems that semantic comprehension and keyword matching are difficult to balance and the adaptability is poor due to the adoption of a fixed weight in the existing retrieval technology. The invention provides a multi-path recall mechanism fusing vector semantic retrieval, BM25 keyword retrieval and entity retrieval. A query feature vector containing 13-dimensional features such as semantic complexity, keyword density and entity coverage rate is constructed, a query type is recognized in combination with an SVM and a random forest integration model, a dynamic weight distribution algorithm is designed, and the final weight of each retrieval path is calculated in real time. And an adaptive multi-source enhanced reciprocal ranking fusion (AMSE-RRF) algorithm is further adopted to carry out optimization fusion on multiple paths of results, and a depth reordering model can be selected to improve the precision. According to the method, the accuracy and robustness of retrieval can be remarkably improved in multiple scenes of medical treatment, finance, government affairs and the like according to a millisecond-level self-adaptive adjustment strategy of query features.

The invention discloses a matrix calculation adaptive optimization method and system based on an ARM architecture. The method comprises the following steps: preprocessing to-be-processed matrix data; performing local activeness calculation and hot spot region identification on the preprocessed matrix data, and determining long-tail distribution characteristics of the matrix; calculating the optimal block size range of the matrix based on the long tail distribution characteristics of the matrix and the multi-level cache capacity parameters in the processor information, and generating an asymmetric block scheme; based on an asymmetric partitioning scheme, establishing a mapping relation between matrix features and optimal partitioning parameters; calculating the calculation density and the memory access mode of each block based on the asymmetric block scheme and the mapping relation, and generating a task scheduling scheme; based on the task scheduling scheme, matrix calculation is executed on the processor, and a final calculation result is output. According to the method, self-adaptive blocking and heterogeneous core scheduling are realized by identifying the long tail distribution characteristics of the matrix, and the performance and energy efficiency of matrix calculation on ARM are improved.

The invention provides a method for generating an SQL (Structured Query Language) by a natural language based on bidirectional mapping and semantic parsing, which relates to the technical field of database query and comprises the following steps of: extracting natural language query elements and packaging the natural language query elements into structured data, and establishing a mapping relationship from a query field to a service attribute and a physical data table by adopting a bidirectional Hash index technology; and automatically identifying multi-table association keys, performing semantic extension and compliance verification, generating an abstract syntax tree, performing processing according to user permission, and finally converting the abstract syntax tree into an SQL statement conforming to a target database syntax specification. According to the method, the accuracy and the efficiency of converting the natural language into the SQL are improved, and the flexibility and the safety of the system are enhanced.

The invention provides a multi-modal knowledge extraction method and system based on multi-agent collaborative optimization, and relates to the technical field of knowledge extraction, and the method comprises the steps: carrying out the multi-modal deconstruction of an original document to be extracted; constructing a multi-modal agent, respectively executing feature extraction and preliminary knowledge extraction, and outputting a single-modal multi-component system; based on a cross-modal knowledge graph, mapping information of different modals to a unified semantic node, and establishing cross-modal association and analyzing a logic chain through a graph neural network and a causal reasoning module; dynamically allocating resources according to the importance of map nodes, and screening structured knowledge; and through confidence analysis and node traceability evaluation, an intelligent agent cooperation mechanism is optimized, and increment correction is carried out on a result. According to the method and the device, the technical problem of low knowledge extraction accuracy and efficiency caused by insufficient multi-modal knowledge collaborative mining capability due to knowledge extraction of literatures by adopting a single agent in the prior art can be solved, and the knowledge extraction quality and efficiency are improved.

The invention relates to the technical field of data center heat dissipation, and particularly provides a single-phase and two-phase immersion liquid cooling method and system based on AI intelligent decision, and the method comprises the steps: injecting coupled data into a dynamic feature extraction engine, and outputting a thermodynamic state evolution tensor which comprises the characteristics of a temperature change rate, a load-heat flux density coupling coefficient and the like; the thermodynamic state evolution tensor is input into the deep neural network model, the temperature and pressure matched with the current thermodynamic state evolution tensor are calculated, and a closed-loop control instruction set capable of being executed by equipment is generated; a closed-loop control instruction set is injected into an execution mechanism set, execution mechanisms execute power reconstruction and flow channel switching according to instructions, gaseous fluorinated liquid is liquefied and flows back through an efficient condenser in a two-phase mode, and heat dissipation mode self-adaptive switching and heat cycle reconstruction are achieved. The system comprises a server, an AI algorithm controller, a cooling liquid storage device, a condenser, a circulating pump, an electric valve, a pressure release valve and a temperature sensor. The heat dissipation efficiency and the system reliability are remarkably improved.

The invention discloses a cost optimization method for resource scheduling management of a cloud data center, and relates to the technical field of cloud computing, and the method comprises the following steps: S1, collecting and modeling a multi-dimensional resource state of the cloud data center, and generating a resource change trend based on a sliding time window and a prediction model; and S2, constructing a multi-target game scheduling model taking calculation, storage, bandwidth and energy consumption as participants, outputting a scheduling game solution in combination with task modal adaptability parameters, and forming task-resource optimal matching. According to the method, through multi-dimensional resource state collection, a sliding time window and an advanced prediction model, resource dynamic changes and future trends can be captured more accurately, more reliable input is provided for scheduling decisions, resource waste or performance bottlenecks caused by information lag are avoided, calculation, storage, bandwidth and energy consumption are modeled as multi-party game participants, and the game efficiency is improved. Nash equilibrium is solved in combination with task modal adaptability parameters, and an optimal scheduling scheme giving consideration to resource utilization rate, performance and cost can be found.

The invention provides a distributed storage resource intelligent scheduling method and device, and relates to the technical field of data processing, and the method comprises the steps: carrying out the feature splicing of feature vectors of different modes, so as to obtain a multi-mode feature vector; predicting the user satisfaction based on the multi-modal feature vector and the resource adjustment parameter; establishing a resource demand priority mapping table under different service scenes according to the user satisfaction; constructing a multi-objective optimization model according to the resource demand priority mapping table; on the basis of the multi-objective optimization model, predicting the resource state and the load condition of each node in the distributed storage system; and according to the resource state and the load condition of each node, lightweight rule scheduling is carried out to obtain a preliminary scheduling scheme. According to the invention, intelligent scheduling management of distributed storage resources is realized.

The invention provides a multi-round dialogue intention recognition method and system based on self-adaptive semantic understanding, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining a natural language dialogue text of a current round of a user, and taking the natural language dialogue text as original input data; based on original input data, multi-level semantic features are extracted through a dynamic semantic coding algorithm, and semantic vector representation of a current round of dialogue is generated; setting three fixed anchor points in a semantic vector space based on a current round semantic vector and a historical dialogue state vector to form a triangular analysis structure; performing gridding segmentation on the triangular analysis structure, and generating a feature adjustment value according to distribution characteristics of segmented grids; and dynamically correcting the extraction process of the context-related features by using the feature adjustment value to obtain the corrected context-related features. According to the method, end-to-end optimization is realized in multiple rounds of interaction scenes such as customer service and intelligent assistants through full-process design.

The invention discloses an accurate flow control method and system for a two-phase cold plate cooling data center, and relates to the technical field of two-phase cold plate cooling, and the method comprises the following steps: S1, collecting multi-mode operation monitoring data in real time, and carrying out the data preprocessing; s2, constructing a multivariable short-time-sequence prediction model, predicting the cooling demand, and performing optimization regulation and control on a cooling demand prediction result; s3, the target regulation and control flow of the cooling liquid is predicted, and flow and cooling execution measures are taken according to the target regulation and control flow prediction result; the opening degree of the valve is accurately adjusted and evaluated in real time, and accurate flow control is achieved; s4, integrating multi-mode operation monitoring data, a cooling demand prediction result, a target regulation and control flow prediction result and a valve opening accurate regulation evaluation result, and constructing a parameter optimization and safety fault-tolerant mechanism; the problems of chip safety and energy consumption risks caused by cold plate temperature overshoot and cooling capacity regulation lag under high-load fluctuation of the server are solved.

The invention relates to the technical field of data analysis, and discloses a GPU computing power resource scheduling method and system, and the method comprises the steps: collecting node hardware parameters and dynamic load indexes of a GPU cluster to construct a multi-dimensional resource feature vector of the GPU cluster, and constructing a resource portrait of the GPU cluster; establishing a node health degree scoring model of the GPU cluster, and generating a health degree score of a cluster node corresponding to the GPU cluster; analyzing a video memory demand of the GPU task request, and calculating an intensive identifier and a communication dependency relationship; determining the SLA weight of the GPU task request, calculating the resource shortage sensitivity of the GPU task request based on the video memory demand, and calculating the target task priority of the GPU task request in combination with the SLA weight; and determining a resource scheduling node group requested by the GPU task in the resource portrait, generating resource scheduling parameters of the resource scheduling node group, and executing scheduling of computing power resources of the GPU cluster based on the resource scheduling parameters. According to the method, the scheduling efficiency of the GPU computing power resources can be improved.

The invention discloses an image processing method and device and a storage medium. The method comprises the steps of obtaining a to-be-simulated 3D convolution model and training data; decomposing the 3D convolution model into cascading of a 3D space convolution model and a 3D time convolution model to obtain a pseudo 3D cascading convolution model; training a pseudo 3D cascade convolution modelby using the training data, and obtaining parameters of a 3D spatial convolution model and a 3D time convolution model; converting the 3D space convolution model and the 3D time convolution model intoa 2D space convolution model and a 2D time convolution model; setting a feature rearrangement rule for the 2D spatial convolution model and the 2D time convolution model; mapping model parameters ofthe 3D spatial convolution model and the 3D time convolution model into parameters of a 2D spatial convolution model and a 2D time convolution model to obtain a 2D cascaded convolution model; and performing convolution operation on the image by using the 2D spatial convolution model and the 2D time convolution model. By means of the mode, image processing conducted through 3D convolution operationcan be achieved through the 2D convolution model.

The invention discloses a law shield AI intelligent case handling all-in-one machine system based on a large language model, and relates to the technical field of law artificial intelligence and judicial informatization, the system comprises an integrated terminal device, a case semantic modeling module, a class case knowledge engine, a risk prediction module, a large language model service interface and an intelligent document generation module; the system constructs a case semantic graph through multi-modal information fusion and a graph neural network, performs legal rule path matching and similarity reasoning based on a class case database, outputs structured legal suggestions and standard legal instruments in combination with user context recognition and large language model multi-round generation capability, and realizes dynamic updating of the semantic graph. The method improves the automation, structuring and interpretability of case processing, and is suitable for intelligent case handling scenes such as legal assistance, litigation assistance and judicial mediation.

The invention relates to the technical field of computers, and discloses a computing power resource multi-dimensional scheduling method and system based on dynamic weight, and the method comprises a data perception step, a weight generation step, an intelligent decision-making step and a scheduling optimization step. The system corresponds to the method. The method comprises the following steps: a data sensing step: collecting multi-dimensional state parameters of computing power nodes and carrying out feature modeling to construct a global feature space; a weight generation step: dynamically adjusting the weight of each dimension based on a machine learning model and a rule engine; an intelligent decision-making step of screening candidate nodes in the global feature space and evaluating priorities, generating an optimal node cluster and performing resource dynamic slice distribution; and a scheduling optimization step: monitoring an execution effect and performing closed-loop feedback so as to iteratively optimize a weight strategy and decision logic. The problems that in the prior art, the sensing dimension is single, and decision-making weight is rigid are solved, and multi-dimensional accurate sensing, dynamic weight decision making and elastic resource allocation of computing power resources are achieved.

The invention discloses a retrieval enhancement generated document screening system and method fusing a verification mechanism, and relates to the technical field of document screening, the system comprises a user input and query analysis module for extracting key information through natural language processing, and converting the key information into a high-dimensional semantic vector, a meta-tag and a keyword set; the multi-source document retrieval module is used for obtaining documents from multiple data sources through mixed retrieval and generating a candidate set through preliminary screening and sorting; the credibility evaluation and security verification module is used for generating scores and labels after multi-dimensional evaluation and screening qualified documents; the document consistency detection module is used for detecting document conflicts, processing and sequencing, and ensuring logic consistency; the document acquisition and generation module is used for inputting qualified documents into a generation model and generating answers with references; and the result output and tracing module is used for outputting answers and recording whole-process data to ensure traceability. The invention aims to ensure the accuracy and credibility of the generated content through a multi-dimensional verification mechanism.

The invention provides a multi-modal document content cross-platform analysis system, and relates to the technical field of data processing, and the system comprises a document preprocessing module which is used for receiving multi-source heterogeneous document input data, and generating a preprocessed document through format conversion, page segmentation, noise reduction and optical character recognition; the feature extraction module is used for extracting three types of features, including spatial layout features, semantic features and logic structure features, based on the preprocessed document; according to the method, the multi-source heterogeneous document is cooperatively processed, accurate extraction, calibration and association of features in cross-platform analysis are realized, finally structured data are generated, and the accuracy, consistency and cross-platform applicability of multi-modal document analysis are improved.

The invention discloses a retrieval generation method and system based on multi-agent collaboration, a terminal and a medium, and relates to the field of artificial intelligence. Performing semantic analysis on the input word embedding converted by the natural language query instruction through a query analysis agent, and determining a semantic intention vector; performing reinforcement learning and meta learning on the semantic intention vector through a strategy construction agent, and determining a retrieval strategy; performing semantic enhancement on the semantic intention vector according to knowledge graph node embedding to obtain a semantic enhancement vector; determining a data channel according to the semantic enhancement vector, a retrieval strategy and a real-time system load, and calling the data channel for retrieval to obtain candidate documents; and generating a target answer according to each candidate document based on an adaptive reflection feedback mechanism in combination with an auto-encoder and a generative adversarial network. The problems that the prior art depends on a fixed retrieval strategy, has limitation when facing complex query, multi-round interaction and cross-modal data fusion, is easily interfered by noise and is not accurate enough in semantic matching are effectively solved.

The invention discloses an android container rendering optimization method based on cross-domain hard real-time Fen synchronization, which comprises the following steps: by taking a swan-mong system as a host and an android system as a container, creating a hash table, a synchronous thread and a shared memory corresponding to a GPU core when the host is started, acquiring VSync cycle registration callback, transmitting shared memory FD to the container, and finishing shared memory mapping and alignment by the container. Registering a GPU queue to complete callback; when the Android application is started, a container obtains a queue and a physical address of a rendering buffer area, creates a Fen and binds the Fen to the queue, after the queue is submitted, metadata is written into a shared memory to inform a host, after the host receives the metadata, nodes are created and stored in a hash table, and an overtime timer is registered; after the GPU completes the command queue, the container calls back an update state and a verification value to notify the host, and after the host is verified to be valid, the corresponding hash table is updated, the timer is reset, and asynchronous screen loading is triggered; and the host executes buffer area synthesis and submission of the display equipment to finish on-screen, so that the stability of the rendering frame rate is improved, and the reliability of cross-domain synchronization is ensured.

The invention relates to the technical field of information retrieval and generation, in particular to a retrieval enhancement method based on multi-modal data fusion and modal perception. According to the method, firstly, a dual-channel architecture is adopted to perform feature extraction and coding on a text and an image respectively, and mutually independent embedded representation spaces are constructed, so that high-quality collaboration and matching of cross-modal representation are realized; and a pseudo-pairing generation mechanism is introduced to effectively mine and reconstruct the existing non-paired data in the knowledge base. And designing a query modal perception and dynamic weighting mechanism for accurately controlling the fusion proportion of the image-text bimodal information in the retrieval stage so as to match the modal demand difference of different query contents. And further executing aggregation retrieval and reordering of the cross-modal information by using dynamic weighted fusion retrieval to generate a candidate set of multi-modal responses. According to the method, accurate matching and dynamic weight adjustment of the image-text content are realized, and the accuracy and expression integrity of the generated content are improved.