245 results about "Semantic annotation" patented technology

The invention provides a scientific and technological literature intelligent retrieval method and related equipment based on generative artificial intelligence, and the method comprises the steps: carrying out the multi-layer semantic annotation of medical scientific and technological literatures, constructing a symptom-disease dynamic association map, and building a medical scientific and technological literature knowledge base; performing medical context analysis and multi-modal feature extraction on user query, and generating a unified retrieval vector in combination with Boolean operation nested analysis and semantic alignment processing; performing evidence grading retrieval and clinical scene matching based on the unified retrieval vector to obtain a preliminary candidate literature set, and optimizing the preliminary candidate literature set into a target candidate literature set through fine-grained semantic recalculation; and calculating a retrieval prior probability according to the evaluation dimension, performing knowledge weighted fusion on the candidate literature, and generating a medical science and technology literature recommendation report. According to the method, the medical term association relationship is deeply understood through the association map, the result is ensured to be matched with the patient characteristics through evidence grading retrieval and clinical scene matching and screening, and the accuracy of document retrieval is improved.

The invention provides a mine abnormal event real-time identification method and system based on time sequence characteristics, and relates to the technical field of mode identification, and the method comprises the steps: carrying out the time-space alignment and semantic annotation of multi-modal monitoring data, and constructing a time sequence knowledge graph; calculating a dynamic association weight between entities, and analyzing a risk propagation path; predicting a risk situation based on a historical evolution rule; and dynamically generating a differential early warning strategy and establishing a closed-loop tracking system. According to the invention, early identification, accurate prediction and efficient disposal of mine safety risks can be realized, and the mine safety management level is improved.

The invention relates to an industrial equipment maintenance intelligent question-answering system based on multi-agent collaboration. Wherein the input unit is used for receiving text, voice, image or equipment scanning and other multi-mode user input information and analyzing the information into structured problem information; the scheduling unit performs semantic understanding and problem classification on the structured problem information based on the fine-tuned cross-language pre-training language model and an incremental training mechanism; the processing unit calls a corresponding domain agent according to the classification result, and generates an intelligent question and answer processing result including predictive maintenance suggestions, structured reply content and semantic annotation information; and the fusion unit fuses the local knowledge base, the graph database and the networking retrieval information, performs multi-hop semantic reasoning on the intelligent question and answer processing result, and generates multi-modal reply information including text description, image screenshots, prediction curves and recommendation links. The system can support multi-language and multi-mode intelligent question answering and predictive maintenance in a complex industrial maintenance scene.

The invention discloses a highway data fusion management method, and relates to the technical field of intelligent traffic management, and the method comprises the steps: collecting the global operation data of a highway in real time through a multi-source heterogeneous sensing network; performing space-time alignment and semantic annotation processing on the operation data to construct a fusion data set; inputting the feature subset into a lightweight space-time fusion model to form a multi-target decision set; executing the traffic control instruction sequence in a preset space-time window according to the multi-target decision set; and generating a self-optimization report including a model iteration path and road network health assessment based on the deviation degree of the execution feedback data and the expected optimization target. According to the expressway data fusion management method provided by the invention, collaborative optimization of passing efficiency and safety of the expressway is guaranteed.

The invention discloses a BIM model automatic generation method and system based on point cloud data, and belongs to the field of building information modelling, and the transmission method comprises the steps: obtaining original point cloud data, and employing a filtering algorithm based on point cloud density adaptive adjustment to carry out the preprocessing of the point cloud data; constructing a voxel octree structure for the preprocessed point cloud data, and performing semantic classification on the point cloud; geometric modeling is carried out based on the segmented point cloud subsets, and a fitting algorithm is adopted to carry out shape completion on a point cloud area; semantic annotation is carried out on the components subjected to geometric reconstruction, a corresponding relation between component types and spatial attributes is constructed, fusion features based on a point feature histogram and a local curvature are adopted, and classification is carried out; a standard BIM component family is converted, and a three-dimensional BIM model is constructed through the mapping relation. According to the method, the voxel octree data structure and the deep semantic segmentation neural network model are combined, division and semantic recognition are performed on the point cloud data, the intelligent degree of the model is improved, and manual intervention is reduced.

The invention discloses a quadruped robot obstacle avoidance control method and system based on path planning, and relates to the technical field of quadruped robot obstacle avoidance control, and the method comprises the steps: obtaining environment point cloud data, image data and quadruped robot motion speed data, and carrying out the terrain semantic segmentation and semantic pixel back projection of the image data, thereby obtaining a quadruped robot obstacle avoidance result; generating semantic point cloud data, combining the semantic point cloud data with the environment point cloud data subjected to motion compensation, and constructing a semantic annotation grid map; performing global path search on the semantic annotation grid map to generate a global smooth path; when the quadruped robot advances along the global smooth path, path nodes on the global smooth path are extracted at a fixed step pitch, the terrain category and the grid occupation state of each path node are judged according to the semantic annotation grid map, and a local reference path is generated; and executing a multi-stage obstacle avoidance strategy on the local reference path, and generating a foot end track sequence.

The invention discloses a multi-modal metadata alignment fusion method and device, equipment and a storage medium, and the method comprises the steps: carrying out the metadata extraction of structured data, unstructured text data and image data, and generating multi-modal metadata with semantic annotations; establishing a shared semantic embedding space, and mapping the multi-modal metadata to the shared semantic embedding space for coding to obtain a unified spatial vector; determining an alignment candidate pair from the unified spatial vector through similarity calculation, and identifying a semantic relationship of the alignment candidate pair; and performing conflict detection on the aligned candidate pairs and the corresponding semantic relationships, and resolving conflicts based on weight weighting fusion to obtain a unified metadata system. According to the method, improvement and optimization are carried out from multiple aspects of multi-modal data processing, semantic understanding, alignment accuracy, conflict resolution and the like, the defects in the prior art are overcome, and a more accurate and comprehensive multi-modal metadata alignment fusion result can be provided.

The invention relates to the field of artificial intelligence, and discloses an intelligent AI semantic annotation method and system based on multi-modal analysis, images, audios, texts and multi-modal data of a sensor are synchronously collected through AI, deep semantic features of all modals are extracted by using a deep learning model after preprocessing, vectors are generated, and the multi-modal data are subjected to semantic annotation; fusing into a semantic scene vector by means of a cross-modal attention mechanism, constructing a cross-modal association graph, and learning a causal logic path by using a graph neural network; constructing a spatiotemporal causal diagram by combining spatiotemporal information, and integrating an event time sequence and spatial dependence by using a time sequence diagram neural network to form a venation path; according to the method, the two knowledge maps are fused into a comprehensive knowledge map, preliminary annotations are generated through rule base reasoning, a high-precision result is output after optimization, the problems of semantic loss and annotation fragmentation caused by modal splitting and context missing in a traditional method can be effectively solved, meanwhile, the manual verification cost is reduced, and the integrity and efficiency of semantic annotation in a complex scene are improved.

The invention provides an intelligent electronic medical record generation method based on a portable robot, and the method comprises the steps: firstly constructing a medical knowledge graph from an ICD-11 term library, real-time data and real-time data, generating a standardized entity relationship set, and generating knowledge vectors supporting semantic reasoning through a graph embedding algorithm; then converting the doctor-patient dialogue audio into a structured text through a medical voice model, and generating semantic annotation data in combination with a knowledge vector matching atlas entity; when the matching degree exceeds a dynamic threshold value, the data are automatically converted into HL7 FHIR standard data, and after the compatibility with an existing map is automatically checked, synchronous updating of the electronic medical record is finally completed through template alignment and API adaptation. According to the method, the automatic conversion from the unstructured dialogue to the standardized electronic medical record is realized, and the quality and the utilization efficiency of the medical data are improved.

The present disclosure provides a method for generating annotation data for robotic training using a hierarchical transformer-based model with multiple layers. The transformer-based model includes Alpha models generating low-level control outputs and Beta models generating high-level control outputs. The method receives multimodal input data comprising visual sensor data and natural language instructions, processes this data through the hierarchical transformer-based model to generate annotations at different abstraction levels, wherein Beta models create semantic annotations describing task objectives and Alpha models generate motor command annotations specifying robotic actions, and stores these annotations with the input data to create annotated training data for robotic control systems.

The invention relates to a smart city ESG multi-source data visualization analysis method, device and equipment and a medium, and the method comprises the steps: carrying out the standardized semantic annotation and space-time alignment of city multi-source heterogeneous data, and generating a semantic triple set with a space-time label; the real-time intensity of the causal relationship in the ESG dynamic knowledge graph is constructed and quantified; semantic binding is carried out on the map and the city information model, and a visual descriptor is generated; discovering and rendering a causal relationship chain in the three-dimensional scene based on user interaction; and deducing simulation intervention and optimizing model parameters. According to the method, dynamic and integrated presentation and interactive deduction of complex causal relationships of environment, society and governance in a multi-dimensional space-time scene are realized, and the problems of surface analysis, disjunction of data and space and insufficient decision support in the prior art are effectively solved.

The invention relates to a method, a system and equipment for generating a large model SQL (Structured Query Language) based on business domain semantic enhancement and multi-round voting. The method comprises the following steps: acquiring a natural language input by a user to recognize and judge a business field related to user query; performing semantic annotation and expansion on the input query; organizing related information into Prompt, inputting the Prompt into a large language model, and generating an SQL statement; generating a plurality of candidate SQL statements, and selecting the candidate SQL statements with the highest occurrence frequency as output; and submitting the finally output SQL statement to an actual database system for execution, and returning and displaying a query result. Through the technologies of business domain division, data structure semantic annotation, multi-round candidate generation, voting screening and the like, SQL generation accuracy and system robustness of natural language query are remarkably improved, query intentions and field constraints in business scenes of enterprises such as banks and the like can be accurately recognized, field matching errors are avoided, and the query efficiency is improved. And through multi-round iterative generation and consistent voting screening, the correctness and stability of the output SQL statement are ensured.

The invention provides a semantic aerial view visual relocation method and device in a non-exposed scene, electronic equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring a multi-view image sequence under a non-exposed scene (such as a tunnel, an underground pipe gallery or an underground parking lot); semantic recognition is carried out based on a pre-trained semantic target detection model, and spatial consistency semantic features are extracted through a semantic-geometric dual-channel fusion mechanism combining a semantic mask and geometric constraints; the method comprises the following steps of: realizing three-dimensional reconstruction by using a voxel micro-renderable modeling method (VGGT), and generating a dense three-dimensional semantic point cloud fusing semantics and a geometric structure; two-dimensional semantics are mapped to a three-dimensional space through a projection and back projection relation, and point cloud semantics are endowed; main structure planes such as the ground, the left wall surface and the right wall surface are extracted, and a two-dimensional semantic aerial view with semantic annotation is generated; and pose estimation is carried out based on a reciprocal matching strategy guided by a semantic mask, so that visual repositioning with high precision, high robustness and semantic interpretability is realized. The method breaks through the problems of low precision, sparse features and poor semantic consistency of traditional visual repositioning in a non-exposed environment, and can be widely applied to the fields of intelligent transportation, underground inspection and unmanned system positioning.

The invention discloses a graphical user interface test case generation method based on a multi-agent framework, and relates to the field of graphical user interface tests.The graphical user interface test case generation method based on the multi-agent framework comprises the following steps that S1, a user demand document is obtained, and file text content and file format information are analyzed and extracted; s2, performing paragraph segmentation on the file text content to form logic semantic units; s3, carrying out correlation analysis on the segmented paragraphs, and obtaining a ternary file group; s4, performing paragraph annotation addition on the ternary file group, and constructing a semantic annotation result set; s5, extracting the agent framework to generate a graphical user interface test case, performing test recording, and storing a test result; s6, the result is verified, and a test case list and a software test report are generated. By conducting multi-dimensional analysis on the text content and the format structure in the document, the reduction efficiency from natural language description to structural semantic construction is improved.

The invention provides a ship design drawing structured vector analysis method and an intelligent question and answer method. The method comprises the following steps: constructing a drawing primitive initial data set; generating a semantic annotation entity set; mapping the semantic annotation entity set to a two-dimensional coordinate system to generate a relation annotation entity pair set; repeated entities with the same semantic content and the coordinate position error lower than a set threshold value are removed, and an effective entity relation set is constructed; converting the effective entity relationship set into a structured semantic relationship set; inputting the drawing primitive initial data set into a neural network target detection model to generate an image recognition entity set; and fusing the structured semantic relationship set and the image recognition entity set to construct a drawing semantic map, finely adjusting the large language model, and outputting a text question and answer result. According to the method, ship drawing automatic analysis and semantic question and answer efficient fusion are realized, and the structure understanding precision and the interaction response capability are improved.

The invention discloses a supply chain finance heterogeneous data cleaning and fusion processing system, and relates to the technical field of supply chain finance data management, and the system comprises a heterogeneous data processing platform which is in communication connection with the following modules: a data obtaining module which is used for obtaining heterogeneous data from each participant of supply chain finance, comprising structured data, semi-structured data and unstructured data, and preprocessing the obtained multi-source heterogeneous data; and the knowledge graph construction module is used for performing semantic annotation on entities and relationships in the heterogeneous data and constructing a supply chain finance knowledge graph model. According to the method, modeling is carried out through semantic annotation and relation extraction, the incidence relation between heterogeneous data is defined, then semantic alignment and fusion processing are carried out, data from different sources are mapped into a unified knowledge graph framework, the accuracy and reliability of data fusion are improved, and deeper data insight is provided for supply chain financial services.

The invention relates to the technical field of water network intelligent management and control, and discloses a water network management and control multi-source space digital intelligent fusion base construction and decision optimization method, which comprises the following steps: cooperatively obtaining multi-source space data; format conversion, coordinate system unification and systematic semantic annotation are carried out through a data preprocessing platform, and a normalized spatial data set is formed; constructing a data fusion model, quantitatively evaluating the quality of a data source by adopting a fuzzy comprehensive evaluation method so as to determine a fusion weight, and performing weighted fusion by adopting a specific algorithm aiming at different data types such as vectors, grids and three-dimensional models so as to generate a unified spatial data model; and finally, a decision optimization system performs decision scheme generation and iterative optimization based on the model in combination with a hydrodynamic model and a genetic optimization algorithm. By establishing a standardized data processing and targeted weighted fusion process, the problems that multi-source heterogeneous data is difficult to integrate and the fusion precision is not high are effectively solved, and a reliable data base is constructed.

The invention provides an automatic action trajectory labeling system and method based on a visual language model, and relates to the field of visual technical models. The automatic action trajectory labeling system based on the visual language model comprises a key frame extraction module, a VLM semantic labeling module, a historical labeling database, a diffusion model optimization module and an reflection correction module, and the key frame extraction module extracts a key frame sequence from an input video through optical flow analysis and a TSN network scene change detection algorithm; and the VLM semantic annotation module is used for outputting a candidate segmentation point set containing action starting and ending points, the VLM semantic annotation module adopts a multi-modal VLM, takes a key frame image and a context text instruction as input, and generates a preliminary semantic tag and a corresponding vision-language embedding vector. According to the method, multiple bottlenecks of the existing action track labeling technology are solved, the labeling precision is remarkably improved, and the target of time boundary optimization is achieved.

The invention discloses a three-dimensional point cloud building automatic modeling system based on deep learning. The system comprises a point cloud acquisition and input module, a point cloud preprocessing module, a depth feature extraction module, a semantic segmentation and component identification module, a structure parameter analysis module and a parameterized model generation module. According to the invention, through deep fusion of the point cloud deep learning network and the parametric modeling engine, full-process automation of building three-dimensional modeling is realized; the depth feature extraction module is used, so that the recognition accuracy of structures such as doors, windows and roof edges can be effectively improved, the precision of a building model is ensured, and the depth feature extraction module can continuously improve the recognition accuracy along with continuous use of the system; and by using the semantic segmentation and component identification module, the irregularity of the building point cloud, the complexity of the structure and the shielding noise can be identified and distinguished, and the problem that semantic annotation and topological repair need to be manually performed in the prior art is solved.

The invention provides an electric power industry-oriented A I intelligent question answering and professional report generation method, which comprises the steps of extracting key information from a constructed knowledge graph to form a preliminary electric power knowledge base structure, and the extraction process comprises the steps of identifying high-frequency nodes, analyzing connectivity among the nodes and evaluating importance weights of the nodes; based on the preliminary knowledge base structure, integrating structured and unstructured data in the power field to form a complete power knowledge base, and keeping synchronous updating with the knowledge graph; based on the electric power knowledge base, training a natural language processing model in the electric power field, which comprises named entity recognition and relation extraction by adopting a deep learning model in sequence; and performing semantic annotation on nodes and edges in the knowledge graph by utilizing a trained natural language processing model, and integrating new semantic information into the knowledge graph through entity alignment and relation mapping.

The invention discloses a motion track construction method based on a visual large model, and relates to the technical field of computer vision, and the method comprises the steps: employing a target tracking algorithm based on Kalman filtering, and generating a smooth time sequence synchronization track from an original laser radar point cloud and an original video stream; dividing the trajectory into a series of candidate kinematic segments which are complete in kinematics and semantics by applying a hybrid method combining a minimum description length principle and visual language model semantic verification; performing preliminary semantic annotation on the segments by utilizing a visual language model to generate an initial annotation track; performing logic consistency refining on the initial labeling track until the initial labeling track is converged into a refined labeling track; and formatting the refined trajectory into a standard structured semantic trajectory representation character string. According to the method, a semantic gap between low-dimensional physical observation and high-dimensional driving intention is bridged, and ideal input is provided for understanding and prediction tasks of downstream complex scenes.

The invention provides an agent strategy optimization method and device based on an MCP normal form and electronic equipment. The method comprises the steps that a data retrieval request is acquired; analyzing the data retrieval request to determine data retrieval content; converting the data retrieval content into a data retrieval vector; and based on the data retrieval vector, matching with a semantic annotation index table of unstructured multi-modal data in a database to retrieve the multi-modal data matched with the data retrieval request.

The invention discloses a human body gesture generation method and related equipment, and relates to the technical field of computer vision, and the method comprises the steps: obtaining multi-modal input information, the multi-modal input information comprises a voice audio signal, text transcription information and a reference gesture sequence, the text transcription information comprises a semantic annotation, and the reference gesture sequence comprises a reference gesture sequence; the reference gesture sequence is a basic gesture template in the target scene; generating a multi-modal feature based on the multi-modal input information; performing time alignment processing operation on the multi-modal features to obtain alignment condition features; performing space-time decoupling modeling operation on the alignment condition features to obtain optimized gesture potential features; inputting the optimized gesture potential features into a diffusion model for iterative denoising to obtain denoised gesture potential features; and generating a target human body gesture sequence based on the de-noised gesture potential features.

The invention belongs to the technical field of geospatial information systems, and particularly relates to a component-level catenary three-dimensional model lightweight three-dimensional tile conversion method, which comprises the following steps: S1, forming a component-level fine model data set with semantic annotations; s2, constructing a detail level division rule; s3, reconstructing a lightweight linear component model; s4, constructing a comprehensive evaluation function Q, deleting the body-shaped components of which the Q values are smaller than a preset threshold value, and retaining the body-shaped components of which the Q values are greater than or equal to the preset threshold value; s5, obtaining optimized body-shaped component model data; and S6, according to the detail level division rule in the S2, assembling and recombining the lightweight linear component model in the S3 and the optimized body-shaped component model data in the S5, generating a hierarchical component structure, converting each component into a three-dimensional instance model, and outputting a three-dimensional tile data structure. And efficient organization and visualization of the contact network BIM model in the GIS environment are realized.

The invention provides an efficient annotation-driven hierarchical fault positioning method, which comprises the following steps of: guiding a large language model to intelligently analyze and generate semantic annotations of a text based on a positioning algorithm of large model annotations, and performing fine-grained software fault positioning from a file level to a function level and then to a position level by using the annotation-based hierarchical positioning method. And an efficient hierarchical progressive sorting and screening algorithm is used for ensuring the software fault positioning efficiency. According to the method, the defect positioning efficiency can be ensured while the positioning accuracy is ensured. The positioning algorithm based on large model annotation strategically balances the information density, provides enough context clues, and improves the model understanding ability; according to the annotation-based hierarchical positioning method, positioning is divided into file / function / position hierarchies, and annotations are added by using a large model cue word project in sequence, so that the positioning accuracy is improved; and an efficient hierarchical progressive sorting and screening algorithm is provided, so that the optimal balance between the performance and the cost is realized.

A power industry standard provisions search method and system based on semantic understanding. The method comprises: collecting standard provisions from various professions in the power industry, and pre-processing the collected standard provisions; constructing a deep learning model capable of understanding power industry terms and contextual meaning; performing semantic annotation on the pre-processed power industry standard provisions, and on the basis of the annotation result, constructing an index for the power industry standard provisions; using the deep learning model to perform semantic understanding on a search condition, and querying matching power industry standard provisions; and sorting and displaying the searched standard provisions according to relevance and matching degrees. Compared with previous semantic annotation methods only based on dictionary word segmentation, the semantic annotation method based on semantic understanding realizes a deeper level of semantic annotation, such that annotation is performed on the basis of a certain understanding of the concepts of power industry terms, and the deeper level of semantic annotation provides a foundation for subsequent search and query.

The invention discloses a three-dimensional visualization head and neck tumor preoperative imaging system based on deep learning. The method comprises the following steps: image analysis and preprocessing; carrying out image denoising and spatial-temporal feature extraction based on a deep learning convolutional neural network architecture, and introducing a u-Net model to realize image segmentation and semantic annotation; performing three-dimensional reconstruction and surface rendering by adopting a Marking Cubes algorithm, and realizing visual interaction image presentation and personalized operation by combining volume rendering and surface rendering; and data is output through multiple ports, and data viewing and interactive operation of a web terminal and a mobile terminal are supported. The method has the advantages that according to the technical scheme, through fusion of a three-dimensional attention mechanism and multi-phase data, the tumor segmentation Dice coefficient reaches 0.92 + / -0.03, and the method is superior to a traditional threshold segmentation method.

The invention provides a new energy automobile chassis structure visual detection method and system, and relates to the technical field of computer vision. The method comprises the following steps: firstly, carrying out partition semantic annotation on a target chassis image, extracting the center and the area of each detection region, calculating an attention degree coefficient and generating a dynamic sampling step length; constructing a grid shooting point set in the communication reserved area and establishing a local coordinate system; constructing a graph G based on all the grid points, generating a shortest path by adopting a path planning algorithm, and controlling the shooting trolley to move in sequence according to the path to complete chassis image acquisition; then image filtering and splicing are carried out to generate a complete chassis map; and finally, performing state identification and action judgment on the image blocks based on a Markov decision model, and outputting a chassis structure defect detection result. According to the invention, through full-process fusion of structure sensing sampling, shortest path optimization and Markov intelligent detection, the efficiency, accuracy and intelligent level of new energy automobile chassis structure detection are significantly improved.

The invention relates to the technical field of medical report generation, and discloses a medical image automatic annotation and report generation system which comprises a preprocessing module, a hierarchical feature extraction module, a semantic annotation module, a guide generation module, a diagnosis reasoning module and a man-machine cooperation interface. According to the method, through standardized preprocessing, hierarchical feature extraction and automatic generation of the annotation and the report, the processing efficiency is greatly improved, and the manual load is reduced; secondly, on the basis of hierarchical feature extraction and semantic and visual embedding alignment, feature support and semantic mapping precision of annotation and reporting are enhanced, and result accuracy and cross-scene consistency are improved; meanwhile, multi-modal alignment processing and multi-dimensional information fusion enhance the adaptability of the system to different image types, generate a structured report conforming to the clinical process and improve the clinical applicability; in addition, a man-machine cooperation feedback mechanism forms a parameter optimization closed loop, so that the system dynamically adapts to new scenes and specifications, and continuous improvement of generalization ability is realized.

The invention relates to the technical field of integrated circuit design automation, and discloses an integrated circuit design whole-process collaborative verification and consistency guarantee method, which comprises the following steps of: constructing a unified design data model, and representing design data from function specifications to physical layout by using a multi-level attribute graph structure; establishing a design intention keeping mechanism, and tracking the transmission of the design intention in the hierarchical refinement process through intention semantic annotation, cross-level entity mapping and intention keeping degree evaluation; executing a hybrid verification strategy, combining formalized verification with dynamic simulation, and guiding verification resource allocation through a coverage rate feedback mechanism; performing constraint consistency check, performing constraint comparison at key nodes of the design process, and automatically identifying and positioning constraint conflicts; according to the method, the capture time of design errors can be brought forward by 80%, the number of design iterations is reduced by 40%, and the design quality and efficiency are remarkably improved.