Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1545 results about "Semantic map" patented technology

Automatic construction method of end-to-end agent based on graph structure semantic fusion

The invention relates to the technical field of artificial intelligence, in particular to an automatic construction method of an end-to-end agent based on graph structure semantic fusion. The method comprises the following steps: receiving business demand data input by a user; business target and demand constraint condition analysis is carried out on the business demand data, and a core workflow framework of the intelligent agent is generated; performing end-to-end execution path analysis on the core workflow framework of the intelligent agent to obtain an end-to-end workflow; constructing a dynamic evolution semantic map; and constructing an end-to-end call chain execution strategy based on the end-to-end workflow, and performing agent instance packaging and agent instance reinforcement learning enhancement processing according to the dynamic evolution semantic map, thereby automatically constructing an end-to-end agent. According to the invention, by fusing the graph structure knowledge and the generation capability of the large language model, an efficient, accurate and extensible agent automatic construction scheme is provided for various complex business scenes.
Owner:BEIJING ZHONGSHURUIZHI TECH CO LTD

Unmanned driving dynamic path planning method and system based on multi-source data fusion

The invention belongs to the technical field of path planning, and discloses an unmanned driving dynamic path planning method and system based on multi-source data fusion, and the method comprises the steps: collecting an ice and snow pavement friction coefficient, a curve curvature and an obstacle point cloud, constructing a sensor confidence coefficient matrix, generating a fused semantic map, and constructing a dynamic environment semantic model. Outputting a real-time friction coefficient field and a risk thermodynamic map layer; the roadside unit broadcasts coordinates of opposite vehicles in a blind area of a curve to a vehicle end, constructs an ice and snow pavement offset crowdsourcing map, and generates a global-local fusion topology; fusing the real-time friction coefficient field and the global-local fusion topology to generate a smooth trajectory set, and further generating a risk optimal path instruction set; a steering angle and torque instruction is decomposed, positioning drift is compensated in real time, and a normal mode for updating the vehicle positioning state and a degradation mode when the millimeter wave radar fails are constructed; and generating execution logs and health state vectors, and aggregating the execution logs and the health state vectors of multiple vehicles to form closed-loop iterative update.
Owner:HENAN HAIRONG SOFTWARE CO LTD

Semantic comprehension driven cross-modal information fusion and retrieval method and system

The invention discloses a cross-modal information fusion and retrieval method and system driven by semantic comprehension, and the method comprises the steps: obtaining text, image and audio original data, and extracting an initial feature set of each modal through a deep neural network; dynamically distributing each modal weight coefficient based on an attention mechanism, and performing weighted fusion on the initial feature set to obtain cross-modal fusion feature representation; through a cross-modal semantic association analysis model, high-dimensional semantic association features are extracted from the fusion feature representation, and semantic enhancement feature vectors are generated; constructing a cross-modal semantic graph network based on the vector, complementing missing modal features, and generating an optimized multi-modal feature set; and inputting the optimized feature set and the query sample into a contrast learning model, calculating a semantic similarity score, and generating a cross-modal retrieval result sorting list according to the score.
Owner:SHANGHAI CIVIL AVIATION VOCATIONAL & TECH COLLEGE

Construction scene prediction method and device fusing image, text and BIM mode

The invention provides a construction scene prediction method and device fusing an image, a text and a BIM modal, and relates to the technical field of intelligent construction prediction management. According to the method, the BIM semantic graph is constructed by extracting the BIM semantic information of the BIM model, and the target detection recognition of the construction site video is carried out in combination with the YOLO model to obtain the target detection result; performing cross-modal alignment with the CLIP to realize deep fusion of the multi-modal data of the image, the text and the BIM to obtain a multi-modal heterogeneous graph; and inputting the multi-modal heterogeneous graph into a space-time sequence model for prediction, outputting prediction results of construction scenes at a plurality of moments in the future, and dynamically mapping the prediction results to a digital twinborn platform to realize risk early warning and visual display. The construction dynamic change can be captured in real time, the construction progress and risk can be accurately predicted, and the intelligent level of construction management is improved.
Owner:XIAMEN UNIV OF TECH

Rescue robot path planning method and system under industrial vision assistance

The invention discloses a rescue robot path planning method and system under industrial vision assistance, and relates to the field related to industrial vision, and the method comprises the steps: collecting three-dimensional space data of a rescue environment in real time, generating a dynamic environment point cloud data set, and constructing a three-dimensional semantic map of a rescue area; thermal imaging data updated in real time are called, path analysis is carried out in combination with the three-dimensional semantic map, and a path planning strategy set is obtained; and predicting the motion track of the dynamic obstacle based on the local dynamic obstacle avoidance strategy, optimizing the global path planning strategy according to obstacle prediction track data, and generating a motion control instruction of the rescue robot. The technical problem of poor real-time performance and adaptability of path planning caused by insufficient perception of environment dynamic information in path planning of an existing rescue robot is solved, the strong perception capability depending on industrial vision is achieved, the environment dynamic information is accurately captured in real time, and the real-time performance of path planning is improved. And the real-time response speed of path planning and the adaptability to a dynamic environment are improved.
Owner:JIANGSU SANMING ZHIDA TECH CO LTD

Multi-modal AI data fusion processing method and device, equipment and medium

The invention relates to a multi-modal AI data fusion processing method, device and equipment and a medium, and the method comprises the steps: firstly extracting visual, auditory and text modal features through a pre-training encoder, executing dimension alignment, and generating a standard data feature set with unified dimensions; a cross-modal semantic graph is constructed based on a cosine similarity algorithm, and the problem of semantic mismatch of heterogeneous data is solved; residual enhancement is carried out on the map nodes, and noise interference is eliminated; fusing the optimized features and the semantic topology in combination with a graph convolutional network to generate aggregation graph representation; the fusion features are mapped to a low-dimensional semantic space through a variational auto-encoder, and cross-modal correlation essence is captured; the key dimension contribution degree is quantified, a visual report is generated, and semantic association rules among modals are disclosed, so that the dimension isomerism limitation of a traditional fusion technology is broken through, quantifiable cross-modal semantic mapping is established, the whole process traceability from feature fusion to decision interpretation is realized, and the method is suitable for popularization and application. And the multi-modal decision black box problem in the fields of medical diagnosis, automatic driving and the like is effectively solved.
Owner:罗林松

Internet of Things data integration method and system based on dynamic semantic atlas and edge collaboration

The invention discloses an Internet of Things data integration method and system based on dynamic semantic atlas and edge collaboration, and the method comprises the steps: carrying out the equipment access and protocol conversion, capturing the original data of equipment through an edge node, analyzing the average communication interval of 100ms + / -20ms through an LSTM model, generating an equipment fingerprint hash value, analyzing a message structure through a TinyBERT model, and extracting a key field, a temperature value and a timestamp. The method comprises the following steps: establishing a dynamic semantic graph, converting the dynamic semantic graph into a standard JSON format, uploading the standard JSON format to a cloud end through a service grid, constructing a dynamic semantic graph, collecting multi-source metadata by the cloud end, generating an entity relationship by utilizing a Transform model, dynamically optimizing a mapping rule based on reinforcement learning, automatically associating a Pressures field to a database column PSI, and carrying out collaborative optimization by an edge cloud; according to the method, the knowledge graph and the Transform model are combined, the data entity relation is updated in real time, the semantic drift problem of a traditional static graph is solved, the cross-domain data association accuracy is improved by 35%, the unique device fingerprint is generated through the message frequency and load distribution, and dynamic tracking of the mobile device is supported.
Owner:BEIJING DETA JINGYAO INFORMATION TECH CO LTD

IMU (Inertial Measurement Unit)-assisted deep SLAM (Simultaneous Localization and Mapping) method and system fusing language-vision multi-mode perception

The invention provides an IMU (inertial measurement unit)-assisted depth SLAM (simultaneous localization and mapping) method and system fusing language-vision multi-mode perception, and the system comprises functional modules such as initial calibration and semantic map initialization, pre-integration prediction and key frame judgment, dense point cloud reconstruction and relative pose estimation, semantic embedding extraction, semantic guidance loopback detection and semantic three-dimensional map incremental updating. IMU motion priori, depth geometric constraint and language model semantic factors are subjected to combined modeling through a graph optimization framework, and high-precision positioning and labeled map construction in a complex dynamic environment are achieved. Compared with the prior art which only depends on geometric or inertial information, the method has the advantages that the loop-back mismatching rate is reduced, the closed-loop convergence efficiency and the long-time relocation robustness are improved, and a semantic interface is provided for upper-layer tasks such as natural language navigation and target retrieval. The method can be widely applied to the fields of service robots, security inspection, intelligent driving, post-disaster search and rescue and the like.
Owner:XIAN TECH UNIV

High-quality video content automatic generation method and related equipment

The invention relates to a high-quality video content automatic generation method and related equipment, and the method comprises the following steps: carrying out the multi-modal feature extraction of an input original video material, and obtaining a video feature vector set; performing content semantic analysis on the video feature vector set to obtain a video semantic map; performing narrative structure optimization on the video semantic map through a deep reinforcement learning technology to obtain an optimized video story line; performing multi-modal content generation based on the optimized video story line to obtain a candidate video clip set; and performing intelligent editing and synthesis on the candidate video clip set to obtain target high-quality video content, thereby solving the technical problem that the generated content is lack of depth and attraction due to the fact that many automatic attempts are limited to simple image or clip splicing and potential story clues in video materials cannot be deeply mined.
Owner:SHENZHEN CHUANGYUAN INTERACTIVE TECH CO LTD

Intelligent monitoring management method and system based on archive digitization

The invention discloses an intelligent monitoring management method and system based on archive digitization, and relates to the technical field of data management, and the method comprises the steps: collecting and preprocessing multi-source archive data, employing a multi-mode BERT model to carry out the feature fusion of different data sources, and generating a unified semantic representation; semantic labeling is performed on archive data through a multi-label classification model, a semantic graph of archive content is constructed by using a graph database, an association relationship between archives is represented, a semantic index tree is constructed based on the semantic graph, and rapid positioning and calling of the archive content are optimized; and recording the change of each file version, positioning the change position based on a semantic index tree, identifying the semantic change of the file through a semantic difference comparison algorithm, recording hash, carrying out granularity division on the file content through the semantic boundary of each level of node in the index tree, and generating a user access strategy. According to the invention, dynamic perception and risk early warning of user behaviors are realized, and the intellectualization and safety of the archive management system are effectively improved.
Owner:XIAN XINCHUANG TECH CO LTD

Robot obstacle avoidance and navigation method based on multi-modal fusion and visual language model

The invention provides a robot obstacle avoidance and navigation method based on multi-modal fusion and a visual language model, and the method comprises the steps: collecting different modal data in real time through a plurality of sensors, and carrying out time synchronization processing and normalization processing; extracting features of different modal data and fusing the features through an intermediate layer; and inputting the fused multi-modal data into a visual language model, generating a semantic map of the environment by utilizing semantic segmentation of the model and a target detection result, generating an action strategy in combination with a natural language instruction and a visual analysis result, and converting the generated action strategy into a control signal which can be executed by the robot to realize closed-loop control. According to the method, the visual language model and the multi-modal sensor fusion technology are combined, and the perception, decision making and real-time response capabilities of the mobile robot in a complex dynamic environment are improved.
Owner:ZHUHAI MAKERWIT TECH CO LTD

High-accuracy threat intelligence assisted network threat tracing method

The invention discloses a high-accuracy threat intelligence assisted network threat tracing method, which comprises the following steps: S1, collecting and preprocessing multi-source network security data, and constructing a time-marked event sequence set; s2, constructing an optimized Transform network model, and processing an attack event sequence by using position coding and time embedding; s3, a black swan optimization algorithm is initialized, and a Transform structure hyper-parameter is dynamically optimized; s4, outputting an attack event semantic vector, and constructing an attack path semantic map; s5, the intelligence information vector is embedded into a Transform hidden space; s6, calculating semantic similarity and dependency intensity, and generating an attack source candidate set and a traceability path; s7, outputting an attack traceability path, a starting point node and an information label, and generating a structured traceability report; and S8, according to the traceability result feedback, updating the black swan algorithm and the Transform model. The method is used for realizing intelligent modeling of multi-source network attack events and high-accuracy traceability analysis of attack source nodes.
Owner:GUANGXI POWER GRID CORP

Data query method and system based on natural language text

The invention discloses a data query method and system based on a natural language text. The method comprises the following steps: dynamically shielding the natural language text to generate a semantic vector sequence; key entities and association relationships thereof in the semantic vector sequence are extracted, and a structured entity relationship set is obtained; matching the structured entity relationship set with knowledge graph nodes to generate a heterogeneous semantic graph; performing heterogeneous fusion on the heterogeneous semantic graph and text syntactic features to generate intermediate query representation; processing the intermediate query representation to generate an executable statement carrying a semantic association identifier; and verifying the semantic consistency of the response content of the executable statement and the original input, and iterating to regenerate the executable statement when the semantic consistency does not pass the verification. And efficient and accurate natural language query conversion and response generation are realized through dynamic shielding enhanced semantic robustness, knowledge graph path extension and weight iterative optimization, heterogeneous feature fusion and a multi-modal verification mechanism.
Owner:NORTH CHINA UNIV OF WATER RESOURCES & ELECTRIC POWER

Dynamic environment semantic SLAM method based on monocular vision and LiDAR fusion

The invention relates to a dynamic environment semantic SLAM method based on monocular vision and LiDAR fusion, and belongs to the technical field of robots. The method comprises the following steps: 1) performing instance segmentation on point clouds to obtain unknown motion state point clouds, pure static road sign point clouds and ground attribute point clouds, identifying semi-static and dynamic road sign point clouds through initial pose estimation and Kalman filtering, and then performing accurate pose estimation; 2) segmenting and enhancing the image instance, extracting SuperPoint feature points, projecting a dynamic road sign to the segmented image so as to distinguish static and non-static points, tracking static features by adopting a plurality of tracking strategies, and optimizing the pose by utilizing a local map; 3) carrying out heterogeneous sensor attitude fusion; 4) outputting an optimized track by combining two loopback detection results; and 5) constructing a global pure static semantic map. According to the method, the dynamic environment influence is considered, and the positioning precision and the mapping quality of the system in the dynamic complex environment are improved.
Owner:CHONGQING UNIV +1

Unmanned aerial vehicle intelligent inspection path generation method for interior of building based on BIM model feature extraction

The invention discloses a BIM model feature extraction-based unmanned aerial vehicle intelligent inspection path generation method for the interior of a building. The method comprises the steps of extracting a spatial geometric feature set, a spatial topological feature set and a semantic feature set from original BIM model data; constructing a basic space graph representing a space structure and a semantic enhancement graph representing a function relationship based on the feature set, and generating a multi-level semantic graph; task targets and dependency relationships are extracted from the inspection task description and the multi-level semantic graph, and a task weight matrix is generated; generating an optimized path set based on the multi-level semantic graph and the task weight matrix; performing multi-dimensional scoring and real-time optimization on the optimized path set to generate an emergency adjustment strategy; and finally verifying the inspection path. According to the method, through multi-level feature extraction and multi-level semantic graph construction, accurate understanding of the building space is realized, and the intelligent level and reliability of routing inspection path planning are improved.
Owner:CHINA RAILWAY CONSTRUCTION ENGINEERING GROUP

Decision-making method and device based on multi-modal semantic alignment, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a decision-making method, device, equipment and medium based on multi-modal semantic alignment. Executing cross-modal alignment by taking the voice semantic map as a reference to generate associated information, fusing the voice features, the visual features, the action features and the associated information to generate a fusion feature vector, inputting a decision network to generate a decision feature vector and generate a task execution instruction, obtaining execution feedback information of the task execution instruction, and updating the decision network. According to the method, input is dominated by voice instructions, visual features, action features and semantic map depth alignment and fusion are combined, input naturalness and multi-modal data analysis and decision-making efficiency are improved, and interaction adaptability and decision-making accuracy of the model in a complex scene are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Intelligent retrieval method and system for genuine medicinal materials based on atlas

The invention relates to the technical field of knowledge graph retrieval, in particular to a genuine medicinal material intelligent retrieval method and system based on a graph. The method comprises the following steps: performing semantic granularity analysis on a retrieval request input by a user, constructing a multi-level semantic edge and generating a hierarchical semantic graph structure; semantic enhancement is carried out on the map relation through semantic annotation, and a multi-condition intention is extracted in combination with dimensions such as regions, drug properties and channel tropism; further, the system executes multi-hop path combination, a structured semantic path conforming to the composite intention is mined, edge nodes in the path are inferred and complemented, and a genuine medicinal material retrieval result with a closed structure and complete semantics is generated. Compared with a traditional keyword matching and static field retrieval mode, the method has higher semantic perception ability and reasoning intelligence, and the accuracy and adaptability of the system in processing fuzzy, composite and path-incomplete retrieval scenes are remarkably improved.
Owner:HUNAN VOCATIONAL COLLEGE OF SCI & TECH

Four-foot robot mechanical arm tail end force feedback teleoperation control system and method

The invention belongs to the technical field of robot control, particularly provides a force feedback teleoperation control system and method for the tail end of a mechanical arm of a quadruped robot, and aims at the key challenges that control errors are caused by communication time delay and soft obstacles are difficult to recognize in a dynamic environment. Modeling and judgment are conducted on the contact state of the tail end of the mechanical arm in advance, and feedforward control and buffer adjustment oriented to communication time delay are achieved. And meanwhile, a dynamic semantic map is constructed in combination with multi-source sensing information, and soft obstacle reasoning and path optimization are performed by fusing a tail end force sense change trend, so that the recognition and avoidance capabilities of the system in a complex and invisible obstacle environment are remarkably improved. The system has good perspectiveness, self-adaptability and high redundancy safety characteristics, is suitable for multi-task inspection operation of industrial sites such as a thermal power plant, and is especially suitable for a remote man-machine cooperative operation scene in a narrow space.
Owner:武汉跨克信息技术有限公司

Unmanned cluster brain-like navigation map fusion construction and cooperative positioning method

The invention provides an unmanned cluster brain-like navigation map fusion construction and cooperative positioning method. The method comprises the following steps: acquiring multi-modal perception data, respectively acquiring vision, sound wave and pose information through a binocular camera, a radar and an inertial sensor, simulating a human brain nerve coding mechanism, and generating a pulse sequence and a feature vector in combination with spatio-temporal information; constructing a multi-modal coding unit into a hypergraph node, and based on a dynamic hyperedge connection topological relation, aggregating spatial-temporal characteristics through a heterogeneous hypergraph convolutional network to generate a high-order brain-like semantic map of a single agent; sharing a local brain-like map by multiple agents through distributed communication, detecting geometric and semantic conflicts of an overlapped region, performing space-time alignment based on an anchor point reference, eliminating feature contradictions by utilizing probability distribution matching, and generating a global consistent high-confidence brain-like map; and outputting the optimal position estimation. Through bionic neural coding, heterogeneous hypergraph modeling and multi-agent collaborative optimization, establishment and positioning of a high-order brain-like map in a dynamic unknown environment are realized.
Owner:NANJING UNIV OF POSTS & TELECOMM

Three-dimensional Gaussian sputtering method for sparse visual angle semantic priori

The invention discloses a three-dimensional Gaussian sputtering method for sparse visual angle semantic priori. The method comprises the following steps of: 1, acquiring a target scene image, constructing a real image set as a data set, and manually selecting an interested object in a target scene to perform semantic three-dimensional reconstruction to obtain an initial semantic image of a sparse view angle; a multi-view image is collected, camera external parameters and scene sparse point clouds are obtained, a plurality of views are selected and input into the SAM2 segmentation model, and a view set Is with semantic images is obtained; 2, using a pre-trained SAM2 segmentation model as an interactive image sequence segmentation model, and initializing a three-dimensional Gaussian primitive according to the scene sparse point cloud; and step 3, training parameters of semantic three-dimensional Gaussian sputtering based on the trained three-dimensional Gaussian sputtering model and the interactive image sequence segmentation model, and reconstructing a target scene. According to the method, the high-quality semantic model is efficiently reconstructed. And the reconstruction result can be easily corrected through the interactive graphical interface in the training process.
Owner:XIDIAN UNIV

Large model application construction method based on configurable workflow and domain knowledge base

The invention discloses a large model application construction method based on a configurable workflow and a domain knowledge base. The method comprises the following steps: S1, constructing the domain knowledge base, establishing a semantic map and generating a knowledge embedding data set; s2, defining a configurable workflow, setting a jump rule based on a semantic process language, and binding a task semantic tag; s3, configuring a Prompt adaptive generation mechanism, and generating a Prompt input text in combination with the semantic tag and the knowledge embedding data set; s4, calling a knowledge embedding data set, retrieving semantic segments and embedding Prompt to form enhanced Prompt input; s5, inputting the large language model to obtain a return result and an index, and executing jump judgment; s6, scheduling a large language model service instance, and dynamically selecting a service interface according to an index and a task state; and S7, processing by a process termination node, arranging an output result, recording a log and calling data. According to the method, intelligent scheduling and application construction of the large model based on the workflow and the knowledge base are realized.
Owner:JIANGSU YIQICE NETWORK TECH CO LTD

Robot dynamic environment adaptive sensing and navigation system based on three-dimensional laser radar

The invention discloses a robot dynamic environment adaptive sensing and navigation system based on a three-dimensional laser radar, relates to the technical field of robots, and solves the technical problems that comprehensive environment information is difficult to obtain, and the weight is difficult to adjust by fusing weather types and sensor confidence coefficients. Comprising the following steps: generating original point cloud data by combining a bionic compound eye type laser radar with a silicon photon integrated chip; marking point clouds based on a KITTI data set, performing preprocessing, training a Transform model to output a dynamic obstacle mask, and filtering background point clouds; a weather detection model is constructed, the weight is dynamically adjusted according to the weather type and the sensor confidence coefficient, and position and attitude estimation is fused; laser radar point cloud constructs a geometric map, a camera depth map generates a dense map, and semantic tags are mapped to generate an environmental semantic map; and converting the environmental semantic map into a three-dimensional grid map, and planning an obstacle avoidance path based on the grid map by using an A * algorithm.
Owner:BEIJING HAOYU WORLD SURVEYING & MAPPING DEVELOPING CO LTD

French shield AI intelligent case handling all-in-one machine system based on large language model

The invention discloses a law shield AI intelligent case handling all-in-one machine system based on a large language model, and relates to the technical field of law artificial intelligence and judicial informatization, the system comprises an integrated terminal device, a case semantic modeling module, a class case knowledge engine, a risk prediction module, a large language model service interface and an intelligent document generation module; the system constructs a case semantic graph through multi-modal information fusion and a graph neural network, performs legal rule path matching and similarity reasoning based on a class case database, outputs structured legal suggestions and standard legal instruments in combination with user context recognition and large language model multi-round generation capability, and realizes dynamic updating of the semantic graph. The method improves the automation, structuring and interpretability of case processing, and is suitable for intelligent case handling scenes such as legal assistance, litigation assistance and judicial mediation.
Owner:SHAANXI YUETU POLICE EQUIP MFG CO LTD

Unmanned aerial vehicle surveying and mapping method and system, electronic equipment and storage medium

The invention provides an unmanned aerial vehicle surveying and mapping method and system, electronic equipment and a storage medium, and relates to the technical field of unmanned aerial vehicle surveying and mapping. The method comprises the following steps: carrying out base station position planning based on geographic data and preset factors, and arranging a CORS platform base station; then, acquiring a remote sensing image to construct a three-dimensional model, and performing semantic segmentation to obtain key ground feature information; and generating a multi-modal environment semantic map for surveying and mapping route planning based on registration of the key surface feature information and the geographic data. The unmanned aerial vehicle obtains surveying and mapping data, CORS positioning information and surveying and mapping image data in real time according to the surveying and mapping route, and environment semantic positioning data is obtained based on the surveying and mapping image data and multi-mode environment semantic map registration. And finally, performing registration processing by comprehensively utilizing the CORS positioning information, the environmental semantic positioning data and the surveying and mapping data to obtain target surveying and mapping data. Through the scheme, the surveying and mapping accuracy of the unmanned aerial vehicle is improved.
Owner:JIANGSU RENHE ZHONGHENG ENG CONSULTING REAL ESTATE

Robot semantic navigation method and system, terminal and storage medium

The invention provides a robot semantic navigation method and system, a terminal and a storage medium, and the method comprises the steps: inputting a received natural language command and a pre-constructed semantic map into a pre-trained large language model, so that the large language model extracts a target navigation object in the natural language command, matching the target navigation object with a semantic map to determine a target position point of the target navigation object on the semantic map; performing path planning based on the current position of the robot and the target position point to obtain a corresponding target path so that the robot navigates to the target position point based on the target path; the semantic map is a global map which corresponds to the current space environment and contains semantic information. The robot can execute accurate positioning and navigation tasks in a complex environment through the semantic map containing semantic information and the large language model, the requirement for high spatial precision is met, and the robot can understand natural languages of human beings.
Owner:SHENZHEN TECH UNIV

Decision-making method and device guided by multi-modal semantic map, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as financial science and technology and medical health, and discloses a decision-making method and device guided by a multi-modal semantic map, equipment and a medium. Extracting a visual feature vector, a language feature vector and an action feature vector, splicing to generate a multi-modal initial feature, mapping the multi-modal initial feature to a shared semantic space, constructing a multi-modal semantic map, and inputting a map-guided attention mechanism to generate a cross-modal alignment feature; the cross-modal alignment features and task targets are input into a meta-learner to generate task adaptability features, the task adaptability features are input into a parallel reasoning network to execute subtasks in parallel, and a gating fusion network integrates output results to generate a global decision. According to the method, cross-modal semantic association and task adaptability are enhanced through the combination of shared semantic space mapping, map guiding attention and a meta learning device, and the accuracy and efficiency of multi-modal decision making are improved through the combination of parallel reasoning and gating fusion.
Owner:PING AN TECH (SHENZHEN) CO LTD

Electronic medical record free text analysis method, system and equipment

The invention relates to the technical field of text data analysis, in particular to an electronic medical record free text analysis method, system and device, which improve the efficiency of information extraction and reduce the demand of manual intervention. The method comprises the steps of receiving free text data of the electronic medical record, performing cleaning, word segmentation and medical term standardization processing, and converting an unstructured text into structured data; based on deep learning and a medical knowledge base, text features are extracted through a pre-training language model, entity boundaries are captured on an output layer in combination with a conditional random field, medical entities in a text are recognized, and the recognized entities are classified and labeled; extracting a causal relationship, a treatment relationship and an examination relationship among entities through a dependency syntactic analysis and semantic role labeling technology, and constructing an entity association network; performing dynamic correction and supplementation on entity classification and relationships in combination with medical record context information; and outputting an analysis result in a structured JSON format to generate a computable semantic map.
Owner:SHANDONG GUOSHUAI HEALTH BIG DATA CO LTD +1

Method and system for generating official document key abstract based on multi-modal feature extraction

The invention provides an official document key abstract generation method and system based on multi-modal feature extraction, and relates to the technical field of multi-modal artificial intelligence generation, and the method comprises the steps: firstly obtaining text modal data, image modal data and table modal data of a to-be-processed official document, then carrying out the hierarchical semantic analysis processing of the text modal data, and obtaining a to-be-processed official document key abstract; the method comprises the following steps: generating a text semantic feature set, performing visual element extraction processing on image modal data, generating an image feature set, performing structured analysis processing on table modal data, generating a table feature set, and performing cross-modal alignment processing on the text semantic feature set, the image feature set and the table feature set. According to the method, the dynamic association feature sets among the text semantics, the image elements and the table elements are determined according to the text semantics, the image elements and the table elements, the three feature sets are subjected to multi-modal fusion processing according to the feature sets, the target abstract content of the to-be-processed official document is generated, complementarity of multi-modal information in the official document is fully utilized, and the generated abstract is more complete, accurate and targeted.
Owner:STATE GRID SHANDONG ELECTRIC POWER COMPANY WEIFANG POWER SUPPLY

Well mining unmanned cloud control platform global path planning method based on V2X

The invention discloses a V2X-based global path planning method for a mine unmanned driving cloud control platform, and relates to unmanned driving. The V2X-based global path planning method comprises the following steps: constructing a traffic semantic map data structure # imgabs0 #; according to task issuing or operation plan adjustment, generating path request data R, and performing time constraint, resource constraint and path optimality constraint verification on the path request data R; according to the R and # imgabs1 #, adopting a heuristic search algorithm based on a graph theory to carry out optimal path search on the road topological structure, and generating a global path P containing a node sequence and driving parameters; and acquiring obstacle data detected by the vehicle end through a local sensor, performing obstacle avoidance correction through a local path optimization algorithm according to the obstacle data and the global path P, and generating a local path meeting the safety distance constraint and the path deviation constraint. According to the method, on the premise of meeting multi-dimensional coupling constraints such as time-space, priority-resource, safety-efficiency and the like, the optimal driving path dynamically adapting to the complex environment of the well industry and mining is generated.
Owner:LEIKE ZHITU (BEIJING) TECH CO LTD

Market supervision data asset multi-dimensional evaluation method and system based on hierarchy-network dynamic fusion model

The invention discloses a market supervision data asset multi-dimensional evaluation method and system based on a hierarchy-network dynamic fusion model, and relates to the technical field of data asset evaluation. According to the method, a semantic association and index alignment relationship between data assets is comprehensively described by constructing a semantic map of the data assets; a hierarchy-network dynamic fusion model is formed by combining an analytic hierarchy process and a network analysis process, so that the determination of the index weight is more scientific and reasonable; a graph neural network is utilized to perform embedded representation learning on a data asset graph structure, comprehensive feature expression of each data asset is extracted, a multi-objective optimization method is combined, a Pareto optimal solution set is generated, scoring, sorting and grading are performed on the data assets, and reliability and interpretability of an evaluation result are ensured; the evaluation report is output in a structured data format and is provided for a market supervision system through an interface, thereby facilitating effective management and decision support for data assets by a supervision department, and having a wide application prospect.
Owner:江苏省市场监督管理局数据中心