2results about How to "Close to actual needs" patented technology

This invention provides a controllable image description method, system, device, and medium based on multimodal fusion. The method includes the following steps: based on the original image features X... ν * and object regression box features X ν b The images are fused to generate sample image features X. ν Extract each word from the labeled language text, and label and positionally encode the extracted words to generate sample text description features X. w Generate a trajectory regression box based on the mouse trajectory segment, and generate sample trajectory features X based on the trajectory regression box. r Using a pre-built TO-Transformer feature fusion model, the sample image features X are processed. ν The sample text description feature X w and the sample trajectory feature X r Feature fusion is performed to generate sample fusion features; based on the sample fusion features, a controllable image description model is generated using a pre-built output model, thereby effectively improving the controllability and efficiency of image description.

The application discloses a kind of knowledge graph construction methods and devices for ship power system design task.The method includes the following steps: mode layer design is carried out, and the concept of ship power system and the relationship between concepts are defined;Unstructured data is preprocessed;The entity and the relationship between entities are marked;The entity data set and the entity relationship data set marked are trained to obtain the corresponding model;Triplet extraction is carried out based on the obtained model, imported into the graph database, and the concept knowledge graph of ship power system is formed;Modeling is carried out, and the knowledge graph of ship power system design task is formed;Atlas fusion is carried out, and the final knowledge graph is formed.The application can realize the construction of the knowledge graph of ship power system design task, make the knowledge graph construction in the field more convenient, efficient and accurate, provide knowledge base for subsequent use of atlas to build query platform, and improve the retrieval efficiency of ship designers.