The invention discloses a multi-
modal design work intelligent classification and retrieval
system based on
deep learning, and relates to the technical field of multi-
modal deep learning retrieval. Image, text and audio features are extracted through MS-CNN and Transform; realizing cross-
modal semantic fusion by using a
knowledge graph and GNN; the hierarchical
cascade classifier is combined with
incremental learning to realize rapid and accurate classification; the
semantic enhancement retrieval supports
fuzzy query and cross-modal retrieval; in addition, the
system also has the functions of design
collaboration, quality evaluation and safety operation and maintenance, and the design
resource management efficiency is improved. According to the method, multi-
modal data are fused, design features are accurately extracted, cross-modal deep
correlation analysis is achieved, through intelligent classification, semantic retrieval and personalized recommendation, the design resource retrieval efficiency and accuracy are improved, meanwhile, data safety is guaranteed, design cooperation is supported, a designer is assisted to rapidly obtain inspiration and grasp the design trend, and the design quality is improved. And the intelligent development of the design industry is promoted.