The application discloses a kind of art
video annotation methods based on
gene learning model, the method includes the following steps: S1, the
key frame of video is extracted, the subscript of
key frame in all frames of art video is recorded, the time of current
key frame is calculated, and key frame is input into
feature extraction network and is extracted feature;S2, the audio of art video is separated, and audio feature is extracted;S3, the visual feature of each key frame and audio feature are synchronously aggregated, and the multi-
modal fusion feature of each frame is obtained, the multi-
modal fusion feature of all key frames is time-series aggregated, and video-level time-series aggregated feature is obtained;S4, according to the video-level time-series aggregated feature obtained,
inference is carried out, and video-level feature is obtained, according to the key frame feature obtained, video frame-level feature is obtained;The application can realize the multi-
granularity annotation of traditional art video, is helpful to subsequent management, retrieval of the video, is conducive to the spread of Chinese culture.