Video positioning method and device and electronic equipment

A technology of video positioning and video clips, applied in the field of computer vision, can solve problems such as lack of video positioning, and achieve the effect of enhancing accuracy, improving efficiency, browsing experience, and close association and aggregation.

Active Publication Date: 2019-09-10
TENCENT TECH (SHENZHEN) CO LTD
View PDF11 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] With the rapid growth of the number of videos, video positioning technology can improve the processing efficiency of video in various application scenarios, so it has more and more important application value. However, related technologies lack effective technical solutions for video positioning.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video positioning method and device and electronic equipment
  • Video positioning method and device and electronic equipment
  • Video positioning method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. All other embodiments obtained under the premise of creative labor belong to the protection scope of the present invention.

[0062]In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and The various technical solutions described in the embodiments of the present invention may be combined with each other without conflict.

[0063] Unless otherwise defined, all technical and scientific terms used in the embodiments of the present invention have the same meaning as commonly understood by those skilled in the technical field of the embodiments of the present invention. The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video positioning method and device and electronic equipment. The method comprises the steps of obtaining a video and a statement; performing feature extraction on the videoand the statement respectively to obtain corresponding video clip features and word features; fusing the video clip features and the word features to obtain fusion features; aggregating and associating the fusion features layer by layer based on a time sequence through a time sequence convolutional neural network to obtain a multi-layer time sequence convolutional feature map; and performing semantic modulation on each layer of feature map in the multi-layer time sequence convolution feature map to obtain a modulated feature map, and performing time sequence convolution operation on the modulated feature map to obtain a target video clip related to semantics of the statement. According to the method and the device, the target video clip related to semanteme of the input statement can be quickly and accurately positioned.

Description

technical field [0001] The present invention relates to computer vision technology in the field of artificial intelligence (AI, Artificial Intelligence), in particular to a video positioning method, device and electronic equipment. Background technique [0002] Computer vision technology is a branch in the field of AI technology. Its purpose is to use machines to learn based on prior knowledge, so as to have the logical ability to classify and judge media information such as videos and images. [0003] Video localization technology is a typical application of computer vision technology. For a given sentence, video localization technology can find video clips semantically related to the sentence from the video. For example, for the sentence "I want to go swimming", the video positioning technology can find a video segment including a swimming scene from the video. For another example, the video positioning technology can be applied to application scenarios such as online vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/234H04N21/44G06K9/00
CPCH04N21/23418H04N21/44008G06V20/46
Inventor 袁艺天马林王景文刘威朱文武
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products