A video positioning method, device and electronic equipment

A technology of video positioning and video clips, which is applied in the field of computer vision, can solve the problems of lack of video positioning, etc., and achieve the effect of enhancing accuracy, improving efficiency and browsing experience, and closely related and aggregated

Active Publication Date: 2020-07-10
TENCENT TECH (SHENZHEN) CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] With the rapid growth of the number of videos, video positioning technology can improve the processing efficiency of video in various application scenarios, so it has more and more important application value. However, related technologies lack effective technical solutions for video positioning.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A video positioning method, device and electronic equipment
  • A video positioning method, device and electronic equipment
  • A video positioning method, device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. All other embodiments obtained under the premise of creative labor belong to the protection scope of the present invention.

[0062]In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and The various technical solutions described in the embodiments of the present invention may be combined with each other without conflict.

[0063] Unless otherwise defined, all technical and scientific terms used in the embodiments of the present invention have the same meaning as commonly understood by those skilled in the technical field of the embodiments of the present invention. The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video positioning method, device and electronic equipment. Wherein, the method includes: acquiring video and sentences; performing feature extraction on the video and the sentence respectively to obtain corresponding video segment features and word features; fusing the video segment features and the word features to obtain fusion features ; Aggregating and associating the fusion feature layer by layer based on time series through a time series convolutional neural network to obtain a multi-layer time series convolution feature map; performing semantic modulation on each layer feature map in the multi-layer time series convolution feature map to obtain modulation After the feature map, and perform temporal convolution operation on the modulated feature map to obtain the target video segment related to the semantics of the sentence. Through the present invention, it is possible to quickly and accurately locate the target video segment related to the semantics of the input sentence.

Description

technical field [0001] The present invention relates to computer vision technology in the field of artificial intelligence (AI, Artificial Intelligence), in particular to a video positioning method, device and electronic equipment. Background technique [0002] Computer vision technology is a branch in the field of AI technology. Its purpose is to use machines to learn based on prior knowledge, so as to have the logical ability to classify and judge media information such as videos and images. [0003] Video localization technology is a typical application of computer vision technology. For a given sentence, video localization technology can find video clips semantically related to the sentence from the video. For example, for the sentence "I want to go swimming", the video positioning technology can find a video segment including a swimming scene from the video. For another example, the video positioning technology can be applied to application scenarios such as online vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/234H04N21/44G06K9/00
CPCH04N21/23418H04N21/44008G06V20/46
Inventor 袁艺天马林王景文刘威朱文武
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products