Video clip positioning method and device and computer readable storage medium

A technology of video clips and positioning methods, which is applied in the field of video processing and can solve problems such as poor video positioning accuracy

Pending Publication Date: 2021-12-17
GUANGZHOU YUNCONG INFORMATION TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] It can be seen that the current video segment positioning method based on language query has the problem of poor video positioning accuracy.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video clip positioning method and device and computer readable storage medium
  • Video clip positioning method and device and computer readable storage medium
  • Video clip positioning method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0109] Some embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0110] In the description of the present invention, "module" and "processor" may include hardware, software or a combination of both. A module may include hardware circuits, various suitable sensors, communication ports, memory, and may also include software parts, such as program codes, or a combination of software and hardware. The processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor or any other suitable processor. The processor has data and / or signal processing functions. The processor can be implemented in software, hardware or a combination of both. The non-transitory computer readabl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of video processing, particularly provides a video clip positioning method and device and a medium, and aims to solve the problem of how to improve the positioning accuracy during video clip positioning. The method comprises the following steps: controlling a video positioning model to obtain a first fusion feature according to candidate features of candidate video clips in a video sample and language features of language description information, and acquiring a second fusion feature corresponding to the candidate video clips with the same starting time or ending time according to the first fusion feature by adopting a graph convolutional network; training a video positioning model according to the matching degree of the candidate video clip predicted by the second fusion feature and the language description information; and carrying out video clip positioning by adopting the trained model. Accurate candidate video clips can be obtained according to the first fusion features to improve the accuracy of video positioning, candidate video clips with semantics difficult to distinguish can be accurately distinguished according to the second fusion features, and the accuracy of video positioning is further improved.

Description

technical field [0001] The present invention relates to the technical field of video processing, and specifically provides a video segment positioning method, device and computer-readable storage medium. Background technique [0002] At present, the video clip localization methods based on language query mainly include one-stage method and two-stage method. Specifically, the one-stage method mainly includes two methods. One method is to predict each frame in the video and judge whether it is the start frame or the end frame of the video segment related to the query language. Since this method It mainly predicts based on the content of the current frame, ignoring the global features of the video, resulting in poor prediction results; another method is to use all the frames in the real label video clip to regress the current frame and the starting frame and The distance of the end frame, according to the distance to judge whether the current frame is the start frame or the en...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/783G06F16/78G06N3/04G06N3/08
CPCG06F16/783G06F16/7867G06N3/084G06N3/044G06N3/045
Inventor 高伽林孙新许蒙蒙周曦
Owner GUANGZHOU YUNCONG INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products