Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video content retrieval method based on semantic search

A technology for semantic search and video content, applied in digital data information retrieval, special data processing applications, instruments, etc., can solve the problems of blurred audio and text, unable to be blurred, unable to find answers, etc., to improve ambiguity and improve convenience Effects of Sex and Possibility

Pending Publication Date: 2021-10-12
深圳前海黑顿科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] 1. The audio text parsed from the video is generally fuzzy and filled with a large number of interfering characters, which cannot be blurred by traditional precise search methods;
[0007] 2. Character-level search methods cannot handle sentence-level semantic information, because a word difference in the language may lead to semantic subversion, and character-level search methods cannot capture sentence-level semantic information;
[0008] 3. The question-and-answer mode cannot be realized, and the user's input text can only be matched. If the user's input text is a "question sentence", the answer to the question sentence cannot be found from massive video information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video content retrieval method based on semantic search
  • Video content retrieval method based on semantic search
  • Video content retrieval method based on semantic search

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0076] 1. User uploads video:

[0077] Video video_name='video_test.mp4'

[0078] Call the encapsulated interface:

[0079] upload_video(video_name)

[0080] For extracting audio voice_name='voice_test.mp3',

[0081] And convert audio to text, generate subtitle subtitling='test.json'

[0082] 2. Search in the video library

[0083]

[0084]

[0085] The result returns the best clip in the matched video for users to choose 3. Search within the specified video

[0086]

[0087] The results return multiple groups of matching results in the specified video according to the matching degree, determine the time of the video clip according to the start_time and end_time returned by the result, and determine the position of the subtitle by subs_pos, and display the corresponding video clip and subtitle to the user for them to choose to watch.

[0088] In the present invention, the semantic search-based video content retrieval method improves the ambiguity of the search, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video content retrieval method based on semantic search. According to the video content retrieval method based on semantic search, the search ambiguity is improved, and the problem that a traditional accurate search method cannot well process analyzed audio texts full of interference characters is solved; According to the video content retrieval method based on semantic search, semantic association is supported, and fuzzy matching at the levels of synonyms, synonyms and associated words is supported. Compared with a traditional semantic retrieval method, the invention provides a fuzzy retrieval method which is more suitable for life use, and corresponding synonyms, synonyms and associated words are intelligently matched with specific meanings of words in the target text in the text; according to the video content retrieval method based on semantic search, question and answer type search is supported, answers are accurately positioned in the materials according to the questions of the user, and convenience and possibility of search are improved.

Description

technical field [0001] The invention relates to the related field of video content retrieval, in particular to a video content retrieval method based on semantic search. Background technique [0002] With the continuous development of Internet technology and the continuous increase of network bandwidth today, online video has attracted a large number of users with its convenient access experience, diverse video sources and real-time update speed, making online video a part of users' online life. Indispensable and important component. [0003] With the massive growth of various videos in the network, video users often obtain interested video content through video retrieval. Existing video retrieval services mainly search for videos that meet the search criteria in the video library and provide them to users through information such as the video name, video format, video duration, or video resolution input by video users. However, with the continuous development of terminal ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/783G06F16/732G06N3/04
CPCG06F16/7844G06F16/732G06N3/045G06N3/044
Inventor 裴正奇于秋鑫彭陈
Owner 深圳前海黑顿科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products