Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Video Semantic Communication Method and System Based on Hierarchical Knowledge Expression

A hierarchical and semantic technology, applied in the field of video communication, can solve the problems of waste of communication bandwidth, incomplete semantic extraction, insufficient semantic representation ability, etc., to improve the integrity, avoid inaccurate semantic description, improve semantic representation ability and communication bandwidth. The effect of utilization

Active Publication Date: 2022-04-19
XIDIAN UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to propose a video semantic communication method and system based on hierarchical knowledge expression to solve the problems of incomplete semantic extraction, insufficient semantic representation ability and redundant semantic description in the prior art, expand application scenarios, and avoid waste of communication bandwidth

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video Semantic Communication Method and System Based on Hierarchical Knowledge Expression
  • Video Semantic Communication Method and System Based on Hierarchical Knowledge Expression
  • Video Semantic Communication Method and System Based on Hierarchical Knowledge Expression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0033] This example is oriented to the video semantic communication requirements of online interactive conferences, and implements a video semantic communication method and system based on hierarchical knowledge expression for single-person body movements and multi-person interaction behaviors in conference scenarios.

[0034] refer to figure 1 , this example is based on the video semantic communication method of hierarchical knowledge expression, including the following steps:

[0035] Step 1, build a hierarchical knowledge base K.

[0036] 1.1) Establish a semantic-aware knowledge base K 0 , which is used to store the primary structured semantic feature G extracted from the video 0 The signal-aware network W e 0 and from the primary structured semantic features G 0 Signal Reconstruction Network for Reconstructing Video

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention proposes a video semantic communication method based on hierarchical knowledge expression, mainly to solve the problems of incomplete semantic extraction, insufficient semantic representation ability and redundant semantic description existing in the prior art. The implementation plan is: build a hierarchical knowledge base composed of multi-level signal perception network, semantic abstraction network, semantic reconstruction network and video reconstruction network; collect video signals to be transmitted; based on the signal perception network and semantic abstraction network in the hierarchical knowledge base The structured semantic features of the video signal are extracted and transmitted through an ultra-narrowband channel; the video signal is reconstructed by using the semantic reconstruction network and the signal reconstruction network in the hierarchical knowledge base according to the structured semantic features. The invention not only improves the completeness of semantic extraction, but also improves the semantic representation ability and communication bandwidth utilization rate by mining semantic features of different scales and using structured data structure to represent semantics, which can be used for online meetings, human-computer interaction, intelligent internet of things.

Description

technical field [0001] The invention belongs to the technical field of video communication, and in particular relates to a video semantic communication method and system based on hierarchical knowledge expression, which can be used for online meetings, human-computer interaction, and intelligent Internet of Things. Background technique [0002] Video communication is a communication service that delivers video information. The commonly used video communication technologies now realize the transmission of video information through the complete transmission of video signals, and judge the quality of video communication by the integrity of the transmitted signals. With the rapid improvement of video signal clarity and the geometric growth of the number of communication terminals, the communication bandwidth that is gradually approaching the limit of growth has been unable to meet the needs of video communication scenarios under the background of the intelligent era such as larg...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/169H04N19/90H04N19/91H04N21/234H04N21/44G06F40/30
CPCH04N19/169H04N19/90H04N19/91H04N21/44008H04N21/23418G06F40/30
Inventor 石光明高大化杨旻曦张中强董宇波谢雪梅刘丹华
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com