Video semantic communication method and system based on hierarchical knowledge expression

A hierarchical and semantic technology, applied in the field of video communication, can solve the problems of waste of communication bandwidth, incomplete semantic extraction, insufficient semantic representation ability, etc., to improve the integrity, avoid inaccurate semantic description, improve semantic representation ability and communication bandwidth. The effect of utilization

Active Publication Date: 2021-08-27
XIDIAN UNIV
View PDF7 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to propose a video semantic communication method and system based on hierarchical knowledge expression to solve the problems of incomplete semantic extraction, insufficient semantic representation ability and redundant semantic description in the prior art, expand application scenarios, and avoid waste of communication bandwidth

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video semantic communication method and system based on hierarchical knowledge expression
  • Video semantic communication method and system based on hierarchical knowledge expression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0033] This example is oriented to the video semantic communication requirements of online interactive conferences, and implements a video semantic communication method and system based on hierarchical knowledge expression for single-person body movements and multi-person interaction behaviors in conference scenarios.

[0034] refer to figure 1 , this example is based on the video semantic communication method of hierarchical knowledge expression, including the following steps:

[0035] Step 1, build a hierarchical knowledge base K.

[0036] 1.1) Establish a semantic-aware knowledge base K 0 , which is used to store the primary structured semantic feature G extracted from the video 0 The signal-aware network W e 0 and from the primary structured semantic features G 0 Signal Reconstruction Network for Reconstructing Video

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video semantic communication method based on hierarchical knowledge expression, and mainly aims to solve the problems of incomplete semantic extraction, insufficient semantic representation capability and redundant semantic description in the prior art. According to the implementation scheme, the method comprises the following steps: constructing a hierarchical knowledge base consisting of a multi-level signal sensing network, a semantic abstract network, a semantic reconstruction network and a video reconstruction network; collecting a to-be-transmitted video signal; extracting structured semantic features of the video signals based on a signal sensing network and a semantic abstract network in the hierarchical knowledge base, and transmitting the structured semantic features through an ultra-narrowband channel; and reconstructing a video signal by using a semantic reconstruction network and a signal reconstruction network in the hierarchical knowledge base according to the structured semantic features. According to the method, semantic features of different scales are mined, and the semantics are structurally represented by using the structured data, so that the integrity of semantic extraction is improved, the semantic representation capability and the communication bandwidth utilization rate are improved, and the method can be applied to online conferences, human-computer interaction and intelligent Internet of Things.

Description

technical field [0001] The invention belongs to the technical field of video communication, and in particular relates to a video semantic communication method and system based on hierarchical knowledge expression, which can be used for online meetings, human-computer interaction, and intelligent Internet of Things. Background technique [0002] Video communication is a communication service that delivers video information. The commonly used video communication technologies now realize the transmission of video information through the complete transmission of video signals, and judge the quality of video communication by the integrity of the transmitted signals. With the rapid improvement of video signal clarity and the geometric growth of the number of communication terminals, the communication bandwidth that is gradually approaching the limit of growth has been unable to meet the needs of video communication scenarios under the background of the intelligent era such as larg...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/169H04N19/90H04N19/91H04N21/234H04N21/44G06F40/30
CPCH04N19/169H04N19/90H04N19/91H04N21/44008H04N21/23418G06F40/30
Inventor 石光明高大化杨旻曦张中强董宇波谢雪梅刘丹华
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap