Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

VR conference control system and method based on face modeling and expression tracking

A control system and control method technology, applied in the field of virtual scenes, can solve problems such as poor realism

Pending Publication Date: 2020-11-03
KAIDAER SCI & TECH DEV SHENZHEN
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of people-to-people communication, most of them focus on conveying sound, and the sense of reality is poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR conference control system and method based on face modeling and expression tracking
  • VR conference control system and method based on face modeling and expression tracking
  • VR conference control system and method based on face modeling and expression tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0033] It should be noted that related terms such as "first" and "second" can be used to describe various components, but these terms do not limit the components. These terms are only used to distinguish one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and the second component may also be referred to as the first component similarly. The term "and / or" refers to a combination of any one or more of related items and descriptive items.

[0034] Such as Figure 4 As shown, Figure 4 It is a block diagram of the VR conference control system based on face modeling and expression tracking of the present invention. A VR conference control system based on face modeling and expression tracking of the present inv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking module, and an interaction module, wherein the conference scene selection module is used for entering a conference scene according to the user's selection; the face detection module is used for recognizing face information of a wearer; the facial expression tracking module is used for obtaining a plurality of feature points in the face information every other preset time period and mapping the feature points into the 3D face model in real time, and the interaction module is used for outputting aconference scene and the 3D face model. According to the invention, the real-time change of each feature point in the face information can be accurately updated to the 3D face model in real time, i.e., the expression change of each participant in the conference can be observed in the virtual scene, so the method is more vivid and the information except the sound can be clearly understood.

Description

Technical field [0001] The invention belongs to the technical field of virtual scenes, and particularly relates to a VR conference control system and method based on face modeling and expression tracking. Background technique [0002] At present, the existing VR system mainly uses virtual reality technology to 3D scenes on the existing situational conference system, and combines video conferencing and 3D technology to realize network video under the comprehensive combination of voice, video system and 3D virtual screen Meetings shorten the distance between people and realize cross-regional connection and interaction. It can be displayed interactively in the virtual world on the screen. However, in the process of person-to-person communication, the voice is mostly conveyed, and the sense of reality is poor. [0003] Therefore, the existing technology needs to be improved. Summary of the invention [0004] The main purpose of the present invention is to propose a VR conference cont...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06T17/00H04N7/15
CPCG06T17/00H04N7/15G06V40/174G06V40/161G06V40/168
Inventor 何宝华沈睦生严明月
Owner KAIDAER SCI & TECH DEV SHENZHEN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com