Unlock instant, AI-driven research and patent intelligence for your innovation.

Sign language news broadcasting method based on visual human

A technology for news broadcast and virtual human, applied in the field of control, can solve the problems of inaccurate sign language, deformation of gestures and movements, etc., and achieve the effect of solving the problem of synchronization between sign language and sound

Active Publication Date: 2011-08-17
HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the selection of key frames and the improper application of the difference algorithm will cause the deformation of gestures, resulting in inaccurate sign language expressions
[0009] (2) Optimization problem of sign language frame sequence

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language news broadcasting method based on visual human
  • Sign language news broadcasting method based on visual human
  • Sign language news broadcasting method based on visual human

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The sign language news broadcasting method based on virtual human of the present invention can be applied to many fields such as bilingual broadcasting of TV programs, computer-aided dumb language teaching, sign language MMS, deaf-mute auxiliary terminal equipment, electronic signs, electronic advertisements, and digital interactive entertainment. It helps to improve and improve the living, learning and working conditions of the deaf-mute and provide them with better services.

[0031] The present invention provides a sign language news broadcasting method based on a virtual human, which comprises the following steps:

[0032] S1 models the virtual human, realizes the mapping of the joint angle vector to the specific gesture of the virtual human, and generates a sequence of sign language frames. On this basis, the Hermite interpolation algorithm is used to interpolate the joint angle vector, which can effectively control the motion speed of the virtual human while drivi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a sign language news broadcasting method based on visual human, comprising the following steps: S1 performs modeling on the visual human to realize the mapping to a visual human special gesture from a joint angle vector so as to generate a signal language frame sequence; S2 synchronously analyzes the signal language and voice in the sign language news broadcasting process, simplifies frame vector, calculates frame weight number and optimizes the frame sequence; S3 processes video streaming so as to add a cartoon expressed by the optimized visual human signal language into the video streaming so as to finally synchronously broadcast signal language and voice.

Description

technical field [0001] The invention relates to a control method, in particular to a virtual human-based sign language news broadcast method that can be applied to the bilingual broadcast of TV programs. Background technique [0002] In 1998, Hitachi successfully developed a two-dimensional and three-dimensional animation software for sign language CAI, which collected more than 4,000 sign language words, which is currently a relatively large sign language teaching software. [0003] In 2001, the ViSiCAST system was developed through the joint research of the University of East Anglia in Norway and the University of Hamburg in Germany and other academic groups and companies. The system uses motion capture technology to capture motion data and realizes the conversion from speech to British Sign Language. It has been applied to public places such as post offices and the Internet. [0004] In 2004, Vcom3D developed a set of sign language editing software for 3D virtual people,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G09B21/00H04N5/262G06T13/40
Inventor 王轩赵海楠于成龙许欣欣
Owner HARBIN INST OF TECH SHENZHEN GRADUATE SCHOOL