Unlock instant, AI-driven research and patent intelligence for your innovation.

A Screen Video Generation Method Fused with Portrait and Voice

A screen video and voice technology, applied in the field of computer multimedia, can solve the problems of lack of portrait recording of computer users, difficulty in hearing user voices, etc.

Active Publication Date: 2017-07-11
浙江航天长峰科技发展有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Whether it is recording teaching videos or used as monitoring, there is a deficiency in existing software or systems: the lack of portrait recording of computer users, and the editing of recorded portraits into screen video files
And this is actually a very important function, because whether it is teaching or monitoring, when the voice of the computer user is recorded, usually the ambient noise is not necessarily small, so it is sometimes difficult to distinguish the user's voice

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Screen Video Generation Method Fused with Portrait and Voice
  • A Screen Video Generation Method Fused with Portrait and Voice

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] A screen video generation method that integrates portraits and voices, such as figure 1 shown, including the following steps:

[0031] Step 101, first start the image capture thread: capture the screen image according to the preset video frame rate time interval, then call the pre-installed video codec library on the device to encode, and finally store the video code stream into the video file;

[0032] Step 201, start a recording thread while starting the image capture thread: capture audio data, then call the pre-installed audio codec library on the device to encode, and finally write the audio code stream into the video file;

[0033] Step 301, audio and video synchronization is based on audio, and when the recording thread writes a code stream of a piece of audio data to the video file, the absolute time T of the video file is calculated according to the cumulative value of the audio sampling frequency and the length of the audio data recording block, Described abs...

Embodiment 2

[0044] A screen video generation method for fusion of portrait and voice described in embodiment 2, its step 101-step 501 is the same as embodiment 1, and its main difference from embodiment 1 is that the step 601 adopts the method of furthest away from the mouse position Determine the specific position where the face image is added to the screen image, and then add the face image data to the current frame screen image through the superposition method to generate a screen video that combines the portrait and voice, wherein the method that is farthest from the mouse position is : Take the farthest point on the screen from the mouse position in the current frame to add the face image. The reason for using this method is that the mouse position is often the focus of the user’s attention on the screen. To use this method, the current mouse position must be known in advance. For tablet computers and touch-screen smart phones, it is necessary to know the pointer at the closest moment...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a screen video generation method that integrates portraits and voices, belongs to the field of computer multimedia technology, and includes the steps of starting an image capture thread, starting a recording thread, synchronizing audio and video, starting a face capture thread, and capturing people. The face image is added to the specific position of the screen image, and the face image data is added to the current frame screen image by the replacement method or the superposition method to generate a screen video that combines portraits and voices. The above screen video generation method that fuses portraits and voices , the audio and video synchronization method converts the number of image frames into time, so that the total audio time and video time are consistent, thereby effectively ensuring the strict synchronization of audio and video data. On the basis of audio and video synchronization, the user's data is captured by the camera Portrait, and then combine the user's face (that is, expression) with voice to give video viewers a more intuitive experience and improve the understanding of the screen video content.

Description

technical field [0001] The invention relates to a method for generating screen video by combining portrait and voice, and belongs to the technical field of computer multimedia. Background technique [0002] At present, the application of screen capture software at home and abroad is relatively common, mainly used in education and teaching, or for computer screen monitoring. Well-known software or systems include EZvid, BlueBerry, Screenr, and CamStudio, as well as screen recording experts, network monitoring software "Third Eye" and so on. These software can record the moving image of the computer screen as a video file, and simultaneously include the ambient sound recorded simultaneously. Whether it is recording teaching videos or used as monitoring, there is a deficiency in existing software or systems: the lack of portrait recording of computer users, and the editing of recorded portraits into screen video files. And this is actually a very important function, because w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/265G06F9/46
Inventor 陆成刚洪榛田茂利杜焕强俞珊珊黄蒙
Owner 浙江航天长峰科技发展有限公司