Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Expression-based video generation method, apparatus and device, and storage medium

A video and expression technology, applied in the field of image processing, can solve the problem of not being able to automatically capture wonderful moment videos.

Active Publication Date: 2020-05-26
武汉星巡智能科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to propose a video generation method, device, equipment and storage medium based on facial expressions, aiming to solve the technical problem in the prior art that it is impossible to automatically capture wonderful moments of video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression-based video generation method, apparatus and device, and storage medium
  • Expression-based video generation method, apparatus and device, and storage medium
  • Expression-based video generation method, apparatus and device, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Embodiment 1 of the present invention provides an expression-based video generation method, such as figure 1 As shown, the method includes:

[0038] S1. Store the video to be synthesized within a preset period of time and detect in real time whether the video to be synthesized contains an interesting expression image;

[0039] Wherein, the preset time period may be a default time period of the system, such as 20 minutes, or may be a time period preset by the user according to needs. Taking 20 minutes as an example, during the video shooting process, this step can temporarily store the video to be synthesized within 20 minutes, and automatically detect whether each frame image in the video to be synthesized contains funny expression images through the face detector.

[0040] Wherein, the funny emoticon image can be set according to the image requirements of the generated target video or the user's preferences. Preferably, the funny emoticon images include: smiley emoti...

Embodiment 2

[0046] Embodiment 2 of the present invention provides an expression-based video generation method, such as figure 2 As shown, the method includes:

[0047] S201. Store the video to be synthesized within a preset period of time and detect in real time whether the video to be synthesized contains funny expression images;

[0048] S202. When it is detected that the video to be synthesized contains a funny expression image, score the funny expression image according to a preset scoring rule to obtain a score value, and judge whether the score value is greater than a preset value;

[0049] In a specific implementation manner, the funny emoticon image is a smiley image of a specified group of people, and the preset scoring rule is a scoring rule formed by the smiling degree and image quality of the smiling face image. The score value of the funny emoticon image is the sum of the weights of the first score item obtained from the composition factor of the degree of laughter and the ...

Embodiment 3

[0063] Embodiment 3 of the present invention provides an expression-based video generation method, such as image 3 As shown, the method includes:

[0064] S301. Allocate temporary storage space for storing videos to be synthesized.

[0065] The size of the temporary storage space can be set according to the storage space of the video to be synthesized during the preset time period is larger than that.

[0066] S302. Store the video to be synthesized within a preset period of time and detect in real time whether the video to be synthesized contains funny facial expressions;

[0067] Exemplarily, the funny emoticon image is a baby smiling face image, and the detecting whether the video to be synthesized contains an interesting emoticon image includes:

[0068] S11, detecting the face image of the baby;

[0069] Specifically, in this step, the image in the video stream may be automatically detected by a face detector; and it is judged whether there is a baby face in the curre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an expression-based video generation method, apparatus and device, and a storage medium, and relates to the technical field of image processing. The method comprises the stepsof storing a to-be-synthesized video in a preset time period and detecting whether the to-be-synthesized video comprises an interesting expression image or not in real time; and when detecting that the to-be-synthesized video includes an interesting expression image, combining and storing the to-be-synthesized video and a video in a first time period after the interesting expression image to generate a target video. According to the invention, the interesting expression images in the video can be automatically detected, and the front and back video contents of the interesting expression imagesare merged to generate a wonderful small video, so that the wonderful instant video is automatically captured, the life interesting instant is recorded, and the user experience is improved.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an expression-based video generation method, device, equipment and storage medium. Background technique [0002] There are often some wonderful moments or memorable moments in life that need to be preserved. For example, babies and toddlers will continue to improve in the process of growth, and it will also bring many happy moments to parents. Parents like to use video cameras or digital cameras to capture interesting photos of infants and young children to record the beautiful moments of infants and young children. However, due to busy work and other reasons, parents cannot always accompany their children, nor can they capture every moment of infants and young children. Funny expression. Therefore, there is an urgent need for a method that can automatically recognize interesting expressions and automatically capture wonderful or beautiful moments. Contents o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06F16/74
CPCH04N21/816G06V40/174G06F16/74Y02D10/00
Inventor 陈辉张晓亮熊章张智雷奇文
Owner 武汉星巡智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products