Video image processing method and device, and terminal device

A technology of video image and processing method, which is applied in the field of information processing, and can solve problems such as audience disgust, failure to achieve advertising effects, and occupation of network resources.

Inactive Publication Date: 2017-11-10
BEIJING SENSETIME TECH DEV CO LTD
View PDF4 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, thi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video image processing method and device, and terminal device
  • Video image processing method and device, and terminal device
  • Video image processing method and device, and terminal device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] figure 1 It is a flow chart showing a video image processing method according to Embodiment 1 of the present invention. The method is carried out by a computer system comprising processing means of video images.

[0049] refer to figure 1 , in step S110, perform face motion detection on the currently played video image containing face information.

[0050] Among them, the facial movements include but are not limited to blinking, opening the mouth, nodding and pouting. The face information may include information related to the face, eyes, mouth, nose and / or hair. The video image may be an image of a live video that is being broadcast live, or a video image that has been recorded or is being recorded.

[0051] In the implementation, take live video as an example. At present, there are multiple live video platforms, such as Huajiao live platform, YY live broadcast platform, etc. Each live broadcast platform includes multiple live broadcast rooms, and each live broadca...

Embodiment 2

[0066] figure 2 It is a flow chart showing a method for obtaining a first convolutional network model according to Embodiment 2 of the present invention.

[0067] In the first embodiment above, the process of performing facial action detection on a human face in step S110 of the video image may be implemented by using a corresponding feature extraction algorithm or using a neural network model such as a convolutional network model. In this embodiment, the convolutional network model is taken as an example to perform facial motion detection on the video image. For this purpose, the first convolutional network model for detecting the state of human face motion in the image can be pre-trained.

[0068] The video image processing method in this embodiment can be executed by any device with data collection, processing and transmission functions, including but not limited to mobile terminals and PCs, which are not limited in the implementation of the present invention.

[0069] re...

Embodiment 3

[0095] image 3 It is a flow chart showing the video image processing method according to Embodiment 3 of the present invention. In this embodiment, the business object is a special effect containing semantic information. Specifically, the business object may include at least one of the following special effects including advertisement information: two-dimensional sticker special effects, three-dimensional special effects, particle special effects, and the like. The video image is a live broadcast video image, such as a video image of an anchor on the Huajiao live broadcast platform when performing a live video broadcast.

[0096] In step S310, the currently played video image containing face information is acquired.

[0097] Wherein, for the specific processing of the above-mentioned step S310, reference may be made to the related content of the step S110 in the above-mentioned first embodiment, which will not be repeated here.

[0098] In step S320, key points of the human...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a video image processing method and device, and a terminal device. The video image processing method comprises the following steps: performing human face facial motion detection on a current video image containing the human face information; confirming the display position of a business object to be displayed in the video image when the detected facial motion matches the corresponding predetermined facial motion; and drawing the business object in the display position by means of the computer graphics. By means of the embodiment of the invention, the network resources and / or the client system resources can be saved, the interestingness of the video image is added, and the video can be watched by the user normally without disturbing; therefore, the aversion of the user to the business object displayed in the video image can be reduced, the attention of the audience can be attracted to a certain extent, and the influence of the business object can be improved.

Description

technical field [0001] The present invention relates to information processing technology, in particular to a video image processing method, device and terminal equipment. Background technique [0002] With the development of Internet technology, people use the Internet to watch videos more and more, thus, Internet video provides business opportunities for many new businesses. Because Internet video can become an important business traffic entrance, it is considered a high-quality resource for advertising placement. [0003] Existing video advertisements are mainly inserted into a fixed-duration advertisement at a certain time when the video is played, or placed at a fixed position in the area where the video is played and its surrounding areas. [0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, this video advertising method often disturbs the normal video viewin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06F9/44
CPCG06F9/451G06V40/176G06V40/168G06V40/172G06V20/41G06V20/46G06F18/00
Inventor 栾青彭义刚
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap