Video image processing method and device, and terminal device

A video image and processing method technology, applied in the field of information processing, can solve the problems of occupying network resources, occupying client system resources, disturbing the normal video viewing experience of viewers, etc.

Inactive Publication Date: 2017-11-10
BEIJING SENSETIME TECH DEV CO LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, thi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video image processing method and device, and terminal device
  • Video image processing method and device, and terminal device
  • Video image processing method and device, and terminal device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 1 It is a flow chart showing a video image processing method according to Embodiment 1 of the present invention. The method is carried out by a computer system comprising processing means of video images.

[0050] refer to figure 1 , in step S110, perform facial expression detection on the currently played video image containing human face information.

[0051] Wherein, the face information may include information related to the face, eyes, nose and / or hair. The video image may be an image of a live video that is being broadcast live, or a video image in a recorded video, etc. Facial expressions include, but are not limited to, happiness, anger, pain, sadness, etc.

[0052] In the implementation, take live video as an example. At present, there are multiple live video platforms, such as Huajiao live platform, YY live broadcast platform, etc. Each live broadcast platform includes multiple live broadcast rooms, and each live broadcast room will include at least...

Embodiment 2

[0065] figure 2 It is a flow chart showing a method for obtaining a first convolutional network model according to Embodiment 2 of the present invention.

[0066] The process of detecting the facial expression of a human face in step S110 in the first embodiment above can be realized by using a corresponding feature extraction algorithm or using a neural network model such as a convolutional network model. In this embodiment, the convolutional network model is taken as an example to perform facial expression detection on a video image. For this purpose, the first convolutional network model for detecting the attributes of a human face in an image can be pre-trained.

[0067] The video image processing method in this embodiment can be executed by any device with data collection, processing and transmission functions, including but not limited to mobile terminals and PCs, which are not limited in the implementation of the present invention.

[0068] refer to figure 2 , first...

Embodiment 3

[0100] Figure 4 It is a flow chart showing the video image processing method according to Embodiment 3 of the present invention. In this embodiment, the business object is a special effect containing semantic information. Specifically, the business object may include at least one of the following special effects including advertisement information: two-dimensional sticker special effects, three-dimensional special effects, particle special effects, and the like. The video image is a live broadcast video image, such as a video image of an anchor on the Huajiao live broadcast platform when performing a live video broadcast.

[0101] In step S410, the currently played video image containing face information is acquired.

[0102] Wherein, for the specific processing of the above step S410, reference may be made to the relevant content in the step S110 in the first embodiment above, and details are not repeated here.

[0103] In step S420, based on the face information in the vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a video image processing method and device, and a terminal device. The video image processing method comprises the following steps: performing human face facial expression detection on a current video image containing the human face information; confirming the display position of a business object to be displayed in the video image when the detected facial expression matches the corresponding predetermined facial expression; and drawing the business object in the display position. By means of the embodiment of the invention, the network resources and / or the client system resources can be saved, the interestingness of the video image is added, and the video can be watched by the user normally without disturbing; therefore, the aversion of the user to the business object displayed in the video image can be reduced, the attention of the audience can be attracted to a certain extent, and the influence of the business object can be improved.

Description

technical field [0001] The present invention relates to information processing technology, in particular to a video image processing method, device and terminal equipment. Background technique [0002] With the development of Internet technology, people use the Internet to watch videos more and more, thus, Internet video provides business opportunities for many new businesses. Because Internet video can become an important business traffic entrance, it is considered a high-quality resource for advertising placement. [0003] Existing video advertisements are mainly inserted into a fixed-duration advertisement at a certain time when the video is played, or placed at a fixed position in the area where the video is played and its surrounding areas. [0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, this video advertising method often disturbs the normal video viewin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
CPCG06V40/174G06F18/00
Inventor 栾青张伟
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products