Gesture control method and device, and terminal device

A gesture control and gesture technology, applied in the field of information processing, can solve the problems of occupying network resources, occupying client system resources, audience dislike, etc., to save system resources, reduce dislike, and increase interest.

Inactive Publication Date: 2017-11-10
BEIJING SENSETIME TECH DEV CO LTD
View PDF4 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, this video advertising method often disturbs the normal video viewing experience of viewers, arouses audience disgust, and cannot achieve the expected advertising effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture control method and device, and terminal device
  • Gesture control method and device, and terminal device
  • Gesture control method and device, and terminal device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] figure 1 It is a flow chart showing the gesture control method according to Embodiment 1 of the present invention. The method is performed by a computer system including a gesture control device.

[0046] refer to figure 1 , in step S110, perform gesture detection on the currently playing video image.

[0047] Wherein, the video image may be an image of a live video that is being broadcast live, may also be a video image in a recorded video, or may be a video image in the process of recording, etc. Gestures may include hand waving, scissors, fist clenching, clasping hands, closing or opening of palms, and the like.

[0048] In the implementation, take live video as an example. At present, there are multiple live video platforms, such as Huajiao live platform, YY live broadcast platform, etc. Each live broadcast platform includes multiple live broadcast rooms, and each live broadcast room will include at least one An anchor, an anchor can broadcast live video images ...

Embodiment 2

[0064] figure 2 It is a flow chart showing the method for obtaining the first convolutional network model and the second convolutional network model according to Embodiment 2 of the present invention.

[0065] The processing of performing gesture detection on the currently playing video image in step S110 in the first embodiment above can be implemented by using a corresponding feature extraction algorithm or using a neural network model such as a convolutional network model. In this embodiment, taking the convolutional network model as an example, the human hand candidate area where the human hand is located and gesture detection are performed on the video image. Therefore, the first convolutional network model for detecting the human hand candidate area in the image can be pre-trained and used for A second convolutional network model for gesture detection from human hand candidate regions. Among them, the gestures include: waving, scissors hand, fist clenching, clapping ha...

Embodiment 3

[0092] image 3 It is a flow chart showing the gesture control method according to Embodiment 3 of the present invention. Wherein, the video image is a live video image, and the business object is a special effect containing semantic information, which may specifically include at least one of the following special effects including advertising information: two-dimensional sticker special effects, three-dimensional special effects, particle special effects, etc.

[0093] In step S310, the currently played video image is acquired.

[0094] Wherein, for the content of the above step S310, refer to the related content of the step S110 in the above first embodiment, which will not be repeated here.

[0095] In this embodiment, the human hand candidate area corresponding to the hand information can be determined through the video image and the pre-trained convolutional network model, and hand gestures can be detected in the human hand candidate area. For the corresponding processin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a gesture control method and device, and a terminal device. The gesture control method comprises the following steps: performing gesture detection on a current video image; conforming the display position of a business object to be displayed in the video image when the gesture matches the predetermined gesture; and drawing the business object in the display position by means of computer graphics. By means of the embodiment of the invention, the network resources and / or the client system resources can be saved, the interestingness of the video image is added, and the video can be watched by the user normally without disturbing; therefore, the aversion of the user to the business object displayed in the video image can be reduced, the attention of the audience can be attracted to a certain extent, and the influence of the business object can be improved.

Description

technical field [0001] The present invention relates to information processing technology, in particular to a gesture control method, device and terminal equipment. Background technique [0002] With the development of Internet technology, people use the Internet to watch videos more and more, thus, Internet video provides business opportunities for many new businesses. Because Internet video can become an important business traffic entrance, it is considered a high-quality resource for advertising placement. [0003] Existing video advertisements are mainly inserted into a fixed-duration advertisement at a certain time when the video is played, or placed at a fixed position in the area where the video is played and its surrounding areas. [0004] However, on the one hand, this video advertising method not only occupies network resources, but also occupies client system resources; on the other hand, this video advertising method often disturbs the normal video viewing exper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00G06K9/62
CPCG06F3/017G06V40/28G06F18/214
Inventor 栾青钱晨刘文韬
Owner BEIJING SENSETIME TECH DEV CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap