Unlock instant, AI-driven research and patent intelligence for your innovation.

A method, device and medium for lens tracking of live broadcast

A lens, on-site technology, applied in the video field, can solve the problem that the video cannot be transitioned well

Active Publication Date: 2022-07-29
广州逅艺文化科技有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, most users who use mobile phones and cameras for live broadcasting need a photographer assistant to manually align the camera lens, adding an additional human resource, and because the photographer's operation may not be able to keep up with the position of the pen during the shooting process, the video cannot be very good Transition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method, device and medium for lens tracking of live broadcast
  • A method, device and medium for lens tracking of live broadcast
  • A method, device and medium for lens tracking of live broadcast

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0097] Reference attached figure 2 , the present embodiment implements a method for tracking footage of live broadcast, which includes the following steps:

[0098] S1, obtain the position coordinates of the human finger joints in the picture;

[0099] Since the shapes of pens such as calligraphy and painting are different, and the characteristics of the nib vary greatly due to the color of the pigment / ink, the material of the nib, and the strength of the stroke, this embodiment selects the method of finger joint tracking to determine the position of the pen drop. The specific finger joint tracking method can be implemented by using a convolutional neural network, which belongs to a method known in the art, and will not be repeated in this embodiment.

[0100] refer to image 3 , this example marks 20 joints of the finger, and uses a convolutional neural network to identify the 20 joints.

[0101] S2, the pen drop point prediction, obtain the position coordinates of the fi...

Embodiment 2

[0143] refer to Figure 4 , the present embodiment provides a lens tracking device for live broadcast, which includes the following modules:

[0144] The finger joint position acquisition module is used to obtain the position coordinates of the human finger joints in the screen;

[0145] refer to image 3 , this example marks 20 joints of the finger, and uses a convolutional neural network to identify the 20 joints.

[0146] A pen-down point prediction module, used to obtain the effective position coordinates of the finger joints, and calculate the positions OX and OY of the pen-down point;

[0147] OX is the abscissa, OY is the ordinate, where the upper left corner of the screen is the origin of the coordinates.

[0148] Due to the different postures of holding the pen, there are occlusions, which makes it difficult to identify the coordinates of all 20 finger joints. In this embodiment, the occlusions are divided into three categories:

[0149] A. P4, P8, P12, P20 are va...

Embodiment 3

[0189] Reference attached Figure 5 , this embodiment provides a schematic structural diagram of a shot tracking device 20 for live broadcast. The live shot tracking device 20 of this embodiment includes a processor 21 , a memory 22 , and a computer program stored in the memory 22 and executable on the processor 21 . When the processor 21 executes the computer program, the steps in the above-mentioned embodiment of the method for tracking a shot of a live broadcast are implemented. Alternatively, when the processor 21 executes the computer program, the functions of the modules / units in the foregoing device embodiments are implemented.

[0190] Exemplarily, the computer program may be divided into one or more modules / units, and the one or more modules / units are stored in the memory 22 and executed by the processor 21 to complete the present invention. invention. The one or more modules / units may be a series of computer program instruction segments capable of performing speci...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a camera tracking method for live broadcast, which includes the following steps: S1, obtaining the position coordinates of the finger joints of people in the picture; S2, predicting the pen drop point, obtaining the position coordinates of the effective points of the finger joints, and calculating The position of the pen drop point; S3, control the pan / tilt and the lens to obtain the target screen width, and when the target screen width is smaller than a preset threshold, zoom in on the lens; when the target screen width is greater than a preset threshold, reduce the Lens; according to the coordinates of the pen drop point, control the movement of the gimbal so that the target is centered. By identifying the position of the finger joints, and predicting the position of the pen drop point according to the position of the finger joint, and then controlling the zoom and movement of the lens according to the position of the pen drop point, the close-up process of pen movement and drawing can be shown.

Description

technical field [0001] The present invention relates to the field of video, and in particular, to a method for tracking footage of live broadcast. Background technique [0002] In the process of art creators sharing art works and creating, cultural and educational arts such as calligraphy and painting generally require the switching and splicing of multi-screen and multi-cameras such as the creator's portrait screen, work close-up screen, and PPT computer screen during live broadcast. refer to figure 1 , The close-up picture of the work generally requires tracking the position of the pen, and showing the close-up process of the pen movement and drawing. At present, most users who use mobile phones and cameras to live broadcast need a camera assistant to manually align the camera lens, adding an additional human resource, and because the photographer may not be able to keep up with the position of the pen during the shooting process, the video cannot be very good. Transitio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/232
CPCH04N23/61H04N23/69H04N23/695
Inventor 陈映庭陈勇平郑倩萍俞翔
Owner 广州逅艺文化科技有限公司