Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An automatic focusing method of face area in the state of large magnification and shallow depth of field

A face area and automatic focus technology, which is applied in video conferencing cameras and education recording and broadcasting fields, can solve the problems that the background and characters cannot be guaranteed at the same time, it is difficult to achieve real-time processing, and the details of the characters are single, so that the focus vibration is not obvious, Fast search times and highly scalable effects

Active Publication Date: 2021-05-14
杭州晨安科技股份有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] (1) The depth of field will become shallow when the zoom lens is pulled to a large magnification, and it is impossible to ensure that the background and characters are clear at the same time
[0005] (2) The strategy of reducing noise and increasing the aperture will lead to a shallower depth of field, which cannot ensure that the background and characters are clear at the same time
[0006] (3) The background details are too rich, which is mistaken for the subject of the image in the autofocus algorithm and a false peak is calculated, resulting in a clear background and blurred characters
[0007] (4) The details of the characters are too single, and the weight in the auto-focus algorithm is too small, which is ignored by the algorithm when calculating FV (Focus Value), resulting in clear distances from other objects and blurred characters
However, in the face of well-designed, compact and cost-effective camera products, part of the computing power is often consumed in terms of imaging requirements, and then embedding face detection and area designation algorithms into the system will inevitably cause a shortage of computing power, making it difficult to achieve real-time processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automatic focusing method of face area in the state of large magnification and shallow depth of field
  • An automatic focusing method of face area in the state of large magnification and shallow depth of field
  • An automatic focusing method of face area in the state of large magnification and shallow depth of field

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. The following examples are explanations of the present invention and the present invention is not limited to the following examples.

[0059] The present invention comprises the steps:

[0060] Step 1. Based on the YOLO V3 neural network, train the face detector. The steps are as follows:

[0061] (1) Build a neural network training server and use GPU (Nvidia RTX 2080Ti) to accelerate neural network training.

[0062] (2) Prepare training data: D={d 1 , d 2 ,...,d n}, where D represents the face dataset, d n Represents a single face picture sample, n is the number of samples, n is about 400,000 in our training, part of which comes from the open source face database, and the other part is the face data marked by ourselves.

[0063] (3) Improve the YOLO V3 neural network, appropriately reduce the number of convolutional layers of YOLO V3, and re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides an automatic focusing method for a human face area in the state of large magnification and shallow depth of field. In the scene of large magnification and shallow depth of field, face detection, area optimization, and automatic focusing can be performed in camera products with insufficient computing power to find the speaker. The location of the Focus motor is the clearest in the area. The present invention comprises the following steps: Step 1, training a face detector based on the YOLO V3 neural network; Step 2, using the face detector to calculate the set of human face regions in the image: Step 3, optimizing the human face region; Step 4, optimizing the human face The face area is matched with the area divided by the chip, and the focus area of ​​interest is locked; step five, calculate the area of ​​interest: step six, automatic focus.

Description

technical field [0001] The invention relates to an automatic focusing method for a human face area in a state of large magnification and shallow depth of field, and is applied in the field of cameras for education recording and broadcasting and video conferencing. Background technique [0002] In recent years, in applications such as educational recording, video conferencing, etc., 10x, 12x, or 20x zoom cameras are usually used to play videos with people as the theme in real time in an indoor scene of 5-10 meters. The key point is to ensure that the facial areas of the characters are absolutely clear. In this context, it is an effective way to solve this problem by proposing to use the face area as the key area for automatic focusing. [0003] Considering such a usage scenario, such as figure 1 As shown, in this three-dimensional scene, the sequence from far to near is the background (blackboard, background wall, etc.), the subject (speaker), and the camera (10 times, 12 t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06T7/62G06N3/04H04N5/232
CPCG06T7/62G06V40/161H04N23/67H04N23/611G06N3/045
Inventor 王全强刘红艳毛海滨
Owner 杭州晨安科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products