Intelligent video director method based on microphone array sound guidance

Abstract

The invention relates to an intelligent video director method based on microphone array sound guidance, belonging to the field of intelligent technology. The method comprises the following steps of: photographing several positions of a space / region by the user and taking the photos as demonstrations and memorizing the photos in a training set; collecting the sound in the space / region by a microphone array; analyzing the audio data of each microphone by a sound source localization method to locate the positions of the sound source; referring to the training set to calculate the photographing parameters of the camera / high-speed balls corresponding to the positions of the sound source by a K-neighbor method; and guiding the camera to photograph by the given parameters. The method can alternatively capture corresponding target videos automatically, needs not to measure or collate the position of the camera, and has excellent adaptability to the environment; the specified range GCC-PHAT time delay computation method and the least square method position-computation method adopted by the method have a certain immunity to the noise interference so that the method can inhibit the interference of the corresponding noise well.

Description

technical field [0001] The invention relates to a method in the technical field of video guidance, in particular to an intelligent video guidance method based on microphone array sound guidance. Background technique [0002] The technology of guiding the camera to automatically capture the video of a certain target (such as a person) in a space / area is a video guidance technology. This technology can capture the video of the target according to the user's preset requirements without the intervention of a human guide, so it is called It is an intelligent video guidance technology. According to the type and number of cameras used, the intelligent video guidance system can be divided into two different technologies: multi-camera guidance and single-camera guidance. [0003] There are multiple cameras in the multi-camera guidance system, and the system captures the video of the target by selecting one of the cameras (usually the one closest to the target and with the best shoot...

AI Technical Summary

Problems solved by technology

This method has the following deficiencies: 1. Tracking is a moving target, which cannot be captured by the method for a target that makes a sound and does not move; 2. It relies on the segmentation of the background image, so when the background image changes (such as in a playing video) In front of the projection screen), this method is difficult to capture the real target; 3. The user example training method is not adopted for the picture requirements of the target in the specified area, and it is difficult for the user to express and change its requirements in an intuitive way

However, in the actual application of the guidance system, the position of the target sound source is often difficult to meet the far-field model, and the restriction that the microphones must be arranged in a regular shape also brings a lot of inconvenience to the deployment

Images