Drone Microphone Direction Overlay for Sound Source Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to effectively improve the quality of sound picked up by unmanned aircraft equipped with directional microphones, as the sound pickup direction is difficult to visualize and align with the sound source, leading to suboptimal sound capture.

Innovation Solution

An information processing device that calculates the sound pickup direction of a directional microphone using the positions and orientations of both the camera and the microphone, superimposes this direction on the captured image, and displays it to the user, allowing for easier alignment and improved sound quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a directional microphone is used to pick up sound from a specific direction, then sound quality is improved, but the sound pickup direction cannot be visually confirmed, making it difficult to align with the sound source

Engineering Contradiction:
Improvesound qualityVSAvoidalignment with sound source
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces an intermediary visual indicator (arrow or line) that represents the microphone's pickup direction on the displayed image. This intermediary element bridges the gap between the invisible sound pickup direction and the visible image, allowing the operator to see where the microphone is pointing and align it with the sound source accordingly.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a visual copy or representation of the microphone's pickup direction by drawing an arrow or line on the image that corresponds to the spatial orientation of the microphone. This visual copy allows the operator to perceive the invisible sound pickup direction through the displayed image, enabling proper alignment with the sound source.

Inventive Principle:
Principle #26Copying

2Device complexity

If only image data is provided without sound direction information, then the system is simple, but the operator cannot determine where the microphone is pointing to capture quality sound

Engineering Contradiction:
Improvesystem simplicityVSAvoidsound pickup direction information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent adds a new dimension of information visualization by overlaying directional indicators (arrows or lines) on the two-dimensional image. This additional visual layer conveys the three-dimensional spatial orientation of the microphone without complicating the basic image display system, allowing operators to perceive sound pickup direction while maintaining system simplicity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12024284B2Information processing device, information processing method, and recording medium
Publication Date: 2024.07.02 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US12024284B2 patent drawing
  • US12024284B2 patent drawing
  • US12024284B2 patent drawing

AI summary

A controller includes processor and memory. The memory stores (i) a captured image outputted from a camera in an unmanned aircraft and (ii) sound outputted from a directional microphone in the unmanned aircraft, and stores (i) a position and an orientation of the camera and (ii) a position and an orientation of the directional microphone. The processor obtains, from the memory, the captured image, the sound, the position and the orientation of the camera, and the position and the orientation of the directional microphone, calculates a sound pickup direction of the directional microphone using the position and the orientation of the camera and the position and the orientation of the directional microphone, superimposes an object indicating the sound pickup direction at a position, on the captured image, corresponding to the sound pickup direction calculated, and causes a display device to display the captured image on which the object is superimposed.