Imaging Device Sound Processing for Subject Isolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices, such as digital cameras, face challenges in effectively isolating and enhancing the sound of a subject while minimizing ambient noise, especially when the subject is not centered within the frame, due to limitations in sound directivity control and volume adjustment based on subject distance and zoom magnification.

Innovation Solution

An electronic device equipped with an imaging unit, sound collecting unit, and sound processing unit that captures images and sound data, measures subject distance, and adjusts sound volume and directivity synthesis to emphasize subject sound over ambient noise, using a combination of omnidirectional microphones and volume control algorithms to optimize sound data processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sound directivity control is enhanced to isolate subject sound from ambient noise, then sound quality improves, but device complexity increases

Engineering Contradiction:
Improvesound qualityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the sound field into subject sound and ambient noise components by using multiple microphones to capture different spatial audio information. The sound processing unit separates these components through digital signal processing, applying different volume adjustments to each component based on subject distance and zoom magnification, thereby isolating subject sound from ambient noise without requiring complex physical acoustic structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary sound processing unit that acts as a mediator between the microphones and the final output. This unit performs directivity synthesis and volume control based on subject distance and zoom magnification, effectively isolating subject sound from ambient noise through software-based processing rather than complex hardware acoustic design.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If volume adjustment based on subject distance is implemented, then realism of audio experience improves, but processing complexity increases

Engineering Contradiction:
Improverealism of audio experienceVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements feedback by using the subject distance information (acquired from the imaging unit or distance measurement unit) to dynamically adjust the volume of subject sound in the sound processing unit. Similarly, zoom magnification feedback is used to adjust ambient noise volume. This closed-loop approach enhances realism by automatically adapting audio characteristics to the current shooting conditions without requiring manual intervention.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes the volume parameter of subject sound and ambient noise based on subject distance and zoom magnification parameters. The sound processing unit dynamically adjusts these audio parameters according to the captured image data, creating a more realistic audio experience that correlates with the visual zoom and distance information.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If ambient noise is reduced through directivity control, then subject sound clarity improves, but loss of ambient sound information increases

Engineering Contradiction:
Improvesubject sound clarityVSAvoidloss of ambient sound information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies dynamic volume adjustment to ambient noise based on zoom magnification. When zooming in, ambient noise volume is reduced to enhance subject sound clarity. When zooming out, ambient noise volume is increased to preserve the sense of environment. This dynamic approach allows the system to maintain subject sound clarity while preserving ambient sound information according to the shooting context.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different volume adjustment strategies to different sound components: subject sound volume is adjusted based on subject distance, while ambient noise volume is adjusted based on zoom magnification. This localized quality control allows the system to enhance subject sound clarity in the foreground while selectively preserving or reducing ambient sound information based on the specific shooting scenario.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9232146B2Imaging device with processing to change sound data
Publication Date: 2016.01.05 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US9232146B2 patent drawing
  • US9232146B2 patent drawing
  • US9232146B2 patent drawing

AI summary

The disclosure herein aims to provide an electronic device that makes a sound recording, which gives a realistic sensation. An electronic device disclosed herein includes an imaging unit that captures an image of a subject; an acquiring unit that acquires a parameter having a constant relation with a subject distance that is a distance from the subject to the device; a sound collecting unit that collects sound and generates sound data; a zooming unit that adjusts a magnification of an image of the subject; and a sound processing unit that changes a degree of changing a volume indicated by the sound data with respect to the change in the magnification, according to the parameter.