Omnidirectional Camera Microphone Arrangement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup systems fail to provide a simple configuration for reproducing omnidirectional images with a realistic feeling during playback, as they lack a clear arrangement of microphones relative to cameras.

Innovation Solution

An omnidirectional camera system is designed with at least two image forming optical systems and two image pickup devices, along with multiple microphones arranged to capture stereophonic sound, allowing for the generation and playback of omnidirectional moving images with a realistic three-dimensional sound experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple microphones are used to collect sound for omnidirectional imaging, then the realistic feeling of the reproduced image is improved, but the configuration complexity and difficulty of arranging microphones relative to cameras increases

Engineering Contradiction:
Improverealistic feeling of reproduced imageVSAvoidconfiguration complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional planar microphone arrangements to three-dimensional spatial arrangements. Specifically, it employs spherical coordinate systems to position microphones in three-dimensional space around the imaging device, enabling true omnidirectional sound capture that matches the omnidirectional visual field. This dimensional expansion allows realistic spatial audio reproduction without increasing configuration complexity, as the three-dimensional positioning naturally accommodates multiple microphones in an organized manner.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the sound collection task into multiple segments by using several microphones positioned at different locations and orientations. Each microphone captures sound from specific directions, and the system processes these segmented audio signals separately before synthesizing them into a complete omnidirectional sound field. This segmentation approach simplifies the overall configuration by allowing independent optimization of each microphone's position and orientation.

Inventive Principle:
Principle #1Segmentation

2Reliability

If a specific arrangement of microphones is implemented to reproduce realistic images, then the quality of sound reproduction is improved, but the ease of manufacture and setup is worsened

Engineering Contradiction:
Improvequality of sound reproductionVSAvoidease of setup
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent creates a universal microphone arrangement system that can be applied to various omnidirectional imaging configurations. The spherical coordinate-based positioning method serves multiple functions: it defines microphone positions, determines orientation angles, and establishes processing parameters all within a single framework. This multi-functionality ensures high-quality sound reproduction while simplifying setup, as the same universal system adapts to different numbers and types of microphones without requiring custom arrangements for each case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If at least five three-dimensionally-arranged microphones are used to collect sound, then the stereophonic sound quality is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvestereophonic sound qualityVSAvoidnumber of microphones
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent optimizes the number of microphones by changing the parameter of microphone quantity from the conventional five or more to exactly four. This parameter change is achieved through the spherical coordinate positioning system, which allows four strategically positioned microphones to capture sufficient spatial audio information for realistic omnidirectional reproduction. The four microphones are arranged with specific directional orientations (including upward and downward facing microphones), and the processing unit applies appropriate weighting and processing to achieve high-quality stereophonic sound without the complexity and cost of five or more microphones.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3596916B1Image pickup apparatus and image pickup system
Publication Date: 2023.07.26 RICOH CO LTD
  • EP3596916B1 patent drawingFigure 1
  • EP3596916B1 patent drawingFigure 2
  • EP3596916B1 patent drawingFigure 3

AI summary

[Object] An object is to provide an image pickup apparatus and an image pickup system with which it is possible to reproduce an image with a realistic feeling. [Means of Achieving the Object] An image pickup apparatus includes an image forming optical system that includes a plurality of wide angle lenses; an image pickup device; and four or more sound pickup devices installed at respective vertexes of a triangular pyramid.