Image Processing Apparatus Using Directional Microphones for Moving Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing moving object detection technologies often result in erroneous detection, which complicates post-processing and requires selective execution of processes based on the object's purpose, leading to inefficiencies.

Innovation Solution

An image processing system that integrates image sensors and directional microphones to associate sound information with pixel addresses, allowing for the detection and classification of moving objects and background objects, enabling targeted processing based on their characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If moving object detection is performed using only image information, then the detection process is simple, but erroneous detection increases and reliability decreases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines image information from an image sensor with sound information from directional microphones to perform moving object detection. The association processing section integrates these different types of data, allowing the system to leverage both visual and acoustic cues to improve detection reliability and reduce erroneous detection compared to using image information alone.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The association processing section acts as an intermediary that links sound information to pixel addresses in the image information. This intermediary component enables the integration of acoustic data with visual data, allowing the object detection section to more accurately identify moving objects by correlating sound sources with their visual representations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If selective process execution is implemented based on object classification, then processing efficiency improves, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies different processing approaches based on the type of object detected. The process execution section selectively executes predetermined processes based on whether an object is classified as a moving object or background, allowing optimized processing for each category rather than applying a uniform processing approach to all detected entities.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12111409B2Image processing apparatus, system, image processing method, and image processing program
Publication Date: 2024.10.08 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12111409B2 patent drawing
  • US12111409B2 patent drawing
  • US12111409B2 patent drawing

AI summary

An image processing apparatus includes a first reception section, a second reception section, an association processing section, an object detection section, and a process execution section. The first reception section receives image information acquired by an image sensor. The second reception section receives sound information that is acquired by one or plural directional microphones and that is generated for at least a partial region in a field of the image sensor. The association processing section associates the sound information with a pixel address of the image information indicating a position in the field. The object detection section detects, from the image information, at least a part of an object that is present in the field. The process execution section executes a predetermined process on the object on the basis of a result of the association performed by the association processing section.