Missing Area Detection in Multi-Camera Wearable Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In image generation using multiple cameras, changes in relative positional relationships can result in gaps or missing areas where photography is not possible, leading to incomplete omnidirectional images, particularly with wearable cameras or those with a limited number of cameras.

Innovation Solution

An information processing apparatus and method that includes a missing determination unit to identify missing areas in images and a notification control unit to alert users or managers, with optional image stabilization and missing supplement processing to fill gaps using past video frames or image synthesis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images are generated using a plurality of cameras, then omnidirectional imaging capability is improved, but missing areas may occur due to changes in relative positional relationships between cameras

Engineering Contradiction:
Improveomnidirectional imaging capabilityVSAvoidcompleteness of image coverage
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary determination of missing areas by comparing photographing cover ranges before final image generation. The notification control unit alerts users in advance about potential missing areas, allowing for corrective action before the imaging task is completed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system establishes a feedback loop where the notification control unit continuously monitors and compares the photographing cover ranges of multiple cameras, providing real-time feedback about missing areas to users, enabling them to adjust camera positions or add cameras to achieve complete coverage.

Inventive Principle:
Principle #23Feedback

2Device complexity

If the number of cameras is reduced to simplify the system, then device complexity is decreased, but the likelihood of missing areas increases

Engineering Contradiction:
Improvenumber of camerasVSAvoidcompleteness of image coverage
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system determines and notifies only the specific partial areas that are missing rather than requiring complete redundancy. This allows the use of minimal necessary cameras while still achieving complete coverage by identifying and addressing only the insufficient portions.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If camera positions are adjusted to eliminate missing areas, then image completeness is improved, but operational complexity increases

Engineering Contradiction:
Improvecompleteness of image coverageVSAvoidcamera position adjustment
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs automatic determination of missing areas through computational comparison of camera cover ranges, eliminating the need for manual inspection and adjustment. The notification control unit automatically identifies and communicates missing areas, reducing operational burden.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11189055B2Information processing apparatus and method and program
Publication Date: 2021.11.30 SONY GROUP CORP
  • US11189055B2 patent drawing
  • US11189055B2 patent drawing
  • US11189055B2 patent drawing

AI summary

There is provided an information processing apparatus and method and a program that enable grasping of a missing in an image. A missing determination unit determines whether or not there is a missing portion in an image captured by a plurality of cameras, and supplies a determination result (presence or absence of a missing) to a display control unit. The display control unit controls notification according to the determination result (presence or absence of a missing). The present disclosure can be applied to, for example, a system for causing a circumference image from an image captured by a wearable terminal to be displayed in another wearable terminal.