Foreground Region Segmentation for Virtual Viewpoint Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating virtual viewpoint images from multiple camera inputs result in high transmission loads, which can lead to transmission failures, especially when dealing with large numbers of cameras and high-resolution images.

Innovation Solution

An image processing apparatus that detects a foreground region, divides it into multiple regions, calculates a circumscribed rectangle for each divided region, and transmits only the data corresponding to these rectangles, thereby reducing the transmission load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple high-resolution images are transmitted to generate virtual viewpoint images, then image quality is improved, but transmission load increases causing transmission failures

Engineering Contradiction:
Improveimage qualityVSAvoidtransmission load
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the foreground region into multiple divided regions and calculates circumscribed rectangles for each region. Only the image data within these rectangles is transmitted, segmenting the transmission load to reduce total data quantity while maintaining necessary image quality for virtual viewpoint generation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary image data corresponding to the circumscribed rectangles of divided foreground regions, excluding unnecessary background and non-foreground areas. This extraction reduces transmission load while preserving the essential information needed for high-quality virtual viewpoint image generation.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If circumscribed rectangle method is applied to reduce transmission load, then transmission reliability is improved, but processing complexity increases

Engineering Contradiction:
Improvetransmission reliabilityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary processing by detecting the foreground region and dividing it into multiple regions before transmission. The circumscribed rectangles are calculated in advance to determine exactly which image data needs to be transmitted, reducing transmission load while managing processing complexity through structured preprocessing steps.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250078280A1Image processing apparatus, image processing method, and image processing system
Publication Date: 2025.03.06 CANON KK
  • US20250078280A1 patent drawing
  • US20250078280A1 patent drawing
  • US20250078280A1 patent drawing

AI summary

An image processing apparatus detects a foreground region from an input image, obtains a plurality of divided regions by dividing the foreground region, determines a circumscribed rectangle for one of the plurality of divided regions and transmits data of the input image corresponding to the circumscribed rectangle.