Imaging Apparatus Compressive Sensing Block Partitioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In systems where multiple cameras capture and analyze videos, increased camera numbers and improved image quality can lead to network bandwidth congestion and increased power consumption, necessitating a reduction in data transmission and power usage without compromising analysis accuracy.

Innovation Solution

An imaging apparatus with an image sensor that partitions its surface into blocks, selectively samples pixels using row and column selection signals, and generates reduced images, which are then used for feature detection and transmission, thereby reducing data transmission and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of cameras is increased or image quality is improved, then the accuracy of behavior analysis is improved, but network bandwidth congestion occurs and power consumption increases

Engineering Contradiction:
Improveaccuracy of behavior analysisVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The imaging apparatus segments the image sensor into multiple blocks and applies different sampling functions to different blocks. This allows selective reduction of data in less important blocks while maintaining higher quality in important blocks, thereby reducing overall power consumption and network bandwidth usage while preserving analysis accuracy for critical regions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different blocks of the image sensor are assigned different sampling rates and processing qualities based on their importance for behavior analysis. This local differentiation enables the system to maintain high measurement precision in critical areas while reducing power consumption in less critical areas, resolving the contradiction between accuracy and energy usage

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the number of cameras is increased or image quality is improved, then the accuracy of behavior analysis is improved, but network bandwidth congestion occurs

Engineering Contradiction:
Improveaccuracy of behavior analysisVSAvoidamount of data transmitted
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The image is divided into multiple blocks with different sampling functions applied to each. This segmentation allows the system to transmit reduced data for non-critical blocks while maintaining full quality for critical blocks, reducing overall data transmission volume and preventing network congestion while preserving analysis accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different blocks are processed with different quality levels based on their analytical importance. This local quality differentiation reduces the total quantity of data transmitted through the network while ensuring that blocks critical for behavior analysis maintain sufficient quality for accurate measurement

Inventive Principle:
Principle #3Local quality

3Quantity of substance

If compressive sensing is applied to reduce data transmission, then network bandwidth usage is reduced, but measurement precision may be degraded

Engineering Contradiction:
Improveamount of data transmittedVSAvoidaccuracy of behavior analysis
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The image sensor is divided into multiple blocks, each applying different sampling functions. This allows compressive sensing to be applied selectively to less important blocks while maintaining full precision in critical blocks, thus reducing overall data transmission without degrading the measurement precision required for accurate behavior analysis

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different sampling rates and processing qualities are applied to different blocks based on their importance. This local quality control ensures that compressive sensing reduces data transmission in non-critical areas while preserving measurement precision in areas essential for behavior analysis accuracy

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10602084B2Imaging apparatus which performs compressive sensing reading data for a partitioned block output from an image sensor
Publication Date: 2020.03.24 SONY GROUP CORP
  • US10602084B2 patent drawing
  • US10602084B2 patent drawing
  • US10602084B2 patent drawing

AI summary

The present disclosure relates to an imaging apparatus comprising an image sensor that includes an imaging surface in which many pixels are arranged vertically and horizontally, a pixel control unit that controls the image sensor, selects a pixel corresponding to a sampling function among pixels configuring a block by applying the sampling function for each block acquired by partitioning the imaging surface of the image sensor into a plurality of blocks, and outputs a sampling signal based on a pixel value of the selected pixel, and a reduced image generating unit that generates a reduced image on the basis of the sampling signal for each block output from the image sensor.