Compressed Sensing Image Preview Reconstruction for Wearable Cameras

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Compressed sensing reconstruction processes are complex and slow, making real-time reconstruction of high-resolution images on small devices, such as wearable cameras, impractical due to high computational costs and time delays.

Innovation Solution

An electronic device with a processor configured to reconstruct a preview image of compressed sensing data in real-time using an algorithm that approximates image segments with a unique value based on the inner-product of a matrix sum of rows and local measurements, allowing for fast and low-power image acquisition without altering existing compressed sensing techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If compressed sensing reconstruction is performed using standard optimization processes, then high-resolution signal reconstruction is achieved, but the process becomes complex and slow, making real-time reconstruction impossible on small devices

Engineering Contradiction:
Improveimage reconstruction qualityVSAvoidreconstruction process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple blocks or segments and processes each segment independently using simplified reconstruction algorithms. This segmentation allows the complex global reconstruction problem to be broken down into multiple simpler local problems that can be solved faster and in parallel, reducing overall computational complexity while maintaining acceptable reconstruction quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies simplified reconstruction algorithms that do not fully reconstruct the entire high-resolution image but instead provide partial reconstruction of image segments. This partial action approach trades off some reconstruction quality for significant reductions in computational complexity and processing time, enabling real-time operation on resource-constrained devices.

Inventive Principle:
Principle #16Partial or excessive action

2Loss of information

If full signal acquisition is performed before compression, then complete image data is captured, but the acquisition process requires more time and power compared to compressed sensing

Engineering Contradiction:
Improveimage data completenessVSAvoidacquisition time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary compression of the image signal at the sensor level before full image formation occurs. By applying compressed sensing techniques during the acquisition phase rather than as a post-processing step, the system captures only the essential information needed for reconstruction, significantly reducing the time and data volume required while maintaining acceptable image quality.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If compressed sensing is used for continuous recording, then large amounts of data can be stored, but full reconstruction of all recorded images would be too costly in terms of computational resources

Engineering Contradiction:
Improveamount of recorded dataVSAvoidcomputational energy cost
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The patent applies different reconstruction strategies to different regions or segments of recorded images based on their importance or characteristics. Critical regions receive more sophisticated reconstruction treatment while less important regions use simpler, faster algorithms. This local quality approach allows the system to handle large volumes of continuous recording data with varying computational effort, optimizing energy consumption while maintaining overall system performance.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10404907B2Electronic device, method and computer program
Publication Date: 2019.09.03 SONY GROUP CORP
  • US10404907B2 patent drawing
  • US10404907B2 patent drawing
  • US10404907B2 patent drawing

AI summary

An electronic device includes compressed sensing circuitry including an image sensor to capture an image and output compressed sensing image data. There is processing circuitry to reconstruct in real-time a preview image of the compressed sensing image data. A display screen displays the preview image which has been reconstructed.