Steganographic Image Preprocessing for AR Bandwidth Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems face inefficiencies due to the need to transmit all captured images to a remote server for matching with reference images, leading to bandwidth waste and increased server workload, as well as requiring user intervention and complex processing to adjust images for matching.

Innovation Solution

Incorporating steganographic marks within images that are processed by the user device to identify and preprocess images before transmission, allowing only marked images to be sent, and using these marks to adjust image data for better matching, thereby reducing unnecessary data transmission and processing load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all captured images are transmitted to the remote server for matching, then the matching accuracy is improved, but the bandwidth usage increases and server workload increases

Engineering Contradiction:
Improvematching accuracyVSAvoidbandwidth usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent applies preliminary action by embedding steganographic marks in reference images before transmission. These marks enable the user device to pre-filter captured images by detecting matching marks, thereby identifying only those images that require server transmission for annotation retrieval, significantly reducing unnecessary bandwidth consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The user device performs self-service by autonomously detecting steganographic marks in captured images and filtering out images without matching marks before server transmission. This local preprocessing reduces the volume of data sent to the server while maintaining matching accuracy for relevant images.

Inventive Principle:
Principle #25Self-service

2Reliability

If all captured images are transmitted to the remote server for matching, then the matching completeness is improved, but the server processing power increases

Engineering Contradiction:
Improvematching completenessVSAvoidserver processing power
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent extracts the essential identification function by embedding steganographic marks in reference images. This allows the user device to locally extract and filter images containing matching marks, separating the identification task from the server's annotation retrieval task, thereby reducing server processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The steganographic marks serve as an intermediary mechanism between reference images and captured images. These marks enable efficient local filtering at the user device, acting as a mediator that pre-qualifies images for server transmission, thus reducing the processing burden on the server.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If user intervention is required to select images for transmission, then the transmission relevance is improved, but the ease of operation decreases

Engineering Contradiction:
Improvetransmission relevanceVSAvoiduser operation simplicity
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The system performs self-service by automatically embedding steganographic marks in reference images and enabling the user device to autonomously detect these marks in captured images. This automated filtering process eliminates the need for manual user selection, maintaining transmission relevance while preserving ease of operation.

Inventive Principle:
Principle #25Self-service

4Reliability

If image adjustments are performed to compensate for different capture conditions, then the matching accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvematching accuracyVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by embedding steganographic marks in reference images that encode information about capture conditions and required adjustments. This pre-encoding of adjustment parameters simplifies the matching process by providing guidance information in advance, reducing the complexity of real-time image processing.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9094616B2Method and system for image capture and facilitated annotation
Publication Date: 2015.07.28 BIGTINCAN HLDG LTD
  • US9094616B2 patent drawing
  • US9094616B2 patent drawing
  • US9094616B2 patent drawing

AI summary

A method for capturing and processing an image, comprising: capturing a captured image with an image sensor; retrieving steganographic marks hidden in said captured image; processing said captured image based on said hidden marks, so as to generate a processed image; matching the processed image with a reference image from a set of reference images and superimposing elements on the captured image, depending on said reference image. A user device, comprising an image sensor suitable for capturing at least one image and a processor configured to at retrieve hidden marks in said captured image and generating a processed image based on said hidden marks retrieval and annotations processed remotely; the user device is part of a system with a remote server matching the image.