3D Feature Extraction for Privacy and Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging technologies for capturing three-dimensional objects are costly, power-intensive, and vulnerable to privacy breaches due to the need for transmitting full images, which is inefficient and exposes sensitive information.

Innovation Solution

A system comprising capture devices and processors that extract and output only the features from images, rather than the full images, allowing for the creation of three-dimensional representations without compromising privacy, reducing bandwidth and power consumption, and enabling applications like avatar puppeteering and background replacement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full images are transmitted for 3D feature extraction, then measurement precision is improved, but loss of information increases and privacy is compromised

Engineering Contradiction:
Improve3D feature extraction accuracyVSAvoidprivacy breach
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent extracts only the necessary 3D features (depth, shape, spatial relationships) from images while leaving behind all other information including identifiable personal data. This extraction approach transmits minimal data packets containing solely geometric information needed for 3D reconstruction, thereby maintaining measurement precision while preventing privacy breaches.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates simplified copies of image data in the form of 3D feature representations rather than transmitting original images. These copies contain only essential spatial and geometric information required for 3D object recognition, eliminating personally identifiable information while preserving the functional requirements for accurate 3D feature extraction.

Inventive Principle:
Principle #26Copying

2Measurement precision

If full images are transmitted for 3D processing, then measurement precision is improved, but use of energy increases

Engineering Contradiction:
Improve3D feature extraction accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system extracts and transmits only essential 3D feature data (depth maps, spatial coordinates, geometric relationships) rather than complete image streams. This dramatically reduces the volume of data requiring transmission and processing, thereby reducing energy consumption while maintaining sufficient information for accurate 3D feature extraction and object recognition.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by transmitting only the specific portion of image data necessary for 3D processing (depth and spatial features) rather than complete images. This selective transmission reduces bandwidth requirements and energy consumption for data transfer and processing while providing adequate information for the intended 3D applications.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If full images are transmitted for 3D analysis, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improve3D feature extraction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and transmits pre-processed 3D feature data (depth information, spatial relationships, geometric characteristics) rather than raw images requiring full processing. This approach reduces the computational burden on receiving systems, enabling faster 3D object recognition and analysis while maintaining high measurement precision through the transmission of essential spatial features.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If multiple cameras are used for passive 3D capture, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedepth determination accuracyVSAvoidsystem configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary processing step where 3D features are extracted and represented in a simplified format (depth maps, spatial feature vectors) before transmission. This intermediary representation serves as a mediator between multiple camera inputs and the final 3D reconstruction process, reducing system complexity by pre-processing and consolidating data from multiple sources into standardized feature formats that are easier to process and integrate.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20220301261A1Device and method for identifying and outputting 3D objects
Publication Date: 2022.09.22 DSP GROUP
  • US20220301261A1 patent drawing
  • US20220301261A1 patent drawing
  • US20220301261A1 patent drawing

AI summary

A device, system, method and computer program product, the device including a capture device adapted to capture at least one image, a processor configured to extract at least one feature from the image, and an interface for providing the at least one feature, while avoiding providing the at least one image.