Sensor Data Processing Device with On-the-Fly Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data processing systems face challenges in efficiently handling and processing multiple sensor data from various types and numbers of sensors, leading to increased memory bandwidth and power consumption.

Innovation Solution

A data processing device with preprocessors and a hybrid data processing engine that performs correction and enhancement tasks on sensor data, utilizing a switching circuit to selectively route data through preprocessors and converters, and performing image enhancement and depth information determination on-the-fly without relying on memory access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple sensor data are processed through conventional memory access methods, then data processing capability is improved, but memory bandwidth and power consumption increase

Engineering Contradiction:
Improvedata processing capabilityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system segments the data processing function into multiple preprocessors (first preprocessor, second preprocessor, etc.), each handling specific sensor data independently. This segmentation enables parallel processing of multiple sensor inputs without requiring centralized memory access, thereby improving processing capability while reducing memory bandwidth consumption and power usage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a switching circuit as an intermediary component that routes sensor data directly between preprocessors and the data processing device, bypassing memory for active data. This intermediary mechanism eliminates unnecessary memory access operations, reducing both memory bandwidth consumption and power consumption while maintaining high processing capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple sensor data are processed through conventional memory access methods, then data processing capability is improved, but memory bandwidth increases

Engineering Contradiction:
Improvedata processing capabilityVSAvoidmemory bandwidth
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

By dividing the processing system into multiple specialized preprocessors that handle different sensor data streams independently, the system eliminates the need for repeated memory access operations. Each preprocessor maintains local processing capability, segmenting the data flow to reduce overall memory bandwidth requirements while preserving high processing capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The switching circuit serves as an intermediary that establishes direct data pathways between sensors and preprocessors, bypassing memory for active data transmission. This intermediary structure reduces memory bandwidth consumption by eliminating unnecessary read/write operations while maintaining high data processing throughput.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If sensor data are corrected and processed with multiple preprocessors, then processing efficiency is improved, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system divides processing functions into multiple specialized preprocessors, each optimized for specific correction tasks (e.g., lens shading correction, bad pixel correction). This functional segmentation improves processing efficiency by enabling parallel specialized operations while managing complexity through modular, standardized preprocessor units with consistent interfaces.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal preprocessor modules that can handle multiple types of sensor data and correction functions. Each preprocessor is designed with multi-functional capability to process different sensor inputs (image sensors, depth sensors, etc.) through standardized correction algorithms, improving processing efficiency while controlling complexity through reusability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Use of energy by moving object

If on-the-fly processing is performed without memory access, then power consumption is reduced, but processing flexibility decreases

Engineering Contradiction:
Improvepower consumptionVSAvoidprocessing flexibility
Core Design Contradiction:
Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic routing through a switching circuit that can adaptively direct sensor data to appropriate preprocessors based on real-time processing needs. This dynamic configuration enables on-the-fly processing without memory access while maintaining processing flexibility, as the switching circuit can reconfigure data pathways dynamically to accommodate different processing scenarios and sensor combinations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11049212B2Data processing device for processing multiple sensor data and system including the same
Publication Date: 2021.06.29 SAMSUNG ELECTRONICS CO LTD
  • US11049212B2 patent drawing
  • US11049212B2 patent drawing
  • US11049212B2 patent drawing

AI summary

Provided is a data processing device and a method of operating the same. The data processing device includes: a plurality of preprocessors configured to perform correction processing on a plurality of sensor data; a first switching circuit configured to selectively map and input the plurality of sensor data from at least two sensors to at least two preprocessors among the plurality of preprocessors; and a hybrid data processing engine configured to perform at least one of image enhancement and depth information determination on the plurality of sensor data received, via an on-the-fly method, from the at least two preprocessors.