PLD Image Engine Preprocessing for Low Power Tagging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic systems face significant power consumption challenges when performing image processing tasks, particularly in portable devices, due to the need for primary controllers to handle unsuitable raw imagery, which limits operational flexibility and efficiency.

Innovation Solution

Implementing a low power image processing engine within a programmable logic device (PLD) that preprocesses imagery at an engine-quality level suitable for image tagging, reducing the reliance on primary controllers and enabling efficient operation across various power states, including sleep modes, using a trained image engine that mimics unfavorable image capture conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a primary controller processes raw imagery to enable image tagging, then image tagging capability is achieved, but power consumption increases significantly

Engineering Contradiction:
Improveimage tagging capabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system divides image processing into two segments: a low-power PLD-based image engine that performs preliminary processing and tagging on raw imagery, and a primary controller that only activates when needed for complex tasks. This segmentation allows image tagging to occur without continuously powering the high-consumption primary controller.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A PLD-based image engine acts as an intermediary between the camera sensor and the primary controller. It receives raw imagery, performs preprocessing and tagging operations, and only communicates with the primary controller when intervention is needed, thereby reducing the primary controller's power consumption while maintaining image tagging functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the primary controller is powered on for image processing, then sophisticated imagery-based features are enabled, but operational flexibility is limited due to power draw

Engineering Contradiction:
Improveimagery-based featuresVSAvoidpower draw
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system dynamically manages power states of different components. The PLD-based image engine operates continuously in a low-power state to handle basic imagery tasks, while the primary controller transitions between sleep and active states based on processing needs. This dynamic power management enables sophisticated imagery features while adapting power consumption to actual operational requirements.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If human-quality processing resources are used, then high-quality image processing is achieved, but power consumption increases

Engineering Contradiction:
Improveimage processing qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies different processing qualities to different aspects of image handling. The PLD-based image engine performs sufficient preprocessing and tagging at a lower quality level appropriate for its function, while reserving high-quality human-level processing for specific tasks that require it. This local quality approach ensures adequate image processing capability without the continuous power consumption of full human-quality processing resources.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240420492A1Image tagging engine systems and methods for programmable logic devices
Publication Date: 2024.12.19 LATTICE SEMICON CORP
  • US20240420492A1 patent drawing
  • US20240420492A1 patent drawing
  • US20240420492A1 patent drawing

AI summary

Systems and methods for controlling the operation of an electronic system are disclosed. An example electronic system includes an edge PLD including programmable logic blocks (PLBs) configured to implement an image engine preprocessor and an image engine. The edge PLD is configured to receive raw imagery provided by an imaging module of the electronic system via a raw image pathway of the electronic system; to generate, via the image engine preprocessor, engine-quality imagery corresponding to the received raw imagery; and to generate, via the image engine of the edge PLD, one or more image tags associated with the generated engine-quality imagery. The one or more image tags and/or the associated engine-quality imagery is used to control operation of the electronic system.