Heterogeneous Microprocessor for Energy-Scalable Sensor Inference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Embedded computing systems face a challenge in balancing computational flexibility with power efficiency, as hardware specialization for energy constraints limits flexibility and programmable accelerators struggle with energy efficiency due to high programmability overhead and complex mapping of computations.

Innovation Solution

A heterogeneous microprocessor is designed with a central processing unit, a programmable feature-extraction accelerator using Gene-Computation Cores and a support-vector machine accelerator, along with a Power Management Unit for fine-grained clock gating, enabling both feature extraction and classification while controlling energy consumption through genetic programming and error-aware modeling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If hardware specialization is used to address power constraints, then power efficiency is improved, but computational flexibility is limited

Engineering Contradiction:
Improvepower efficiencyVSAvoidcomputational flexibility
Core Design Contradiction:
Use of energy by moving objectVSAdaptability or versatility

Solution Approach 1:

The processor is divided into heterogeneous cores with specialized functions: Gene-Computation cores for feature extraction, SVM cores for classification, and a CPU for control. Each core type is optimized for specific computational tasks, allowing the system to segment workloads according to energy efficiency requirements while maintaining overall flexibility through core selection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The processor architecture provides multi-functionality by integrating multiple types of cores (Gene-Computation, SVM, CPU) that can be selectively activated based on workload requirements. The GPMM manager coordinates these diverse cores to handle various computational tasks, making the system universally applicable to different sensor inference problems while maintaining energy efficiency through selective activation of appropriate cores.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If programmable accelerators are used to maintain flexibility, then computational flexibility is improved, but energy efficiency deteriorates due to high programmability overhead

Engineering Contradiction:
Improvecomputational flexibilityVSAvoidenergy efficiency
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The Gene-Computation cores utilize genetic programming to automatically generate and optimize their own execution pipelines and feature extraction algorithms. This self-service capability eliminates the need for external programming overhead, as the cores autonomously adapt to different sensor inference tasks through evolutionary optimization, thereby maintaining flexibility without the energy penalty of traditional programmable accelerators.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The architecture dynamically changes execution parameters by selecting different Gene-Computation cores with varying levels of genetic programming optimization based on the specific computational task. This allows the system to adjust the balance between programmability and energy efficiency in real-time, activating highly optimized cores for energy-critical tasks while using more flexible cores for tasks requiring adaptability.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If complex mapping of computations is implemented in programmable accelerators, then computational flexibility is improved, but device complexity increases

Engineering Contradiction:
Improvecomputational flexibilityVSAvoidmapping complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The GPMM (Gene-Computation Manager) serves as an intermediary layer between the high-level computational tasks and the heterogeneous cores. It automatically maps sensor inference problems to appropriate Gene-Computation cores by generating genetic programs that describe the desired feature extraction and classification logic, eliminating the need for complex manual mapping while maintaining computational flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The architecture replaces complex mechanical mapping systems with biological evolution mechanisms. Instead of manually programming computation mappings, the system uses genetic programming to evolutionarily optimize the mapping between sensor data and feature extraction operations, substituting complex deterministic mapping algorithms with stochastic evolutionary processes that automatically adapt to different computational requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11500635B2Heterogeneous microprocessor for energy-scalable sensor inference using genetic programming
Publication Date: 2022.11.15 THE TRUSTEES OF PRINCETON UNIV
  • US11500635B2 patent drawing
  • US11500635B2 patent drawing
  • US11500635B2 patent drawing

AI summary

A heterogeneous microprocessor configured to perform classification on an input signal. The heterogeneous microprocessor includes a die with a central processing unit (CPU) a programmable feature-extraction accelerator (FEA) and a classifier. The FEA is configured to perform feature extraction on the input signal to generate feature data. The classifier is configured to perform classification on the feature data and the CPU is configured to provide processing after classification. The FEA may be configured with a plurality of Gene-Computation (GC) Cores. The FEA may be configured for genetic programing with gene depth constraints, gene number constraints and base function constraints. The classifier may be a support-vector machine accelerator (SVMA). The SVMA may include training data based on error-affected feature data. The heterogeneous microprocessor may also include an automatic-programming & classifier training module. An automatic-programming & classifier training module may be configured to receive input-output feature data and training labels and generate gene code and a classifier model.