One-Shot Neural Network Architecture Search for Multi-Task Hardware

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Neural networks require high-performance hardware, which is often limited in vehicles and embedded systems due to space and energy constraints, necessitating methods to optimize neural network architectures for multiple objectives including performance and hardware efficiency.

Innovation Solution

A method for training a one-shot neural network using a hypernetwork to optimize network weights and architecture parameters across multiple hardware platforms, incorporating a multiple-gradient descent and meta-learned predictors to balance performance and resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If neural networks are used to evaluate measured variables in vehicle control units, then the power of generalization and ability to handle previously unseen situations is improved, but the hardware platform requirements increase, leading to higher price, space consumption, and energy usage

Engineering Contradiction:
Improvepower of generalizationVSAvoidspace consumption
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

The patent applies parameter changes by systematically varying architecture parameters (number of layers, neurons per layer, activation functions, dropout rates) to find optimal network configurations that achieve the desired generalization power while minimizing space and resource requirements. This is done through automated architecture search methods that explore the parameter space to identify efficient network designs tailored to specific hardware constraints.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements universality by developing architecture search methods that can optimize neural networks for multiple objectives simultaneously (accuracy, space efficiency, energy consumption, inference time). The system creates multi-objective optimization frameworks that evaluate and balance multiple competing requirements, enabling a single architecture search process to produce networks that are universally applicable across different hardware platforms and performance criteria.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If neural networks are used in embedded systems, then the ability to correctly evaluate unseen situations is improved, but the maximum current consumption and heat dissipation increase due to hardware platform requirements

Engineering Contradiction:
Improveevaluation accuracyVSAvoidcurrent consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent uses parameter changes to optimize energy consumption by adjusting network architecture parameters such as the number of layers, neurons, and activation functions. The architecture search process evaluates energy efficiency metrics and selects configurations that minimize current consumption while maintaining the required evaluation accuracy for embedded systems.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies partial action by implementing pruning techniques that remove redundant neurons and connections from the neural network. This creates a sparse architecture that uses fewer computational resources and consumes less energy, while retaining the essential functionality needed for accurate evaluation of unseen situations in embedded environments.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If traditional architecture search methods are used, then a single objective can be optimized, but multiple objectives cannot be optimized simultaneously without scalarization

Engineering Contradiction:
Improveoptimization efficiencyVSAvoidmulti-objective optimization complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements universality by creating a unified architecture search framework that handles multiple objectives simultaneously without requiring scalarization. The system uses Pareto optimization and multi-objective evolutionary algorithms that can evaluate and balance multiple competing goals (accuracy, space, energy, time) in a single search process, making the optimization process both more efficient and more comprehensive.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary evaluation mechanism that assesses multiple objectives concurrently during the architecture search process. This intermediary layer ranks and compares different architecture candidates based on multiple criteria simultaneously, enabling the system to navigate the complex multi-objective optimization landscape without reducing it to a single scalar value.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If more hardware features are added to meet neural network requirements, then the performance and generalization ability improve, but the price of the hardware platform increases

Engineering Contradiction:
Improvegeneralization abilityVSAvoidhardware cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent applies parameter changes by optimizing neural network architecture parameters to achieve the desired generalization ability with minimal hardware requirements. The architecture search process identifies efficient network configurations that can be implemented on cost-effective hardware platforms, avoiding the need for expensive high-performance hardware by finding software-level optimizations.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements this principle by designing neural network architectures that are optimized for efficiency and can be deployed on lower-cost hardware platforms. The architecture search process prioritizes finding solutions that work well on budget-friendly hardware, trading off some hardware capabilities for cost savings while maintaining adequate generalization performance through smart architectural design.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS20250272576A1Method and/or apparatus for architecture search
Publication Date: 2025.08.28 ROBERT BOSCH GMBH
  • US20250272576A1 patent drawing
  • US20250272576A1 patent drawing
  • US20250272576A1 patent drawing

AI summary

A method for an architecture search of architecture of a one-shot neural network in order to solve a multi-task problem depending on at least one piece of target hardware.