Neural Processing Unit Runtime Testing for Defect Isolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The integration of neural processing units (NPUs) in system-on-chip (SoC) or system-in-package (SiP) increases complexity, leading to higher defect rates during manufacturing, which can result in unpredictable AI operation failures in critical applications like autonomous vehicles and AI robots, as minute defects are difficult to detect before shipment.

Innovation Solution

An in-system component tester (ICT) is used to test functional components during runtime, selecting components in an idle state, monitoring their states, and isolating them from the system bus for testing, with features like a scheduler, generator, and tester to analyze test results and replace defective components with spare components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If neural processing units are integrated in system-on-chip or system-in-package, then manufacturing cost is reduced and size is decreased, but complexity increases leading to higher defect rates

Engineering Contradiction:
Improvemanufacturing costVSAvoidsystem complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The system divides the SoC/SiP into multiple functional components (first functional component, second functional component, etc.) that can be independently tested. Test wrappers are assigned to specific components to isolate testing, allowing complex integrated systems to be managed through segmented, component-level verification while maintaining the cost and size benefits of integration.

Inventive Principle:
Principle #1Segmentation

2Area of stationary object

If multiple semiconductor components are integrated in SoC or SiP, then board substrate size is reduced, but defect detection difficulty increases

Engineering Contradiction:
Improveboard substrate sizeVSAvoiddefect detection difficulty
Core Design Contradiction:
Area of stationary objectVSDifficulty of detecting and measuring

Solution Approach 1:

Test wrappers serve as intermediary components between the functional components and the testing system. Each test wrapper is specifically assigned to test a particular functional component, acting as a mediator that simplifies the detection process. This intermediary layer enables systematic testing of minute defects in densely integrated components without requiring complex external testing equipment.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary testing by assigning test wrappers to functional components before the system is shipped. This preliminary action identifies and isolates defective components early in the manufacturing process, preventing defective units from reaching customers. The testing is conducted during the manufacturing phase rather than waiting for field failures.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If functional components are tested during runtime, then defective components can be identified, but system operation is interrupted

Engineering Contradiction:
Improvedefect detection accuracyVSAvoidsystem downtime
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system implements periodic testing where test wrappers are assigned to functional components at scheduled intervals during runtime. The processor alternates between executing application programs and executing test programs through periodic context switching. This periodic action enables defect detection during operation without requiring continuous system shutdown, balancing reliability improvement with minimal operational disruption.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically switches between normal operation mode and testing mode. The processor can dynamically allocate resources to testing when functional components are in idle state, and return to normal operation when testing is complete or defective components are identified. This dynamic adaptation allows the system to maintain high availability while performing necessary defect detection.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250216453A1Neural processing unit performing test for detecting failure
Publication Date: 2025.07.03 DEEPX CO LTD
  • US20250216453A1 patent drawing
  • US20250216453A1 patent drawing
  • US20250216453A1 patent drawing

AI summary

This disclosure proposes an inventive system capable of testing a component in the system during runtime. The system may comprise: a substrate; a plurality of functional components, of the plurality of functional components being mounted onto the substrate and including a circuitry; a system bus formed with electrically conductive pattern onto the substrate thereby allowing the plurality of functional components to communicate with each other; one or more wrappers, each of the one or more wrappers connected to one of the plurality of functional components; and an in-system component tester (ICT) configured to: select, as a component under test (CUT), at least one functional component, in an idle state, of the plurality of the functional components; and test, via the one or more test wrappers, the at least one functional component selected as the CUT.