NPU Enclave Isolation in SoC for Secure AI Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing importance of Neural Processing Units (NPUs) in AI technology highlights the need for secure data protection against external software and hardware attacks, as existing solutions fail to provide a robust security environment, leading to potential data leakage and device malfunctions.
Innovation Solution
An electronic device with a System on Chip (SoC) that includes a processor, NPU, and memory with an enclave page cache and NPU enclave, featuring a trusted execution environment (TEE) isolated from system software execution environments, along with a memory protection engine for counter mode encryption/decryption and access control, ensuring secure data processing and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If NPU is integrated into SoC for AI processing, then processing capability is improved, but security against external attacks deteriorates
Solution Approach 1:
The patent divides the memory space into distinct enclaves (secure regions) and non-secure regions. The NPU operates within isolated enclave memory spaces that are segmented from the general system memory, preventing unauthorized access while maintaining processing capabilities. This segmentation allows the NPU to process data securely without exposing it to potential attacks from other system components.
Solution Approach 2:
The patent introduces a memory management unit (MMU) and validation table as intermediary components between the NPU and system memory. These intermediaries control and validate all memory access requests, acting as a security barrier that filters out malicious access attempts while allowing legitimate NPU operations to proceed efficiently.
2Reliability
If TEE is isolated from system software execution environment, then security is improved, but access control complexity increases
Solution Approach 1:
The validation table structure serves multiple functions simultaneously: it validates memory access addresses, controls enclave permissions, manages translation between virtual and physical addresses, and maintains security policies. This multi-functionality reduces the need for separate complex control mechanisms while maintaining strong security isolation.
Solution Approach 2:
The enclave memory management system is designed to be self-validating through hardware-enforced rules in the validation table. Access control decisions are made automatically by the MMU based on pre-configured validation rules, eliminating the need for complex software-based access control logic and reducing overall system complexity.
Data Source
AI summary
An electronic device includes a System on Chip (SoC) and a memory. The SoC includes a processor and a neural processing unit (NPU). The memory includes an enclave page cache (EPC), in which a validation table is stored, and at least one NPU enclave. The NPU enclave and the EPC have a trusted execution environment, which is isolated from an execution environment in which system software of the CPU is executed.