Temporal Filter Quantization for Energy-Efficient Image Sequence AI
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Recurrent Neural Networks (RNNs) face challenges in energy efficiency and quantization, making them unsuitable for mobile computing units, as they require significant processing energy and cannot be effectively quantized without compromising identification accuracy.
Innovation Solution
Implementing neural networks with time folds, which allows for energy-efficient quantization of filter coefficients and activations, reducing bit requirements and enabling more compact hardware designs while maintaining performance, by applying filters to time sequences and incorporating temporal and spatial folding mechanisms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If RNN parameters are quantized to reduce energy consumption and storage requirements, then energy efficiency and compactness improve, but identification accuracy deteriorates
Solution Approach 1:
The patent changes the parameter representation from floating-point to quantized formats (binary, ternary, quaternary values). This parameter transformation enables significant energy reduction and storage compression while maintaining identification accuracy through optimized quantization schemes and training methodologies specifically designed for quantized RNNs.
Solution Approach 2:
The patent implements dynamic quantization strategies where quantization precision is adaptively adjusted based on the specific computational context, data characteristics, and operational requirements. This allows the system to maintain high accuracy when needed while achieving maximum energy efficiency in other scenarios, resolving the contradiction between precision and energy consumption.
2Ease of operation
If RNN parameters are quantized to enable mobile computing unit operation, then device portability improves, but processing capability deteriorates
Solution Approach 1:
The patent transforms parameters into quantized formats suitable for mobile devices with limited resources. By using binary, ternary, or quaternary quantization levels, the system achieves compact representation that fits mobile computing units while maintaining adequate processing capability through optimized algorithms and architecture design.
Solution Approach 2:
The patent segments the RNN processing into quantized operational units that can be efficiently executed on mobile hardware. This segmentation allows the system to distribute computational tasks across mobile device resources while maintaining overall processing capability despite the constraints of quantized operations.
3Quantity of substance
If strong quantization is applied to RNN parameters, then storage requirements reduce, but computational precision deteriorates
Solution Approach 1:
The patent applies parameter changes by transforming continuous floating-point parameters into discrete quantized values (binary, ternary, quaternary). This transformation dramatically reduces storage requirements while computational precision is preserved through specialized training procedures and quantization-aware operations that account for the discrete nature of the parameters.
Solution Approach 2:
The patent uses copying mechanisms where full-precision parameters are maintained during training phases, and quantized versions are generated for deployment. This allows the system to leverage high-precision training data and algorithms while deploying compact quantized models, effectively decoupling the precision requirements of training from the storage constraints of deployment.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a machine learning system (10) comprising at least one temporal filter (21). An input, comprising a temporal sequence of images, is processed by the machine learning system (10) using the filter (21). The machine learning system (10) is configured to apply the filter (21) to a sequence of pixels, all of which are located at the same coordinates of the images or at the same coordinates of intermediate results. The filter coefficients of the filter (21) are quantized. The invention further relates to a method, a computer program, and a device for creating the machine learning system (10).