Dynamic Low Latency Optimization for Mobile Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current processor-based systems, especially mobile devices, face performance degradation due to limited resources when running multiple applications concurrently, leading to perceptible latencies in applications requiring low latency environments, such as VR and AR, as existing low latency optimization techniques are static, not resource-oriented, and lack dynamic enablement/disabling capabilities.

Innovation Solution

A dynamic low latency optimization system that configures low latency operation from the hardware layer up to the application level, using process resolver and optimization engine modules to obtain information about application services and hardware, enabling or disabling low latency mode on an application-by-application basis, optimizing CPU core partitioning, scheduling, and resource management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple applications are run concurrently on processor-based platforms with limited hardware resources, then application functionality and versatility are improved, but system performance and latency are degraded

Engineering Contradiction:
Improveapplication functionalityVSAvoidsystem latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system dynamically adjusts latency optimization settings based on real-time application requirements and system state. The dynamic latency optimization module monitors running applications and automatically enables or disables low-latency modes, adjusting CPU scheduling policies, interrupt handling priorities, and buffer sizes according to the specific needs of each application without requiring manual reconfiguration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies latency optimization locally to specific applications rather than globally to the entire system. Each application can receive tailored optimization settings based on its latency sensitivity requirements, allowing time-critical applications to receive aggressive optimization while less sensitive applications maintain normal system behavior, thus resolving the contradiction between versatility and latency.

Inventive Principle:
Principle #3Local quality

2Loss of time

If static low latency optimization techniques are applied to the system, then latency performance is improved for certain applications, but the system loses adaptability to different application requirements and dynamic conditions

Engineering Contradiction:
Improveapplication latencyVSAvoidsystem adaptability
Core Design Contradiction:
Loss of timeVSAdaptability or versatility

Solution Approach 1:

The system transitions from static to dynamic optimization by implementing real-time monitoring and adjustment mechanisms. The dynamic latency optimization module continuously evaluates system state and application requirements, enabling the system to adapt latency optimization settings dynamically rather than relying on pre-configured static settings, thus maintaining both low latency and high adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms where the system monitors application performance metrics and system state, then uses this information to adjust latency optimization settings. The dynamic latency optimization module receives feedback from application performance data and system resource utilization, automatically tuning optimization parameters to maintain low latency while adapting to changing conditions.

Inventive Principle:
Principle #23Feedback

3Loss of time

If low latency mode is enabled system-wide, then latency-sensitive applications achieve better performance, but system overhead increases and other applications may be unnecessarily optimized

Engineering Contradiction:
Improvelatency performanceVSAvoidsystem overhead
Core Design Contradiction:
Loss of timeVSLoss of energy

Solution Approach 1:

The patent applies latency optimization selectively to specific applications rather than enabling it system-wide. The dynamic latency optimization module identifies which applications require low-latency performance and applies optimization only to those applications, leaving other applications to run with normal system settings, thus reducing unnecessary system overhead and energy consumption.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies partial optimization by enabling low-latency mode only for the duration and scope necessary. Rather than maintaining aggressive optimization continuously across the entire system, the dynamic latency optimization module enables optimization partially and temporarily only when and where it is needed, reducing overall system overhead while maintaining performance for latency-sensitive applications.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10430245B2Systems and methods for dynamic low latency optimization
Publication Date: 2019.10.01 HONG KONG APPLIED SCI & TECH RES INST
  • US10430245B2 patent drawing
  • US10430245B2 patent drawing
  • US10430245B2 patent drawing

AI summary

Systems and methods which provide low latency optimization configured to perform from the hardware layer across the operating system to an application. Low latency operation implemented in accordance with embodiments is optimized for a specific application, which interfaces with specific hardware, executing on a host processor-based system configured for low latency optimization according to the concepts herein. For example, a low latency optimization implementation may comprise various modules implemented in both the user space and Kernel space, wherein the modules cooperate to obtain information regarding the services and hardware utilized by an application and to provide such information for facilitating low latency operation with respect to the application. In operation according to embodiments, low latency operation is dynamically enabled or disabled by a low latency optimization implementation, such as to facilitate low latency operation on an application by application basis as appropriate or as desired.