Mobile Device Offloading for Video Audio Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video and audio processing in mobile devices require intensive processing and memory resources, leading to resource wastage and battery drain, especially in today's mobile environment where such resources are limited.

Innovation Solution

Offloading intensive video and audio processing tasks to a web-based server, which analyzes image and audio data streams to recognize objects and determine positional information, allowing mobile client devices to focus on aligning audio input and output systems without the need for powerful hardware, thus enabling personalized and bi-directional communication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If video and audio processing is performed locally on mobile devices, then processing capability and response speed are improved, but device complexity and energy consumption increase

Engineering Contradiction:
Improveprocessing speedVSAvoidenergy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent extracts the intensive video and audio processing functions from the mobile device and relocates them to a remote server. The mobile device retains only lightweight functions for capturing media streams, transmitting data, and presenting results, while the server performs computationally intensive object recognition and analysis, thereby reducing energy consumption on the mobile device while maintaining processing capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a communication network as an intermediary between the mobile device and the remote server. This intermediary enables the mobile device to offload processing tasks without requiring direct integration with powerful hardware, allowing the device to maintain simplicity while accessing advanced processing capabilities through the networked server infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If powerful hardware is used for video and audio processing, then processing capability is improved, but device weight and cost increase

Engineering Contradiction:
Improveprocessing capabilityVSAvoiddevice weight
Core Design Contradiction:
ProductivityVSWeight of moving object

Solution Approach 1:

The patent extracts the heavy processing workload from the mobile device and places it on a remote server with powerful hardware. This allows the mobile device to achieve high processing capability without incorporating heavy processors or large amounts of memory locally, thereby maintaining portability and reducing device weight while still enabling intensive video and audio analysis.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If comprehensive video and audio analysis is performed, then recognition accuracy is improved, but processing time and energy consumption increase

Engineering Contradiction:
Improverecognition accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the processing tasks between the mobile device and the remote server. The mobile device performs lightweight preprocessing and transmits data streams, while the server performs comprehensive object recognition and analysis. This segmentation allows comprehensive analysis to be performed without the mobile device experiencing time delays or energy constraints, as the server handles the computationally intensive tasks with sufficient resources.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9137314B2Methods, systems, and products for personalized feedback
Publication Date: 2015.09.15 AT&T INTELLECTUAL PROPERTY I L P
  • US9137314B2 patent drawing
  • US9137314B2 patent drawing
  • US9137314B2 patent drawing

AI summary

Methods, systems, and computer program products provide personalized feedback in a cloud-based environment. A client device routes image data and audio data to a server for analysis. The server analyzes the image data to recognize people of interest. The server also analyzes the audio data to generate audible feedback. Because the server performs image recognition and audio processing, the client device is relieved of these intensive operations.