Mobile Camera Object Tracking for Low-Bandwidth Content Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems require significant computational resources and bandwidth for object detection and content delivery, leading to inefficiencies and delays in presenting relevant content to users.
Innovation Solution
Implementing on-device pixel tracking and object detection techniques to determine when a camera is still, selectively transmitting high-quality images for object recognition, and caching content for rapid presentation, thereby reducing unnecessary processing and bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If image data is continuously transmitted to content distribution system for object recognition, then content delivery speed is improved, but network bandwidth consumption increases
Solution Approach 1:
The system performs preliminary object detection on the mobile device before transmitting image data to the content distribution system. By detecting objects locally first, the system prepares and filters image data in advance, transmitting only relevant images that contain detected objects. This preliminary action reduces unnecessary bandwidth consumption while maintaining fast content delivery for recognized objects.
2Measurement precision
If object detection is performed on every captured image, then object recognition accuracy is improved, but computational resource consumption increases
Solution Approach 1:
The system applies different processing quality levels to different images based on local conditions. Object detection is performed on images that meet specific criteria (e.g., containing detected objects, captured when camera is still) rather than uniformly processing all images. This local quality approach maintains high recognition accuracy for relevant images while reducing computational resources for unnecessary processing.
3Device complexity
If camera movement is not detected, then simpler processing is used, but image quality for object detection deteriorates
Solution Approach 1:
The system implements feedback by detecting camera movement through pixel tracking and comparing image sequences. When camera movement is detected, the system provides feedback to adjust processing accordingly - either by selecting more stable frames for object detection or by triggering additional stabilization processing. This feedback mechanism ensures high image quality for object detection while managing processing complexity through adaptive decision-making.
Data Source
AI summary
Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.