Portable AR Device Server Offloading for Marker Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Complex augmented reality applications for devices like the Sony PlayStation 3 require portability and efficient marker recognition, but existing systems face challenges in maintaining high image quality and processing power on portable devices, leading to reduced fidelity and increased computational load.
Innovation Solution
A portable electronic device with a video camera and wireless connectivity, coupled with a server for remote image analysis, where the server predicts and sends region-of-interest data to the device for reduced bandwidth usage and enhanced marker recognition, allowing for real-time augmented reality rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If image processing is performed locally on portable devices, then processing speed is improved, but device complexity and power consumption increase
Solution Approach 1:
The patent introduces a server as an intermediary between the portable device and the image processing tasks. The server performs the computationally intensive marker recognition and image analysis, while the portable device handles only lightweight tasks such as capturing images, transmitting data to the server, and displaying results. This intermediary approach resolves the contradiction by maintaining fast processing speeds through server power while keeping the portable device simple and low-power.
Solution Approach 2:
The patent extracts the complex image processing functions from the portable device and relocates them to a remote server. The portable device retains only essential functions (camera, display, basic communication), while the server handles marker detection, image analysis, and augmented reality content generation. This extraction resolves the contradiction by eliminating the need for high-power processing hardware in the portable device.
2Measurement precision
If high image quality is maintained for marker recognition, then measurement precision is improved, but bandwidth consumption increases
Solution Approach 1:
The patent applies different quality levels to different regions of the transmitted image data. Instead of transmitting the entire high-resolution image at full quality, the system transmits only the regions containing potential markers at high resolution, while other areas are transmitted at lower resolution or omitted entirely. This local quality approach maintains marker recognition precision while significantly reducing overall bandwidth consumption.
Solution Approach 2:
The patent transmits partial image data rather than complete high-resolution images. The system sends selectively processed image portions that contain sufficient information for marker detection, using techniques such as transmitting only key feature points, low-resolution previews with region-of-interest markers, or compressed differential data. This partial action approach achieves adequate recognition precision with reduced data transmission.
Data Source
AI summary
A portable electronic device comprises a video camera for capturing a sequence of video images, an image processor operable to compress a first region of a current video image to a first extent and a second region of the current video image to a second, greater, extent to generate a processed current video image, a network communications interface operable to send processed video images to a server, and to receive control data from the server, and the image processor is operable to augment the current video image with one or more computer graphic elements; in which control data received from the server comprises image region information indicating a region of a video image estimated to comprise a predetermined marker and optionally augmentation instructions, and the image processor is operable to define the first region of the current video image responsive to the image region information from the server.