Portable Terminal AR Service with Sensor-Based POI Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current portable terminals providing Augmented Reality (AR) services lack advanced functionalities to meet increasing user expectations and diverse demands, particularly in providing comprehensive information about Point Of Interests (POIs) and enhancing user interaction with AR environments.
Innovation Solution
A portable terminal equipped with a controller, GPS receiver, geomagnetic sensor, acceleration sensor, camera, and image recognizer, which determines the attitude angle and mode of operation to provide map, constellation, and POI information, adjusts camera zoom based on user motion, and integrates image recognition to tag and display POI information, enabling enhanced AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If basic AR service is provided with camera and simple POI display, then device complexity is low, but service functionality and user satisfaction are insufficient
Solution Approach 1:
The portable terminal integrates multiple sensors (acceleration sensor, geomagnetic sensor, GPS receiver) and image recognizer to enable the device to perform multiple functions including attitude detection, location tracking, image recognition, and AR display, transforming a simple camera device into a comprehensive AR service platform that can adapt to diverse user needs
Solution Approach 2:
The patent combines sensor data processing, image recognition, GPS location services, and AR display functions into a unified system controlled by a single controller, merging previously separate functionalities into an integrated AR service platform that reduces system complexity while enhancing service capabilities
2Loss of information
If sensor data and image recognition are integrated for comprehensive POI information, then information completeness is improved, but processing complexity increases
Solution Approach 1:
The controller divides information processing into distinct modules: attitude angle calculation from sensor data, image recognition for POI identification, GPS location matching, and AR graphic generation. Each module processes specific data types independently before integrating results, reducing overall processing complexity while maintaining information completeness
Solution Approach 2:
The controller acts as an intermediary that receives raw data from multiple sensors and the image recognizer, processes this data through coordinated algorithms, and generates synthesized AR graphics. This intermediary processing layer manages the complexity of integrating multiple data sources while delivering comprehensive POI information to the display
3Ease of operation
If camera zoom is adjusted based on user motion detection, then user interaction is enhanced, but energy consumption increases
Solution Approach 1:
The acceleration sensor continuously monitors device motion and automatically triggers camera zoom adjustments based on detected user actions such as shaking or rotating the device. The system serves itself by using sensor data to directly control camera parameters without requiring manual user input, enhancing interaction while minimizing energy consumption through event-driven operation
Solution Approach 2:
The system employs periodic sampling of acceleration sensor data at optimized intervals rather than continuous monitoring, triggering camera zoom adjustments only when specific motion patterns are detected. This periodic action reduces energy consumption compared to continuous camera control while maintaining responsive user interaction
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
A method and an apparatus provides a service using a sensor and image recognition in a portable terminal that supports Augmented Reality (AR). The method includes determining whether the portable terminal is parallel to ground using an acceleration sensor. When the portable terminal is parallel to the ground, either a map including nearby Point Of Interest (POI) information or constellation information is displayed.