Augmented Reality Location Overlay Using Magnetometer and Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices struggle to display real-time location information of surrounding objects using GPS, as it is delayed and limited in interaction with the actual environment, especially when relying on photos captured by the device's camera which may not reflect the current view.
Innovation Solution
A system and method that uses a mobile device's camera to capture and display images, with the ability to select objects within the image, determine the facing direction using a magnetometer, and overlay direction and distance indicators, providing real-time location information such as bearing and coordinates, which updates automatically as the device changes orientation or position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If GPS is used to display location information, then location data can be obtained, but the display is delayed and limited in interaction with the actual environment
Solution Approach 1:
The patent combines multiple sensing technologies (camera, magnetometer, accelerometer, GPS) into a unified augmented reality system. The camera captures real-time images, the magnetometer determines facing direction, and these are merged with GPS location data to provide immediate, interactive location information overlaid on the live camera feed, eliminating the delay inherent in GPS-only solutions.
Solution Approach 2:
The patent introduces a camera-based image capture system as an intermediary between the GPS location data and the user interface. Instead of directly displaying GPS coordinates, the system captures real-time images of the environment and overlays location information on these images, providing immediate visual feedback that reflects the current view and enhances interaction with the actual environment.
2Loss of information
If photos captured by the camera are used to gather information about surroundings, then visual data can be obtained, but the photos may not reflect the current view and appear delayed
Solution Approach 1:
The patent implements continuous real-time image capture and processing through the camera system. Instead of relying on discrete photos, the system continuously captures images and processes them to extract location information, ensuring that the displayed information always reflects the current view without delays. This continuous action maintains synchronization between the visual data and the actual surroundings.
3Reliability
If direction and distance indicators are overlaid on the image, then real-time location information is provided, but the system complexity increases
Solution Approach 1:
The patent makes the mobile device perform multiple functions using existing components. The camera serves both as a visual display medium and as a sensing device for extracting location information. The magnetometer, accelerometer, and GPS work together to provide directional and positional data that is integrated into the same display system, reducing the need for separate dedicated components and minimizing overall system complexity.
Solution Approach 2:
The patent enables the mobile device to self-determine its location and orientation information by using its own built-in sensors (camera, magnetometer, accelerometer, GPS). The device captures images, processes them to identify location data, calculates bearing and distance using its sensor data, and displays the results without requiring external specialized equipment, thereby managing the complexity within the device's existing capabilities.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables effective and real-time display of location information for objects surrounding the mobile device, enhancing situational awareness by providing immediate and informative data about the environment, suitable for various electronic devices including smartphones and tablets.
Implementation Method 1
The facing direction of the mobile device is detected using the mobile device's facing direction finder, which is communication with a magnetometer
Data Source
AI summary
A system and a method are provided for displaying location information on a mobile device. The location information can include direction, distance, positional coordinates, etc. The mobile device's display displays an image captured using the mobile device's camera. A selection input is received to identify an object in the image. A facing direction of the mobile device is detected using the mobile device's magnetometer. The mobile device determines a bearing to the object relative to the mobile device's facing direction. The mobile device then determines a distance between the mobile device and the object. The obtained or computed location data is overlaid on the image, thereby augmenting the image. The location data can include at least a direction indicator of the object and the distance between the mobile device and the object, whereby the direction indicator can be determined using the bearing.