AR Odometry Sensor Fusion for Personal Mobility Pose Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Personal mobility systems lack essential controls, performance feedback indicators, and obstacle detection or avoidance systems, posing safety risks and operational challenges, especially in urban environments with high user concentration demands.
Innovation Solution
Integration of AR wearable devices with personal mobility systems to centralize telemetry data, detect obstacles, and interact with virtual objects, using sensor fusion and pose tracking to enhance user experience and safety by providing augmented reality overlays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If additional controls and performance indicators are incorporated into personal mobility systems, then user safety and operational capability improve, but device complexity increases
Solution Approach 1:
The patent introduces an AR wearable device as an intermediary between the personal mobility system and the user. This intermediary receives sensor data from the mobility system's existing sensors (accelerometer, gyroscope, magnetometer, barometer) and processes it to generate augmented reality overlays, thereby providing enhanced safety information without adding complexity to the mobility system itself.
Solution Approach 2:
The patent moves the display of performance feedback and safety information from traditional two-dimensional screens to a three-dimensional augmented reality space. Virtual objects and overlays are positioned in 3D space relative to the user's field of view, providing intuitive spatial awareness of speed, distance, and environmental hazards without requiring additional physical controls.
2Device complexity
If traditional display indicators (LED or LCD) are used for performance feedback, then device complexity remains low, but user awareness and safety monitoring capability are severely limited
Solution Approach 1:
The patent replaces traditional mechanical/electronic display systems (LED or LCD indicators) with an optical augmented reality system. The AR wearable device uses transparent or semi-transparent displays to project virtual objects and overlays that provide comprehensive performance feedback including speed, distance, elevation, and hazard detection, vastly superior to simple LED/LCD indicators.
Solution Approach 2:
The AR wearable device serves multiple functions simultaneously: it displays performance metrics, provides navigation guidance, detects obstacles, monitors environmental conditions, and offers safety warnings. This multi-functional approach replaces what would otherwise require multiple separate indicators and systems, providing comprehensive feedback without proportionally increasing complexity.
3Loss of information
If AR wearable devices with transparent displays are used, then user awareness of virtual and physical environment improves, but visual field occlusion may occur
Solution Approach 1:
The patent uses transparent or semi-transparent display materials that allow light to pass through, enabling users to see the physical environment while viewing virtual information. The display properties are optimized locally in different regions to balance visibility of virtual objects with transparency to the real world, minimizing occlusion while maximizing information delivery.
Data Source
AI summary
A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.