Using augmented reality to exchange spatial information with a robotic cleaning device
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robotic vacuum cleaners face challenges in accurately mapping and navigating around obstacles due to mapping errors and the difficulty for users to identify objects in sparse or small maps, especially for inexperienced users.
Innovation Solution
A method and device that allow users to acquire a visual representation of the robotic cleaning device, compute coordinate transforms, and send instructions on how to move over the area to be cleaned, enabling precise control and communication of spatial information between the user's device and the robotic cleaner.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the robotic vacuum cleaner draws a map for user input, then the user can provide cleaning instructions, but mapping errors reduce the accuracy of spatial information
Solution Approach 1:
The system creates a visual copy of the robot's current view and displays it on the user's device. This visual representation serves as an accurate replica of the robot's perspective, allowing users to provide instructions based on what they actually see rather than interpreting abstract map data. The copying principle resolves the contradiction by providing both ease of operation (intuitive visual interface) and measurement precision (accurate spatial representation).
Solution Approach 2:
The visual representation acts as an intermediary between the robot's camera system and the user's control interface. Instead of directly interacting with raw spatial data or map coordinates, users interact with a processed visual display that mediates the communication, preserving spatial accuracy while simplifying user operation.
2Quantity of substance
If the map is small or sparse with details, then the data transmission is efficient, but it is difficult for inexperienced users to identify objects in the map
Solution Approach 1:
Instead of transmitting and displaying abstract map data, the system transmits and displays a visual copy of the robot's actual camera view. This approach maintains efficient data transmission (sending image frames rather than processed maps) while dramatically improving object identification for users, as they can directly see what the robot sees without needing to interpret sparse graphical representations.
3Extent of automation
If the robotic cleaning device operates autonomously, then it can freely move around without human intervention, but it experiences mapping errors that reduce navigation accuracy
Solution Approach 1:
The system implements a feedback loop where the robot's visual data is continuously transmitted to the user's device, allowing real-time monitoring and correction of navigation. Users can observe the robot's perspective and provide corrective instructions when mapping errors occur, combining autonomous operation with human oversight to maintain navigation accuracy.
Data Source
AI summary
A method of controlling movement of a robotic cleaning device over an area to be cleaned. The method includes acquiring a visual representation of the robotic cleaning device on a display of a wireless communication device, identifying the robotic cleaning device in the visual representation, computing a coordinate transform between the visual representation and a robotic cleaning device coordinate system, creating an instruction by receiving user-indicated spatial information on the display or how the robotic cleaning device should move over the area to be cleaned, applying the transform to the spatial information, transforming the spatial information to the robot coordinate system, and sending the instruction to the robotic cleaning device via wireless communication, to cause the robotic cleaning device to move over said area in accordance with the transformed spatial information.