Decluttering Robot AR Control for Object Sorting in Clutter
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users face challenges in effectively interacting with decluttering robots due to the need for advanced programming knowledge and the inability to intuitively control nuanced robotic behavior, especially in cluttered environments where objects require specific handling and communication of impediments.
Innovation Solution
A robotic system equipped with neural networks for object classification and navigation, combined with an augmented reality interface that allows users to interactively instruct the robot through a mobile device, providing real-time feedback and assistance for object categorization, organization, and task management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fully autonomous decluttering robot with rudimentary look up capabilities is used, then the robot can pick up objects on the floor, but the user cannot achieve nuanced control over robotic behavior and classification of particular objects
Solution Approach 1:
The patent introduces an augmented reality interface as an intermediary between the user and the robot's control system. This interface allows users to interact with the robot through intuitive visual overlays and simple commands rather than requiring programming knowledge. The AR interface translates complex robot behaviors into visually understandable and controllable elements for the user.
Solution Approach 2:
The patent replaces traditional mechanical control interfaces (buttons, switches, physical controls) with an augmented reality-based interaction system. This substitution enables more flexible and intuitive control methods such as gesture recognition, voice commands, and visual selection through AR overlays, eliminating the need for physical interaction complexity.
2Adaptability or versatility
If the robot operates autonomously without user interaction, then it can perform basic cleaning tasks, but it cannot receive instructions for actions outside preset routines or communicate needs when tasks are impeded
Solution Approach 1:
The patent implements a bidirectional feedback system where the robot can communicate its status, obstacles, and needs to the user through the AR interface, and the user can provide real-time instructions and corrections. This feedback loop enables the robot to adapt its behavior dynamically based on user input while maintaining autonomous operation for routine tasks.
Solution Approach 2:
The patent creates a dynamic system where the level of automation adjusts based on task complexity and user availability. For routine tasks, the robot operates fully autonomously, but when impediments are encountered or nuanced decisions are needed, the system dynamically shifts to user-assisted mode, allowing flexible transition between automation levels.
3Adaptability or versatility
If the robot uses preset routines for object classification and handling, then it can perform basic sorting tasks, but it cannot handle objects unique to the user's home or adapt to specific decluttering needs
Solution Approach 1:
The patent enables users to pre-configure object classification criteria, destination locations, and handling preferences through the AR interface before the robot begins operation. This preliminary setup allows the robot to adapt to user-specific needs without requiring training time during actual decluttering tasks, as the classification system is pre-customized to the user's home environment.
Data Source
AI summary
A robot is operated to navigate an environment using cameras and map the type, size and location of objects. The system determines the type, size and location of objects and classifies the objects for association with specific containers. For each category of object with a corresponding container, the robot chooses a specific object to pick up in that category, performs path planning and navigates to objects of the category, to either organize or pick up the objects. Actuated pusher arms move other objects out of the way and manipulates the target object onto the front bucket to be carried.