Remote Robot Operation Screen for Situational Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote operation systems for mobile robots require users to manually recognize and respond to the robot's surroundings, which can be complex and inefficient, especially in dynamic environments.
Innovation Solution
A remote operation system with a mobile robot and operation terminal that includes a camera for capturing images, a screen display controller to manage dual sub-screens for different display modes, and units for recognizing targets, obstacles, and navigation, allowing for adaptive and intuitive operation based on the robot's situation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the user manually recognizes and responds to the robot's surroundings, then the system can operate with basic functionality, but the operation becomes complex and inefficient
Solution Approach 1:
The robot autonomously recognizes surrounding target objects and determines communication targets without requiring manual user recognition. The system performs self-service by automatically acquiring communication target information and presenting selection options to the user, thereby reducing operational complexity while maintaining efficiency.
Solution Approach 2:
The robot preliminarily recognizes and identifies surrounding target objects before the user needs to interact. By pre-processing the environment recognition and target identification, the system prepares communication target options in advance, allowing the user to simply select from pre-prepared options rather than manually analyzing the surroundings.
2Loss of information
If the operation terminal displays only a single monitor image, then the display is simple, but the user lacks comprehensive situational awareness
Solution Approach 1:
The display is segmented into multiple regions: a first display region showing the monitor image and a second display region showing communication target information. This segmentation allows comprehensive information presentation while maintaining organized, manageable display elements that do not overwhelm the user.
Solution Approach 2:
The system adds a new dimension to the display by incorporating communication target information alongside the monitor image. Instead of merely expanding the image area, it introduces a complementary information dimension that provides situational awareness without obscuring the primary visual feed.
3Loss of information
If the system automatically recognizes surrounding objects, then situational awareness improves, but the processing load and system complexity increase
Solution Approach 1:
The system introduces an intermediary processing layer that bridges the camera input and user interface. The surrounding target object recognition unit and communication target determination unit act as intermediaries that automatically process visual information and translate it into actionable communication options, reducing the burden on the user while managing system complexity through modular architecture.
Data Source
AI summary
A remote operation system includes a mobile robot, and an operation terminal configured to communicate with the mobile robot with each other. The mobile robot transmits, to the operation terminal, monitor image information based on a captured image by a camera. The operation terminal receives the monitor image information, and displays, on a terminal display unit, an operation screen including a monitor image based on the captured image. A screen display controller displays the operation screen on the terminal display unit, the operation screen including a first sub screen for displaying the monitor image and a second sub screen different from the first sub screen, and changes a display content of the second sub screen in accordance with a predetermined display mode.