Mobile Terminal AR Overlays for Robot Cleaner Path Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile terminals fail to intuitively and clearly display the traveling path of robot cleaners, as the real and cleaning map images are mixed, reducing readability and user understanding of the robot's path and uncleaned regions.

Innovation Solution

A mobile terminal with a display and controller that generates an augmented reality (AR) image of the robot cleaner's path, superimposing it onto the real image projected by a built-in camera, allowing users to recognize the cleaned and uncleaned regions clearly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the real image and cleaning map image are simultaneously displayed without processing, then the user can check the cleaning region, but the two images are mixed together decreasing readability and making it difficult to recognize the traveling path

Engineering Contradiction:
ImprovereadabilityVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the real image captured by the camera and the cleaning map image into a single augmented reality display. The controller superimposes the cleaning map onto the real image, combining both visual information sources into one integrated view that maintains readability while showing both the actual space and cleaning status.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller acts as an intermediary that processes and integrates the cleaning map data with the real-time camera feed. It overlays the cleaning map information onto the real image in a way that preserves the distinguishability of both layers, using transparency or positioning strategies to prevent complete mixing while maintaining information visibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If the cleaning map is displayed separately from the real image, then the traveling path is clear, but the user cannot intuitively recognize the real space corresponding to the path

Engineering Contradiction:
Improveintuitive recognitionVSAvoidspatial correspondence information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent combines the cleaning map display with the real image view by overlaying them. This merging allows users to see both the actual physical space through the camera and the cleaning status information simultaneously in the same visual field, enabling intuitive recognition of which real-space regions correspond to cleaned or uncleaned areas on the map.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds an informational dimension to the real image by overlaying the cleaning map data. Instead of displaying the cleaning map as a separate 2D representation, it superimposes the map information onto the real-world view, creating a multi-layered augmented reality display that provides spatial correspondence without requiring the user to mentally map between separate views.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10373389B2Mobile terminal and method of operating thereof
Publication Date: 2019.08.06 LG ELECTRONICS INC
  • US10373389B2 patent drawing
  • US10373389B2 patent drawing
  • US10373389B2 patent drawing

AI summary

A mobile terminal includes a camera, a display configured to display a real image projected by the camera, and a controller configured to recognize the real image to request a traveling path corresponding to the real image from a robot cleaner, to generate an augmented reality (AR) image of the traveling path based on the traveling path received from the robot cleaner, and to display the AR image to be superimposed on the real image.