Mobile robot performing multiple detections using image frames of same optical sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cleaning robots require multiple sensors to perform obstacle avoidance, positioning, and object recognition, leading to high computation loading, power consumption, and low recognition correctness.

Innovation Solution

A mobile robot utilizing a single optical sensor with different light sources activated at various times to capture image frames, enabling obstacle avoidance, visual simultaneous localization and mapping (VSLAM), and object recognition, while reducing computation and power consumption by determining exposure times and regions of interest.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple sensors are used to perform obstacle avoidance, positioning and object recognition, then detection functions are improved, but device complexity and power consumption increase

Engineering Contradiction:
Improvedetection functionVSAvoidsensor quantity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by enabling a single optical sensor to perform multiple detection functions (obstacle avoidance, positioning via VSLAM, and object recognition) that traditionally required multiple specialized sensors. The sensor alternates between different operational modes with different light sources to achieve these diverse functions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple sensor functions into a single optical sensor system. By merging obstacle detection, positioning, and object recognition capabilities into one sensor that can operate in different modes, the system reduces the total number of components while maintaining comprehensive detection functionality.

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If multiple sensors are used to perform different detecting functions, then detection coverage is improved, but power consumption increases

Engineering Contradiction:
Improvedetection coverageVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by alternating the optical sensor between different operational modes (obstacle avoidance mode with laser diode, positioning mode with LED, object recognition mode with LED). This time-division multiplexing allows the single sensor to cover all detection needs while consuming less power than continuously operating multiple sensors.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The single optical sensor is designed to be universal, capable of performing obstacle avoidance, positioning, and object recognition functions by switching between different light sources and processing modes, thereby eliminating the need for multiple power-consuming sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If the optical sensor captures images continuously for multiple functions, then detection accuracy is improved, but computation loading increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidcomputation loading
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the image processing tasks into different stages and modes. The optical sensor captures images for specific purposes (obstacle detection, positioning features, object recognition) at different times, and the processor handles corresponding computations separately, reducing overall computational burden compared to continuous full-function processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by capturing images with different light sources for different functions at appropriate times before final processing. For example, obstacle avoidance images are captured first, then positioning images, and finally object recognition images, allowing the processor to handle computations in an organized sequence rather than all at once.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If auto exposure is used for the optical sensor, then image quality is improved, but power consumption and processing time increase

Engineering Contradiction:
Improveimage qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies parameter changes by switching between auto exposure mode and fixed exposure time mode depending on the operational context. For obstacle avoidance with laser diode, fixed exposure time is used for efficiency. For positioning and object recognition with LED, auto exposure or adjusted exposure parameters are used to optimize image quality, thereby balancing power consumption with detection needs.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution allows for efficient multiple detecting functions using a single optical sensor, reducing power consumption and improving recognition correctness by optimizing exposure times and focusing on specific regions of interest.

Implementation Method 1

a light source configured to project a light section toward a moving direction of the mobile robot

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

performs the visual simultaneous localization and mapping (VSLAM) according to the image frame captured by the optical sensor when a light emitting diode is emitting light

Methodology Applied
Scientific EffectLight: Light Emitting Diode

Data Source

PatentUS11752635B2Mobile robot performing multiple detections using image frames of same optical sensor
Publication Date: 2023.09.12 PIXART IMAGING INC
  • US11752635B2 patent drawing
  • US11752635B2 patent drawing
  • US11752635B2 patent drawing

AI summary

There is provided a mobile robot that controls an exposure time of an optical sensor during a time interval during which images of a gap between tiles are captured. At an end of the time interval that an image of a gap between tiles is captured, the exposure time of the optical sensor is adjust to the exposure time being used right before the time interval to avoid high brightness of the captured image while the image of a gap between tiles is suddenly disappeared from a field of view of the optical sensor.