Industrial Vehicle Bystander Pose Estimation for Collision Avoidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Material handling vehicles (MHVs) face challenges in navigating environments safely and efficiently, particularly in detecting bystanders and adjusting their operations to avoid collisions, due to limitations in existing sensor technologies and training requirements for operators.

Innovation Solution

An autonomous MHV control system utilizing a machine learning-based automation processing system that integrates bystander detection and pose estimation models, processing sensor data from various types of sensors to generate control actions, ensuring safe navigation and communication with other MHVs to update routes and avoid bystanders.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional sensor technologies are used for bystander detection, then the system complexity remains low, but the detection accuracy and safety are insufficient

Engineering Contradiction:
Improvebystander detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the detection task into multiple specialized machine learning models: a bystander detection model for identifying presence, a pose estimation model for determining body orientation, and a behavior prediction model for anticipating movements. This segmentation allows each model to specialize in a specific aspect, improving overall detection accuracy while managing system complexity through modular architecture

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from traditional 2D image processing to 3D pose estimation by inferring three-dimensional body positions and orientations from sensor data. This dimensional enhancement enables more accurate bystander detection and behavior prediction, resolving the contradiction between detection precision and system complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If operator training and supervision are implemented to ensure safety, then collision prevention improves, but operational efficiency and productivity decrease

Engineering Contradiction:
Improvecollision preventionVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The MHV equips itself with autonomous bystander detection and behavior prediction capabilities through onboard machine learning models. The vehicle independently monitors its environment, predicts potential hazards, and adjusts its operations without requiring external operator intervention or supervision, thereby maintaining high safety standards while preserving operational efficiency

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system replaces the mechanical system of human operator training and supervision with an automated machine learning-based detection and prediction system. This substitution eliminates the need for continuous operator attention and training while maintaining or improving collision prevention capabilities, thus resolving the productivity-reliability contradiction

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If the MHV operates autonomously without operator control, then productivity increases, but the ability to respond to unexpected bystander behaviors decreases

Engineering Contradiction:
Improveoperational efficiencyVSAvoidresponse to unexpected behaviors
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary actions by continuously predicting bystander behaviors using machine learning models before actual hazards occur. By anticipating potential movements and interactions, the autonomous MHV prepares appropriate responses in advance, enabling it to adapt to unexpected behaviors while maintaining high productivity through proactive rather than reactive operations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback loops where sensor data from multiple sources feeds into machine learning models that predict bystander behaviors, which then inform real-time adjustments to MHV operations. This feedback mechanism enables the autonomous vehicle to adapt dynamically to unexpected situations while maintaining efficient autonomous operation

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20240158216A1Systems and Methods for Bystander Pose Estimation for Industrial Vehicles
Publication Date: 2024.05.16 RAYMOND LTD
  • US20240158216A1 patent drawing
  • US20240158216A1 patent drawing
  • US20240158216A1 patent drawing

AI summary

Systems and methods for enhanced MHV operation using an automation processing system for bystander detection and bystander pose estimation to control operation of the MHV.