Smart Glasses Crane Control via Vision Steering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operating industrial cranes from the floor level can be inefficient and unsafe due to the need for continuous visual attention to the load and surroundings, with challenges in managing free space, obstacles, inertia, and oscillation, and existing solutions lack intuitive and flexible control methods.

Innovation Solution

The use of smart glasses with a camera and communication link to a wireless control device for an industrial crane, enabling augmented reality data presentation and automatic steering of the crane, allowing operators to give commands without continuous gaze direction, with features like swaying control, restricted area detection, and safety area creation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the operator continuously monitors the load and surroundings visually, then safety is improved, but operator workload and complexity of operation increase

Engineering Contradiction:
ImprovesafetyVSAvoidoperator workload
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system enables automatic steering where the crane system steers itself based on detected target positions and restricted areas, eliminating the need for continuous manual control while maintaining safety through automated monitoring and navigation

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual visual monitoring and mechanical control with an automated vision-based system using cameras, image processing, and computer control algorithms to detect targets, determine positions, and automatically steer the crane

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual control is used for precise positioning, then positioning precision is improved, but productivity decreases due to continuous visual attention required

Engineering Contradiction:
Improvepositioning precisionVSAvoidoperational efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system replaces manual positioning control with an automated vision-based positioning system that uses camera detection, image processing, and computer algorithms to achieve precise positioning automatically, eliminating the trade-off between precision and productivity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary automated control system that acts as a mediator between the operator's intent and the crane's movement, using vision sensors and control algorithms to achieve precise positioning without requiring continuous manual intervention

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If automated steering is implemented, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveintuitive controlVSAvoidcontrol system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses a multi-functional integrated control platform that combines camera detection, image processing, target recognition, position calculation, and steering control in a single unified system, reducing overall complexity despite the advanced capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary automated control system that acts as a mediator between the operator's intent and the crane's movement, using vision sensors and control algorithms to achieve precise positioning without requiring continuous manual intervention

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3337750B1Controlling of lifting device
Publication Date: 2020.07.15 KONECRANES GLOBAL OY
  • EP3337750B1 patent drawingFigure 1a~1b
  • EP3337750B1 patent drawingFigure 2~4

AI summary

A method and equipment for detecting (210) with smart glasses (130) used by the operator (140) an target (150; 120) intended by the operator; detecting (220) a driving command given by the operator; and responsively to the detection of the driving command steering (230) the loading member (1 16) or the load (150) towards said target.