Forklift 3D Visual Overlay for Precise Load Handling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current driver assistance systems for industrial trucks, such as forklifts, primarily focus on displaying two-dimensional images and do not effectively utilize three-dimensional information to support the driver in navigating obstacles and managing load capacity during storage and outsourcing processes.

Innovation Solution

The implementation of a visualization assistance system that uses cameras and depth sensors to generate and overlay three-dimensional images, providing the driver with spatial awareness and object recognition, allowing for precise control of the truck and its load capacity, including the ability to simulate movement sequences and avoid collisions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If two-dimensional images are displayed to show the surroundings, then the driver can see the environment, but spatial awareness and depth perception are insufficient

Engineering Contradiction:
Improvespatial informationVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent transitions from displaying two-dimensional images to overlaying three-dimensional objects on the two-dimensional display. This dimensionality change provides depth information and spatial relationships without requiring a complete 3D display system, resolving the contradiction between information completeness and system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system creates virtual copies of real-world objects using depth sensor data and overlays them on the camera feed. These 3D model copies provide accurate spatial representation while keeping the underlying display system simple and compatible with existing 2D screens.

Inventive Principle:
Principle #26Copying

2Measurement precision

If three-dimensional objects are overlaid on displayed images, then spatial awareness is improved, but the system complexity increases

Engineering Contradiction:
Improvespatial measurement accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an image processing device as an intermediary between the depth sensors and the display. This mediator handles the complex tasks of 3D reconstruction, object recognition, and overlay positioning, isolating the complexity from the core driving system while providing precise spatial measurements to the driver.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If depth sensors and evaluation algorithms are added to determine three-dimensional information, then object recognition and collision avoidance improve, but the device complexity increases

Engineering Contradiction:
Improvecollision avoidance reliabilityVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The depth sensors and image processing device serve multiple functions: they provide spatial awareness for collision avoidance, enable 3D object recognition for storage assistance, and offer measurement capabilities for load positioning. This multi-functionality justifies the added complexity by delivering multiple safety and operational benefits from a single system addition.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3947246B1Method for warehousing assistance for an industrial truck, and industrial truck
Publication Date: 2025.02.12 JUNGHEINRICH AG
  • EP3947246B1 patent drawingFigure 1~2
  • EP3947246B1 patent drawingFigure 3~5

AI summary

The invention relates to a method for warehousing assistance for an industrial truck (10) that comprises one or more cameras (20, 22, 24), which record(s) at least some of the surroundings of the industrial truck (10), and an image processing device which has, at the driver's seat (14) of the industrial truck (10), an operating input interface (18) and a display device (16), wherein at least one camera (20, 22, 24) records at least part of a load receiving means (12) of the industrial truck (10) and following a request made by means of an input on the operating input interface (18) or automatically, at least one three-dimensional object is superimposed on the displayed images (40) and/or on a view made visible by the display device (16). The invention further relates to a display assistance system and an industrial truck (10). In addition, according to the invention, with the aid of sensors and evaluation algorithms, three-dimensional information relating to an object (44) to be loaded or unloaded relating to a movement of the industrial truck (10) or its load receiving means (12) is determined and the result is superimposed as a three-dimensional object (50, 52, 54, 60, 62, 64) which assists the destination-oriented control of the industrial truck (10) and/or the load receiving means (12) for loading or unloading the object (44) which is to be loaded or unloaded.