Neural Network Feature Map Interior Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for detecting the presence of objects, such as people or luggage, within the interior of public transport vehicles lack robustness, particularly in varying lighting conditions and are prone to false detections due to environmental changes like graffiti or contamination.

Innovation Solution

A computer-implemented method utilizing a trained neural network with multiple layers generating feature maps, comparing features across these maps with predetermined values to determine if the interior is in a predetermined state, employing a teacher-student system and masked training of autoencoders to enhance detection accuracy and robustness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a trained neural network with multiple layers is used to detect objects in the interior, then detection accuracy is improved, but sensitivity to changing lighting conditions and environmental changes increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidrobustness to lighting and environmental changes
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent divides the detection task into multiple independent feature maps, each capturing different aspects of the image data. By segmenting the feature extraction process into parallel maps that can be independently compared against reference values, the system achieves both high detection accuracy through multiple specialized features and robustness by not relying on any single feature map that might be affected by lighting or environmental changes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extends the comparison from single feature values to multi-dimensional feature spaces by comparing feature maps against reference feature maps. This dimensional expansion allows the system to consider multiple characteristics simultaneously (edges, textures, colors, shapes) and their relationships, improving detection accuracy while the reference comparisons provide stability against environmental variations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If multiple feature maps are compared with reference values, then false detections are reduced, but computational complexity increases

Engineering Contradiction:
Improverobustness against false detectionsVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-computing and storing reference feature maps during a training phase. These reference maps capture the normal state of the interior across various conditions. During operation, the system only needs to compare current feature maps against these pre-established references, significantly reducing computational complexity while maintaining high reliability in false detection reduction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates copies of reference feature maps that represent the normal interior state under various conditions. By comparing current feature maps against these copied references rather than performing complex real-time analysis, the system achieves robust false detection reduction with reduced computational burden. The copies serve as templates for efficient comparison.

Inventive Principle:
Principle #26Copying

3Measurement precision

If manual inspection of the interior is performed by an operator, then detection of objects is achieved, but time consumption and labor requirements increase

Engineering Contradiction:
Improveobject detection capabilityVSAvoidinspection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical system of manual visual inspection by an operator with an automated image processing system using neural networks. The system captures images, extracts features, compares them against references, and automatically detects objects without human intervention. This substitution eliminates time consumption and labor requirements while maintaining or improving detection precision through consistent, fatigue-free automated analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements self-service by enabling the system to automatically perform the entire inspection process without human operators. The neural network system independently captures images, processes features, compares against references, identifies deviations, and generates detection results. This self-service capability eliminates dependency on manual inspection while achieving reliable object detection.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP4435638A1Computer-implemented method for detecting a state of a public transport vehicle interior
Publication Date: 2024.09.25 SIEMENS MOBILITY GMBH
  • EP4435638A1 patent drawingFigure 1~2
  • EP4435638A1 patent drawingFigure 3
  • EP4435638A1 patent drawingFigure 4

AI summary

The invention relates to a device and a computer-implemented method for detecting that the interior of a public transport vehicle is not in a predetermined state, wherein a trained neural network with multiple layers is provided, one layer representing a feature map, wherein several feature maps for the image are created from a recorded image of the interior of the public transport vehicle using the layers of the trained neural network, wherein a feature map has features for image sections of the image with at least one or more image pixels, wherein the features of several feature maps are compared with reference values, wherein, upon a predetermined deviation of the features from the reference values, it is recognized that the interior is not in the predetermined state, and wherein, upon recognition that the interior is not in the predetermined state,a signal is output or stored.