Neural Network Training Stability via Point Cloud Grid Aggregation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional neural network training methods struggle with processing point cloud data from radar and LIDAR sensors, leading to unstable training processes and poor performance due to the dominance of cells with no data points, which results in trivial solutions where errors are overlooked.

Innovation Solution

A method that aggregates point cloud data into a grid, using weighted cost functions to emphasize cells with data points and optimize mesh width, ensuring that the neural network focuses on analyzing occupied cells, thereby improving training stability and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If point cloud data is directly processed by neural network without grid aggregation, then data processing speed is improved, but training stability deteriorates due to dominance of empty cells

Engineering Contradiction:
Improvedata processing speedVSAvoidtraining stability
Core Design Contradiction:
SpeedVSStability of the object's composition

Solution Approach 1:

The patent divides the spatial region into a grid of cells, segmenting the point cloud data into discrete spatial units. This segmentation allows the neural network to process structured grid data rather than raw point clouds, improving training stability by eliminating the dominance of empty cells while maintaining efficient processing through the organized cell structure.

Inventive Principle:
Principle #1Segmentation

2Ease of manufacture

If uniform weighting is applied to all grid cells in cost function, then computational simplicity is improved, but measurement precision deteriorates due to trivial solutions from empty cells

Engineering Contradiction:
Improvecomputational simplicityVSAvoiderror assessment accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent applies local quality by assigning different weights to different grid cells based on their occupancy status. Cells containing point cloud data receive higher weights while empty cells receive lower weights, allowing the cost function to focus computational attention on relevant regions and prevent trivial solutions without significantly increasing computational complexity.

Inventive Principle:
Principle #3Local quality

3Device complexity

If mesh width is not optimized, then device complexity is reduced, but manufacturing precision deteriorates due to poor classification performance

Engineering Contradiction:
Improvetraining configuration complexityVSAvoidobject classification accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent introduces dynamic adaptability by making the mesh width a trainable parameter that can be optimized during the training process. This allows the system to automatically find the optimal grid resolution for different datasets and applications, improving classification accuracy while maintaining relatively simple device complexity through parameter optimization rather than structural complexity.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230057329A1Numerically more stable training of a neural network on training measured data provided as a point cloud
Publication Date: 2023.02.23 ROBERT BOSCH GMBH
  • US20230057329A1 patent drawing
  • US20230057329A1 patent drawing
  • US20230057329A1 patent drawing

AI summary

A method for monitored training of a neural network. In the method, training examples including training measured data and associated training output variables are provided; a spatial region, which contains at least a part of the locations indicated by the training measured data of a training example, is subdivided into a grid made up of adjoining cells; for each cell, values of the measured variables contained in the training measured data for all locations in this cell are aggregated to form values of the measured variables which relate to this cell; these aggregated values of the measured variables are mapped by the neural network on one or multiple output variables; deviations of these output variables from the training output variables are assessed using a predefined cost function; parameters of the neural network are optimized.