Point Cloud Filter Processing Using Representative Values

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The processing load for nearest neighbor searches in point cloud data is extremely heavy due to the large number of points, leading to a potential increase in processing time for filter processes.

Innovation Solution

An image processing apparatus and method that perform a filter process on point cloud data using a representative value for each local region in three-dimensional space, and encode a two-dimensional plane image of the filtered point cloud data to generate a bitstream.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If nearest neighbor search is performed for each point in point cloud data to apply three-dimensional smooth filter, then subjective image quality is maintained, but processing time increases significantly

Engineering Contradiction:
Improvesubjective image qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent divides the point cloud data into multiple local regions (e.g., using octree structure or grid division). For each local region, only the representative value (e.g., average position or color) is calculated and used for filtering, rather than performing nearest neighbor search on all individual points. This segmentation reduces the computational complexity from O(N) to O(M) where M is the number of local regions, significantly decreasing processing time while maintaining acceptable image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses representative values (copies) of local regions instead of the actual individual point data. By calculating filtering results based on these simplified representative values and then applying them back to the original points, the system achieves similar filtering effects with much lower computational cost, avoiding the need for exhaustive nearest neighbor searches.

Inventive Principle:
Principle #26Copying

2Reliability

If nearest neighbor search is performed on all points in point cloud data, then accurate filter results are obtained, but processing load becomes extremely heavy

Engineering Contradiction:
Improvefilter accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the point cloud into local regions and performs filtering operations on representative values of these regions rather than individual points. This maintains sufficient filter accuracy for visual purposes while dramatically improving processing efficiency by reducing the number of operations from proportional to total point count to proportional to number of regions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies filtering based on representative values which is a partial action compared to full nearest neighbor search on all points. This partial action is sufficient to achieve the desired filtering effect for visualization purposes, and the patent explicitly states that excessive precision is not always necessary for acceptable results.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12243197B2Image processing apparatus and image processing method for suppressing an increase in processing time of a filter process for point cloud data
Publication Date: 2025.03.04 SONY GROUP CORP
  • US12243197B2 patent drawing
  • US12243197B2 patent drawing
  • US12243197B2 patent drawing

AI summary

A filter process is performed on point cloud data using a representative value of the point cloud data for each local region obtained by dividing a three-dimensional space. A two-dimensional plane image on which the point cloud data subjected to the filter process is projected is encoded, and a bitstream is generated. The filter process can be performed by, for example, an information processing apparatus, an image processing apparatus, electronic equipment, an information processing method, a program, or the like.