Point Cloud LoD Selection by Viewpoint Density

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for distributing and rendering 3D point cloud data struggle to maintain subjective image quality while controlling data load, as the appropriate level of detail (LoD) selection is inadequate due to variations in viewpoint distance and orientation, leading to potential image degradation and increased load.

Innovation Solution

An image processing apparatus and method that calculates the necessary point density based on the display size of a point cloud object relative to the viewpoint position, selecting or correcting the LoD content file to ensure the point density meets or exceeds this requirement, thereby maintaining image quality and controlling data load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If LoD selection is based only on distance from viewpoint to object, then data transmission load is reduced, but subjective image quality degrades due to insufficient point density at certain viewing angles

Engineering Contradiction:
Improvedata transmission loadVSAvoidsubjective image quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent changes the selection criteria from a single parameter (distance) to multiple parameters (distance and viewing angle), dynamically adjusting the LoD selection based on the combination of these parameters to maintain appropriate point density across different viewing conditions

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces dynamic LoD selection that adapts to changing viewpoint conditions. The system continuously monitors both distance and viewing angle, and adjusts the selected LoD in real-time to maintain optimal point density regardless of the viewer's position or orientation

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If high-definition LoD is selected for all objects, then subjective image quality is maintained, but data transmission load and processing load increase significantly

Engineering Contradiction:
Improvesubjective image qualityVSAvoiddata transmission load
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies different LoD levels to different objects or regions based on their specific viewing conditions. Instead of uniformly applying high-definition LoD to all objects, the system selectively applies appropriate LoD levels to each object based on its distance and viewing angle, optimizing the balance between quality and data load

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies high-definition LoD only when necessary (when viewing angle and distance require it) rather than always. This partial application of high-definition rendering maintains image quality where needed while reducing overall data transmission load by using lower LoD levels for objects that don't require high definition

Inventive Principle:
Principle #16Partial or excessive action

3Device complexity

If LoD selection does not consider viewing angle, then device complexity is reduced, but point density becomes insufficient for objects at certain orientations causing image degradation

Engineering Contradiction:
Improveselection algorithm complexityVSAvoidpoint density accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent extends the selection algorithm to consider additional parameters (viewing angle) without fundamentally complicating the core logic. The system calculates viewing angle and uses it as an additional criterion for LoD selection, maintaining a relatively simple algorithm structure while improving accuracy

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230196700A1Image processing apparatus and image processing method
Publication Date: 2023.06.22 SONY GROUP CORP
  • US20230196700A1 patent drawing
  • US20230196700A1 patent drawing
  • US20230196700A1 patent drawing

AI summary

The present disclosure relates to an image processing apparatus and an image processing method capable of suppressing degradation of subjective image quality while suppressing an increase in load.On the basis of the display size of a point cloud object depending on the relative position of the point cloud object based on the position of a viewpoint, the necessary point density that is the density of points necessary for displaying the point cloud object is calculated, and the content file of LoD in which the density of points of the point cloud object is equal to or higher than the calculated necessary point density is selected. The present disclosure can be applied to, for example, an image processing apparatus, an information processing apparatus, a reproduction device, a 3D rendering device, an electronic device, a method thereof, and the like.