3D View Interpolation via Sphere Grid and Optical Flow

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in efficiently rendering and displaying three-dimensional models from multiple viewing angles, leading to poor user experience due to limited storage capacity and performance issues.

Innovation Solution

The method involves determining a target drawing viewpoint based on user interactions, using a pre-generated sphere grid model to identify the corresponding grid region, and generating a target interpolation image using optical flow information to match the user's intended viewing angle.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If rendering and storing views from multiple viewing angles is adopted to improve user experience, then the accuracy of displayed views is improved, but the storage space requirement increases

Engineering Contradiction:
Improveview accuracyVSAvoidstorage space
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the 3D model into multiple grid regions on a sphere grid, where each grid region corresponds to a specific viewing angle range. Instead of storing complete views from all angles, only key grid regions are pre-rendered and stored. When a user requests a view, the system segments the sphere grid to identify the corresponding grid region and generates the view by interpolating between stored key views, thereby reducing storage requirements while maintaining view accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary rendering and storage of views from key grid regions on the sphere grid before user interaction. These pre-computed views are stored in advance, eliminating the need to render all possible views in real-time. When a user interacts with the 3D model, the system quickly retrieves and interpolates between the pre-stored key views to generate the requested angle, balancing preparation work with storage efficiency.

Inventive Principle:
Principle #10Preliminary action

2Speed

If real-time rendering of views from different viewing angles is performed to match user dragging operations, then the responsiveness is improved, but the device performance requirement increases

Engineering Contradiction:
Improveresponse speedVSAvoiddevice performance
Core Design Contradiction:
SpeedVSPower

Solution Approach 1:

The patent applies partial action by only rendering and processing the specific grid region that corresponds to the user's current viewing angle, rather than rendering the entire 3D model from all angles. The system identifies the target grid region on the sphere grid and performs interpolation only for that region using optical flow information, significantly reducing the computational load while maintaining real-time responsiveness to user interactions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent replaces the traditional mechanical rendering system with an optical flow-based interpolation system. Instead of performing full 3D rendering computations in real-time, the system uses optical flow information to estimate pixel movements between key views and interpolates the target view mathematically. This substitution of computational mechanics dramatically reduces device performance requirements while maintaining response speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Quantity of substance

If only a limited number of views are stored to save storage space, then the storage efficiency is improved, but the user experience deteriorates due to view mismatch

Engineering Contradiction:
Improvestorage efficiencyVSAvoiduser experience
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent introduces optical flow information as an intermediary element between the stored key views and the user's requested view. The optical flow data captures pixel movement patterns between adjacent views, enabling accurate interpolation even when only a limited number of key views are stored. This intermediary information allows the system to generate smooth transitions and accurate views at intermediate angles, maintaining user experience while improving storage efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter representation from storing complete image data at all angles to storing key views with associated optical flow parameters. By transforming the storage format to include optical flow information (which describes pixel displacement vectors), the system can reconstruct intermediate views with high accuracy using fewer stored images, thereby improving storage efficiency without sacrificing user experience.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250061586A1Image processing method and apparatus, and electronic device and storage medium
Publication Date: 2025.02.20 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20250061586A1 patent drawing
  • US20250061586A1 patent drawing
  • US20250061586A1 patent drawing

AI summary

An image processing method and apparatus, an electronic device, and a storage medium. The method includes: determining a target drawing viewpoint corresponding to a trigger operation on a target object when the trigger operation is detected; determining a target grid region to which the target drawing viewpoint belongs based on a pre-generated target sphere grid model, and determining a target interpolation image corresponding to the target drawing viewpoint according to at least one optical flow information set of the target grid region; and issuing the target interpolation image to a target client, so as to display, on the target client, the target interpolation image corresponding to the trigger operation.