3D GUI Plane Projection for Low-Fatigue Object Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operating a graphical user interface (GUI) for controlling 3D objects is tiring due to the need to grip an input device in midair, which increases user fatigue.

Innovation Solution

A video generation unit generates a video with a 3D object and GUI arranged in a virtual space, allowing portions of the 3D object to be cut out along planes of the GUI, enabling intuitive operation using a two-dimensional input device like a mouse.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a three-dimensional input device is used to operate the GUI in virtual space, then the operational capability for 3D objects is improved, but the user fatigue increases due to needing to grip the device in midair

Engineering Contradiction:
Improveoperational capabilityVSAvoiduser fatigue
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a two-dimensional projection (copy) of the three-dimensional GUI onto a plane that can be operated with conventional 2D input devices. This copying approach allows users to interact with 3D virtual objects using familiar 2D interfaces, eliminating the need for specialized 3D input devices while maintaining full operational capability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent projects the three-dimensional GUI onto a two-dimensional plane, effectively reducing the dimensionality of the interface. This dimensionality change allows standard 2D input devices to control 3D virtual objects by mapping 2D input coordinates to 3D spatial positions, resolving the contradiction between 3D operational capability and 2D input convenience.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the GUI is displayed as a complete 3D object in virtual space, then the visual information is improved, but the ability to view internal structures is reduced

Engineering Contradiction:
Improvevisual informationVSAvoidinternal structure visibility
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent segments the three-dimensional GUI into multiple two-dimensional projected views (such as front, back, left, right, top, and bottom views). This segmentation allows users to selectively view different aspects of the 3D object, including internal structures, by choosing appropriate projection planes, thereby maintaining complete visual information while enabling internal structure detection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By projecting the 3D GUI onto multiple 2D planes from different perspectives, the patent enables users to view internal structures that would be obscured in a single 3D view. The dimensionality reduction to multiple 2D projections provides comprehensive visual information including cross-sections and internal arrangements without requiring transparent or cutaway 3D rendering.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20260057623A1Information processing apparatus, information processing system, and program
Publication Date: 2026.02.26 SONY GROUP CORP
  • US20260057623A1 patent drawing
  • US20260057623A1 patent drawing
  • US20260057623A1 patent drawing

AI summary

The present technology relates to an information processing apparatus, an information processing system, and a program that allows a GUI to be suitably operated. An information processing apparatus of the present technology includes a video generation unit configured to generate a video including a 3D object and a GUI having at least three planes arranged in a virtual space, the video including the 3D object in which one portion is cut out along a plane of the GUI in a case where the 3D object and the GUI overlap in the virtual space. The present technology can be applied to, for example, an information processing apparatus that controls display of a spatial reproduction display.