User Input Device Camera for 3D Scene Interaction Recording

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for stereoscopic displays lack effective methods to record or preserve user interactions with virtual objects using a user input device, such as a stylus, within the three-dimensional virtual space.

Innovation Solution

A method and system for capturing two-dimensional images from the perspective of a user input device in a three-dimensional scene, where the point of view of the camera is determined by the position and orientation of the device, allowing for independent camera viewpoints and activation of a camera mode to capture and store images or sequences of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user input device is used to interact with virtual objects in a 3D scene, then user interaction capability is improved, but there is no effective method to record or preserve these interactions

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidinteraction recording capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent creates a virtual camera that copies the user input device's position and orientation to capture images from the device's perspective. This allows recording of user interactions by generating image copies from the interactive viewpoint, preserving the interaction data without interfering with the interaction itself.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual camera acts as an intermediary between the user input device and the recording system. It translates the device's spatial position and orientation into capture parameters, enabling interaction recording while maintaining the independence and natural operation of the input device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If a camera mode is added to capture images from user input device perspective, then image capture functionality is improved, but device complexity increases

Engineering Contradiction:
Improveimage capture functionalityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Instead of adding physical camera hardware, the patent creates a virtual camera that copies the user input device's characteristics. This software-based approach adds capture functionality without the complexity of additional physical components, maintaining system simplicity while enhancing versatility.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual camera system allows the user input device to serve multiple functions: both interaction control and image capture viewpoint specification. This multi-functionality is achieved through software integration rather than hardware multiplication, reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11284061B2User input device camera
Publication Date: 2022.03.22 ZSPACE INC
  • US11284061B2 patent drawing
  • US11284061B2 patent drawing
  • US11284061B2 patent drawing

AI summary

Systems and methods for capturing a two dimensional (2D) image of a portion of a three dimensional (3D) scene may include a computer rendering a 3D scene on a display from a user's point of view (POV). A camera mode may be activated in response to user input and a POV of a camera may be determined. The POV of the camera may be specified by position and orientation of a user input device coupled to the computer, and may be independent of the user's POV. A 2D frame of the 3D scene based on the POV of the camera may be determined and the 2D image based on the 2D frame may be captured in response to user input. The 2D image may be stored locally or on a server of a network.