Haptic Rendering via Graphics Pipeline Data Repurposing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current haptic rendering systems are inefficient and incompatible with 3D graphics applications, limiting processing speeds and realism in virtual environments, as they process haptic data separately from graphical data and are not designed to interpret or provide haptic information.

Innovation Solution

The method involves repurposing graphical data from the graphics pipeline for haptic rendering, allowing integration of haptic functionality into 3D graphics applications, using APIs to access and interpret data from buffers like depth, feedback, and texture maps for enhanced force feedback and interaction techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If haptic rendering is processed separately from graphical rendering, then haptic systems can maintain independent control, but processing efficiency decreases and compatibility with 3D graphics applications is limited

Engineering Contradiction:
Improveindependent controlVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent merges haptic rendering with graphical rendering by integrating haptic data processing into the graphics pipeline. The system uses the same 3D scene data, geometry, and rendering calculations that graphical systems already perform to generate haptic feedback, eliminating the need for separate haptic processing and improving overall efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent makes the graphics pipeline multi-functional by enabling it to serve both graphical rendering and haptic rendering purposes. The same data structures, geometry processing, and rendering calculations are used to generate both visual and haptic outputs, allowing a single system to perform multiple functions without requiring dedicated separate processing paths.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If haptic rendering uses dedicated processing, then haptic feedback accuracy is maintained, but processing speed decreases and latency increases

Engineering Contradiction:
Improvehaptic feedback accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent performs haptic rendering calculations in advance during the graphical rendering process. By computing haptic data alongside graphical data before final output, the system prepares haptic feedback information ahead of time, reducing real-time processing requirements and latency while maintaining accuracy through pre-computed precise calculations.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If haptic systems are designed independently, then haptic control is precise, but adaptability to 3D graphics applications is reduced

Engineering Contradiction:
Improvehaptic control precisionVSAvoidcompatibility with 3D graphics applications
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent enables the graphics pipeline to serve both graphical and haptic rendering functions, making the system adaptable to various 3D graphics applications while maintaining haptic control precision. The unified approach allows seamless integration with different 3D applications using standard graphics APIs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary layer that bridges haptic rendering with the graphics pipeline. This intermediary component translates and adapts graphical rendering data into haptic feedback data, enabling precise haptic control while maintaining compatibility with diverse 3D graphics applications through a standardized interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If separate haptic processing is used, then haptic rendering can be optimized independently, but device complexity increases

Engineering Contradiction:
Improvehaptic rendering optimizationVSAvoidsystem architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines haptic rendering optimization within the existing graphics pipeline architecture, eliminating the need for separate dedicated haptic processing hardware or software systems. This integration reduces overall system complexity while maintaining the ability to optimize haptic rendering through the established graphics processing infrastructure.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS7990374B2Apparatus and methods for haptic rendering using data in a graphics pipeline
Publication Date: 2011.08.02 3D SYSTEMS INC
  • US7990374B2 patent drawing
  • US7990374B2 patent drawing
  • US7990374B2 patent drawing

AI summary

The invention provides methods for leveraging data in the graphics pipeline of a 3D graphics application for use in a haptic rendering of a virtual environment. The invention provides methods for repurposing graphical information for haptic rendering. Thus, at least part of the work that would have been performed by a haptic rendering process to provide touch feedback to a user is obviated by work performed by the graphical rendering process.