Markup Transparency in 3D Scene Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In three-dimensional (3D) scene rendering, existing methods struggle to draw markup such as text and shapes in a way that they are both visible and not obscuring the scene, or being obscured by it, especially in multi-dimensional renderings like 3D maps.

Innovation Solution

The disclosed architecture determines the utility of markup and scene objects by computing their contributions based on distance ratios and applies depth fading to ensure that the markup is prominently visible when its contribution is greater than the scene's, and vice versa, using techniques that fade either the markup, the occluding scene object, or both.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If markup is drawn with full opacity in a 3D scene, then the markup is clearly visible, but the scene is obscured

Engineering Contradiction:
Improvemarkup visibilityVSAvoidscene obscuration
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies different opacity levels to different regions of markup based on local scene conditions. Markup pixels that would obscure important scene elements are rendered with reduced opacity or excluded, while other markup pixels maintain full opacity for readability. This local differentiation resolves the contradiction by making markup visible where appropriate while preserving scene visibility where needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts markup opacity based on scene context, camera position, zoom level, and importance scoring. Rather than using a static opacity value, the system calculates optimal opacity levels in real-time based on multiple factors including the markup's importance score, the scene's zoom level, and the specific spatial relationship between markup and scene elements. This dynamic adjustment allows the system to adapt to changing viewing conditions and resolve the visibility contradiction adaptively.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If markup is drawn entirely within the 3D scene, then the markup does not obscure the scene, but the markup can be obscured by scene elements

Engineering Contradiction:
Improvescene visibilityVSAvoidmarkup visibility
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent treats markup and scene elements with differential rendering based on their respective importance scores and spatial relationships. Rather than uniformly placing all markup within the scene or excluding it, the system evaluates each markup element locally and applies appropriate opacity adjustments or exclusions to ensure both scene visibility and markup readability where needed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent introduces an intermediary rendering layer that mediates between fully opaque markup and completely scene-integrated markup. This intermediary approach uses calculated opacity values between 0 and 1 to blend markup with the scene, allowing markup to be partially visible through scene elements while maintaining readability. This intermediary solution resolves the contradiction by finding a middle ground between the two extreme approaches.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If markup opacity is increased for better visibility, then the markup becomes more prominent, but it obscures more of the scene

Engineering Contradiction:
Improvemarkup prominenceVSAvoidscene occlusion
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent applies local quality by assigning different opacity values to different markup pixels based on their specific spatial relationship with scene elements and their importance scores. Rather than uniformly increasing opacity across all markup, the system selectively increases opacity only for markup pixels that do not overlap with important scene elements, while maintaining lower opacity for pixels that would cause obscuration. This local differentiation allows markup prominence to be enhanced without proportionally increasing scene occlusion.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes the opacity parameter dynamically based on multiple factors including markup importance scores, scene zoom level, camera position, and spatial overlap analysis. Rather than using a fixed high opacity value, the system adjusts the opacity parameter adaptively to balance markup prominence with scene visibility, resolving the contradiction by making opacity a variable parameter rather than a constant.

Inventive Principle:
Principle #35Parameter changes

4Stability of the object's composition

If markup is rendered with depth fading to match scene depth, then the markup blends with the scene, but the markup becomes less distinct and readable

Engineering Contradiction:
Improvescene integrationVSAvoidmarkup readability
Core Design Contradiction:
Stability of the object's compositionVSMeasurement precision

Solution Approach 1:

The patent applies local quality by evaluating each markup pixel's spatial relationship with scene elements and applying differential opacity adjustments. Rather than uniformly applying depth fading to all markup to achieve scene integration, the system selectively reduces opacity only for markup pixels that would cause obscuration, while maintaining higher opacity for pixels that need to remain readable. This local differentiation allows partial scene integration while preserving markup readability where critical.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts markup opacity based on scene context, zoom level, and importance scoring rather than applying static depth fading. The system can increase markup opacity when readability is critical (such as for important labels or annotations) while reducing it when scene visibility is more important. This dynamic adjustment allows the system to adapt to changing priorities between scene integration and markup readability based on the specific viewing context.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3069104B1Presenting markup in a scene using transparency
Publication Date: 2020.02.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3069104B1 patent drawingFigure 1
  • EP3069104B1 patent drawingFigure 2
  • EP3069104B1 patent drawingFigure 3

AI summary

Architecture that enables the drawing of markup in a scene that neither obscures the scene nor is undesirably obscured by the scene. When drawing markup such as text, lines, and other graphics, into the scene, a determination is made as to the utility to the viewer of drawing the markup with greater prominence than an occluding scene object. The utility of the markup is based on the distance of the scene object and markup from the camera. Thus, if an object that appears small in the scene and is in front of the markup, the markup will be drawn more clearly, whereas if the same object appears large in the scene and is in front of the markup, the markup is rendered faint, if drawn at all.