3D Building Display Target Acquisition Using BIM Semantic Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Three-dimensional building displays often face challenges with target acquisition, particularly when objects occlude each other, making it difficult for users to select specific targets like HVAC devices or light switches due to their larger size and spatial relationships.

Innovation Solution

The method involves extracting Building Information Modeling (BIM) semantic data to create a semantic space for objects, adjusting the scale factor of the 3D display based on the number and category of objects, and using interaction context information to aid target acquisition, allowing for increased sensitivity in sparse scenes and reduced sensitivity in dense scenes, and enabling transitions between different interaction modes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If objects are displayed in a 3D building display with realistic spatial relationships, then depth perception and realism are improved, but target acquisition becomes difficult when objects occlude each other

Engineering Contradiction:
Improvedepth perceptionVSAvoidtarget acquisition
Core Design Contradiction:
Illumination intensityVSEase of operation

Solution Approach 1:

The system performs preliminary actions by detecting object occlusion relationships before target acquisition occurs. When an object is occluded, the system proactively adjusts the scale factor and provides alternative selection methods, preventing the user from struggling with difficult target acquisition.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The scale factor is made dynamic rather than static. The system automatically adjusts the scale factor based on the detected occlusion relationships and scene density, allowing the display to adapt its sensitivity to the specific spatial configuration of objects being viewed.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If the display shows detailed information about multiple objects, then information completeness is improved, but the complexity of selecting specific targets increases

Engineering Contradiction:
Improveinformation completenessVSAvoidselection complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Different parts of the interface have different properties. The system applies different scale factors and selection sensitivities to different regions or contexts within the display, allowing detailed information to be presented while simplifying the selection process for specific targets based on their spatial context.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the scale factor is increased to improve sensitivity for selecting small objects, then target acquisition precision is improved, but the display becomes too sensitive in dense scenes causing excessive interactions

Engineering Contradiction:
Improvetarget acquisition precisionVSAvoidinteraction efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system changes the scale factor parameter dynamically based on scene conditions. Rather than using a fixed high sensitivity setting, the scale factor is adjusted according to object density and occlusion relationships, maintaining precision when needed while reducing sensitivity in dense areas to prevent excessive interactions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2798616B1Target aquisition in a three dimensional building display
Publication Date: 2020.04.01 HONEYWELL INTERNATIONAL INC
  • EP2798616B1 patent drawingFigure 1
  • EP2798616B1 patent drawingFigure 2

AI summary

The present disclosure provides methods, devices, and computer- readable media for target acquisition in a three dimensional building display are described herein. One or more embodiments include extracting building information modeling semantic data of each of a number of modeled objects in a visual scene of a three dimensional building display, determining a semantic space for each of the number of modeled objects based, at least in part, on the building information modeling semantic data, adjusting a scale factor of the three dimensional building display based, at least in part, on the semantic space of each of the number of modeled objects, and acquiring a target of at least one of the modeled objects using the adjusted scale factor.