Viewpoint-Aware Display Control for Fastening-Location Overlays

The patent applies dimensionality change by transitioning virtual object display from a two-dimensional screen to a three-dimensional space that overlaps with the real workspace. Virtual objects are positioned at specific spatial coordinates (x, y, z) relative to the worker's viewpoint and task location, enabling information to be accessed in the third dimension without blocking the line of sight to real objects. This spatial arrangement allows simultaneous visibility of both virtual information and real task objects.

The patent implements local quality by making different parts of the virtual display have different spatial properties. Virtual objects are selectively positioned at different locations and orientations based on their type and importance. Critical information is placed in locations that do not obstruct views of task objects, while less critical information can be positioned elsewhere. Each virtual object's position and orientation are individually optimized to minimize obstruction while maximizing information accessibility.

The patent applies dynamics by making virtual object positions and orientations dynamic rather than fixed. The system continuously tracks the worker's viewpoint and adjusts the position of virtual objects in real-time to maintain optimal visibility. Virtual objects are repositioned based on the worker's head movements, eye direction, and the location of task objects, ensuring that information remains accessible without causing obstruction as the worker moves throughout the task.

The patent introduces the worker's viewpoint and line of sight as an intermediary between virtual objects and task objects. By using eye tracking and head position data as mediators, the system calculates optimal positions for virtual objects that are close to task locations but positioned along the worker's line of sight or in peripheral vision areas, preventing direct overlap with task objects while maintaining immediate information access.