Augmented reality interface

Abstract

Methods for augmenting a view of a physical environment with computer-generated sensory input are provided. In one aspect, a method includes receiving visual data providing for display an image of a physical three-dimensional environment and orientation data indicating an orientation of a device within the physical environment, and generating a simulated three-dimensional environment. The method also includes providing the image of the physical environment for display within the simulated environment, and providing at least one computer-generated visual object within the simulated environment for overlaying on the displayed image of the physical environment. The computer-generated visual object is displayed using perspective projection. Systems and machine-readable storage media are also provided.

Description

BACKGROUND[0001]1. Field[0002]The present disclosure generally relates to computer data, and more particularly to the use of a computing device to display data.[0003]2. Description of the Related Art[0004]Augmented reality (AR) is commonly described as a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensor input such as sound, video, graphics or global positioning system data. AR software applications are often used on mobile devices to assist users in finding physical objects or locations in the physical world by displaying computer-generated visual objects near the physical objects or locations.[0005]AR software applications that provide a direct view of a physical world environment commonly use orthographic projection (or orthogonal projection) to display computer-generated visual objects. Orthographically projected virtual objects, however, often result in a virtual visual layout that is inconsistent with ...

AI Technical Summary

Benefits of technology

This patent describes an augmented reality application that makes virtual objects appear more realistic using perspective projection and a properly configured field of view. By matching the dimensions of the virtual objects to the device's camera display and the user's field of view, the virtual objects move and rotate with greater realism as the user moves the device. Overall, this technology makes it easier for users to interact with virtual objects in a more immersive way.

Problems solved by technology

Orthographically projected virtual objects, however, often result in a virtual visual layout that is inconsistent with the human visual system.

Consequently, a user's resulting visual experience of the virtual world is unnatural, inaccurate, and unintuitive.

Furthermore, the field of view parameters used by many such AR software applications make visual interaction with and the movement and positioning of virtual objects appear unnatural and inaccurate.

Improper field of view parameters also undermine a desired visual relationship between a virtual object and its physical counterpart.

Improper field of view parameters can result in virtual objects being displayed on-screen when in reality the physical objects they represent are not in view of the camera (e.g., in which case the chosen field of view is too large).

Improper field of view parameters can also result in virtual objects not being displayed even when the represented physical object is on screen (e.g., in which case the chosen field of view is too small).

Furthermore, certain virtual objects 101 and 103 are not properly aligned with their respective physical objects 104 and 105 because an improper field of view results in a distribution of virtual objects that are either too close to the center of the screen or too far from the center of the screen.

Images