System, method, and graphical user interface for interacting with augmented and virtual reality environment

Abstract

The invention relates to a system, method, and graphical user interface for interacting with an augmented and virtual reality environment. A computer system concurrently displays, in the augmented reality environment: a representation of at least a portion of a field of view of one or more cameras including respective physical objects, wherein the representation is updated as field of view contentchanges; and a respective virtual user interface object at a respective position determined in the virtual user interface based on the position of the respective physical object in the field of view.While an input is detected at a location corresponding to the displayed respective virtual user interface object, in response to detecting movement of the input relative to the respective physical object in the field of view of the one or more cameras, the system adjusts an appearance of the respective virtual user interface object in accordance with an amount of movement of the input relative tothe respective physical object.

Description

[0001] This application is a divisional application of an invention patent application with an application date of August 30, 2018, an application number of 201880055301.0, and an invention title of "System, Method and Graphical User Interface for Interacting with Augmented and Virtual Reality Environments". technical field [0002] The present invention generally relates to computer systems for virtual / augmented reality, including but not limited to electronic devices for interacting with augmented and virtual reality environments. Background technique [0003] In recent years, the development of computer systems for virtual / augmented reality has increased significantly. An example virtual / augmented reality environment includes at least some virtual elements that replace or augment the physical world. Input devices, such as touch-sensitive surfaces, for computer systems and other electronic computing devices are used to interact with virtual / augmented reality environments. ...

AI Technical Summary

Problems solved by technology

For example, using an input sequence to select one or more user interface objects (e.g., one or more virtual elements in a virtual / augmented reality environment) and perform one or more actions on the selected user interface objects is cumbersome, giving Inflicts significant cognitive load on the user and detracts from the experience with the virtual / augmented reality environment

Also, these methods take longer than necessary, wasting energy

Images