Massive simultaneous remote digital presence world

Abstract

To provide a preferred massive simultaneous remote digital presence world.SOLUTION: Various methods and apparatuses are described herein for enabling one or more users to interface with virtual or augmented reality environments. An example system includes a computing network having computer servers interconnected through high bandwidth interfaces to gateways for processing data and / or for enabling communication of data between the servers and one or more local user interface devices. The servers include memory, processing circuitry, and software for designing and / or controlling virtual worlds, as well as for storing and processing user data and data provided by other components of the system. One or more virtual worlds may be presented to a user through a user device for the user to take experience and interact.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) Pursuant to 35 U.S.C. §119(e), this application claims priority to U.S. Provisional Patent Application No. 61 / 483,505, filed May 6, 2011, and to U.S. Provisional Patent Application No. 61 / 483,511, filed May 6, 2011.

[0002] FIELD OF THEINVENTION The present invention relates generally to methods and apparatus for enabling interactive virtual or augmented reality environments for multiple users. [Background technology]

[0003] (background) Virtual and augmented reality environments are generated by a computer using, in part, data that describes the environment. This data may represent, for example, various objects that a user may sense and interact with. Examples of these objects include objects that are rendered and displayed for the user to see, audio that is played for the user to hear, and tactile (or haptic) feedback for the user to feel. Users may sense and interact with virtual and augmented reality environments through a variety of visual, auditory, and tactile means. Summary of the Invention [Means for solving the problem]

[0004] This disclosure describes various systems and methods for one or more users to interact with or participate in a virtual or augmented reality environment.

[0005] In one exemplary embodiment, the system includes a computing network having a computer server interconnected to a gateway via a high bandwidth interface for processing data and / or enabling communication of data between the server and one or more local user interface devices. The server includes memory, processing circuitry, and software for designing and / or processing the virtual world, as well as for storing and processing user data and data provided by other components of the system. One or more virtual worlds may be presented to users through user devices for the users to experience and interact with. Multiple users may use the devices to simultaneously interact with one or more digital worlds by each using the device to observe and interact with each other and with objects created within the digital world.

[0006] Examples of user devices include smartphones, tablet devices, heads-up displays (HUDs), gaming consoles, or generally any other device capable of generating or communicating an interface to a user to communicate data, see, hear, and / or touch. Generally, a user device will include a processor for executing program code stored in memory on the device, coupled with a visual display, and a communication interface. The interface allows for visual, audible, and / or physical interaction between the user and the digital world, including other users and objects (real or virtual) presented to the user. In one embodiment, the user device comprises a head-mounted display system having an interface, a user sensing system, an environmental sensing system, and a processor. The present specification also provides, for example, the following items: (Item 1) 1. A system for enabling one or more users to interact with a virtual world comprised of virtual world data, the system comprising: a computer network comprising one or more computer servers, the one or more computer servers comprising a memory, a processing circuit, and software stored in the memory and executable by the processing circuit to process at least a portion of the virtual world data; the computer network is operable to transmit the virtual world data to a user device for presentation to a first user; At least a portion of the virtual world changes in response to changes in the virtual world data; At least a portion of the virtual world data is altered in response to physical objects sensed by the user device. (Item 2) 2. The system of claim 1, wherein the changes to the virtual world data describe a virtual object having a predetermined relationship with the physical object. (Item 3) 3. The system of claim 2, wherein the changes to the virtual world data are presented to a second user device for presentation to a second user in accordance with the predetermined relationship. (Item 4) The system of any one of items 1 to 3, wherein the virtual world is operable to be rendered by at least one of the computer server or the user device. (Item 5) 5. The system of any one of claims 1 to 4, wherein the virtual world is presented in at least one of a two-dimensional format or a three-dimensional format. (Item 6) The system of any one of items 1 to 5, wherein the user device is operable to provide an interface to enable interaction between a user and the virtual world in at least one of an augmented reality mode, a virtual reality mode, or a combination of an augmented reality mode and a virtual reality mode. (Item 7) The system according to any one of items 1 to 6, wherein the virtual world data is transmitted over a data network. (Item 8) The system of any one of items 1 to 7, wherein the computer network is operable to receive at least a portion of the virtual world data from a user device. (Item 9) A system described in any one of items 1 to 8, wherein at least a portion of the virtual world data transmitted to the user device comprises instructions for generating at least a portion of the virtual world. (Item 10) The system of any one of items 1 to 9, wherein at least a portion of the virtual world data is transmitted to a gateway. (Item 11) 1. A system for enabling one or more users to interact with a virtual world, the system comprising: a user device for presenting the virtual world to a user and enabling the user to interact with the virtual world, the user device comprising: Memory, A processing circuit; software stored in the memory, the software executable by the processing circuitry to render at least a portion of the virtual world from virtual world data received at least in part from a computer network; a display operable to present the virtual world to the user; a communications interface operable to communicate at least a portion of the virtual world data over a data network; a sensing system operable to sense at least one of the user, a physical object, or a physical environment surrounding the user; Equipped with The system, wherein the processing circuitry is operable to execute the software to render changes to the virtual world in response to at least one of the sensed user, the sensed physical object, or the sensed physical environment. (Item 12) Item 12. The system of item 11, wherein the modification of the virtual world comprises a virtual object having a predetermined relationship with the sensed user, physical object, or physical environment. (Item 13) Item 13. The system of item 12, wherein the communication interface is operable to communicate the virtual object to the computer network. (Item 14) 14. The system of any one of claims 1 to 13, wherein the virtual world is presented in at least one of a two-dimensional format or a three-dimensional format. (Item 15) The system of any one of claims 1 to 14, wherein the user device enables interaction in at least one of an augmented reality mode, a virtual reality mode, or a combination of an augmented reality mode and a virtual reality mode. (Item 16) 16. The system of any one of claims 1 to 15, wherein the user device further comprises a device for providing tactile or haptic feedback. (Item 17) The system of any one of items 1 to 16, wherein at least a portion of the virtual world data is received from a gateway. (Item 18) 18. The system of any one of items 1 to 17, wherein the gateway is operable to deliver the virtual world data for processing. (Item 19) 1. A computer-implemented method, comprising: Presenting a virtual world to a user device; receiving sensor data generated by one or more sensors associated with the user device in response to a gesture performed by a user using the user device; Recognizing the gesture; and generating a virtual object in response to the recognized gesture; presenting the virtual object on the user device; A method comprising: (Item 20) 20. The method of claim 19, further comprising presenting the virtual object at a second user device. (Item 21) 21. The method according to any one of claims 1 to 20, further comprising establishing a relationship between the virtual object and a physical object in the vicinity of the user. (Item 22) 1. A computer-implemented method, comprising: receiving, using a user device, sensory data generated by a sensor associated with the user device about a physical object in a vicinity of the user; Recognizing the object; generating a virtual object having a predetermined relationship with the physical object in response to recognizing the object; transmitting the virtual object to a display associated with the user device for presentation to the user in accordance with the predetermined relationship; A method comprising: (Item 23) 23. The method of claim 22, further comprising transmitting the virtual object to a second display associated with a second user device for presentation to a second user in accordance with the predetermined relationship. (Item 24) 1. A computer-implemented method, comprising: storing data defining a digital world, the data defining one or more objects; receiving sensor data generated by sensors associated with a plurality of user devices, the sensor data describing at least one physical characteristic of an environment of the user devices; generating an instance of a predefined object for each of a plurality of users in response to the sensor data; transmitting the instance of the default object created for the user to each user of the plurality of users; A method comprising: (Item 25) 25. The method of claim 24, wherein the sensor data describes one or more of the following physical characteristics: position, orientation of a user, movement of a user, a user device, environmental conditions, and physical objects in the vicinity of the user.

[0007] The foregoing and other features and advantages of the present disclosure will become more apparent from the following detailed description of illustrative embodiments, read in conjunction with the accompanying drawings, in which: The detailed description and drawings are merely illustrative of the present disclosure, rather than limiting the scope of the invention, as defined by the appended claims and their equivalents.

[0008] Embodiments are illustrated by way of example in the accompanying drawings, in which like numbers indicate like parts and in which the invention is not necessarily drawn to scale. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an exemplary embodiment of the disclosed system for enabling an interactive virtual or augmented reality environment for multiple users. [Diagram 2] FIG. 2 illustrates an example of a user device for interacting with the system illustrated in FIG. [Diagram 3] FIG. 3 illustrates an exemplary embodiment of a mobile wearable user device. [Figure 4] FIG. 4 illustrates examples of objects viewed by a user when the mobile wearable user device of FIG. 3 is operating in augmentation mode. [Diagram 5] FIG. 5 illustrates examples of objects viewed by a user when the mobile wearable user device of FIG. 3 is operating in virtual mode. [Figure 6] FIG. 6 illustrates examples of objects viewed by a user when the mobile wearable user device of FIG. 3 is operating in a mixed virtual interface mode. [Figure 7] FIG. 7 illustrates an embodiment in which two users located in different geographic locations each interact with the other user and a common virtual world through their respective user devices. [Figure 8] FIG. 8 illustrates an embodiment in which the embodiment of FIG. 7 is augmented to include the use of a haptic device. [Figure 9A] FIG. 9A illustrates an example of mixed mode interaction where a first user is interacting with a digital world in a mixed virtual interface mode and a second user is interacting with the same digital world in a virtual reality mode. [Figure 9B] FIG. 9B illustrates another example of mixed mode interaction in which a first user interacts with a digital world in a mixed virtual interface mode and a second user interacts with the same digital world in an augmented reality mode. [Figure 10] FIG. 10 illustrates an example illustration of a user's field of view when interacting with the system in augmented reality mode. [Figure 11] FIG. 11 illustrates an example illustration of a user's view showing virtual objects triggered by physical objects when the user is interacting with the system in augmented reality mode. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Referring to Figure 1, system 100 is representative hardware for implementing the processes described below. The representative system comprises a computing network 105 consisting of one or more computer servers 110 connected via one or more high bandwidth interfaces 115. The servers in a computing network need not be co-located. The one or more servers 110 each comprise one or more processors for executing program instructions. The servers also include memory for storing the program instructions and data used and / or generated by processes executed by the servers under the direction of the program instructions.

[0011] The computing network 105 communicates data among the servers 110, and between the servers and one or more user devices 120, over one or more data network connections 130. Examples of such data networks include, but are not limited to, any and all types of public and private data networks, both mobile and wired, including, for example, the many interconnections of such networks commonly referred to as the Internet. No particular media, topology, or protocols are intended to be implied by the illustration.

[0012] The user devices are configured to communicate directly with either the computing network 105, or the server 110. Alternatively, the user devices 120 communicate locally with the remote server 110, and optionally with other user devices, via a specially programmed local gateway 140 for processing data and / or communicating data between the network 105 and one or more local user devices 120.

[0013] As shown, the gateway 140 is implemented as a separate hardware component including a processor for executing software instructions and memory for storing software instructions and data. The gateway has its own wired and / or wireless connection to a data network for communicating with the server 110 comprising the computing network 105. Alternatively, the gateway 140 can be integrated with a user device 120 worn or carried by a user. For example, the gateway 140 may be implemented as a downloadable software application that is installed and executed on a processor included in the user device 120. The gateway 140, in one embodiment, provides access to the computing network 105 to one or more users via the data network 130.

[0014] The servers 110 each include, for example, working memory and storage devices for storing data and software programs, a microprocessor for executing program instructions, a graphics processor and other specialized processors for rendering and generating graphic, image, video, audio, and multimedia files. The computing network 105 may also include devices for storing data that is accessed, used, or created by the servers 110.

[0015] The server, and optionally software programs executing on the user device 120 and gateway 140, are used to generate a digital world (also referred to herein as a virtual world) in which the user interacts with the user device 120. The digital world is represented by data and processes that describe and / or define virtual, non-existent entities, environments, and conditions that can be presented to the user via the user device 120 for the user to experience and interact with. For example, any type of object, entity, or item that would appear to be physically present when instantiated in a scene viewed or experienced by the user may include a description of its appearance, its behavior, how the user is allowed to interact with it, and other characteristics. The data used to create the environment of the virtual world (including virtual objects) may include, for example, atmospheric data, terrain data, weather data, temperature data, location data, and other data used to define and / or describe the virtual environment. In addition, the data defining the various conditions governing the operation of the virtual world may include, for example, physical laws, time, spatial relationships, and other data that may be used to define and / or create the various conditions governing the operation of the virtual world (including virtual objects).

[0016] Entities, objects, conditions, properties, behaviors, or other features of the digital world will generally be referred to herein as objects (e.g., digital objects, virtual objects, rendered physical objects, etc.) unless the context dictates otherwise. Objects may be any type of animate or inanimate object, including, but not limited to, structures, plants, vehicles, people, animals, living things, machines, data, videos, text, photos, and other users. Objects may also be defined in the digital world to store information about items, behaviors, or conditions that actually exist in the physical world. Data that describes or defines an entity, object, or item, or stores its current state, will generally be referred to herein as object data. This data is processed by the server 110, or by the gateway 140 or user device 120, depending on the implementation, to instantiate an instance of the object and render the object in an appropriate manner for the user to experience the user device.

[0017] Programmers who develop and / or create the digital world create or define the objects and the conditions under which they are instantiated. However, the digital world may allow others to create or modify the objects. Once an object is instantiated, the state of the object may be permitted to be changed, controlled, or manipulated by one or more users experiencing the digital world.

[0018] For example, in one embodiment, the development, production, and management of the digital world is generally provided by one or more system administration programmers. In some embodiments, this may include the development, design, and / or execution of storylines, themes, and events in the digital world, as well as the delivery of discourse through various forms of events and media, such as, for example, film, digital, networked, mobile, augmented reality, and live entertainment. System administration programmers may also handle the technical management, discussion management, and curation of the digital world and its associated user communities, as well as other tasks typically performed by network administration personnel.

[0019] A user interacts with one or more digital worlds using some type of local computing device, generally designated as a user device 120. Examples of such user devices include, but are not limited to, a smartphone, a tablet device, a heads-up display (HUD), a gaming console, or any other device capable of communicating data and providing an interface or display to a user, or a combination of such devices. In some embodiments, user device 120 may include or communicate with local peripheral or input / output components, such as, for example, a keyboard, a mouse, a joystick, a game controller, a haptic interface device, a motion capture controller, audio equipment, voice equipment, a projector system, a 3D display, and holographic 3D contact lenses.

[0020] An example of a user device 120 for interacting with the system 100 is illustrated in Figure 2. In the exemplary embodiment shown in Figure 2, a user 210 may interact with one or more digital worlds through a smartphone 220. The gateway is implemented by a software application 230 stored and executing on the smartphone 220. In this particular example, the data network 130 includes a wireless mobile network that connects the user device (i.e., smartphone 220) to the computer network 105.

[0021] In one implementation of a preferred embodiment, the system 100 is capable of supporting a large number of concurrent users (e.g., millions of users) each interacting with the same digital world or with multiple digital worlds using some type of user device 120.

[0022] The user device provides the user with an interface to enable visual, audible, and / or physical interaction between the user and the digital world generated by the server 110, including other users and objects (real or virtual) presented to the user. The interface provides the user with rendered views that can be seen, heard, or otherwise sensed, and the ability to interact with the views in real time. The manner in which the user interacts with the rendered views may be dictated by the capabilities of the user device. For example, if the user device is a smartphone, user interaction may be implemented by the user touching a touch screen. In another example, if the user device is a computer or gaming console, user interaction may be implemented using a keyboard or game controller. The user device may include additional components that enable user interaction, such as sensors, and objects and information (including gestures) detected by the sensors may be provided as input describing the user interaction with the virtual world using the user device.

[0023] The rendered views can be presented in a variety of formats, such as, for example, two-dimensional or three-dimensional visual displays (including projections), sound, and haptic or tactile feedback. The rendered views may be interacted with by the user in one or more modes, including, for example, augmented reality, virtual reality, and combinations thereof. The format of the rendered views, as well as the interface modes, may be dictated by one or more of the user device, data processing capabilities, user device connectivity, network capabilities, and system workload. Having multiple users simultaneously interacting with the digital world, and the real-time nature of the data exchange, is made possible by the computing network 105, the server 110, the gateway component 140 (optionally), and the user devices 120.

[0024] In one example, the computing network 105 is comprised of a large-scale computing system having single and / or multi-core servers (i.e., servers 110) connected via high-speed connections (e.g., high-bandwidth interfaces 115). The computing network 105 may form a cloud or grid network. Each of the servers includes memory and is coupled with computer-readable memory for storing software for implementing data to create, design, modify, or process objects in the digital world. These objects and their instantiations may be dynamic, coming into existence and going out of existence, changing over time, and changing in response to other conditions. Examples of dynamic capabilities of objects are generally discussed herein with respect to various embodiments. In some embodiments, each user interacting with the system 100 may also be represented as an object and / or collection of objects within one or more digital worlds.

[0025] The servers 110 in the computing network 105 also store computational state data for each of the digital worlds. The computational state data (also referred to herein as state data) may be a component of the object data and generally defines the state of an instance of an object at a given instance in time. Thus, the computational state data may change over time and may be affected by the actions of one or more users and / or programmers who maintain the system 100. When a user affects the computational state data (or other data that comprises the digital world), the user directly modifies or otherwise manipulates the digital world. If the digital world is shared or interacted with by other users, the user's actions may affect what is experienced by other users interacting with the digital world. Thus, in some embodiments, changes made to the digital world by a user will be experienced by other users interacting with the system 100.

[0026] Data stored on one or more servers 110 in the computing network 105 is transmitted or deployed, in one embodiment, at high speed and with low latency to one or more user devices 120 and / or gateway components 140. In one embodiment, the object data shared by the server may be complete or may be compressed and contain instructions to recreate the complete object data at the user's end, and may be rendered and visualized by the user's local computing device (e.g., gateway 140 and / or user device 120). Software executing on the server 110 of the computing network 105 may, in some embodiments, adapt the data it generates and sends to a particular user's device 120 for objects in the digital world (or any other data exchanged by the computing network 105) as a function of the user's particular device and bandwidth. For example, as a user interacts with the digital world through a user device 120, the server 110 may recognize the particular type of device being used by the user, the device's connectivity and / or the available bandwidth between the user device and the server, and appropriately determine and balance the size of the data being delivered to the device to optimize the user interaction. An example of this may include reducing the size of the transmitted data to a lower resolution quality so that the data may be displayed on a particular user device having a lower resolution display. In a preferred embodiment, the computing network 105 and / or gateway component 140 delivers data to the user device 120 at a rate sufficient to present an interface that operates at 15 frames per second or greater and with a data resolution that is higher than or equal to high resolution quality.

[0027] The gateway 140 provides a local connection to the computing network 105 for one or more users. In some embodiments, it may be implemented by a downloadable software application running on the user device 120 or another local device such as that shown in FIG. 2. In other embodiments, it may be implemented by a hardware component (a component having a processor, with appropriate software / firmware stored on the component) in communication with the user device 120 but either not incorporated or attached thereto or incorporated with the user device 120. The gateway 140 communicates with the computing network 105 via the data network 130 and provides data exchange between the computing network 105 and one or more local user devices 120. As discussed in more detail below, the gateway component 140 may include software, firmware, memory, and processing circuitry and may be capable of processing data communicated between the network 105 and one or more local user devices 120.

[0028] In some embodiments, the gateway component 140 monitors and adjusts the rate at which data is exchanged between the user device 120 and the computer network 105 to enable optimal data throughput for a particular user device 120. For example, in some embodiments, the gateway 140 buffers and downloads both static and dynamic aspects of the digital world, even beyond the field of view presented to the user through an interface connected to the user device. In such embodiments, instances of static objects (structured data, software-implemented methods, or both) may be stored in memory (local to the gateway component 140, the user device 120, or both) and are referenced to the local user's current location as indicated by data provided by the computing network 105 and / or the user's device 120. Instances of dynamic objects, which may include, for example, intelligent software agents and objects controlled by other users and / or the local user, are stored in a high-speed memory buffer. Dynamic objects, describing two- or three-dimensional objects within the view presented to the user, can be categorized into component shapes, such as, for example, static shapes that move but do not change, and dynamic shapes that change. The portions of the dynamic objects that are changing can be updated by a real-time thread high priority data stream from the server 110 through the computing network 105 managed by the gateway component 140. As an example of a priority thread data stream, data that is within the 60 degree field of view of the user's eye may be given higher priority than data that is more peripheral. Another example includes prioritizing dynamic characters and / or objects within the user's field of view over static objects in the background.

[0029] In addition to managing the data connection between the computing network 105 and the user device 120, the gateway component 140 may store and / or process data that may be presented to the user device 120. For example, the gateway component 140 may in some embodiments receive compressed data from the computing network 105, e.g., describing graphical objects to be rendered for viewing by a user, and perform advanced rendering techniques to reduce the data load transmitted from the computing network 105 to the user device 120. In another example where the gateway 140 is a separate device, the gateway 140 may store and / or process data for local instances of objects, rather than communicating the data to the computing network 105 for processing.

[0030] Referring now also to FIG. 3, the digital world may be experienced by one or more users in various forms that may depend on the capabilities of the user's device. In some embodiments, the user device 120 may include, for example, a smartphone, a tablet device, a head-up display (HUD), a gaming console, or a wearable device. In general, the user device will include a processor for executing program code stored in memory on the device, coupled with a display, and a communication interface. An exemplary embodiment of a user device is illustrated in FIG. 3, which includes a mobile wearable device, i.e., a head-mounted display system 300. According to an embodiment of the present disclosure, the head-mounted display system 300 includes a user interface 302, a user sensing system 304, an environmental sensing system 306, and a processor 308. Although the processor 308 is shown in FIG. 3 as a separate and distinct component from the head-mounted system 300 in alternative embodiments, the processor 308 may be integrated with one or more components of the head-mounted system 300 or may be incorporated into other system 100 components, such as, for example, the gateway 140.

[0031] The user device presents the user with an interface 302 for interacting with and experiencing the digital world. Such interactions may involve the user and the digital world, one or more other users interacting with the system 100, and objects within the digital world. The interface 302 generally provides visual and / or audio sensory input (and in some embodiments physical sensory input) to the user. Thus, the interface 302 may include a speaker (not shown) and, in some embodiments, a display component 303 capable of enabling stereoscopic 3D viewing and / or 3D viewing that embodies more natural properties of the human visual system. In some embodiments, the display component 303 may comprise a transparent interface (such as a transparent OLED) that, when in an "off" setting, enables an optically correct view of the user's surrounding physical environment with little to no optical distortion or computing overlay. As discussed in more detail below, the interface 302 may include additional settings that enable various visual / interface capabilities and functionality.

[0032] The user sensing system 304, in some embodiments, may include one or more sensors 310 operable to detect certain characteristics, properties, or information relating to an individual user wearing the system 300. For example, in some embodiments, the sensors 310 may include a camera or optical detection / scanning circuitry capable of detecting real-time optical properties / measurements of the user, such as, for example, one or more of pupil constriction / dilation, angular measurement / positioning of each pupil, sphericity, eye shape (as eye shape changes over time), and other anatomical data. This data may provide information (e.g., the user's visual focus) or may be used to calculate information that may be used by the head-mounted system 300 and / or the interface system 100 to optimize the user's viewing experience. For example, in one embodiment, the sensors 310 may each measure the pupil constriction rate of each of the user's eyes. This data may be transmitted to the processor 308 (or to the gateway component 140 or to the server 110), and the data may be used to determine the user's reaction to, for example, the brightness setting of the interface display 303. The interface 302 may be adjusted according to the user's response, for example, by dimming the display 303 if the user's response indicates that the brightness level of the display 303 is too high. The user sensing system 304 may include other components than those discussed above or illustrated in FIG. 3. For example, in some embodiments, the user sensing system 304 may include a microphone for receiving audio input from the user. The user sensing system may also include one or more infrared camera sensors, one or more visible spectrum camera sensors, structured light emitters and / or sensors, infrared light emitters, coherent light emitters and / or sensors, gyros, accelerometers, magnetometers, proximity sensors, GPS sensors, ultrasonic emitters and detectors, and a haptic interface.

[0033] The environmental sensing system 306 includes one or more sensors 312 for acquiring data from the physical environment around the user. Objects or information detected by the sensors may be provided as input to the user device. In some embodiments, this input may represent user interaction with the virtual world. For example, a user viewing a virtual keyboard on a desk may use gestures with their fingers as if they were typing on the virtual keyboard. The motion of the moving fingers may be captured by the sensors 312 and provided to the user device or system as input, which may be used to change the virtual world or to create new virtual objects. For example, the finger motions may be recognized (using a software program) as typing, and the recognized typing gestures may be combined with known locations of virtual keys on the virtual keyboard. The system may then render a virtual monitor that is displayed to the user (or other users interacting with the system), which displays the text being typed by the user.

[0034] The sensor 312 may include, for example, a generally outward-facing camera or a scanner for interpreting sight information, for example, through continuously and / or intermittently projected infrared structured light. The environmental sensing system 306 may be used to map one or more elements of the user's surrounding physical environment by detecting and registering the local environment, including static objects, dynamic objects, people, gestures, and various lighting, atmospheric, and acoustic conditions. Thus, in some embodiments, the environmental sensing system 306 may include image-based 3D reconstruction software incorporated into a local computing system (e.g., the gateway component 140 or the processor 308) and operable to digitally reconstruct one or more objects or information detected by the sensor 312. In one exemplary embodiment, the environmental sensing system 306 provides one or more of motion capture data (including gesture recognition), depth sensing, face recognition, object recognition, unique object feature recognition, voice / audio recognition and processing, sound source localization, noise reduction, infrared or similar laser projection, as well as monochrome and / or color CMOS sensors (or other similar sensors), field of view sensors, and various other light-enhancing sensors. It should be understood that the environmental sensing system 306 may include other components than those discussed above or illustrated in FIG. 3. For example, in some embodiments, the environmental sensing system 306 may include a microphone for receiving audio from the local environment. The user sensing system may also include one or more infrared camera sensors, one or more visible spectrum camera sensors, structured light emitters and / or sensors, coherent light emitters and / or sensors, gyros, infrared light emitters, accelerometers, magnetometers, proximity sensors, GPS sensors, ultrasonic emitters and detectors, and haptic interfaces.

[0035] As mentioned above, the processor 308 may in some embodiments be integrated with other components of the head-mounted system 300, integrated with other components of the interface system 100, or may be a stand-alone device (wearable or separate from the user) as shown in FIG. 3. The processor 308 may be connected to various components of the head-mounted system 300 and / or components of the interface system 100 through a physical wired connection or through a wireless connection such as, for example, a mobile network connection (including cellular and data networks), Wi-Fi, or Bluetooth. The processor 308 may include memory modules, integrated and / or additional graphics processing units, wireless and / or wired Internet connectivity, and codecs and / or firmware capable of converting data from a source (e.g., the computing network 105, the user sensing system 304, the environmental sensing system 306, or the gateway component 140) into image and audio data, and the images / video and audio may be presented to the user via the interface 302.

[0036] The processor 308 handles data processing for the various components of the head-mounted system 300, as well as data exchange between the head-mounted system 300 and the gateway component 140, and in some embodiments the computing network 105. For example, the processor 308 may be used to buffer and process data streaming between the user and the computing network 105, thereby enabling a smooth, continuous, and high fidelity user experience. In some embodiments, the processor 308 may process data at a rate sufficient to achieve anywhere between 8 frames / second at 320×240 resolution to 24 frames / second at high resolution (1280×720), or even more, such as 60-120 frames / second and 4k resolution or higher (10k+ resolution and 50,000 frames / second). Additionally, the processor 308 may store and / or process data that may be presented to the user, rather than being streamed in real-time from the computing network 105. For example, the processor 308, in some embodiments, may receive compressed data from the computing network 105 and perform advanced rendering techniques (such as shading or shading) to reduce the data load transmitted from the computing network 105 to the user device 120. In another example, the processor 308 may store and / or process local object data rather than transmitting the data to the gateway component 140 or to the computing network 105.

[0037] The head-mounted system 300 may, in some embodiments, include various settings or modes that enable various visual / interface capabilities and functionality. The modes may be selected manually by the user or automatically by the components of the head-mounted system 300 or the gateway component 140. As mentioned above, one embodiment of the head-mounted system 300 includes an "off" mode in which the interface 302 does not provide substantially any digital or virtual content. In the off mode, the display component 303 may be transparent, thereby enabling an optically correct view of the user's surrounding physical environment with little to no optical distortion or computing overlay.

[0038] In one exemplary embodiment, the head-mounted system 300 includes an "augmented" mode in which the interface 302 provides an augmented reality interface. In the augmented mode, the interface display 303 may be substantially transparent, thereby allowing the user to view the local physical environment. At the same time, virtual object data provided by the computing network 105, the processor 308, and / or the gateway component 140 is presented on the display 303 in combination with the local physical environment.

[0039] 4 illustrates an example embodiment of objects viewed by a user when the interface 302 is operating in an augmented mode. As shown in FIG. 4, the interface 302 presents a physical object 402 and a virtual object 404. In the embodiment illustrated in FIG. 4, the physical object 402 is an actual physical object present in the user's local environment, while the virtual object 404 is an object created by the system 100 and displayed via the user interface 302. In some embodiments, the virtual object 404 may be displayed at a fixed position or location within the physical environment (e.g., a virtual monkey standing next to a particular road sign located in the physical environment) or may be displayed to the user as an object located at a position relative to the user interface / display 303 (e.g., a virtual clock or thermometer visible in the top left corner of the display 303).

[0040] In some embodiments, the virtual object may be cued from or triggered by an object that is physically present within or outside the user's field of view. The virtual object 404 is cued from or triggered by the physical object 402. For example, the physical object 402 may actually be a stool, and the virtual object 404 may be displayed to the user (and in some embodiments to other users interacting with the system 100) as a virtual animal standing on the stool. In such an embodiment, the environmental sensing system 306 may use software and / or firmware stored, for example, in the processor 308, to recognize various features and / or shape patterns (captured by the sensor 312) that identify the physical object 402 as a stool. These recognized shape patterns, such as the top of the stool, may be used to trigger the placement of the virtual object 404. Other examples include walls, tables, furniture, cars, buildings, people, floors, plants, animals, and any object that can be seen may be used to trigger an augmented reality experience in some relationship with one or more objects.

[0041] In some embodiments, the particular virtual object 404 that is triggered may be selected by a user or may be selected automatically by other components of the head-mounted system 300 or the interface system 100. Additionally, in embodiments in which a virtual object 404 is automatically triggered, the particular virtual object 404 may be selected based on the particular physical object 402 (or characteristics thereof) from which the virtual object 404 is cued or triggered. For example, if the physical object is identified as a diving board extending over a pool, the triggered virtual object may be a living being wearing a snorkel, swimsuit, flotation device, or other related item.

[0042] In another exemplary embodiment, the head-mounted system 300 may include a "virtual" mode in which the interface 302 provides a virtual reality interface. In the virtual mode, the physical environment is omitted from the display 303, and virtual object data provided by the computing network 105, the processor 308, and / or the gateway component 140 is presented on the display 303. Omission of the physical environment may be achieved by physically blocking the visual display 303 (e.g., via a cover) or through a feature of the interface 302 in which the display 303 transitions to an opaque setting. In the virtual mode, live and / or stored visual and audio sensations may be presented to the user through the interface 302, and the user experiences and interacts with the digital world (digital objects, other users, etc.) through the virtual mode of the interface 302. Thus, the interface presented to the user in the virtual mode is composed of virtual object data, including the virtual digital world.

[0043] Figure 5 illustrates an example embodiment of a user interface when the head-mounted interface 302 is operating in a virtual mode. As shown in Figure 5, the user interface presents a virtual world 500 composed of digital objects 510, which may include atmosphere, weather, terrain, structures, and people. Although not shown in Figure 5, the digital objects may also include, for example, plants, vehicles, animals, creatures, machines, artificial intelligence, location information, and any other objects or information that define the virtual world 500.

[0044] In another exemplary embodiment, the head-mounted system 300 may include a "mixed" mode, where various features of the head-mounted system 300 (as well as features of the virtual and augmented modes) may be combined to create one or more custom interface modes. In one example custom interface mode, the physical environment is omitted from the display 303, and virtual object data is presented on the display 303 in a manner similar to the virtual mode. However, in this example custom interface mode, the virtual objects may be fully virtual (i.e., they do not exist in the local physical environment), or they may be actual local physical objects that are rendered as virtual objects in the interface 302 instead of physical objects. Thus, in a particular custom mode (referred to herein as a mixed virtual interface mode), live and / or stored visual and audio sensations may be presented to the user through the interface 302, where the user experiences and interacts with a digital world that includes fully virtual objects and rendered physical objects.

[0045] FIG. 6 illustrates an exemplary embodiment of a user interface operating according to a mixed virtual interface mode. As shown in FIG. 6, the user interface presents a virtual world 600 composed of full virtual objects 610 and rendered physical objects 620 (renderings of objects that are otherwise physically present in the scene). According to the example illustrated in FIG. 6, the rendered physical objects 620 include a building 620A, a ground 620B, and a platform 620C, and are shown with a thick outline 630 to indicate to the user that the objects are rendered. In addition, the full virtual objects 610 include an additional user 610A, a cloud 610B, a sun 610C, and a flame 610D above the platform 620C. It should be understood that the full virtual objects 610 may include, for example, atmosphere, weather, terrain, buildings, people, plants, vehicles, animals, creatures, machines, artificial intelligence, location information, and any other objects or information that define the virtual world 600 and that are not rendered from objects present in the local physical environment. Conversely, rendered physical object 620 is an actual local physical object that is rendered as a virtual object in interface 302. Thick outline 630 describes one embodiment for presenting the rendered physical object to a user. As such, the rendered physical object may be presented using methods other than those disclosed herein, etc.

[0046] In some embodiments, the rendered physical objects 620 may be detected using the sensors 312 of the environment sensing system 306 (or using other devices such as a motion or image capture system) and converted into digital object data, for example, by software and / or firmware stored in the processing circuitry 308. Thus, as a user interacts with the system 100 in a mixed virtual interface mode, various physical objects may be displayed to the user as rendered physical objects. This may be particularly useful for allowing the user to interact with the system 100 while still being able to safely navigate the local physical environment. In some embodiments, the user may be able to selectively remove or add rendered physical objects to the interface display 303.

[0047] In another example custom interface mode, the interface display 303 may be substantially transparent, thereby allowing the user to view the local physical environment while various local physical objects are displayed to the user as rendered physical objects. This example custom interface mode is similar to the augmented mode, except that one or more of the virtual objects may be rendered physical objects, as discussed above with respect to the previous example.

[0048] The foregoing custom interface mode examples describe some example embodiments of various custom interface modes that can be provided by the mixed mode of head-mounted system 300. Thus, various other custom interface modes may be created from various combinations of the features and functionality provided by the components of head-mounted system 300 and the various modes discussed above without departing from the scope of this disclosure.

[0049] The embodiments discussed herein merely illustrate some examples for providing interfaces that operate in off, augmented, virtual, or mixed modes, and are not intended to limit the scope or content of each interface mode or the functionality of the components of head-mounted system 300. For example, in some embodiments, virtual objects may include data displayed to a user (time, temperature, altitude, etc.), objects created and / or selected by system 100, objects created and / or selected by a user, or even objects describing other users interacting with system 100. In addition, virtual objects may include augmentations of physical objects (e.g., virtual figures growing out of a physical platform) and may be visually connected to or disconnected from physical objects.

[0050] Virtual objects may also be dynamic, changing over time, changing according to various relationships (e.g., location, distance, etc.) between the user or other users, physical objects, and other virtual objects, and / or changing according to other variables specified in the software and / or firmware of the head-mounted system 300, the gateway component 140, or the server 110. For example, in an embodiment, a virtual object may respond to a user device or its components (e.g., a virtual ball moves when a haptic device is placed next to it), physical or verbal user interactions (e.g., a virtual creature runs away when a user approaches it or speaks when a user talks to it), a chair being thrown at a virtual creature and the creature avoids the chair, other virtual objects (e.g., a first virtual creature reacts when it sees a second virtual creature), physical variables such as location, distance, temperature, time, or other physical objects in the user's environment (e.g., a virtual creature shown standing on a physical road becomes flattened when a physical car passes by).

[0051] The various modes discussed herein may be applied to user devices other than the head-mounted system 300. For example, an augmented reality interface may be provided via a mobile phone or tablet device. In such an embodiment, the phone or tablet may use a camera to capture the physical environment around the user, and virtual objects may be overlaid on the phone / tablet display screen. In addition, virtual modes may be provided by displaying a digital world on the phone / tablet display screen. Thus, these modes may be mixed to create various custom interface modes as described above using the phone / tablet components discussed herein, as well as other components connected to or used in combination with the user device. For example, mixed virtual interface modes may be provided by a computer monitor, television screen, or a device lacking a camera operating in combination with a motion or image capture system. In this exemplary embodiment, the virtual world may be viewed from the monitor / screen and object detection and rendering may be performed by the motion or image capture system.

[0052] 7 illustrates an exemplary embodiment of the present invention in which two users located at different geographic locations each interact with the other user and a common virtual world through their respective user devices. In this embodiment, two users 701 and 702 are tossing a virtual ball 703 (a type of virtual object) back and forth, and each user is able to observe the other user's influence on the virtual world (e.g., each user observes the virtual ball change direction, be caught by the other user, etc.). Because the movement and location of the virtual object (i.e., virtual ball 703) is tracked by server 110 in computing network 105, system 100 may, in some embodiments, communicate to users 701 and 702 the exact location and timing of the arrival of ball 703 to each user. For example, if a first user 701 is located in London, user 701 may throw ball 703 to a second user 702 located in Los Angeles at a speed calculated by system 100. Thus, the system 100 may communicate (e.g., via email, text message, instant message, etc.) the exact time and location of the ball's arrival to the second user 702. In this way, the second user 702 may use his device to know that the ball 703 will arrive at a particular time and location. One or more users may also use geolocation mapping software (or the like) to track one or more virtual objects as they virtually travel the globe. An example of this may be a user wearing a 3D head-mounted display looking up into the sky and seeing a virtual airplane flying overhead, superimposed on the real world. The virtual airplane may be flown by the user, either by an intelligent software agent (software running on the user device or a gateway), by other users, which may be locally and / or remotely, and / or a combination of these.

[0053] As previously mentioned, the user device may include a haptic interface device that provides feedback (e.g., resistance, vibration, light, sound, etc.) to the user when the haptic device is determined by the system 100 to be located at a physical spatial location relative to the virtual object. For example, the embodiment described above with respect to FIG. 7 may be augmented to include the use of a haptic device 802, as shown in FIG. 8. In this exemplary embodiment, the haptic device 802 may be displayed in the virtual world as a baseball bat. When the ball 703 arrives, the user 702 may swing the haptic device 802 toward the virtual ball 703. If the system 100 determines that the virtual bat provided by the haptic device 802 has "made contact" with the ball 703, the haptic device 802 may vibrate or provide other feedback to the user 702, and the virtual ball 703 may bounce off the virtual bat in a direction calculated by the system 100 according to the detected speed, direction, and timing of the contact between the ball and the bat.

[0054] The disclosed system 100, in some embodiments, may facilitate mixed-mode interaction, where multiple users may interact with a common virtual world (and the virtual objects contained therein) using different interface modes (e.g., augmented, virtual, mixed, etc.). For example, a first user who interacts with a particular virtual world in a virtual interface mode may interact with a second user who interacts with the same virtual world in an augmented reality mode.

[0055] 9A illustrates an example in which a first user 901 (interacting with the digital world of the system 100 in a mixed virtual interface mode) and a first object 902 appear as virtual objects to a second user 922 interacting with the same digital world of the system 100 in a full virtual reality mode. As described above, when interacting with the digital world via the mixed virtual interface mode, local physical objects (e.g., the first user 901 and the first object 902) may be scanned and rendered as virtual objects in the virtual world. The first user 901 may be scanned, for example, by a motion capture system or similar device and rendered in the virtual world (by software / firmware stored in the motion capture system, the gateway component 140, the user device 120, the system server 110, or other devices) as a first rendered physical object 931. Similarly, the first object 902 may be scanned, for example, by the environmental sensing system 306 of the head-mounted interface 300 and rendered in the virtual world (by software / firmware stored in the processor 308, the gateway component 140, the system server 110, or other device) as a second rendered physical object 932. The first user 901 and the first object 902 are shown in the first portion 910 of FIG. 9A as physical objects in the physical world. In the second portion 920 of FIG. 9A, the first user 901 and the first object 902 are shown as a first rendered physical object 931 and a second rendered physical object 932 as they appear to a second user 922 interacting with the same digital world of the system 100 in full virtual reality mode.

[0056] FIG. 9B illustrates another exemplary embodiment of mixed mode interaction in which a first user 901 is interacting with a digital world in a mixed virtual interface mode, as discussed above, and a second user 922 is interacting with the same digital world (and the second user's local physical environment 925) in an augmented reality mode. In the embodiment of FIG. 9B, the first user 901 and the first object 902 are located at a first physical location 915, and the second user 922 is located at a different second physical location 925 separated by some distance from the first location 915. In this embodiment, the virtual objects 931 and 932 may be transposed in real time (or near real time) to a location in the virtual world that corresponds to the second location 925. Thus, the second user 922 may observe and interact with rendered physical objects 931 and 932 that describe the first user 901 and the first object 902, respectively, in the second user's local physical environment 925.

[0057] FIG. 10 illustrates an example of an illustration of a user's field of view when interacting with the system 100 in an augmented reality mode. As shown in FIG. 10, the user sees a local physical environment (i.e., a city with multiple buildings) and a virtual character 1010 (i.e., a virtual object). The location of the virtual character 1010 may be triggered by one or more 3D reference frames, such as 2D visual targets (e.g., billboards, postcards, or magazines) and / or buildings, cars, people, animals, airplanes, parts of buildings, and / or 3D physical objects, virtual objects, and / or combinations thereof. In the example illustrated in FIG. 10, known locations of buildings in the city may provide alignment references and / or information and key features for rendering the virtual character 1010. Additionally, the user's geospatial location (e.g., provided by GPS, attitude / position sensors, etc.) or movement location relative to the buildings may include data used by the computing network 105 to trigger transmission of data used to display the virtual character 1010. In some embodiments, the data used to display the virtual character 1010 may include a rendered character 1010 and / or instructions (executed by the gateway component 140 and / or the user device 120) for rendering the virtual character 1010 or portions thereof. In some embodiments, if the user's geo-spatial location is unavailable or unknown, the server 110, the gateway component 140, and / or the user device 120 may still display the virtual object 1010 using an estimation algorithm that uses the user's last known location as a function of time and / or other parameters to estimate where certain virtual and / or physical objects may be located. This may also be used to determine the location of any virtual objects in the event that the user's sensors become occluded and / or experience other malfunctions.

[0058] In some embodiments, the virtual character or virtual object may comprise a virtual figurine, and the rendering of the virtual figurine is triggered by a physical object. For example, referring now to FIG. 11, a virtual figurine 1110 may be triggered by an actual physical platform 1120. The triggering of the figurine 1110 may be in response to a visual object or feature (e.g., a fiducial, a design feature, a geometric shape, a pattern, a physical location, an elevation, etc.) detected by a user device or other component of the system 100. When a user views the platform 1120 without a user device, the user sees the platform 1120 without the figurine 1110. However, when a user views the platform 1120 via a user device, the user sees the figurine 1110 on the platform 1120, as shown in FIG. 11. The figurine 1110 is a virtual object and therefore may be stationary, active, change over time or relative to the user's viewing position, or even change depending on which particular user is viewing the figurine 1110. For example, if the user is a small child, the statue may be a dog, whereas if the viewer is an adult male, the statue may be a large robot as shown in FIG. 11. These are examples of user-dependent and state-dependent experiences. This would allow one or more users to perceive one or more virtual objects, alone and / or in combination with physical objects, and experience customized and personalized versions of the virtual objects. The statue 1110 (or portions thereof) may be rendered by various components of the system, including, for example, software / firmware installed on the user device. Using data indicative of the position and pose of the user device in combination with the alignment features of the virtual object (i.e., statue 1110), the virtual object (i.e., statue 1110) forms a relationship with the physical object (i.e., platform 1120).For example, the relationship between one or more virtual objects and one or more physical objects may be a function of distance, positioning, time, geolocation, proximity to one or more other virtual objects, and / or any other functional relationship including any type of virtual and / or physical data. In some embodiments, image recognition software in the user device may further enhance the relationship from the digital object to the physical object.

[0059] The interactive interfaces provided by the disclosed systems and methods may be implemented to facilitate a variety of activities, such as, for example, interacting with one or more virtual environments and objects, interacting with other users, and experiencing various forms of media content, including advertisements, musical concerts, and movies. However, the disclosed systems facilitate user interaction such that users do not merely watch or listen to media content, but rather actively participate in and experience the media content. In some embodiments, user participation may include modifying existing content or creating new content that is rendered in one or more virtual worlds. In some embodiments, the media content, and / or users creating content, may theme the creation of one or more virtual worlds.

[0060] In one embodiment, a musician (or other user) may create musical content that is rendered to users interacting with a particular virtual world. The musical content may include, for example, various singles, EPs, albums, videos, short films, and concert performances. In one embodiment, multiple users may interact with system 100 to simultaneously experience a virtual concert performed by a musician.

[0061] In some embodiments, produced media may contain a unique identifier code associated with a particular entity (e.g., a band, artist, user, etc.). The code may be in the form of a set of alphanumeric characters, a UPC code, a QR code, a 2D image trigger, a 3D physical object feature trigger, or other digital mark, as well as sound, image, and / or both. In some embodiments, the code may also be embedded in digital media that may be interacted with using system 100. A user may obtain a code (e.g., via payment of a fee) and redeem the code to access media content produced by the entity associated with the identifier code. Media content may be added or removed from the user's interface.

[0062] The embodiments disclosed herein are provided to illustrate one or more examples of methods and apparatus for enabling interactive virtual or augmented reality environments for multiple users. As such, modifications of the methods and apparatus disclosed herein may be made without departing from the scope of the present disclosure as set forth in the claims provided below. For example, although various examples and embodiments are discussed herein with respect to head-mounted display systems, the various examples and embodiments may also be applied to other user devices capable of providing the interfaces or capabilities discussed with respect to these particular embodiments.

Claims

1. A method for enabling one or more users to interact with a virtual world, said method comprising: attaching a structure of the wearable user device to a body part of the person; using processing circuitry of the wearable user device to execute software stored in memory to render at least a portion of the virtual world from virtual world data received at least in part from a computer network; displaying the virtual world to the user using a display of the wearable user device; communicating at least a portion of the virtual world data over a computer network using a communication interface of the wearable user device; sensing at least one of the user, physical objects, or a physical environment surrounding the user with a sensing system of the wearable user device, the sensing system including a camera positioned to detect an angle measurement of a pupil of the user's eye; using a gateway connecting the wearable user device to the computer network, monitoring and regulating the rate of data exchange between the wearable user device and the computer network to enable optimal data throughput for the wearable user device by determining whether a rendered object is a dynamic object or a static object, determining whether the rendered object is within a field of view of the user's pupil having less than 60 degrees, and prioritizing dynamic objects or objects within the field of view over static objects or objects not within the field of view; Including, The method, wherein the processing circuitry is operable to execute the software to render changes in the virtual world in response to at least one of the sensed user, the sensed physical object, and the sensed physical environment.

2. The method of claim 1, wherein the change in the virtual world comprises a virtual object, the virtual object having a predetermined relationship with the sensed user, physical object, or physical environment.

3. The method described in claim 2, wherein the communication interface is operable to communicate the virtual object to the computer network.

4. The method of claim 1, wherein the virtual world is presented in at least one of a two-dimensional format or a three-dimensional format.

5. The method of claim 1, wherein the wearable user device enables interaction in at least one of an augmented reality mode, a virtual reality mode, or a combination of an augmented reality mode and a virtual reality mode.

6. The method of claim 1, wherein the wearable user device further comprises a device for providing tactile or tactile feedback.

7. The method of claim 1, wherein at least a portion of the virtual world data is communicated between a gateway.

8. The method of claim 1, wherein the computer network comprises one or more computer servers, the one or more computer servers comprising memory, processing circuitry, and software stored in the memory and executable by the processing circuitry to process at least a portion of the virtual world data, and the computer network is operable to transmit the virtual world data to a wearable user device for presentation to a first user.

9. The method described in claim 8, wherein the sensing system is an environmental sensing system coupled to the wearable user device configured to acquire data from the physical environment surrounding the user.

10. The method described in claim 9, wherein the environmental sensing system detects predetermined characteristics of static physical objects external to the user.

11. The method described in claim 10, wherein at least one computer server of the computer network receives data from the environmental sensing system to trigger transmission of the virtual world data to the wearable user device.

12. The method of claim 1, wherein the system is configured so that at least a portion of the virtual world changes in response to changes in the virtual world data.

13. The method of claim 12, wherein in addition to changing the virtual world in response to changes in the virtual world data, at least a portion of the virtual world data is changed in response to a static physical object external to the user and sensed by the wearable user device.

14. The method described in claim 13, wherein the static physical objects external to the user include mapped objects in the physical environment near the user.

15. The method described in claim 12, wherein the change in the virtual world data represents rendering at least one of a dynamic virtual object and a static virtual object based on a static physical object external to the user according to a predetermined relationship.

16. The method described in claim 1, wherein the changes in the virtual world data are presented to a second user device for presentation to a second user according to a predetermined relationship.

17. The method of claim 1, wherein the virtual world is operable to be rendered by at least one computer server of the computer network or the wearable user device.

18. The method of claim 1, wherein the virtual world is presented in at least one of a two-dimensional format or a three-dimensional format.

19. The method of claim 1, wherein the wearable user device is operable to provide an interface to enable interaction between a user and the virtual world in at least one of an augmented reality mode, a virtual reality mode, or a combination of an augmented reality mode and a virtual reality mode.

20. The method described in claim 1, wherein the structure that can be attached to a human body part is configured to be a head-mounted structure.

Images