Systems and methods for dynamically loading area-based augmented reality content

Abstract

To provide augmented reality systems and methods for dynamically loading area-based augmented reality content.SOLUTION: An augmented reality device receives beacon signals within a geographical area from beacons, and sends beacon-related signals indicative of the beacon signals to an augmented reality content management server. The augmented reality content management server determines the area of the augmented reality device, determines markers within the area, and sends marker signals and augmented reality content associated with the markers to the augmented reality device. The augmented reality device scans the area and outputs content associated with a marker. As the augmented reality device enters subsequent areas, it receives additional beacon signals, sends additional beacon-related signals, and receives additional marker signals and content. If there is insufficient storage space on the device to store the additional marker signals and content, the device deletes previous marker signals and associated content.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] (CROSS-REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Application Serial No. 62 / 843,968, filed May 6, 2010, entitled "System and Method for Dynamically Loading Region-Based Augmented Reality Content," which is incorporated herein by reference in its entirety.

[0002] (Technical field) The present disclosure relates generally to augmented reality, and more particularly to dynamically loading region-based augmented reality content based on localization information (e.g., a spatial image or a set of visual markers). [Background technology]

[0003] This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described and / or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. As such, it should be understood that these statements are to be read in this light, and not as admissions of prior art.

[0004] Augmented reality devices can include, for example, headwear or eyewear that overlays computer-generated content (e.g., images (including real-time rendered images and / or three-dimensional representations or objects), audio data, haptic data, and the like) with a real-world environment. Augmented reality devices can identify visual markers in the real-world environment, for example, using a camera, and output augmented reality content corresponding to the visual markers, such that the desired augmented reality content is output to a destination space. However, due to the size of the visual markers and augmented reality content, augmented reality devices may only be able to store enough visual markers and augmented reality content to provide an augmented reality experience in a limited space (e.g., an augmented reality experience for up to two or three rooms in a home). It is now recognized that systems and methods for providing augmented reality over larger or wider areas are desirable. Summary of the Invention

[0005] Certain embodiments within the scope of the originally claimed invention are summarized below. These embodiments are not intended to limit the scope of the disclosure; rather, these embodiments are intended merely to provide a brief summary of certain disclosed embodiments. Indeed, the disclosure may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

[0006] In particular, in one embodiment, the augmented reality system includes a beacon that transmits a beacon signal to an augmented reality device located within the geographic region. The augmented reality system also includes an augmented reality content management server that receives a beacon-related signal from the augmented reality device, determines a marker and augmented reality content associated with the marker based in part on the beacon-related signal, and transmits a marker signal indicative of the marker and the augmented reality content to the augmented reality device. The marker (which may be one of a set of markers) is located within the geographic region and is identifiable by a camera of the augmented reality device. The augmented reality system further includes an augmented reality device communicatively coupled to the beacon and the augmented reality content management server. The augmented reality device includes a camera, a display, and a controller having a processor and memory. The processor, when executing instructions stored in the memory, receives the beacon signal from the beacon and transmits the beacon-related signal to the augmented reality content server based on the beacon signal. The processor also receives the marker signal and the augmented reality content from the augmented reality content management server, scans the geographic region using the camera to identify markers within the geographic region, and outputs the augmented reality content to the display in response to identifying the marker.

[0007] In another embodiment, an augmented reality device includes a camera, a display, marker identification logic that identifies a marker within a geographic region using the camera, content output logic that outputs augmented reality content on the display, and a controller having a processor and a memory, wherein the processor, when executing instructions stored in the memory, receives beacon signals from beacons within the geographic region, transmits beacon-associated signals to an augmented reality content management server based on the beacon signals, receives marker signals and augmented reality content from the augmented reality content management server based on the beacon-associated signals, indicative of the markers, directs the marker identification logic to scan the geographic region, identifies the markers within the geographic region, and directs the content output logic to output augmented reality content on the display in response to identifying the markers.

[0008] In yet another embodiment, a tangible, non-transitory computer-readable medium includes instructions for dynamically loading region-based augmented reality content that, when executed by a processor, cause the processor to receive beacon signals from beacons in a geographic region, send beacon-associated signals indicative of the beacon signals to an augmented reality content management server, receive marker signals indicative of markers in the geographic region and augmented reality content associated with the marker signals from the augmented reality content management server based on the beacon-associated signals, scan the geographic region for markers, and output the augmented reality content associated with the markers in response to identifying the markers in the geographic region.

[0009] These and other features, aspects, and advantages of the present disclosure will be better understood when the following detailed description is read in conjunction with the accompanying drawings, in which like characters represent like elements throughout. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a perspective view of an augmented reality system according to one embodiment of the present disclosure. [Figure 2] FIG. 2 is a block diagram of the augmented reality system of FIG. 1 according to one embodiment of the present disclosure. [Figure 3] 1 is a flowchart illustrating a method for dynamically loading region-based augmented reality content, according to one embodiment of the present disclosure. [Figure 4] 3 is a flowchart illustrating a method for facilitating the augmented reality content management server of FIG. 2 dynamically loading region-based augmented reality content, according to one embodiment of the present disclosure. [Figure 5] 3 is a flowchart illustrating a method for the augmented reality content management server of FIG. 2 to update markers, according to one embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] One or more specific embodiments are described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described herein. It is understood that, as with any engineering or design project, the development of any such actual implementation will require numerous implementation-specific decisions to be made to achieve the developer's particular goals, which may vary from implementation to implementation, including compliance with system- and business-related constraints. It is further understood that such a development effort, while potentially complex and time-consuming, would be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill in the art having the benefit of this disclosure.

[0012] When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the element. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. In addition, it should be understood that references to "one embodiment" or "one embodiment" of the present invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

[0013] The present disclosure relates generally to augmented reality, and more particularly, to dynamically loading region-based augmented reality content. Multiple beacons may be spread throughout a physical environment. An augmented reality device may receive beacon signals from the beacons within a geographic region of the physical environment, facilitating determining a distance between the augmented reality device and each beacon. The augmented reality device may transmit a beacon-associated signal indicative of the beacon signal to an augmented reality content management server, which may determine the region of the augmented reality device based on the beacon-associated signal. The augmented reality content management server may then determine markers in or near the region of the augmented reality device. The augmented reality content management server may transmit a marker signal indicative of the marker and augmented reality content associated with the marker to the augmented reality device. The augmented reality device may scan the region and, in response to identifying the marker based on the marker signal, output the augmented reality content associated with the marker.

[0014] As the augmented reality device enters a subsequent geographic region of the physical environment, it can receive additional beacon signals from beacons in the subsequent geographic region, transmit additional beacon-associated signals based on the additional beacon signals, and receive additional marker signals and augmented reality content based on the additional beacon-associated signals. If the augmented reality device lacks storage capacity (e.g., volatile memory such as random access memory (RAM), non-volatile memory such as flash memory, or a combination of the two) to store the additional marker signals and augmented reality content, the augmented reality device can delete previous marker signals and associated augmented reality content. The augmented reality device can store the additional marker signals and augmented reality content. For example, the augmented reality device can delete the oldest stored marker signals and augmented reality content or the stored marker signals and augmented reality content associated with the geographic region of the physical environment farthest from the augmented reality device's current region. The augmented reality device can then scan its current region for markers associated with the additional marker signals and output the additional augmented reality content. Thus, the augmented reality device can continuously store marker signals and augmented reality content associated with the augmented reality device's current region, scan for associated markers associated with newly uploaded marker signals, and output the appropriate, newly uploaded augmented reality content. In this way, area-based augmented reality content can be dynamically loaded and provided even for large or widespread areas with augmented reality content that an augmented reality device may not normally have sufficient storage space to store.

[0015] 1 is a perspective view of an augmented reality system 10 according to one embodiment of the present disclosure. The augmented reality system 10 includes an augmented reality device 12, which can be any suitable electronic device that overlays a real-world environment with computer-generated content (e.g., images, audio data, haptic data, and the like) or augmented reality content. For example, the augmented reality device 12 can include a display 13 that allows a user to view the real-world environment with images superimposed on the view. As such, the augmented reality device 12 can include glasses, a headset, a heads-up display, contact lenses, a virtual retina display, an i-tap, a handheld display, a spatial augmented reality system, Google, and the like. In some embodiments, the augmented reality device 12 can include a user's smartphone or mobile communication device. When the user lifts the smartphone, the smartphone can display the real-world environment using a camera and display augmented reality content over the displayed real-world environment. In some cases, the smartphone can be attached to a headset or goggles, allowing the user to enjoy the augmented reality environment without using their hands to lift the smartphone. In alternative or additional embodiments, the augmented reality device 12 may include audio output components (e.g., speakers, headphones, earphones, and the like) and / or haptic output components (e.g., vibration components, motion generating components, gloves, and the like).

[0016] As shown, a user operates an augmented reality device 12 in a first geographic area or location (e.g., a theme park or entertainment center). In the first geographic area 14, the augmented reality system 10 may include one or more beacons 16. The beacons 16 may facilitate determining the geographic area of ​​the augmented reality device 12. In particular, each beacon 16 may transmit a beacon signal to the augmented reality device 12, which may provide an indication of the distance between the beacon 16 and the augmented reality device 12. The beacon signal may be transmitted to the augmented reality device 12 using an appropriate communication protocol, such as Bluetooth, WiFi, infrared, Ethernet, Thread, ZigBee, Z-Wave, KNX, mobile, etc. The geographic area may include, for example, a range or measurement of a location (e.g., a 20-foot radius of a location), one or more rooms in a building, one or more floors or levels of a building, a portion of one or more rooms and / or one or more floors of a building, and so forth.

[0017] In some embodiments, the beacon signal may include a timestamp (e.g., the time at which the beacon 16 transmitted the beacon signal), and the distance between the beacon 16 and the augmented reality device 12 may be determined (e.g., by the augmented reality device 12) based on the timestamp and the known or predetermined speed of the beacon signal. In some cases, a single beacon 16 may be used to determine the approximate geographic area of ​​the augmented reality device 12 (e.g., within a radius of the beacon 16). In other cases, multiple beacons may be used to more precisely determine the geographic area of ​​the augmented reality device 12 (e.g., via triangulation or other location techniques).

[0018] The beacon signal may also or alternatively include an identifier, such as a region identifier (e.g., associated with the first geographic region 14). Thus, the beacon signal may enable the augmented reality device 12 to determine the region in which the augmented reality device 12 is located based on the region identifier. In some embodiments, the beacon signal may include a timestamp, a version code, and / or a checksum indicating the current associated mapping set, allowing the augmented reality device 12 to determine whether the current mapping set associated with the beacon signal is up to date. For example, each mapping set may include an expiration timestamp to which the augmented reality device 12 compares the timestamp, version code, and / or checksum. If the augmented reality device 12 determines that the associated mapping set of a beacon signal has expired, the augmented reality device 12 may re-query for the latest mapping set. Furthermore, although the beacons 16 shown in FIG. 1 are shown external, the beacons 16 may also be located internally in a building (e.g., one or more beacons 16 in each room of a building), on different floors of a building, and so on. In additional or alternative embodiments, the use of beacons may be supplemented with other suitable location determination techniques, such as Global Positioning System (GPS), WiFi mapping, cellular signal triangulation, and others, for example, to reduce the number of beacons 16 used to determine the geographic region of the augmented reality device 12.

[0019] The augmented reality device 12 can be communicatively coupled to the augmented reality content management server 18, for example, via the communications network 20. In some embodiments, the augmented reality device 12 can transmit a beacon signal transmitted by a beacon or a beacon-related signal indicative of the beacon signal to the augmented reality content management server. The beacon-related signal can be generated by the augmented reality device 12 to include information about the beacon signal relevant to locating the augmented reality device 12. In some embodiments, the beacon-related signal can include at least a partial combination of the beacon signals. The augmented reality content management server 18 can determine a geographic region of the augmented reality device 12. In alternative or additional embodiments, the augmented reality device 12 can determine a region based on the beacon signal and then transmit a location signal indicative of the geographic region to the augmented reality content management server 18. The augmented reality content management server 18 can store, access, or retrieve marker information and augmented reality content associated with the marker information corresponding to the determined region of the augmented reality device 12. The augmented reality content management server 18 can then transmit the marker information (e.g., as a marker signal) and the associated augmented reality content to the augmented reality device 12.

[0020] The marker information may include any suitable information used to identify, describe, or indicate a spatial image or visual marker or tag 22 within the geographic region of the augmented reality device 12. For example, the marker information may include image recognition information, barcode or quick response (QR) code information, and the like. The marker or tag 22 may include any suitable identifier that enables the augmented reality device 12 to recognize the marker 22. For example, the marker 22 may include a visual identifier such as a poster, graphic, design, shape, wall or ceiling shape, wall or ceiling pattern, barcode, QR code, and the like. The camera 24 of the augmented reality device 12 may scan the region and identify the marker 22 using the marker information. In response to identifying the marker 22, the augmented reality device 12 may output augmented reality content 26 associated with the marker. The augmented reality content 26 may include any suitable content that the augmented reality device 12 is capable of outputting, such as image content, audio content, haptic content (e.g., vibration content), and the like. For example, augmented reality content may include creatures flying around (e.g., interacting with the scenery and / or guests), locations where water pipes are buried or electrical wiring is being run within walls for maintenance, and more.

[0021] 1, when the augmented reality device 12 is within the first geographic region 14, the marker information transmitted by the augmented reality content management server 18 indicates a marker 22, which is a window frame. The augmented reality content management server 18 also transmits augmented reality content 26 associated with the marker 22, which is shown as a ghost (dashed line). When the user looks around the first geographic region 14, the camera 24 scans the first geographic region 14 and identifies the marker 22 (e.g., a window frame). The augmented reality device 12 outputs (e.g., displays) the augmented reality content 26 (e.g., a ghost) associated with the marker 22.

[0022] The augmented reality device 12 can store the marker information (associated with the marker 22) and the associated augmented reality content 26. Thus, during subsequent viewing of the marker 22 (e.g., a window frame) by the augmented reality device 12, the augmented reality device 12 can again output the augmented reality content 26 (e.g., a ghost), but without having to download the marker information and the associated augmented reality content 26 from the augmented reality content management server.

[0023] 1 also illustrates a second geographic region or location 28. The second region may also include one or more beacons. In some cases, one or more of the beacons in the second geographic region 28 may be shared with one or more of the beacons 16 in the first geographic region 14. In other cases, the beacons 30 in the second region 28 may not include any of the beacons 16 in the first geographic region 14. Each beacon 30 may transmit a beacon signal to the augmented reality device 12, which may provide an indication of the distance between the beacon 30 and the augmented reality device 12. The augmented reality device 12 may transmit a beacon-related signal to the augmented reality content management server 18 that indicates the beacon signal transmitted by the beacon 16. The augmented reality content management server 18 may then determine the region of the augmented reality device 12 (e.g., the second geographic region 28). In an alternative or additional embodiment, the augmented reality device 12 may determine the region based on the beacon signal and then transmit a location signal indicating the region to the augmented reality content management server 18 .

[0024] The augmented reality content management server 18 can transmit marker information associated with the second geographic region 28 and augmented reality content 26 associated with the marker information to the augmented reality device 12. As shown, when the augmented reality device 12 is within the second geographic region 28, the marker information transmitted by the augmented reality content management server 18 indicates a marker 32, which is a railroad crossing gate. The augmented reality content management server 18 also transmits augmented reality content 34 associated with the marker 32, illustrated as a train (dashed line). When the user looks around the second geographic region 28, the camera 24 scans the second geographic region 28 and identifies the marker 32 (e.g., a railroad crossing gate). The augmented reality device 12 outputs (e.g., displays) the augmented reality content 34 (e.g., a train) associated with the marker 32. Although only one marker (e.g., 2, 32) is shown within each region (e.g., 14, 28) in FIG. 1, it should be understood that each geographic region can include any suitable number of markers (e.g., 1-1000 markers, 1-100 markers, 1-10 markers, etc.).

[0025] The augmented reality device 12 may store marker information (associated with markers 32) and associated augmented reality content 34. Because the augmented reality device 12 has a finite storage space, it may delete previously stored information to make room for the marker information (associated with markers 32) and associated augmented reality content 34. The augmented reality device 12 may use any suitable algorithm to determine which previously stored information to delete. For example, the augmented reality device 12 may delete the oldest stored marker information and associated augmented reality content. As another example, the augmented reality device 12 may delete marker information and associated augmented reality content corresponding to geographic regions or locations farthest from the augmented reality device's current region. As yet another example, the augmented reality device 12 may delete the least frequently used marker information and associated augmented reality content because the user is unlikely to return to the corresponding region. In either case, once the previously stored data is deleted, the augmented reality device 12 stores the marker information (associated with the marker 32) and the associated augmented reality content 34, and during a subsequent view of the marker 32 by the augmented reality device 12 (e.g., a railroad crossing gate), the augmented reality device 12 can again output the augmented reality content 34 (e.g., a train) without having to download the marker information and the associated augmented reality content 26 from the augmented reality content management server 18.

[0026] In alternative or additional embodiments, the augmented reality device 12 may initially store previously stored information in a first (e.g., volatile memory device) memory, such as RAM, and when the augmented reality device 12 determines that there is insufficient storage space in the first memory to store new marker information and / or associated augmented reality content 34, the augmented reality device 12 may move the previously stored information to a second (e.g., non-volatile memory device) memory, such as a hard drive or flash memory device. In such an embodiment, the new marker information and / or associated augmented reality content S may then be quickly loaded from the first (e.g., volatile memory device) memory. When the augmented reality device 12 returns to an initial location associated with the previously stored information, the augmented reality device 12 may quickly reload the previously stored information from the second memory into the first memory, rather than downloading the content from an augmented reality content management server.

[0027] With the above in mind, FIG. 2 is a block diagram of the augmented reality system 10 of FIG. 1 , according to one embodiment of the present disclosure. The augmented reality device 12 may include a controller 50 having one or more processors (shown as a single processor 52) and one or more memory or storage devices (shown as a single memory device 54). The processor 52 may execute software programs and / or instructions stored in the memory devices that facilitate dynamically loading area-based augmented reality content. Furthermore, the processor 52 may include multiple microprocessors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and / or one or more application-specific integrated circuits (ASICS). For example, the processor 52 may include one or more reduced instruction set (RISC) processors. The memory device 54 may store information such as control software, lookup tables, configuration data, and so forth. The memory device 54 may include a tangible, non-transitory, machine-readable medium, such as volatile memory (e.g., random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM)), flash memory, one or more hard drives, and / or other suitable optical, magnetic, or solid-state storage media. Memory devices may store a variety of information and be used for a variety of purposes.

[0028] The augmented reality device 12 may include a communication device 56 that may enable the controller 50 to communicate with any suitable communication network 20. For example, the communication network 20 may include a local area network, a metropolitan area network, a wide area network, a wireless network, and / or an internetwork or the Internet. As such, the communication device 56 may communicate with the network 20 using any suitable communication protocol, such as WiFi, infrared, Ethernet, Bluetooth, Thread, ZigBee, Z-Wave, KNX, mobile, and others.

[0029] Augmented reality device 12 also includes a camera 24 (which may be part of a set of multiple cameras in augmented reality device 12), which may be any suitable image capture or scanning device. Camera 24 may be used to facilitate output of augmented reality content (e.g., 26) of markers (e.g., 22) and scanned areas (e.g., 14). Augmented reality device 12 may also include a display 13, which allows a user to view their real-world environment with augmented reality content superimposed on their view.

[0030] Augmented reality device 12 may also include marker identification logic 58 that facilitates identification of a marker (e.g., 22) within an area (e.g., 14). In particular, marker identification logic 58 may receive marker information from augmented reality content management server 18 (e.g., via communication device 56 over communication network 20) ​​corresponding to the marker, receive one or more images of the area from camera 24, and determine the geographic area of ​​the marker within the one or more images based on the marker information.

[0031] Augmented reality device 12 may also include content output logic 60 that facilitates output of augmented reality content (e.g., 26) to, for example, display 13 of augmented reality device 12. In particular, content output logic 60 may receive augmented reality content from augmented reality content management server 18 (e.g., via communication device 56 over communication network 20) ​​associated with a marker (e.g., 22), receive one or more images of an area (e.g., 14) from a camera, i.e., an indication (e.g., from marker identification logic 58) of the area of ​​the marker within the one or more images, and output (e.g., display) the augmented reality content on augmented reality device 12 (e.g., display 13).

[0032] The term "logic" as used in this disclosure may include hardware (e.g., circuitry), software (e.g., machine-readable instructions), or a combination of the two. Additionally, although FIG. 2 depicts marker identification logic 58 and / or content output logic 60 as separate from other components of augmented reality device 12, it is contemplated that marker identification logic 58 and / or content output logic 60 may be part of other components of augmented reality device 12 and / or part of augmented reality content management server 18, e.g., part of and / or stored in controller 50, processor 52, and / or memory device 54.

[0033] The communication device 56 may enable the augmented reality device 12 to communicate with the augmented reality content management server 18 via the communication network 20 and the communication device 62 of the augmented reality content management server 18. The communication device 62 may communicate with the network 20 using any suitable communication protocol, such as WiFi, infrared, Ethernet, Bluetooth, Thread, ZigBee, Z-Wave, KNX, mobile, and others.

[0034] The augmented reality content management server 18 may also include a controller 64 having one or more processors (shown as a single processor 66) and one or more memory or storage devices (shown as a single memory device). The processor 66 may execute software programs and / or instructions stored in the memory device(s) to facilitate management of marker information and / or augmented reality content. Furthermore, the processor 66 may include multiple microprocessors, one or more “general-purpose” microprocessors, one or more special-purpose microprocessors, and / or one or more ASICS. For example, the processor 66 may include one or more RISC processors. The memory device 68 may store information such as control software, look-up tables, configuration data, and the like. The memory device 68 may include tangible, non-transitory, machine-readable media, such as volatile memory (e.g., RAM), non-volatile memory (e.g., ROM), flash memory, one or more hard drives, and / or other suitable optical, magnetic, or solid-state storage media. The memory device may store a variety of information and may be used for a variety of purposes.

[0035] The augmented reality content management server 18 may include geographic region determination logic 70 that facilitates determining a geographic region or location based on the received beacon-associated signals. Specifically, the geographic region determination logic 70 may be communicatively coupled to a geographic region database 72 that stores information associating regions with beacons. The geographic region database 72 may also store maps of regions and / or locations where beacons are located. In such cases, the augmented reality content management server 18 may determine the geographic region of the augmented reality device 12 and its distance to other regions. Thus, the augmented reality content management server 18 may determine the region from which the augmented reality device 12 is furthest away. The augmented reality content management server 18 may delete mark information and associated augmented reality content from the memory device 54 to create storage space for storing new mark information and associated augmented reality content.

[0036] In alternative or additional embodiments, the geographic region database 72 may be in the form of a table or any other suitable format associating regions with beacons. Thus, the geographic region determination logic 70 may receive one or more beacon-associated signals from the augmented reality device 12 and determine a geographic region using the geographic region database 72 based on the beacon-associated signals. For example, the geographic region database 72 may include information associating a first geographic region 14 with a first set of beacons 16. The geographic region determination logic 70 may receive beacon-associated signals from the augmented reality device 12 generated based on receiving beacon signals from the beacons 16 and determine that the augmented reality device 12 is located within the first region 14 using the geographic region database 72 based on the beacon-associated signals associated with the beacons 16. In some embodiments, the augmented reality device 12 may include geographic region determination logic 70 that may determine a region of the augmented reality device 12 using the geographic region database 72 based on receiving the beacon signals and transmit the region to the augmented reality content management server 18.

[0037] The augmented reality content management server 18 may include marker determination logic 74 that facilitates determining markers within a geographic region or location. In particular, the marker determination logic 74 may be communicatively coupled to a marker database 76 that stores information associating markers with regions. In alternative or additional embodiments, the marker database 76 may be in the form of a table or any other suitable format that associates markers with regions. Thus, the marker determination logic 74 may receive an indication of a region (e.g., from the geographic region determination logic) and, based on the indication, determine one or more markers within the region using the marker database 76. For example, the marker database 12 may include information associating markers 22 (e.g., window frames) with the first region 14. The marker determination logic 74 may receive an indication of the first geographic region 14 from the geographic region determination logic 70 and, based on the indication, determine markers 22 located within the first geographic region 14 using the marker database 76.

[0038] The augmented reality content management server 18 may also include content determination logic 78 that facilitates determining the augmented reality content to be output in response to a marker. In particular, the content determination logic 78 may be communicatively coupled to a content database 80 that stores information associating augmented reality content with markers. The content database 80 may store augmented reality content such as images, video, audio, and / or haptic data related to enabling a user to experience creatures flying overhead. In alternative or additional embodiments, the content database 80 may be in the form of a table or any other suitable format that associates augmented reality content with markers. Thus, the content determination logic 78 may receive an indication of a marker (e.g., from the marker determination logic 74) and, based on the indication, use the content database to determine the augmented reality content to be associated with (e.g., output in connection with) the marker. For example, the content database 80 may include information associating augmented reality content 26 (e.g., ghosts) with markers 22 (e.g., window frames). The content determination logic 78 may receive an indicator of the marker 22 from the marker determination logic 74 and determine the augmented reality content 26 associated with the marker 22 based on the indicator. In some cases, the content determination logic 78 may also determine positioning information for the augmented reality content (e.g., information related to where and / or how to output or display the augmented reality content relative to the marker).

[0039] The augmented reality content management server 18 can then transmit an indication of the marker and the associated augmented reality content to the augmented reality device 12, which can use the marker identification logic to scan the marker based on the indication and, once the marker is identified, output (e.g., display) the augmented reality content (on the display 313) using the content output logic 60. If there are multiple markers in the area in which the augmented reality device 12 is located, the augmented reality content management server 18 can associate each augmented reality content with each marker (e.g., by providing an indication that each augmented reality content is associated with each marker). In this manner, the system 10 can dynamically load area-based augmented reality content 26.

[0040] The augmented reality content management server 18 may include update logic 82 that facilitates updating the geographic region database 72, the marker database 76, and / or the content database 80. For example, the update logic 82 may update the geographic region database as beacons from different geographic regions are added, removed, or modified, thereby keeping the geographic region database 72 current with respect to associating regions with beacons.

[0041] The update logic 82 can also update the marker database 76 when a marker is added, removed, or modified. For example, a marker for which associated augmented reality content is output can include a wall poster, which can be removed. A new marker for outputting associated augmented reality content can be added or identified and updated accordingly in the marker database 76 by the update logic 82. As shown, the update logic 82 can be communicatively coupled to one or more sensors that can determine whether a marker has been added, removed, or modified. In particular, the sensor 84 can include a camera having a view of the area (e.g., 14) in which the marker (e.g., 22) is located. The sensor 84 can include a camera (e.g., a security camera) installed or fixed within or within a viewing distance of the area, a camera manually operated by an employee maintaining or managing the area (e.g., a theme park employee), and / or a camera on the augmented reality device 24 or a mobile communication device (e.g., a smartphone) of a user (e.g., a theme park patron). Update logic 82 can use sensors 84 to determine that a marker has been removed and can use sensors 84 to determine a replacement marker. The replacement marker can be any suitable marker that can be used to determine where and how to output associated augmented reality content. Using FIG. 1 as an example, if window frame marker 22 is removed, update logic 82 can use sensors 84 (e.g., a security camera) to determine that window frame marker 22 has been removed and determine that roofline 86 should be used as the replacement marker. Update logic 82 can update marker database 76 to replace window frame marker 22 with roofline marker 86 and update content database 80 to associate augmented reality content 26 (e.g., a ghost) with roofline marker 86 (instead of the previously associated window frame marker 22).Thus, the marker database 76 can be up to date with respect to markers within a geographic region, and the content database 80 can be up to date with respect to the relationships between augmented reality content and markers. Additionally, the marker database 76 can be initialized by employees manually using installed or fixed cameras (e.g., 84) and / or augmented reality devices 12 and / or cameras (e.g., 24), such as smartphones, to pre-scan the region to capture the markers (e.g., 22) and their locations (e.g., when the theme park is vacant). In some cases, this pre-scan procedure can be repeated periodically (e.g., daily, weekly, monthly) before or after there is traffic within the region (e.g., before the theme park opens or after the theme park closes).

[0042] The update logic 82 may also update the content database when augmented reality content is added, removed, or modified. Thus, the content database 80 may be current with respect to associating augmented reality content with markers. In some embodiments, the update logic 82 may update the geographic region database 72, the marker database 76, and / or the content database 80 when regions, markers, and / or augmented reality content are added, removed, and / or modified. In alternative or additional embodiments, the update logic 82 may update the geographic region database 72, the marker database 76, and / or the content database 80 periodically (e.g., hourly, daily, weekly, and the like).

[0043] 3 is a flowchart illustrating a method 100 for dynamically loading region-based augmented reality content, according to one embodiment of the present disclosure. Method 100 may be performed by any suitable device capable of dynamically loading region-based augmented reality content, such as processor 52. While method 100 is described using a particular order of steps, it should be understood that the present disclosure contemplates that the described steps may be performed in an order different from the illustrated order, and that certain described steps may be skipped or not performed entirely. In some embodiments, method 100 may be implemented by using a processor, such as processor 52, to execute instructions stored on a tangible, non-transitory computer-readable medium, such as memory device 54.

[0044] As shown, at process block 102, processor 52 receives a beacon signal within a geographic region. Referring back to FIG. 1 , processor 52 is part of augmented reality device 12 and may receive a beacon signal from a beacon 16 within first geographic region 14. At process block 104, processor 52 transmits a beacon-related signal indicative of the beacon signal to augmented reality content management server 18. In some embodiments, processor 52 may instead transmit the beacon signal itself (rather than a beacon-related signal derived from the beacon signal) to augmented reality content management server 18.

[0045] At process block 106, the processor 52 receives a marker signal indicating a marker in the geographic region and augmented reality content from the augmented reality content management server 18 based on the beacon-associated signal. Specifically, the augmented reality content management server 18 can determine a geographic region (e.g., first region 14) of the augmented reality device 12 based on receiving the beacon-associated signal using geographic region determination logic 70 and a geographic region database 72. The augmented reality content management server 18 can determine a marker (e.g., marker 22) within the region based on the region using marker determination logic 74 and a marker database 76. The augmented reality content management server 18 can further determine augmented reality content associated with the marker (e.g., ghost 26) using marker-based content determination logic 78 and a content database 80. The augmented reality content management server 18 can transmit the marker signal (e.g., indicating the marker) and the associated augmented reality content to the augmented reality device 12.

[0046] At decision block 108, the processor 52 determines whether there is sufficient storage space to store the marker signals and associated augmented reality content. For example, the processor 52 may determine whether there is sufficient space in the memory device 54. If not, at process block 110, the processor 52 deletes the previous marker signals and / or associated augmented reality content. The processor 52 may use any suitable algorithm to determine which previous marker signals and / or associated augmented reality content to delete. For example, the augmented reality device 12 may delete the oldest stored marker information and associated augmented reality content. As another example, the augmented reality device 12 may delete marker information and associated augmented reality content corresponding to geographic regions or locations farthest from the augmented reality device's current region or location. As yet another example, the augmented reality device 12 may delete the least frequently used marker information and associated augmented reality content because the user is unlikely to return to the corresponding region. The processor 52 then returns to decision block 108 to determine whether there is sufficient storage space to store the marker signals and associated augmented reality content after deleting the previous marker signals and / or associated augmented reality content.

[0047] The processor 52 stores the marker signal and the associated augmented reality content at process block 112. For example, the processor may store the marker signal and the associated augmented reality content in the memory device 54.

[0048] At process block 114, processor 52 scans the area for the marker associated with the marker signal. For example, in Figure 1, processor 52 may direct camera 24 of augmented reality device 12 to scan first area 14 for marker 22 (e.g., a window frame).

[0049] At decision block 116, processor 52 determines whether a marker has been identified. If not, processor 52 continues scanning the area for a marker at process block 114. If a marker is identified, at process block 118, processor 52 outputs augmented reality content associated with the identified marker. Referring back to FIG. 1 , as a user looks around first area 14, processor 52 scans first area 14 using camera 24, identifies marker 22 in the form of a window frame, and outputs augmented reality content 26 in the form of a ghost on display 13 of augmented reality device 12. In some embodiments, processor 52 receives positioning information along with the marker signal and augmented reality content indicating where and how to output the augmented reality content. For example, in FIG. 1 , processor 52 can receive positioning information along with the marker signal and augmented reality content 26 indicating marker 22 and display the augmented reality content 26 (e.g., a ghost) within marker 22 (e.g., a window frame) on augmented reality device 12. In this manner, the method 100 can dynamically load region-based augmented reality content 26 .

[0050] 4 is a flowchart illustrating a method 130 for facilitating dynamic loading of region-based augmented reality content by the augmented reality content management server 18 of FIG. 2 , in accordance with one embodiment of the present disclosure. Method 130 may be performed by any suitable device capable of facilitating dynamic loading of region-based augmented reality content, such as the processor 66 of the augmented reality content management server 18. While method 130 is described using a particular order of steps, it should be understood that this disclosure contemplates that the described steps may be performed in an order different from the illustrated order, and that certain described steps may be skipped or not performed entirely. In some embodiments, method 130 may be implemented by using a processor, such as the processor 66, to execute instructions stored on a tangible, non-transitory computer-readable medium, such as the memory device 68.

[0051] As shown, in process block 132, the processor receives a beacon-related signal from the augmented reality device 12. In particular, the beacon-related signal may refer to a beacon signal transmitted by a beacon and received by the augmented reality device 12. In some embodiments, the processor 62 may instead receive the beacon signal itself from the augmented reality device 12 (rather than a beacon-related signal derived from the beacon signal).

[0052] At process block 134, the processor 62 determines a geographic region of the augmented reality device 12 based on the beacon-associated signals. In particular, the augmented reality content management server 18 can use geographic region determination logic 70 to determine the region of the augmented reality device 12 based on the beacon-associated signals and a geographic region database 72 (which stores information associating regions with beacons).

[0053] At process block 136, processor 62 determines markers for the region. In particular, augmented reality content management server 18 may use marker determination logic 74 to determine markers within the region of augmented reality device 12 based on the markers determined at process block 134 and marker database 76 (which stores information associating markers with regions).

[0054] At process block 138, processor 62 determines the augmented reality content associated with the marker. In particular, augmented reality content management server 18 can use content determination logic 78 to determine the augmented reality content associated with the marker determined at process block 134 and content database 80 (which stores information associating augmented reality content with the marker).

[0055] Next, at process block 140, the processor 62 transmits a marker signal indicative of the marker determined at process block 134 and the associated augmented reality content determined at process block 138 to the augmented reality device 12. In this manner, the method 130 enables the augmented reality content management server 18 to facilitate dynamic loading of region-based augmented reality content.

[0056] 5 is a flowchart illustrating a method 150 in which the augmented reality content management server 18 of FIG. 2 updates a marker (e.g., 22), according to one embodiment of the present disclosure. Method 150 may be performed by any suitable device capable of updating a marker, such as update logic 82 and / or processor 66 of the augmented reality content management server 18. While method 150 is described using a particular order of steps, it should be understood that the present disclosure contemplates that the described steps may be performed in an order different from the illustrated order, and that certain described steps may be skipped or not performed entirely. In some embodiments, method 150 may be implemented by using a processor, such as processor 66, to execute instructions stored on a tangible, non-transitory computer-readable medium, such as memory device 68.

[0057] As shown, at process block 152, the update logic 82 receives an indication to update markers in the geographic region. The indication may be received as part of an asynchronous operation (e.g., triggered due to a marker being added, removed, or changed) or as part of a synchronous operation (e.g., triggered due to periodic updates of markers in the region). By way of example, and referring back to FIG. 1 , the update logic 82 may receive an indication to update markers 22 (e.g., a window frame) in the first region 14, for example, due to a marker 22 being removed.

[0058] At process block 154, the update logic 82 determines the sensors available within the geographic region. Referring back to FIG. 1, the update logic 82 may determine that a sensor 84 (e.g., a security camera) is an available sensor within the first region 14. Similarly, the update logic 82 may determine that a camera 24 of the augmented reality device 12 is an available sensor within the first region 14.

[0059] At process block 156, the update logic 82 directs available sensors to determine or capture a replacement marker for the marker in the geographic region. The replacement marker may be any suitable marker that can be used to determine where and how to output associated augmented reality content. Again, using FIG. 1 as an example, if window frame marker 22 is removed, the update logic 82 may determine, using security camera sensor 84, that roofline 86 should be used as the replacement marker.

[0060] At process block 158, the update logic 82 replaces the marker with a replacement marker. Specifically, the update logic 82 may update the marker database 76 to replace the previous marker with the replacement marker and update the content database 80 to associate the augmented reality content previously associated with the previous marker with the replacement marker. Thus, the marker database 76 may be current with markers in the area, and the content database 80 may be current with the augmented reality content's association with the marker. Using the previous example, the update logic 82 may update the marker database 76 to replace the window frame marker 22 with the roofline marker 86 and update the content database 80 to associate the augmented reality content 26 (e.g., a ghost) with the roofline marker 86 (rather than the previously associated window marker 22). In this manner, method 150 may enable the augmented reality content management server 18 to update markers when they are added, removed, or modified.

[0061] While the embodiments described in this disclosure are susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that the disclosure is not intended to be limited to the particular forms disclosed. The present disclosure is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present disclosure as defined by the appended claims.

[0062] The technology presented and claimed herein is applied with reference to tangible objects and specific examples of a practical nature that clearly improve the technical field of the present invention, and as such is not abstract, intangible, or purely theoretical. Furthermore, if any claim appended at the end of this specification includes one or more elements designated as "means for [performing] ... [function]" or "step for [performing] ... [function]," it is intended that such elements be construed under 35 U.S.C. 112(f). However, for any claim including elements designated in any other manner, it is intended that such elements not be construed under 35 U.S.C. 112(f). [Explanation of symbols]

[0063] 10 Augmented Reality Systems 12 Augmented Reality Devices 13. Display 14 First Geographical Region 16 Beacon 18 Augmented reality content management server 22 Markers or tags 24 Camera 26 Augmented Reality Content 28 Second Geographical Region 30 Beacon 32 markers 34 Augmented Reality Content

Claims

1. 1. An augmented reality system, comprising: an augmented reality device including a camera, a display, and a controller, the augmented reality device being located within the geographic region; one or more beacons configured to transmit one or more beacon signals to the augmented reality devices located within the geographic region; an augmented reality content management server; Equipped with The augmented reality content management server receiving one or more beacon-related signals from the augmented reality device; determining markers located within the geographic region and configured to be identifiable by a camera of the augmented reality device, and augmented reality content associated with the markers based at least in part on the one or more beacon-associated signals; transmitting a marker signal indicative of the marker and the augmented reality content to the augmented reality device; It is structured as follows: the augmented reality device is configured to be communicatively coupled to the one or more beacons and the augmented reality content management server; the controller of the augmented reality device includes a processor and a memory; The processor, when executing instructions stored in the memory, receiving the one or more beacon signals from the one or more beacons and transmitting the one or more beacon-related signals to the augmented reality content management server based at least in part on the one or more beacon signals; receiving the marker signal and the augmented reality content from the augmented reality content management server; scanning the geographic area using the camera; identifying the markers within the geographic region; outputting the augmented reality content to the display in response to identifying the marker; 1. An augmented reality system configured to:

2. 2. The augmented reality system of claim 1, wherein the augmented reality content management server includes geographical region determination logic configured to receive the one or more beacon-related signals from the augmented reality device and determine the geographical region of the augmented reality device based at least in part on the one or more beacon-related signals.

3. The augmented reality system of claim 2 , wherein the geographic region determination logic is communicatively coupled to a geographic region database configured to store information associating a plurality of geographic regions with a plurality of beacons.

4. 3. The augmented reality system of claim 2, wherein the augmented reality content management server includes marker determination logic configured to receive the geographic area of ​​the augmented reality device from the geographic area determination logic and determine the marker based at least in part on the geographic area of ​​the augmented reality device.

5. The augmented reality system of claim 4 , wherein the marker determination logic is communicatively coupled to a marker database configured to store information associating a plurality of markers with a plurality of geographic regions.

6. The augmented reality system of claim 5 , wherein the augmented reality content management server includes content determination logic configured to receive the markers from the marker determination logic and determine the augmented reality content based at least in part on the markers.

7. The augmented reality system of claim 6 , wherein the content determination logic is communicatively coupled to a content database configured to store information associating a plurality of augmented reality contents with a plurality of markers.

8. The augmented reality system of claim 7 , wherein the content database is configured to store the plurality of augmented reality contents.

9. The processor: receiving an indication to update the marker; determining available sensors located within the geographic region; instructing the available sensors to determine replacement markers within the geographic region; replacing the marker with the replacement marker; The augmented reality system of claim 7 , configured to:

10. The processor: Associating the replacement marker with the geographic region in the marker database; associating the augmented reality content with the replacement marker in the content database; 10. The augmented reality system of claim 9, configured to replace the marker with the replacement marker by

11. 1. An augmented reality device, comprising: A camera and The display and marker identification logic configured to identify markers within a geographic area using the camera; content output logic configured to output augmented reality content on the display; a controller including a processor and a memory; Equipped with The processor, when executing instructions stored in the memory, receiving one or more beacon signals from one or more beacons within the geographic region; transmitting one or more beacon-related signals to an augmented reality content management server based at least in part on the one or more beacon signals; receiving, from the augmented reality content management server, a marker signal indicative of the marker and the augmented reality content based at least in part on the one or more beacon-associated signals; directing the marker identification logic to scan the geographic area and identify the markers within the geographic area; directing the content output logic to output the augmented reality content on the display in response to identifying the marker; an augmented reality device configured to:

12. 12. The augmented reality device of claim 11, wherein the processor is configured to determine whether there is sufficient storage space in the memory to store the marker signal and the augmented reality content in the memory, and to store the marker signal and the augmented reality content in the memory in response to determining that there is sufficient storage space in the memory.

13. 13. The augmented reality device of claim 12, wherein the processor is configured to delete the oldest previously stored marker signal, the oldest previously stored augmented reality content, or both in response to determining that there is insufficient storage space in the memory.

14. 13. The augmented reality device of claim 12, wherein the processor is configured to, in response to determining that there is insufficient storage space in the memory, delete previously stored marker information associated with a second geographic area farthest from the geographic area of ​​the augmented reality device, or delete previously stored augmented reality content associated with the second geographic area, or both.

15. 13. The augmented reality device of claim 12, wherein the processor is configured to delete the least recently used previously stored marker signal, the least recently used previously stored augmented reality content, or both in response to determining that the memory does not have sufficient storage space.

16. 1. A tangible, non-transitory computer-readable medium comprising instructions for dynamically loading region-based augmented reality content, the medium comprising: The instructions, when executed by a processor, cause the processor to: receiving a set of beacon signals from a set of beacons within a geographic region; transmitting a set of beacon-related signals indicative of the set of beacon signals to an augmented reality content management server; receiving a set of marker signals indicative of a set of markers within the geographic region and a set of augmented reality content associated with the set of marker signals from the augmented reality content management server based at least in part on the set of beacon-associated signals; scanning the geographic area for the set of markers; and in response to identifying the marker within the geographic region, outputting augmented reality content of the set of augmented reality content associated with a marker of the set of markers. A tangible, non-transitory computer-readable medium that causes

17. 17. The tangible, non-transitory computer-readable medium of claim 16, comprising instructions that cause the processor to determine whether there is sufficient storage space to store the set of marker signals and the set of augmented reality content.

18. 20. The tangible, non-transitory computer-readable medium of claim 17, comprising instructions that, in response to determining that there is sufficient storage space, cause the processor to store the set of marker signals and the set of augmented reality content.

19. 20. The tangible, non-transitory computer-readable medium of claim 17, comprising instructions that cause the processor to delete previously stored marker information associated with a second geographic region, delete previously stored augmented reality content associated with the second geographic region, or both.

20. 20. The tangible, non-transitory computer-readable medium of claim 19, wherein the processor is configured to determine whether there is sufficient storage space to store the set of marker signals and the set of augmented reality content after deleting the previously stored marker information associated with the second geographic region, or after deleting the previously stored augmented reality content associated with the second geographic region, or both, and to store the set of marker signals and the set of augmented reality content in response to determining that there is sufficient storage space.

Images