Augmented reality system with active portable anchor

Abstract

The present application discloses an augmented reality system with an active portable anchor. A method, an apparatus and an augmented reality system (202) include a network (102) and a communication port (103) in the network. The communication port (103) is configured to communicate with a portable active anchor (130) and send a current physical anchor position (220) of the active portable anchor (130) relative to an object (206) to the active portable anchor (130), wherein the current physical anchor position (220) of the active portable anchor (130) relative to the object (206) is determined using the physical anchor position (222) of the active portable anchor (130) and the physical object position (224) of the object (206).

Description

Technical Field

[0001] The present disclosure relates generally to improved augmented reality systems, and in particular to improved methods, apparatus, and systems for augmented reality systems having active anchors. Background Art

[0002] Augmented reality involves an interactive experience with a real-world environment that is enhanced by information from a computer system. The information is displayed on a real-time view of the real-world environment as seen through an augmented reality device. The information is displayed on the real-time view in a manner that provides the user with descriptions or indicators about objects in the real-time view. The information is also referred to as augmented reality information. In other cases, the augmented reality information is displayed on the real-time view of the real-world environment in a seamlessly interwoven manner such that the information is perceived as part of the real-world environment as seen through the augmented reality device.

[0003] Augmented reality devices are used in many applications in real-world environments. For example, augmented reality devices can be used to manufacture or maintain objects such as aircraft. Human operators use augmented reality devices to perform operations to assemble parts, manufacture parts, inspect assemblies, or other operations. The information used to augment the real-time view of the aircraft can include, for example, schematics, graphical indicators identifying inconsistencies, wiring diagrams, displays of components hidden under skin panels, or other types of information.

[0004] Anchors are used to describe the location of an object in a real-world environment. Anchors are also called spatial anchors and mark the location of an object relative to the real-world environment. Anchors can be associated with corresponding locations in a model of the object.

[0005] The use of the anchors' coordinate system can more accurately display augmented reality information such as graphics or holograms on a real-time view of an object. The augmented reality device can use these anchors to orient itself. In other words, the augmented reality device can use the anchors to identify the location of the augmented reality device for displaying augmented reality information on a real-time view of an object.

[0006] Currently, anchors are permanent in the real environment. In other words, the anchors are fixed for displaying augmented reality information. For example, an anchor plate is a physical anchor and is formed or mounted on an object such as a room or a pipe in a room. The positioning of these anchor plates is related to their corresponding positioning in the model of the object to provide an augmented reality device with its own reference to display augmented reality information with a desired level of accuracy on a real-time view of the object.

[0007] One drawback of using these anchors is that there is a limit to the distance at which the augmented reality device can be positioned in terms of accuracy. As the distance of the augmented reality device from the anchor increases, the accuracy with which the augmented reality device displays the augmented reality information over the real-time view of the object decreases.

[0008] For example, distances exceeding five meters may result in an undesirable level of accuracy in positioning the augmented reality device on or near an object to display augmented reality information. As a result, the number of anchors required to achieve the desired accuracy may be greater than is possible or feasible for certain objects. Furthermore, programming anchors into a model for an augmented reality system is time consuming.

[0009] Therefore, it is desirable to have a method and apparatus that takes into account at least some of the above-mentioned problems and other possible problems.For example, it is desirable to have a method and apparatus that overcomes the technical problems of orienting an augmented reality device to an object in a real world environment. Summary of the invention

[0010] In one illustrative embodiment, an augmented reality system includes an active portable anchor, a processor system, and an augmented reality device. The active portable anchor is configured to output a current physical anchor position of the active portable anchor relative to an object. The processor system is configured to determine the current physical anchor position of the active portable anchor relative to the object using the physical anchor position of the active portable anchor and the physical object position of the object. The augmented reality device is configured to receive the current physical anchor position of the active portable anchor relative to the object from the active portable anchor. The augmented reality device is further configured to determine a current model anchor position of the active portable anchor in a model of the object using the current physical anchor position, and to display augmented reality information in association on a real-time view of the object in the augmented reality device using the current model anchor position of the active portable anchor and the model of the object. The current model anchor position of the active portable anchor in the model of the object is updated to reflect the current physical anchor position of the active portable anchor relative to the object.

[0011] In another illustrative embodiment, an augmented reality system includes an active portable anchor and an external tracking system. The active portable anchor is configured to output a current physical anchor position of the active portable anchor relative to an object. The external tracking system is configured to determine a physical anchor position of the active portable anchor and a physical object position of the object. The current physical anchor position of the active portable anchor relative to the object output by the active portable anchor is determined using the physical anchor position of the active portable anchor and the physical object position of the object.

[0012] In yet another illustrative embodiment, an augmented reality system includes a network and a communication port in the network. The communication port is configured to communicate with a portable active anchor and send a current physical anchor position of the active portable anchor relative to an object to the active portable anchor, wherein the current physical anchor position of the active portable anchor relative to the object is determined using a physical anchor position of the active portable anchor and a physical object position of the object.

[0013] The features and functions may be implemented independently in various embodiments of the present disclosure or may be combined in yet another embodiment in which further details can be seen with reference to the following description and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The novel features which are believed to be characteristic of the illustrative embodiments are set forth in the appended claims. However, the illustrative embodiments together with the preferred mode of use, further objects and features thereof will be best understood by reference to the following detailed description of illustrative embodiments of the disclosure when read in conjunction with the accompanying drawings, in which:

[0015] Figure 1 is a pictorial representation of a network of data processing systems in which the illustrative embodiments may be implemented;

[0016] Figure 2 is an illustration of a block diagram of an augmented reality environment according to one illustrative embodiment;

[0017] Figure 3 is an illustration of a block diagram of an active portable anchor according to one illustrative embodiment;

[0018] Figure 4 is an illustration of a data flow diagram for displaying augmented reality information over a real-time view of an object according to an illustrative embodiment;

[0019] Figure 5 is an illustration of an augmented reality environment according to an illustrative embodiment;

[0020] Figure 6 is a diagram of an active portable anchor according to an illustrative embodiment;

[0021] Figure 7 is an illustration of a flow chart of a process for displaying augmented reality information over a live view according to one illustrative embodiment;

[0022] Figure 8 is an illustration of a flow chart of a process for outputting a current physical anchor location for orienting an augmented reality device according to one illustrative embodiment;

[0023] Fig. 9 is an illustration of a flow chart of a process for displaying augmented reality information according to one illustrative embodiment;

[0024] Fig.10 is an illustration of a flowchart of a process for directing an augmented reality device according to one illustrative embodiment;

[0025] Fig.11 is an illustration of a flow chart of a process for receiving a current physical anchor location according to one illustrative embodiment;

[0026] Fig.12 is an illustration of a block diagram of a data processing system according to one illustrative embodiment;

[0027] Fig.13 is an illustration of a block diagram of an aircraft manufacturing and service method according to one illustrative embodiment;

[0028] Fig.14 is an illustration of a block diagram of an aircraft in which the illustrative embodiments may be implemented; and

[0029] Fig.15 is an illustration of a block diagram of a product management system in accordance with an illustrative embodiment. DETAILED DESCRIPTION

[0030] The illustrative embodiments recognize and take into account one or more different considerations. The illustrative embodiments recognize and take into account that the accuracy of the location augmented reality information displayed on the real-time view of the aircraft is important for performing operations on the aircraft. For example, augmented reality information can be displayed on the real-time view to perform operations such as drilling holes in the aircraft, reworking inconsistencies, applying sealants, or installing fasteners. In one illustrative example, the augmented reality information can display inconsistencies using visual information labels. These labels can mark the location of the inconsistency and provide information about the inconsistency.

[0031] The illustrative embodiments recognize and take into account that, in dynamic environments, the use of permanent anchors is currently not feasible. In addition, the illustrative embodiments recognize and take into account that the techniques for programming anchors into models for use with augmented reality devices are time consuming. The illustrative embodiments recognize and take into account that the amount of time currently used to establish anchors is much greater than desired.

[0032] The illustrative embodiments recognize and take into account that currently available techniques for calibrating or orienting augmented reality devices do not work well in dynamic environments where at least one of an object or a human operator with the augmented reality device moves. For example, the illustrative embodiments recognize and take into account that using fixed point or dynamic photogrammetry in an augmented reality system is taxing on resource usage and requires much effort to program features such as anchor plates on an object into a model of the object.

[0033] Furthermore, the illustrative embodiments recognize and take into account that for aircraft, the number of features available for this type of process is so small as to be impractical. Additionally, the illustrative embodiments recognize and take into account that computer aided design data may be much larger than desired without the desired resolution. The illustrative embodiments recognize and take into account that this type of technology is more suitable for smaller volumes or spaces than that used for aircraft.

[0034] The illustrative embodiments also recognize and take into account that currently used anchor plates are not very useful because they need to be in a known position. This type of limitation makes anchor plates impractical for use in dynamic environments where human operators may move relative to the aircraft.

[0035] The illustrative embodiments recognize and take into account that the active portable anchor can enable the augmented reality device to quickly orient itself to an object in the environment. The illustrative embodiments recognize and take into account that the active portable anchor can be used as a calibration plate similar to the current anchor, allowing the augmented reality device to recognize that the anchor exists in the real world environment. The illustrative embodiments also recognize and take into account that the active portable anchor can also be configured to provide the augmented reality device with the current position of the active portable anchor relative to the object.

[0036] The illustrative embodiments recognize and take into account that this type of solution can be implemented by utilizing a secondary positioning system in the form of an external tracking system. The illustrative embodiments recognize and take into account that the external tracking system operates to identify the locations of the active portable anchors and relay that information through those active portable anchors, which in turn provide the information to the augmented reality device.

[0037] Thus, the illustrative embodiments provide a method, apparatus, and system for providing an augmented reality device with the ability to locate itself within an environment using a portable active anchor. In one illustrative example, an augmented reality system includes an active portable anchor, a processor system, and an augmented reality device. The active portable anchor is configured to output a current physical anchor position of the active portable anchor relative to an object. The processor system is configured to determine the current physical anchor position of the active portable anchor relative to the object using the physical anchor position of the active portable anchor and the physical object position of the object.

[0038] The augmented reality device is configured to receive, from the active portable anchor, a current physical anchor position of the active portable anchor relative to the object. The augmented reality device is further configured to determine a current model position of the active portable anchor in a model of the object using the current physical anchor position, and to display augmented reality information in association on a real-time view of the object in the augmented reality device using the current model anchor position of the active portable anchor and the model of the object. The model anchor position of the active portable anchor in the model of the object is dynamically updated to reflect the current physical anchor position of the active portable anchor relative to the object.

[0039] The location of an object includes the position of the object described in three dimensions. For example, the position can be described using a Cartesian coordinate system. In addition, the location of an object also includes the orientation of the object. The orientation can be described using two or more vectors in the illustrative example.

[0040] Referring now to the drawings, and in particular to Figure 1 , depicts a pictorial representation of a network of data processing systems in which the illustrative embodiments may be implemented. Network data processing system 100 is a network of computers in which the illustrative embodiments may be implemented. Network data processing system 100 contains network 102, which is the medium used to provide communications links between various devices and computers connected together within network data processing system 100. Network 102 may include connections such as wire, wireless communication links, or fiber optic cables.

[0041] In the depicted example, server computer 104 and server computer 106 are connected to network 102 along with storage unit 108. In addition, client devices 110 are connected to network 102. As depicted, client devices 110 include client computer 112, client computer 114, and client computer 116. Client devices 110 may be, for example, computers, workstations, or network computers. In the depicted example, server computer 104 provides information such as boot / startup files, operating system images, and applications to client devices 110. In addition, client devices 110 may also include other types of client devices, such as mobile phone 118, tablet computer 120, and smart glasses 122. In this illustrative example, some or all of client devices 110 may form an Internet of Things (IoT), in which these physical devices may connect and exchange data.

[0042] In this example, client device 110 is a client to server computer 104. Network data processing system 100 may include additional server computers, client computers, and other devices not shown. Client device 110 connects to network 102 using at least one of a wired, fiber optic, or wireless connection.

[0043] Program code located in network data processing system 100 may be stored on a computer recordable storage medium and downloaded to the data processing system or other device for use. For example, program code may be stored on a computer recordable storage medium on server computer 104 and downloaded to client device 110 via network 102 for use on client device 110.

[0044] In the depicted example, network data processing system 100 is the Internet with network 102, representing a global collection of networks and gateways that use the Transmission Control Protocol / Internet Protocol (TCP / IP) suite of protocols to communicate with each other. At the heart of the Internet is a backbone of high-speed data communication lines between major nodes or host computers, which consist of thousands of commercial, government, educational, and other computer systems that route data and messages. Of course, network data processing system 100 may also be implemented using many different types of networks. For example, network 102 may include at least one of the Internet, an intranet, a local area network (LAN), a metropolitan area network (MAN), or a wide area network (WAN). Figure 1 This is intended as an example, and not as an architectural limitation for the different illustrative embodiments.

[0045] As used herein, "several," when used with reference to an item, means one or more items. For example, "several different types of networks" are one or more different types of networks.

[0046] In addition, the phrase "at least one of," when used with a list of items, means that different combinations of one or more of the listed items can be used, and only one of each item in the list may be required. In other words, "at least one of" means that any combination of items and quantities of items can be used from the list, but not all items in the list are required. The item may be a specific object, thing, or category.

[0047] For example, but not limited to, "at least one of item A, item B, or item C" may include item A, item A and item B, or item C. This example may also include item A, item B, and item C, or item B and item C. Of course, any combination of these items may be presented. In some illustrative examples, "at least one of..." may be, for example, but not limited to, two items A; one item B; ten items C; four items B and seven items C; or other suitable combinations.

[0048] In one illustrative example, human operator 124 operates an augmented reality device, such as smart glasses 122, to perform at least one of a manufacturing or maintenance operation on aircraft 126. As depicted, server computer 106 sends model 128 of aircraft 126 to smart glasses 122 for use in displaying augmented reality information to augment a real-time view of aircraft 126 for human operator 124.

[0049] In this depicted example, the active portable anchor 130 and the external tracking system 132 provide information for identifying the location of the smart glasses 122 relative to the aircraft 126. The external tracking system 132 identifies the physical location of the aircraft 126 and the active portable anchor 130. A processor system located in at least one of the active portable anchor 130, the external tracking system 132, the client device 110, the server computer 104, or the server computer 106 identifies the current physical anchor location of the active portable anchor 130 relative to the aircraft 126. The active portable anchor 130 sends the current physical anchor location to the smart glasses 122.

[0050] As depicted, the smart glasses 122 receive the current physical location of the active portable anchor 130 from the active portable anchor 130. This current physical anchor location of the active portable anchor 130 can be received by the smart glasses 122 in a number of different ways. For example, the current physical anchor location can be received from at least one of a display of the current physical anchor location on the active portable anchor 130 or a wireless transmission of the current physical location from the active portable anchor 130.

[0051] Smart glasses 122 use the current physical anchor position of active portable anchor 130 to determine where to display augmented reality information on the real-time view of aircraft 126. For example, the augmented reality information may be wiring of aircraft 126 located below the surface of aircraft 126. Using the current physical position, smart glasses 122 determine where to display graphics in the real-time view of aircraft 126 to display the wiring in the actual location of the wiring in aircraft 126.

[0052] The smart glasses 122 determine their position relative to the active portable anchor 130. Upon calibrating themselves to the active portable anchor 130, the smart glasses 122 may process the model 128 of the aircraft 126 to display augmented reality information without user input and without using photogrammetry data of the larger model.

[0053] Regarding accuracy, as the human operator 124 moves, the active portable anchor 130 may be moved to maintain a distance between the smart glasses 122 and the active portable anchor 130 such that the desired accuracy is maintained when the location on the real-time view of the aircraft 126 displays the augmented reality information. As the active portable anchor 130 moves, the new physical anchor location of the active portable anchor 130 may be dynamically determined and provided to the smart glasses 122.

[0054] The illustration of network data processing system 100 used in components of an augmented reality system is not meant to limit the manner in which network data processing system 100 may implement it. In other illustrative examples, one or more intelligent global positioning locators may be present in addition to those depicted. Furthermore, in addition to human operator 124, one or more users with augmented reality devices may be present performing operations on aircraft 126.

[0055] In one illustrative example, network 102 includes communication port 103. Communication port 103 is a hardware port in network 102 that is configured to provide communication with other data processing systems or devices (e.g., active portable anchor 130). Communication can be direct or indirect, utilizing one or more other devices that facilitate sending or receiving communications. In these illustrative examples, communication port 103 is located in a network interface card, a switch, a router, or some other device.

[0056] As depicted, the communication port 103 is configured to communicate with the active portable anchor 130 and transmit to the active portable anchor 130 a current physical anchor position of the active portable anchor 130 relative to an object, such as the aircraft 126, wherein the current physical anchor position of the active portable anchor 130 relative to the object is determined using the physical anchor position of the active portable anchor 130 and the physical object position of the object. The active portable anchor 130 is configured to output the current physical anchor position of the active portable anchor 130 relative to the object, such as the aircraft 126.

[0057] In addition, the augmented reality device, such as the smart glasses 122, is configured to receive a current physical anchor position of the active portable anchor 130 relative to the object from the active portable anchor 130. The smart glasses 122 are configured to determine a current model anchor position of the active portable anchor 130 in the model 128 of the object using the current physical anchor position, and to display augmented reality information in association on a real-time view of the object in the augmented reality device using the current model anchor position of the active portable anchor 130 and the model 128 of the object. The current model anchor position of the active portable anchor 130 in the model 128 of the object is dynamically updated to reflect the current physical anchor position of the active portable anchor 130 relative to the object.

[0058] Thus, the technical problem of orienting an augmented reality device to an object in a real-world environment may be overcome in the network data processing system 100. One or more technical solutions may provide a technical effect of enabling an augmented reality device (e.g., smart glasses 122) to orient itself using an anchor such as an active portable anchor 130. In one or more technical solutions, the active portable anchor 130 may be moved to different positions relative to an object (e.g., an aircraft 126), capable of maintaining a desired distance between the smart glasses 122 and the active portable anchor 130, which results in maintaining a desired level of accuracy when displaying augmented reality information on a real-time view in the smart glasses 122. As a result, one or more of the technical solutions using the active portable anchor 130 enable the human operator 124 to perform operations on the aircraft 126 with a desired level of accuracy when relying on the display of augmented reality information on a real-time view in the smart glasses 122. For example, when the operation is a manufacturing operation such as drilling a hole, the location of the hole may be indicated in the augmented reality information on the real-time view of the aircraft 126 with a desired level of accuracy for drilling the hole.

[0059] Next turn Figure 2 , an illustration of a block diagram of an augmented reality environment is depicted according to an illustrative embodiment. In this illustrative example, an Figure 1 The different components shown in block diagram form in augmented reality environment 200 may be implemented using the components shown in network data processing system 100 in FIG.

[0060] Augmented reality environment 200 is an environment in which augmented reality system 202 is configured to utilize augmented reality device 212 to augment real-time view 204 of object 206 with augmented reality information 208 seen by human operator 210. Object 206 can take a variety of different forms. For example, object 206 can be Figure 1 In addition, object 206 can also be selected from a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly, a monument, and other suitable objects.

[0061] In this illustrative example, augmented reality device 212 is a physical hardware device and is selected from one of a head-mounted display, an optical see-through head-mounted display, a mobile phone, a tablet computer, smart glasses, wearable computer glasses, or some other suitable hardware system that can be moved and held or worn by human operator 210.

[0062] As depicted, real-time view 204 may be provided by augmented reality device 212 as a video feed on a display or by using a transparent see-through display or lens, enabling the user to see the physical real-world environment through the display in augmented reality device 212 .

[0063] For example, real-time view 204 may be seen on a display in augmented reality device 212 in the form of a head-mounted display, smart glasses, or a tablet computer. Augmented reality information 208 may be overlaid on a display in this type of augmented reality device 212. In other illustrative examples, real-time view 204 may be provided indirectly to a display that displays other information on real-time view 204. Real-time view 204 may be provided using a camera system that displays an image or video on a display device in augmented reality device 212.

[0064] In another illustrative example, live view 204 may be directly viewed by a human operator 210 of augmented reality device 212, wherein augmented reality information 208 is displayed through what the user sees on live view 204. When the user directly views live view 204, detection of live view 204 may be performed by using a sensor system, such as a camera system for augmented reality device 212.

[0065] As depicted, augmented reality information 208 augments real-time view 204 and can take a number of different forms. For example, augmented reality information 208 can be selected from at least one of a schematic diagram, a user input window, instructions, a graphic for a hidden structure, or a hologram for a component below the surface of object 206 that is not visible in real-time view 204 of object 206. The component can be, for example, selected from at least one of wiring, piping, composite layers, inconsistencies, joints, line replaceable units, or other components that may be in object 206.

[0066] In another illustrative example, augmented reality information 208 may include a graphical indicator that calls attention to a portion of object 206. For example, the graphical indicator may call attention to an inconsistency, such as a delamination, a crack, worn paint, incorrect dimensions, or other types of inconsistencies.

[0067] As another example, the graphical indicator may call attention to a location where an operation is to be performed. The operation may be, for example, a drilling operation, a fastener installation operation, an inspection operation, or some other suitable type of operation that may be used to manufacture or maintain object 206 .

[0068] Additionally, augmented reality information 208 may also prompt human operator 210 to provide user input to verify that changes should be made to resolve the inconsistency in object 206. In yet another illustrative example, augmented reality information 208 may provide a visualization of the user input made by operator 210. For example, augmented reality information 208 may include a graphical indicator showing where human operator 210 or another operator has “marked” the inconsistency on object 206.

[0069] As depicted, augmented reality system 202 includes several different components. In this example, augmented reality system 202 includes active portable anchor 214, external tracking system 216, processor system 218, and augmented reality device 212.

[0070] The active portable anchor 214 is configured to output a current physical anchor location 220 of the active portable anchor 214 relative to a physical object location 224 of the object 206 .

[0071] As depicted, processor system 218 is a physical hardware system including one or more processor units. When there are more than one processor unit, those processor units can communicate with each other using a communication medium. When the processor units are located in the same data processing system, the communication medium can be one or more buses in the data processing system. When the processor units are located in different data processing systems, the communication medium can be one or more buses and networks. The processor system can be selected from at least one of a central processing unit (CPU), a graphics processing unit (GPU), a multi-core processor, a physical processing unit (PPU), a digital signal processor (DSP), a network processor, or other suitable types of processors.

[0072] In this illustrative example, processor system 218 may be located in one or more different locations. For example, processor system 218 may be located in at least one of active portable anchor 214 , external tracking system 216 , or some other data processing system in augmented reality environment 200 .

[0073] As depicted, processor system 218 is configured to determine current physical anchor position 220 of active portable anchor 214 relative to object 206 using physical anchor position 222 of active portable anchor 214 and physical object position 224 of object 206 .

[0074] In this illustrative example, external tracking system 216 is a physical hardware system. External tracking system 216 includes at least one of a laser tracker, a laser scanner, a camera, a displacement sensor, a measurement sensor, a probe, or some other type of external tracking system.

[0075] The external tracking system 216 is configured to determine a physical anchor location 222 of the active portable anchor 214 and a physical object location 224 of the object 206. The physical anchor location 222 and the physical object location 224 are described using a tracking coordinate system 226 for the external tracking system 216.

[0076] In this depicted example, physical object location 224 may be placed in object coordinate system 228 for object 206. Portions of object 206 may be designated as reference points or origins.

[0077] For example, if object 206 is an aircraft, the origin may be the tip of the nose of the aircraft. Physical anchor location 222 may be transformed or related to object coordinate system 228. Object coordinate system 228 is the coordinate system used in model 234 of object 206.

[0078] The correlation is performed such that the physical anchor position 222 in the tracking coordinate system 226 is converted to a current physical anchor position 220 in the object coordinate system 228, wherein the current physical anchor position 220 of the active portable anchor 214 is relative to the object 206. In other words, the current physical anchor position 220 is relative to a reference point, such as the origin of the object 206 in the object coordinate system 228.

[0079] In other words, physical anchor location 222 and physical object location 224 in tracking coordinate system 226 are related by being converted or transformed to use object coordinate system 228 in model 234 of object 206. This conversion or transformation can be performed when the same reference point is used for the origin of object 206. For example, when object 206 is an aircraft, the origin can be determined, for example, by using three or more reference points. The origin can be, for example, the tip of the nose, a wing tip, a window, or some other feature on or in the aircraft.

[0080] As depicted, the augmented reality device 212 is configured to receive a current physical anchor position 220 of the active portable anchor 214 relative to the object 206 from the active portable anchor 214. The augmented reality device 212 is configured to determine a current model anchor position 232 of the active portable anchor 214 using the current physical anchor position 220 in a model 234 of the object 206. For example, the augmented reality device 212 determines a current model anchor position 232 of the active portable anchor 214 in the model 234 of the object 206 that is related to the current physical anchor position 220 of the active portable anchor 214 relative to the object 206 received from the active portable anchor 214.

[0081] In this illustrative example, model 234 of object 206 may take several different forms. For example, model 234 may be a partial model of object 206, model 234 may include a portion of object 206, or may include all of object 206. For example, when object 206 is an aircraft, model 234 may be a wing of the aircraft or the entire aircraft. In one illustrative example, the partial model of object 206 is selected from at least one of a portion of object 206 in the field of view of augmented reality device 212 or a portion of object 206 within a selected distance of augmented reality device 212.

[0082] In yet another illustrative example, model 234 of object 206 may be selected from one of a plurality of partial models based on dividing object 206 into regions according to various criteria. The criteria may include, for example, at least one of a type of operation to be performed on object 206, a size limit for the partial model, storage space available in augmented reality device 212 for the partial model, and other suitable types of criteria.

[0083] The augmented reality device 212 is configured to display the augmented reality information 208 in association with the real-time view 204 of the object 206 in the augmented reality device 212 using the current model anchor position 232 of the active portable anchor 214 and the model 234 of the object 206. As a result, the current model anchor position 232 of the active portable anchor 214 in the model 234 of the object 206 is dynamically updated to reflect the current physical anchor position 220 of the active portable anchor 214 relative to the object 206.

[0084] In this illustrative example, computer system 236 communicates with augmented reality device 212. In this illustrative example, computer system 236 sends model 234 of object 206 to augmented reality device 212. Computer system 236 is a physical hardware system and includes one or more data processing systems. When there is more than one data processing system, those data processing systems communicate with each other using a communication medium. The communication medium can be a network. The data processing system can be selected from at least one of a computer, a server computer, a tablet computer, or some other suitable data processing system.

[0085] In one illustrative example, there are one or more technical solutions that overcome the technical problems of orienting an augmented reality device to an object in a real-world environment. As a result, one or more technical solutions can provide a technical effect of enabling the augmented reality device to orient itself using an anchor. One or more technical solutions provide an active portable anchor, wherein the anchor can be moved to different positions so that a desired distance can be maintained between the augmented reality device 212 and the active portable anchor 214, which results in maintaining a desired level of accuracy when displaying the augmented reality information 208 on the real-time view 204.

[0086] As a result, the augmented reality system 202 operates as a special purpose computer system, wherein the active portable anchor 214 in the augmented reality system 202 enables the augmented reality device 212 to display the augmented reality information 208 on the real-time view 204 of the object 206 with increased accuracy. The active portable anchor 214 is a physical component that transforms the augmented reality system 202 into a special purpose computer system, for example, as compared to currently available general purpose computer systems that do not have the active portable anchor 214.

[0087] Next turn Figure 3 , depicts an illustration of a block diagram of an active portable anchor according to an illustrative embodiment. In illustrative examples, the same reference numeral may be used in more than one figure. Repeated use of reference numerals in different figures refers to the same elements in the different figures.

[0088] This figure depicts one way that the active portable anchor 214 may be implemented. In this example, the active portable anchor 214 includes a portable frame 300, a communication unit 302, an output system 304, and a processor unit 306. In this example, these components enable an augmented reality device to use the active portable anchor 214 to display augmented reality information on a real-time view of an object. These components operate to enable the active portable anchor 214 to output the current physical anchor position of the active portable anchor 214 relative to the object.

[0089] As depicted, the portable frame 300 is a structure that operates to support, enclose, or hold the components of the active portable anchor 214. At least one of the size or weight of the portable frame 300 is selected so that the portable frame 300 can be moved by an operator. In some cases, the size or weight can be selected so that two human operators can move the portable frame 300.

[0090] The portable frame 300 can take several different forms. For example, the portable frame 300 can be a housing, a shell, a platform, or some other suitable structure. In this example, the communication unit 302, the output system 304, and the processor unit 306 can be physically connected to the portable frame 300.

[0091] As used herein, a first component is "physically connected to" a second component means that the first component can be directly or indirectly connected to the second component. In other words, there can be additional components between the first component and the second component. When there are one or more additional components between the two components, the first component is considered to be indirectly connected to the second component. When the first component is directly connected to the second component, there are no additional components between the two components.

[0092] As depicted, communication unit 302 may be implemented using Wi-Fi, Bluetooth, or some other wireless transmission technology using radio frequency waves, optical signals, or other types of wireless transmission media. For example, "Wi-Fi" is a trademark of the Wi-Fi Alliance, and "Bluetooth" is a registered trademark of Bluetooth SIG, Inc.

[0093] In this illustrative example, communication unit 302 is configured to receive physical anchor location 222 of active portable anchor 214 and physical object location 224 of object 206 determined by external tracking system 216. This location information may be received using a wireless communication link established by communication unit 302.

[0094] The output system 304 is physically connected to the portable frame 300. The output of the output system 304 and the active portable anchor 214 may be performed using at least one of a wireless transmitter or a display device.

[0095] In this example, the processor unit 306 is physically connected to the portable frame 300 and is in communication with the communication unit 302 and the output system 304. The processor unit 306 is configured to determine a current physical anchor position of the active portable anchor relative to the physical object position of the object using the physical anchor position and the physical object position; and output the current physical anchor position of the active portable anchor relative to the physical object position of the object using the output system.

[0096] Augmented reality environment 200 and Figure 2 and Figure 3 The illustration of different components in the illustrative embodiments is not intended to imply physical or architectural limitations on the manner in which the illustrative embodiments may be implemented. Other components in addition to or in place of the components described may be used. Certain components may be unnecessary. In addition, the blocks presented are used to illustrate some functional components. When implemented in the illustrative embodiments, one or more of these blocks may be combined, divided, or combined and divided into different blocks.

[0097] Next turn Figure 4 , depicts an illustration of a data flow diagram for displaying augmented reality information on a real-time view of an object, according to one illustrative embodiment. As depicted, a data flow for displaying augmented reality information on a real-time view of an object 400 is depicted, according to one illustrative embodiment. In this illustrative example, smart glasses 402 are Figure 24. Smart glasses 402 receive a model 404 of an object 400 from a computer 405. Smart glasses 402 use the model 404 to display augmented reality information over a real-time view of the object 400. As depicted, graphics, information, and other data from the model 404 can be used to create or be displayed as augmented reality information.

[0098] In positioning the augmented reality information 418 over the real-time view of the object 400, the smart glasses 402 orient themselves relative to the active portable anchor 406. In this example, the orientation is performed by recognizing the active portable anchor 406 as a reference for identifying the positioning of the smart glasses 402 and relating the model 404 of the object 400 to the real-time view of the object 400. This recognition can be performed when the active portable anchor 406 is in the field of view of the smart glasses 402.

[0099] The smart glasses 402 use photogrammetry sensors and processes to identify the active portable anchor 406. The identification can be based on at least one of the shape, size, or other visual characteristics of the active portable anchor 406. In this illustrative example, the active portable anchor 406 also provides its location to the smart glasses 402. The location of the active portable anchor 406 in the current location data 414 is received from the active portable anchor 406 and used to display augmented reality information 418 on the real-time view of the active portable anchor 406.

[0100] In this illustrative example, active portable anchor 406 is movable during operation of smart glasses 402. The current location of active portable anchor 406 can be dynamically determined using external tracking system 408.

[0101] In this illustrative example, external tracking system 408 includes locator 410 and object locator detector 411. Object locator detector 411 can be manipulated by at least one of a human user or a robot to touch different points on object 400. Locator 410 records measurements based on object locator detector 411 touching object 400. Object locator detector 411 can be used to take measurements of active portable anchor 406. These measurements can be used to identify the physical anchor location of active portable anchor 406 and the physical object location of object 400 that form location information 412.

[0102] The positioning information 412 is sent to the active portable anchor 406. The active portable anchor 406 generates current positioning data 414 using the positioning information 412. The current positioning data 414 includes the current physical anchor position of the active portable anchor 406 relative to the object 400. The active portable anchor 406 sends the current positioning data 414 to the smart glasses 402.

[0103] As depicted, the smart glasses 402 identify in the current positioning data 414 the current physical anchor position of the active portable anchor 406 relative to the object 400. The positioning of the active portable anchor 406 in the model 404 is updated so that the current model anchor position for the active portable anchor 406 corresponds to the current physical anchor position of the active portable anchor 406 relative to the object 400.

[0104] The smart glasses 402 use the active portable anchor 406 to orient themselves relative to the object 400. Through this orientation, the smart glasses 402 identify the position of the smart glasses 402 relative to the active portable anchor 406.

[0105] Smart glasses 402 display augmented reality information 418 over the real-time view of object 400. Positioning of augmented reality information 418 over the real-time view can be performed with greater accuracy when active portable anchor 406 is within a desired distance of smart glasses 402. If glasses 402 move, active portable anchor 406 may also move.

[0106] If the active portable anchor 406 is moved, updates to the location in the model 404 may be performed dynamically using the external tracking system 408 to identify the location of the active portable anchor 406 and send the updated location information to the active portable anchor 406 .

[0107] refer to Figure 5 , a diagram of an augmented reality environment is depicted in accordance with an illustrative embodiment. Augmented reality environment 501 is Figure 2 An example of one implementation of an augmented reality environment 200 is shown in block diagram form in FIG.

[0108] In this illustrative example, aircraft 500 is Figure 2 500. In addition, active portable anchor 502 is positioned relative to aircraft 500. As depicted, external tracking system 504 identifies the locations of aircraft 500 and active portable anchor 502. External tracking system 504 includes intelligent global positioning system (iGPS) locator 506, intelligent global positioning system (iGPS) locator 508, and intelligent global positioning system (iGPS) locator 510.

[0109] These smart GPS locators include laser transmitters that scan a volume of space surrounding the aircraft 500 and the active portable anchor 502 from different locations to identify the location of both objects. The location includes position and orientation based on the coordinate system of the external tracking system 504.

[0110] In this depicted example, nose tip 512 of aircraft 500 is selected as a reference point for aircraft 500. As depicted, nose tip 512 has a location including position L1 (100, 200, 50) and an orientation described as X-vector X1 (0.7, 0.7, 0.14) and Z-vector Z1 (-0.19, 0.28, 0.98). Top 514 of active portable anchor 502 is selected as a reference point for active portable anchor 502 and has a location including position L2 (60, 80, 10) and an orientation described as X-vector X2 (0.44, -0.88, 0.15) and Z-vector Z2 (0.1, -0.1, 0.99).

[0111] The position of the active portable anchor 502 relative to the aircraft 500 can be identified by subtracting the position of the nose tip 512 from the position of the top 514. The relative position is identified as L2-L1 = relative position RL (40, 120, 40). The relative orientation RL (X'Z') is X' = X2-X2 = (0.26, 1.58, -0.01), Z' = Z2-Z1 = (-0.29, 0.38, -0.01)

[0112] Subtracting these positions provides the three-dimensional relative position and relative orientation of the active portable anchor 502 relative to the aircraft 500. This position of the active portable anchor 502 can be used to update the model anchor position of the active portable anchor 502 in the model of the aircraft 500.

[0113] In this depicted example, the nose tip in the model corresponding to nose tip 512 is located at the origin of the aircraft model with position LM(0,0,0), with an orientation of XM=X-Vector(1,0,0) and ZM=Z-Vector(0,0,1). In this example, the current model anchor position in the model can be updated to reflect the position of the active portable anchor in the real world environment. For example, the anchor location (AL) in the model is LM(0,0,0)+RL(40,120,40)=AL(40,120,40), and the anchor orientation (AO) is AO(X',Z'), where XA=(1,0,0)+(0.26,1.58,-0.01)=(1.26,1.58,-0.01) and ZA=(0,0,1)+(-0.29,0.38,-0.01)=(-0.29,0.38,0.99).

[0114] Next reference Figure 6 , depicts an illustration of an active portable anchor according to one illustrative embodiment. In this illustrative example, the active portable anchor 600 is Figure 2 and Figure 3An example of one implementation of an active portable anchor 214 is shown in block diagram form in FIG.

[0115] As depicted, active portable anchor 600 has a portable frame 606. A tablet 608 is physically connected to portable frame 606. Tablet 608 has a shape that an augmented reality device will recognize as an anchor for orienting itself.

[0116] Display device 604 is physically connected to tablet 608 and provides the ability to display the location of active portable anchor 600. Display device 604 may display, for example, a barcode, a matrix barcode, or some other suitable type of format that visually communicates the location of active portable anchor 600. Antenna 610 is configured to receive location information from an external tracking system.

[0117] Figure 7-Figure 9 The different processes in the flowcharts in the can be implemented in hardware, software or both. When implemented in software, the process can take the form of program code that is run by one of the multiple processor units in one or more hardware devices in one or more computer systems.

[0118] refer to Figure 7 , depicts an illustration of a flowchart of a process for displaying augmented reality information on a real-time view according to an illustrative embodiment. In the depicted example, Figure 7 The process can be Figure 2 The various operations may be implemented in one or more components of the augmented reality system 202 in the embodiment of the present invention. For example, the various operations may be implemented by the processor system 218, which may include a processor system 218 that may be located at Figure 2 In different hardware components in the augmented reality system 202 and the augmented reality device 212.

[0119] The process begins with the external tracking system determining a physical anchor location of the active portable anchor and a physical object location of the object (operation 700). In this illustrative example, operation 700 may be performed by Figure 2 The two positionings, the physical anchor positioning and the physical object positioning, are in the tracking coordinate system for the external tracking system.

[0120] The processor system generates current positioning data (operation 702). The current positioning data includes a current physical anchor position of the active portable anchor relative to the object. The current physical anchor position may be identified by subtracting the physical object position from the physical anchor position. Operation 702 may be performed by one or more processor units in the processor system located in at least one of the external tracking system and the active portable anchor.

[0121] The active portable anchor outputs the current positioning data (operation 704). In the illustrative example, the output may be in a form selected from at least one of wireless transmission or visual display of the current positioning data.

[0122] The processor system updates the model of the object using the current positioning data (operation 706). In operation 704, the process updates the model to reflect the current model anchor position of the active portable anchor relative to the object in the model.

[0123] In this example, one or more processor units in a processor system perform the operations and may be located in at least one of the augmented reality device or a computer that stores or sends the model of the object to the augmented reality device, or other data processing and augmented reality systems.

[0124] In operation 706 , the location of the active physical anchor in the model of the object is updated to reflect the current location of the active portable anchor in the real-world environment.

[0125] The augmented reality device orients itself in the real-world environment using the active portable anchor (operation 708). The process terminates thereafter. In this illustrative example, the augmented reality device receives and uses the current physical anchor position output by the active portable anchor to correspond to a model of the object on the real-world view of the object in the real-world environment. The augmented reality device displays augmented reality information with increased accuracy compared to current use.

[0126] Next reference Figure 8 , an illustration of a flowchart of a process for outputting a current physical anchor position to orient an augmented reality device is depicted in accordance with an illustrative embodiment. The process depicted in the flowchart may be Figure 2 The active portable anchor 214 is implemented in.

[0127] The process begins by identifying a current physical anchor location of an active portable anchor (operation 800). The active portable anchor is used by an augmented reality device to display augmented reality information over a real-time view of an object.

[0128] In one illustrative example, the identifying performed in operation 800 includes determining, by the active portable anchor, a current physical anchor position of the active portable anchor relative to the object using a physical anchor position of the active portable anchor and a physical object position of the object. In another example, the identifying step includes determining, by the active portable anchor, a current model anchor position of the active portable anchor in a model of the object that is related to the current physical anchor position of the active portable anchor relative to the object received from the active portable anchor. In yet another illustrative example, the identifying step includes determining, by the external tracker, a current physical anchor position of the active portable anchor relative to the object using a physical anchor position of the active portable anchor and a physical object position of the object.

[0129] The process outputs a current physical anchor position of the active portable anchor relative to the object (operation 802). The process terminates thereafter. The current physical anchor position may be dynamically updated as the active portable anchor is moved to maintain a desired distance from the augmented reality device.

[0130] Next turn Fig. 9 , an illustration of a flowchart of a process for displaying augmented reality information is depicted in accordance with an illustrative embodiment. Fig. 9 The process can be Figure 2 The augmented reality device 212 is implemented in the embodiment of the present invention.

[0131] The process begins by receiving a current physical anchor position of the active portable anchor relative to an object from the active portable anchor (operation 900). The process determines a current model position of the active portable anchor in a model of the object using the current physical anchor position of the active portable anchor relative to the object (operation 902). The process updates the model with the current model position of the active portable anchor (operation 904).

[0132] The process displays augmented reality information on the real-time view of the object in the augmented reality device using the current model position of the active portable anchor and the model of the object (operation 906 ). The process terminates thereafter.

[0133] By dynamically updating the current positioning of the active portable anchor in the model of the object to reflect the current physical anchor positioning of the active portable anchor relative to the physical object positioning of the object, the accuracy of positioning augmented reality information on the real-time view of the object is increased.

[0134] Next reference Fig.10 , an illustration of a flowchart of a process for directing an augmented reality device is depicted in accordance with an illustrative embodiment. Fig.10 The process in can be implemented in one or more components of the augmented reality system 202. For example, different operations can be performed by Figure 2 The invention is implemented by one or more processor units in the augmented reality device 212.

[0135] The process begins by obtaining a current physical anchor location of an active portable anchor from the active portable anchor (operation 1000). In operation 1000, the current physical anchor location may be displayed on a display device on the active portable anchor. The current physical anchor location may be obtained by the augmented reality device from the display device. In another illustrative example, the current physical anchor location may be obtained by the augmented reality device from a wireless transmission received by the augmented reality device from the active portable anchor.

[0136] The process sets a local coordinate system for the augmented reality device based on the current physical anchor position of the active portable anchor (operation 1002). The position includes a location and orientation in three-dimensional space.

[0137] The process identifies a current model anchor position of the active portable anchor in the model of the object (operation 1004). The current model anchor position is in the coordinate system used by the model. The process loads and repositions the geometry in the model for display to match the local coordinate system (operation 1006). The process terminates thereafter. In operation 1006, the augmented reality device loads augmented reality information from the model for display on the real-time view of the object at the desired position on the real-time view.

[0138] Next reference Fig.11 , an illustration of a flowchart of a process for receiving a current physical anchor location is depicted in accordance with an illustrative embodiment. Fig.11 The process can be Figure 2 The augmented reality device 212 is implemented in the embodiment of the present invention.

[0139] The process begins by identifying more than one active portable anchor in a set of active portable anchors for an object (operation 1100). In this example, the set of active portable anchors is a plurality of active portable anchors for the object. The process selects a number of active portable anchors from the set of active portable anchors (operation 1102). As used herein, "a number of..." when used with reference to an item means one or more items. For example, the number of active portable anchors is one or more active portable anchors.

[0140] The selection in operation 1102 can be performed in a variety of different ways. For example, the selection of the closest active portable anchor can be based on the closest one in the field of view of the augmented reality device. In another example, more than one active portable anchor is used in the calibration, and more than one anchor origin is used to cross-reference the position. A bias or greater weight can be applied to closer anchors.

[0141] The process receives a selected number of current physical anchor locations from a selected number of current active portable anchors in the plurality of active portable anchors (operation 1104). The process terminates thereafter. For example, the augmented reality device may receive a single current anchor location of a nearest active portable anchor. In yet another illustrative example, the augmented reality device receives a selected number of current physical anchor locations from the plurality of current active portable anchors.

[0142] The flow charts and block diagrams in the different depicted embodiments illustrate the architecture, function and operation of some possible implementations of the apparatus and method in the illustrative embodiments. In this regard, each box in the flow chart or block diagram can represent at least one of the parts of a module, segment, function or operation or step. For example, one or more in the box can be implemented as a combination of program code, hardware or program code and hardware. When implemented in hardware, the hardware can, for example, take the form of an integrated circuit, which is manufactured or configured to perform one or more operations in the flow chart or block diagram. When implemented as a combination of program code and hardware, the implementation can take the form of firmware. Each box in the flow chart or block diagram can be implemented using a combination of a dedicated hardware system or dedicated hardware that performs different operations and a program code run by dedicated hardware.

[0143] In some alternative implementations of the illustrative embodiments, one or more functions mentioned in the blocks may not occur in the order mentioned in the figure. For example, in some cases, two blocks shown in succession may be performed substantially simultaneously, or the blocks may sometimes be performed in reverse order, depending on the functions involved. In addition, other blocks may be added in addition to the blocks illustrated in the flowchart or block diagram.

[0144] Now turn to Fig.12 , depicts an illustration of a block diagram of a data processing system according to one illustrative embodiment. Data processing system 1200 may be used to implement server computer 104, server computer 106, client device 110, augmented reality device 212, active portable anchor 214, external tracking system 216, computer system 236, smart glasses 402, computer 405, active portable anchor 406, and any other data processing system that may be used to perform operations for the different illustrative examples. As depicted, data processing system 1200 includes a communication framework 1202 that provides communications between processor unit 1204, memory 1206, persistent storage 1208, communication unit 1210, input / output (I / O) unit 1212, and display 1214. In this example, communication framework 1202 may take the form of a bus system.

[0145] Processor unit 1204 serves to execute instructions for software that may be loaded into memory 1206. Processor unit 1204 may be a number of processors, a multi-processor core, or some other type of processor, depending on the particular implementation.

[0146] Memory 1206 and permanent storage 1208 are examples of storage devices 1216. A storage device is any piece of hardware capable of storing information (for example, but not limited to, at least one of data in functional form, program code, or other appropriate information) temporarily, permanently, or both temporarily and permanently. In these illustrative examples, storage devices 1216 may also be referred to as computer-readable storage devices. In these examples, memory 1206 may be, for example, a random access memory or any other suitable volatile or non-volatile storage device. Persistent storage 1208 may take various forms, depending on the particular implementation.

[0147] For example, permanent storage 1208 may include one or more components or devices. For example, permanent storage 1208 may be a hard drive, a solid-state drive (SSD), flash memory, a rewritable optical disk, a rewritable magnetic tape, or some combination thereof. The media used by permanent storage 1208 may also be removable. For example, a removable hard drive may be used for permanent storage 1208.

[0148] In these illustrative examples, communications unit 1210 provides for communications with other data processing systems or devices. In these illustrative examples, communications unit 1210 is a network interface card.

[0149] Input / output unit 1212 allows for input and output of data with other devices that may be connected to data processing system 1200. For example, input / output unit 1212 may provide a connection for user input through at least one of a keyboard, a mouse, or some other suitable input device. Additionally, input / output unit 1212 may send output to a printer. Display 1214 provides a mechanism for displaying information to a user.

[0150] Instructions for at least one of an operating system, applications, or programs may be located in storage devices 1216, which are in communication with processor unit 1204 through communications framework 1202. The processes of the different embodiments may be performed by processor unit 1204 using computer-implemented instructions, which may be located in a memory, such as memory 1206.

[0151] These instructions are referred to as program code, computer usable program code, or computer readable program code, which can be read and executed by a processor in processor unit 1204. The program code in different embodiments may be embodied on different physical or computer readable storage media, such as memory 1206 or permanent storage 1208.

[0152] Program code 1218 resides in functional form on computer readable media 1220, which is selectively removable and can be loaded or transferred to data processing system 1200 for execution by processor unit 1204. In these illustrative embodiments, program code 1218 and computer readable media 1220 form computer program product 1222. In the illustrative example, computer readable media 1220 is computer readable storage media 1224.

[0153] In these illustrative examples, computer readable storage media 1224 is a physical or tangible storage device used to store program code 1218 rather than a medium that propagates or transmits program code 1218 .

[0154] Alternatively, program code 1218 may be transmitted to data processing system 1200 using a computer readable signal medium. Computer readable signal media may be, for example, a propagated data signal containing program code 1218. For example, a computer readable signal medium may be at least one of an electromagnetic signal, an optical signal, or any other suitable type of signal. These signals may be transmitted via at least one of a communication link, such as a wireless communication link, a fiber optic cable, a coaxial cable, an electric wire, or any other suitable type of communication link.

[0155] The different components described for data processing system 1200 are not meant to provide architectural limitations to the manner in which the different embodiments may be implemented. The different illustrative embodiments may be implemented in a data processing system that includes components in addition to or in place of the components described for data processing system 1200. Fig.12 Other components shown in the can be varied from the illustrative examples shown. The different embodiments can be implemented using any hardware device or system capable of running program code 1218.

[0156] You can Fig.13 Aircraft manufacturing and service method 1300 as shown in Fig.14 Illustrative embodiments of the present disclosure are described in the context of aircraft 1400 shown in FIG. Fig.13 , an illustration of a block diagram of an aircraft manufacturing and service method is depicted in accordance with an illustrative embodiment. During pre-production, aircraft manufacturing and service method 1300 may include Fig.14 Specification and design 1302 of the aircraft 1400 and material procurement 1304 .

[0157] During production, Fig.14 Component and subassembly manufacturing 1306 and system integration 1308 of the aircraft 1400 in FIG. Fig.14The aircraft 1400 in the embodiment may be certified and delivered 1310 to be placed in service 1312. While being served 1312 by the customer, Fig.14 The aircraft 1400 in the embodiment is scheduled for routine maintenance and servicing 1314, which may include modification, reconfiguration, refurbishment, and other maintenance or servicing. For example, aircraft inspections during routine maintenance and servicing 1314 may include maintaining or increasing Fig.14 Operation of at least one of flight safety or availability of aircraft 1400.

[0158] Each of the processes of aircraft manufacturing and service method 1300 may be performed or carried out by a system integrator, a third party, an operator, or some combination thereof. In these examples, the operator may be a customer. For purposes of this description, a system integrator may include, but is not limited to, any number of aircraft manufacturers and major system subcontractors; a third party may include, but is not limited to, any number of suppliers, subcontractors, and providers; and an operator may be an airline, a leasing company, a military entity, a service organization, etc.

[0159] Reference now Fig.14 , depicts a diagram of an aircraft in which an illustrative embodiment may be implemented. In this example, aircraft 1400 is comprised of Fig.13 14. Aircraft manufacturing and service method 1300 is shown in the drawings and may include fuselage 1402 having multiple systems 1404 and interior 1406. Examples of systems 1404 include one or more of propulsion system 1408, electrical system 1410, hydraulic system 1412, and environmental system 1414. Any number of other systems may be included. Although an aerospace example is shown, different illustrative embodiments may be applied to other industries, such as the automotive industry.

[0160] Can be Fig.13 Apparatuses and methods embodied herein are employed during at least one of the stages of aircraft manufacturing and service method 1300 .

[0161] In an illustrative example, in Fig.13 Components or subassemblies produced in component and subassembly manufacturing 1306 may be manufactured in a manner similar to that of aircraft 1400. Fig.13 As another example, during the production phase, one or more apparatus embodiments, method embodiments, or a combination thereof may be utilized, such as Fig.13 Component and subassembly manufacturing 1306 and system integration 1308 in the process. Fig.13One or more apparatus embodiments, method embodiments, or a combination thereof may be utilized during or both of the maintenance and servicing 1314 of the component and subassembly manufacturing 1306, system integration 1308, certification and delivery 1310, in service 1312, or maintenance and servicing 1314. For example, one or more apparatus embodiments, method embodiments, or a combination thereof may be utilized during at least one of the component and subassembly manufacturing 1306, system integration 1308, certification and delivery 1310, in service 1312, or maintenance and servicing 1314. Figure 2 202 in augmented reality system 206. By using active portable anchor 214, display of augmented reality information over a human operator's real-time view may be performed in a manner that allows the human operator to move more freely and maintains a desired level of accuracy when displaying the augmented reality information as compared to currently available techniques. Several different illustrative embodiments may substantially speed up assembly of aircraft 1400, reduce the cost of aircraft 1400, or both.

[0162] Now go to Fig.15 , an illustration of a block diagram of a product management system is depicted in accordance with an illustrative embodiment. Product management system 1500 is a physical hardware system. In this illustrative example, product management system 1500 may include at least one of manufacturing system 1502 or maintenance system 1504.

[0163] Manufacturing system 1502 is configured to manufacture products, such as Fig.14 As depicted, manufacturing system 1502 includes manufacturing instrument 1506. Manufacturing instrument 1506 includes at least one of preparation instrument 1508 or assembly instrument 1510.

[0164] Preparation apparatus 1508 is useful for manufacturing a device for forming Fig.14 Preparation apparatus 1508 may include machines and tools. The machines and tools may be at least one of a drill, a hydraulic press, a furnace, a mold, a composite tape laying machine, a vacuum system, a lathe, or other suitable types of apparatus. Preparation apparatus 1508 may be used to manufacture at least one of a metal part, a composite part, a semiconductor, a circuit, a fastener, a rib, a skin panel, a spar, an antenna, or other suitable types of parts.

[0165] Assembly apparatus 1510 is used to assemble components to form Fig.14 The assembly apparatus 1510 may be used to assemble components and parts to form the aircraft 1400. Specifically, the assembly apparatus 1510 may be used to assemble components and parts to form the aircraft 1400. The assembly apparatus 1510 may also include machines and tools. These machines and tools may be at least one of a robotic arm, a crawler, a faster installation system, a track-based drilling system, or a robot. The assembly apparatus 1510 may be used to assemble parts such as seats, horizontal stabilizers, wings, engines, engine cases, landing gear systems, and other parts of the aircraft 1400.

[0166] In this illustrative example, maintenance system 1504 includes maintenance instrument 1512. Maintenance instrument 1512 may include Fig.14 Maintenance instruments 1512 may include any instruments needed to perform maintenance on aircraft 1400. Maintenance instruments 1512 may include tools for performing various operations on parts on aircraft 1400. These operations may include at least one of disassembling a part, refurbishing a part, inspecting a part, reworking a part, manufacturing a replacement part, or other operations for performing maintenance on aircraft 1400. These operations may be for routine maintenance, inspections, upgrades, refurbishments, or other types of maintenance operations.

[0167] In the illustrative example, maintenance instrument 1512 may include ultrasonic inspection equipment, x-ray imaging systems, vision systems, drills, crawlers, and other suitable equipment. In some cases, maintenance instrument 1512 may include preparation instrument 1508, assembly instrument 1510, or both to produce and assemble components required for maintenance.

[0168] The product management system 1500 also includes a control system 1514. The control system 1514 is a hardware system and may also include software or other types of components. The control system 1514 is configured to control the operation of at least one of the manufacturing system 1502 or the maintenance system 1504. Specifically, the control system 1514 may control the operation of at least one of the preparation instrument 1508, the assembly instrument 1510, or the maintenance instrument 1512.

[0169] The hardware in control system 1514 may include computers, circuits, networks, and other types of instruments. Control may take the form of direct control of manufacturing instruments 1506. For example, robots, computer-controlled machines, and other instruments may be controlled by control system 1514. In other illustrative examples, control system 1514 may manage operations performed by human operators during manufacturing or while performing maintenance on aircraft 1400. For example, control system 1514 may assign tasks, provide instructions, display models, or perform other operations to manage operations performed by human operators 1516. In these illustrative examples, control systems 1514 may be implemented Figure 2 The augmented reality system 202 is used to manage Fig.14 At least one of manufacturing or maintenance of aircraft 1400.

[0170] For example, Figure 2 The augmented reality system 202 in the embodiment operates to provide a Fig.14Augmented reality information may be displayed to a human operator who is performing at least one of manufacturing or maintenance of a product of aircraft 1400. The augmented reality information may present instructions for performing at least one of the manufacturing or maintenance operations. As another example, the augmented reality information may identify work orders or tasks to be performed at different locations on aircraft 1400. Furthermore, the displayed augmented reality information may guide the human operator to the location on aircraft 1400 where the operation should be performed.

[0171] also, Figure 2 The augmented reality system 202 in FIG. 20 can also be used to receive input from a human operator. For example, a human operator can record inconsistencies identified from a visual inspection using the augmented reality system 202 .

[0172] In different illustrative examples, human operator 1516 may operate or interact with at least one of manufacturing instrument 1506, maintenance instrument 1512, or control system 1514. The interaction may be performed to manufacture Fig.14 Aircraft 1400 in.

[0173] Of course, product management system 1500 can be configured to manage Fig.14 Although product management system 1500 has been described with respect to manufacturing in the aerospace industry, product management system 1500 can be configured to manage products in other industries. For example, product management system 1500 can be configured to manufacture products for the automotive industry and any other suitable industry.

[0174] Thus, one or more illustrative examples utilize active portable anchors placed on or near objects. These active portable anchors enable the augmented reality device to quickly orient itself to the object in the real world environment. In addition, the active portable anchors can be used as calibration plates similar to current anchors. In other words, the augmented reality device can recognize that an anchor is present in the real world environment and can use the anchor to orient itself to display augmented reality information. The active portable anchor also provides the augmented reality device with the current anchor position of the active portable anchor relative to the object.

[0175] In this way, in one or more technical aspects, an augmented reality device can more effectively locate itself by using an active portable anchor, and more accurately display augmented reality information in a location relative to an object. For example, a graphical indicator of a location for forming a hole in an object can be displayed as augmented reality information on a real-time view of the object in a more accurate manner than currently available systems. The active portable anchor can be moved to another location while updating the active portable anchor to send the new location to the augmented reality device.

[0176] As a result, the augmented reality system in the illustrative example operates as a special purpose computer system, wherein the active portable anchor in the augmented reality system enables the augmented reality device to display augmented reality information on a real-time view of an object with increased accuracy. In particular, the active portable anchor is a physical component that transforms the augmented reality system into a special purpose computer system, as compared to currently available general purpose computer systems that do not have an active portable anchor.

[0177] The illustrative embodiments recognize and take into account that this type of solution can be implemented by utilizing a secondary positioning system in the form of an external tracking system. The illustrative embodiments recognize and take into account that the external tracking system operates to identify the locations of the active portable anchors and relays that information through those active portable anchors, which in turn provide the information to the augmented reality device. Furthermore, the accuracy of positioning the augmented reality information on the real-time view of the object is increased by updating the current model anchor position of the active portable anchor in the model of the object in accordance with the movement of the active portable anchor to reflect the change in the current physical anchor position of the active portable anchor relative to the object.

[0178] The description of different illustrative embodiments has been presented for the purpose of illustration and description, and is not intended to be exhaustive or limited to the embodiments of the disclosed forms. Different illustrative examples describe components that perform actions or operations. In the illustrative embodiments, the components can be configured to perform the described actions or operations. For example, the components can have a configuration or design for the structure that provides the components with the ability to perform the actions or operations described as being performed by the components in the illustrative examples.

[0179] Furthermore, the present disclosure includes embodiments according to the following embodiments:

[0180] Embodiment 1. An augmented reality system (202), comprising:

[0181] an active portable anchor (214) configured to output a current physical anchor position (220) of the active portable anchor (214) relative to the object (206);

[0182] a processor system (218) configured to determine a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206);

[0183] An augmented reality device (212) is configured to receive a current physical anchor position (220) of the active portable anchor (214) relative to an object (206) from the active portable anchor (214); determine a current model anchor position (232) of the active portable anchor (214) in a model (234) of the object (206) using the current physical anchor position (220); and display augmented reality information (208) in association on a real-time view (204) of the object (206) in the augmented reality device (212) using the current model anchor position (232) of the active portable anchor (214) and the model (234) of the object (206), wherein the current model anchor position (232) of the active portable anchor (214) in the model (234) of the object (206) is dynamically updated to reflect the current physical anchor position (220) of the active portable anchor (214) relative to the object (206).

[0184] Embodiment 2. The augmented reality system (202) of Embodiment 1, wherein the processor system (218) is located in the active portable anchor (214).

[0185] Embodiment 3. The augmented reality system (202) according to any of the preceding embodiments, further comprising:

[0186] An external tracking system (216) is configured to determine a physical anchor position (222) of an active portable anchor (214) and a physical object position (224) of an object (206) in a coordinate system, wherein a processor system (218) is located in the external tracking system (216).

[0187] Embodiment 4. The augmented reality system (202) according to any of the preceding embodiments, further comprising:

[0188] A group of active portable anchors (206) for an object, wherein the active portable anchor (214) and the group of active portable anchors are multiple active portable anchors for the object (206), and wherein the augmented reality device (212) receives a selected number of current physical anchor locations from a selected number of current active portable anchors from the multiple active portable anchors.

[0189] Embodiment 5. An augmented reality system (202) according to any of the preceding embodiments, wherein the augmented reality device (212) determines a current model anchor position (232) of an active portable anchor (214) in a model (234) of an object (206) that is related to a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) received from the active portable anchor (214).

[0190] Embodiment 6. An augmented reality system (202) according to any preceding embodiment, wherein the model (234) of the object (206) is a partial model of the object (206) that includes a portion of the object (206).

[0191] Embodiment 7. An augmented reality system (202) according to Embodiment 6, wherein the partial model of the object (206) is selected from at least one of the portions of the object (206) in the field of view of the augmented reality device (212) or the portions of the object (206) within a selected distance of the augmented reality device (212).

[0192] Embodiment 8. The augmented reality system (202) according to any preceding embodiment, further comprising:

[0193] A computer system (236) in communication with an augmented reality device (212), wherein the computer system (236) transmits a model (234) of an object (206) to the augmented reality device (212).

[0194] Embodiment 9. The augmented reality system (202) of any preceding embodiment, wherein the output from the active portable anchor (214) is performed using at least one of a wireless transmitter or a display device.

[0195] Embodiment 10. An augmented reality system (202) according to Embodiment 9, wherein the output is selected from at least one of display of the current physical anchor position (220) on a display device or wireless transmission of the current physical anchor position (220) using a wireless transmitter.

[0196] Embodiment 11. An augmented reality system (202) according to any one of embodiments 3-10, wherein the external tracking system (216) includes at least one of a laser tracker, a laser scanner, a camera, a displacement sensor, a measurement sensor or a detector.

[0197] Embodiment 12. An augmented reality system (202) according to any preceding embodiment, wherein the augmented reality information (208) is selected from at least one of a schematic diagram, a user input window, an instruction, a graphic of a hidden structure, or a hologram.

[0198] Embodiment 13. An augmented reality system (202) according to any of the preceding embodiments, wherein the object (206) is selected from the group consisting of a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, an aircraft, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly and a monument.

[0199] Embodiment 14. An augmented reality system (202), comprising:

[0200] an active portable anchor (214) configured to output a current physical anchor position (220) of the active portable anchor (214) relative to the object (206); and

[0201] An external tracking system (216) is configured to determine a physical anchor position (222) of the active portable anchor (214) and a physical object position (224) of the object (206), wherein a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) output by the active portable anchor (214) is determined using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206).

[0202] Embodiment 15. The augmented reality system (202) according to embodiment 14, further comprising:

[0203] An augmented reality device (212) is configured to receive from an active portable anchor (214) a current physical anchor position (220) of the active portable anchor (214) relative to an object (206); determine a current model anchor position (232) of the active portable anchor (214) using the current physical anchor position (220) of the active portable anchor (214) relative to the object (206); and use the current model anchor position (232) of the active portable anchor (214) and a model (234) of the object (206) to determine a current model anchor position (232) of the active portable anchor (214); and ) displays augmented reality information (208) in association with a real-time view (204) of an object (206) in an augmented reality device (212), wherein a model anchor position of an active portable anchor (214) in a model (234) of the object (206) is dynamically updated to reflect a current physical anchor position (220) of the active portable anchor (214) relative to the object (206), thereby improving the accuracy of displaying the augmented reality information (208) on the real-time view (204) of the object (206).

[0204] Embodiment 16. An augmented reality system according to any one of embodiments 14-15, wherein the object (200) is selected from the group consisting of a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, an aircraft, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly and a monument.

[0205] Embodiment 17. An augmented reality system (202) according to Embodiment 15, wherein the model (234) of the object (206) is a partial model of the object (206), which includes a portion of the object (206).

[0206] Embodiment 18. An augmented reality system (202) according to Embodiment 17, wherein the partial model of the object (206) is selected from at least one of a portion of the object (206) in the field of view of the augmented reality device (212) or a portion of the object (206) within a selected distance of the augmented reality device (212).

[0207] Embodiment 19. An augmented reality system (202), comprising:

[0208] Network (102); and

[0209] A communication port (103) in a network, wherein the communication port (103) is configured to communicate with a portable active anchor (130) and send a current physical anchor position (220) of the active portable anchor (130) relative to an object (206) to the active portable anchor (130), wherein the current physical anchor position (220) of the active portable anchor (130) relative to the object (206) is determined using the physical anchor position (222) of the active portable anchor (130) and the physical object position (224) of the object (206).

[0210] Embodiment 20. An augmented reality system (202) according to embodiment 19, wherein the augmented reality device (212) is configured to receive a current physical anchor position (220) of the active portable anchor (130) relative to the object (206) from the active portable anchor (130); determine a current model anchor position (232) of the active portable anchor (130) in the model (128) of the object (206) using the current physical anchor position (220); and display augmented reality information (208) in association with the current model anchor position (232) of the active portable anchor (130) and the model (128) of the object (206) on a real-time view (204) of the object (206) in the augmented reality device (212), wherein the current model anchor position (232) of the active portable anchor (130) in the model (128) of the object (206) is dynamically updated to reflect the current physical anchor position (220) of the active portable anchor (130) relative to the object (206).

[0211] Embodiment 21. A device comprising:

[0212] An active portable anchor (214) used by an augmented reality device (212) to display augmented reality information (208) on a real-time view (204) of an object (206), wherein the active portable anchor (214) is configured to output a current physical anchor position (220) of the active portable anchor (214) relative to the object (206).

[0213] Embodiment 22. An apparatus according to embodiment 21, wherein the active portable anchor (214) is configured to receive a physical anchor position (222) of the active portable anchor (214) and a physical object position (224) of an object (206) determined (216) by an external tracking system; and to determine a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206).

[0214] Embodiment 23. The apparatus of Embodiment 22, wherein the active portable anchor (214) comprises:

[0215] A portable frame (300);

[0216] a communication unit (302) physically connected to the portable frame (300), wherein the communication unit (302) is configured to receive a physical anchor location (222) of the active portable anchor (214) and a physical object location (224) of the object (206) determined by the external tracking system (216);

[0217] an output system (304) physically connected to the portable frame (300); and

[0218] A processor unit (306) is physically connected to the portable frame (300) and communicates with the communication unit (302) and the output system (304), wherein the processor unit (306) is configured to determine a current physical anchor position (220) of the active portable anchor (214) relative to the physical object position (224) of the object (206) using the physical anchor position (222) and the physical object position (224); and output the current physical anchor position (220) of the active portable anchor (214) relative to the physical object position (224) of the object (206) using the output system (304).

[0219] Embodiment 24. The apparatus of Embodiment 23, wherein the output system (304) comprises at least one of a wireless transmitter or a display device.

[0220] Embodiment 25. The device according to any one of embodiments 21-24, further comprising:

[0221] An augmented reality device (212) configured to receive a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) output by the active portable anchor (214); and to display augmented reality information (208) on the real-time view (204) of the object (206) using the current physical anchor position (220) to place the augmented reality information (208) on the real-time view (204) of the object.

[0222] Embodiment 26. The apparatus of Embodiment 25, wherein the active portable anchor (214) has a shape that is recognized by the augmented reality device (212) as an anchor for displaying augmented reality information (208) on the real-time view (204).

[0223] Embodiment 27. The apparatus according to embodiment 25, further comprising:

[0224] A group of active portable anchors (206) for an object, wherein the active portable anchor (214) and the group of active portable anchors are multiple active portable anchors for the object (206), and wherein the augmented reality device (212) receives a selected number of current physical anchor locations from a selected number of current active portable anchors from the multiple active portable anchors.

[0225] Embodiment 28. The apparatus according to embodiment 22, further comprising:

[0226] An external tracking system (216) is configured to determine a physical anchor location (222) of the active portable anchor (214) and a physical object location (224) of the object (206).

[0227] Embodiment 29. The apparatus of embodiment 28, wherein the external tracking system (216) is selected from at least one of a laser tracker, a laser scanner, a camera, a displacement sensor, a measurement sensor, or a detector.

[0228] Embodiment 30. A device according to any one of embodiments 21-29, wherein the object (206) is selected from the group consisting of a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, an aircraft, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly and a monument.

[0229] Embodiment 31. An augmented reality system (202), comprising:

[0230] An augmented reality device (212) is configured to receive from an active portable anchor (214) a current physical anchor position (220) of the active portable anchor (214) relative to an object (206); determine a current model anchor position (232) of the active portable anchor (214) in a model (234) of the object (206) using the current physical anchor position (220) of the active portable anchor (214) relative to the object (206); and use the current model anchor position (232) of the active portable anchor (214) and the model of the object (206) in the augmented reality device. Augmented reality information (208) (234) is displayed on a real-time view (204) of an object (206) in a device (212), wherein the accuracy of positioning the augmented reality information (208) on the real-time view (204) of the object (206) is increased by updating a current model anchor position (232) of the active portable anchor in the model (234) of the object (206) to reflect changes in the active portable anchor (214) relative to the current physical anchor position (220) of the object (206) from movement of the active portable anchor (214).

[0231] Embodiment 32. An augmented reality system (202) according to Embodiment 31, wherein the model (234) of the object (206) is a partial model of the object (206), which includes a portion of the object (206).

[0232] Embodiment 33. An augmented reality system (202) according to embodiment 32, wherein the partial model of the object (206) is selected from the portion of the object (206) in the field of view of the augmented reality device (212) and the portion of the object (206) within a selected distance of the augmented reality device (212).

[0233] Embodiment 34. A method for displaying augmented reality information (208) on an augmented reality device (212), the method comprising:

[0234] receiving, from the active portable anchor (214), via the augmented reality device (212), a current physical anchor position (220) of the active portable anchor (214) relative to the object (206);

[0235] determining, by the augmented reality device (212), a current model anchor position (232) of the active portable anchor (214) in a model (234) of the object (206) using the current physical anchor position (220) of the active portable anchor (214) relative to the object (206); and

[0236] Augmented reality information (208) is displayed on a real-time view (204) of an object (206) in the augmented reality device (212) using a current model anchor position (232) of an active portable anchor (214) and a model (234) of the object (206), wherein the accuracy of positioning the augmented reality information (208) on the real-time view (204) of the object (206) is increased by dynamically updating the current model anchor position of the active portable anchor (214) in the model (234) of the object (206) to reflect the current physical anchor position (220) of the active portable anchor (214) relative to the physical anchor position of the object (206).

[0237] Embodiment 35. The method according to embodiment 34, wherein the model (234) of the object (206) is a partial model of the object (206), which includes a portion of the object (206).

[0238] Embodiment 36. A method according to embodiment 35, wherein the partial model of the object (206) is selected from the portion of the object (206) in the field of view of the augmented reality device (212) and the portion of the object (206) within a selected distance of the augmented reality device (212).

[0239] Embodiment 37. The method according to any one of embodiments 34-36, further comprising:

[0240] receiving, via the active portable anchor (214), a physical anchor location (222) of the active portable anchor (214) and a physical object location (224) of the object (206) determined by the external tracking system (216);

[0241] determining, by the active portable anchor (214), a current physical anchor position (220) of the active portable anchor (214) relative to the physical object position (224) of the object (206) using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206); and

[0242] A current physical anchor position (220) of the active portable anchor (214) relative to a physical object position (224) of the object (206) is output to the augmented reality device (212) via the active portable anchor (214).

[0243] Embodiment 38. The method according to any one of embodiments 34-37, further comprising:

[0244] A current physical anchor position (220) of the active portable anchor (214) relative to the object (206) is received by the active portable anchor (214).

[0245] Embodiment 39. A method according to any of Embodiments 34-38, wherein a current physical anchor position (220) of an active portable anchor (214) relative to a physical object position (224) of an object (206) is output to an augmented reality device (212) by an output system (304) selected from at least one of a wireless transmitter or a display device.

[0246] Embodiment 40. A method according to any of Embodiments 34-39, wherein the object (206) is selected from the group consisting of a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, an aircraft, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly and a monument.

[0247] Embodiment 41. A method for directing an augmented reality device (212), the method comprising:

[0248] identifying a current physical anchor location (220) of an active portable anchor (214), wherein the active portable anchor (214) is used by an augmented reality device (212) to display augmented reality information (208) on a real-time view (204) of an object (206); and

[0249] A current physical anchor position (220) of the active portable anchor (214) relative to the object (206) is output.

[0250] Embodiment 42. The method of embodiment 41, wherein the identifying step comprises:

[0251] A current physical anchor position (220) of the active portable anchor (214) relative to the object (206) is determined by the active portable anchor (214) using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206).

[0252] Embodiment 43. The method of any one of embodiments 41-42, wherein the identifying step comprises:

[0253] A current model anchor position (232) of the active portable anchor (214) in a model (234) of the object (206) is determined by the active portable anchor (214) in relation to a current physical anchor position (220) of the active portable anchor (214) relative to the object (206) received from the active portable anchor (214).

[0254] Embodiment 44. The method of any one of embodiments 41-43, wherein the identifying step comprises:

[0255] A current physical anchor position (220) of the active portable anchor (214) relative to the object (206) is determined by an external tracker using the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206).

[0256] Many modifications and variations will be apparent to those of ordinary skill in the art. In addition, different illustrative embodiments may provide different features than other desired embodiments. The selected one or more embodiments are chosen and described in order to best explain the principles of the embodiments, the practical application, and to enable others skilled in the art to understand the disclosure of various embodiments with various modifications suitable for the particular use contemplated.

Claims

1. An augmented reality system (202), comprising: An active portable anchor (214) comprising an antenna and an output system configured to visually communicate a current physical anchor position (220) of the active portable anchor relative to an object (206), the active portable anchor connected to a tablet connected to a frame configured to communicate with a tracking system, the tracking system comprising a plurality of locators located outside and remote from the object and the active portable anchor, such that the object includes a tangible feature and such that the tracking system is configured to: scanning a volume containing the object and the active portable anchor; identifying the current physical anchor location of the active portable anchor; as well as identifying a physical object location of the object in a coordinate system of the tracking system; a processor system (218) configured to determine the current physical anchor position of the active portable anchor relative to the object based on the physical anchor position of the active portable anchor (214) and the physical object position of the object; an augmented reality device (212) comprising a display that displays a real-time view of the object, such that the augmented reality device is configured to: receiving, from the active portable anchor (214), the current physical anchor position (220) of the active portable anchor (214) relative to the object (206); determining a current model anchor position (232) of the active portable anchor (214) in a model (234) of the object (206) using the current physical anchor position (220); and Augmented reality information (208) is displayed on the real-time view (204) of the object (206) in the augmented reality device (212) using the current model anchor position (232) of the active portable anchor (214) and the model (234) of the object (206), wherein the current model anchor position (232) of the active portable anchor (214) in the model (234) of the object (206) is dynamically updated to reflect the current physical anchor position (220) of the active portable anchor (214) relative to the object (206).

2. The augmented reality system (202) of claim 1, wherein the processor system (218) is located in the active portable anchor (214).

3. The augmented reality system (202) of any preceding claim, further comprising: An external tracking system (216) configured to determine the physical anchor position (222) of the active portable anchor (214) and the physical object position (224) of the object (206) in the coordinate system, wherein the processor system (218) is located in the external tracking system (216).

4. The augmented reality system (202) according to any one of claims 1-2, further comprising: An active portable anchor set for the object (206), wherein the active portable anchor (214) and the active portable anchor set are a plurality of active portable anchors for the object (206), and wherein the augmented reality device (212) receives a selected number of current physical anchor locations from a selected number of current active portable anchors of the plurality of active portable anchors.

5. An augmented reality system (202) according to any one of claims 1-2, wherein the augmented reality device (212) determines the current model anchor position (232) of the active portable anchor (214) in the model (234) of the object (206), and the current model anchor position (232) is related to the current physical anchor position (220) of the active portable anchor (214) relative to the object (206) received from the active portable anchor (214).

6. The augmented reality system (202) according to any one of claims 1-2, wherein: The model (234) of the object (206) is a partial model of the object (206) that includes a portion of the object (206).

7. The augmented reality system (202) of claim 6, wherein: The partial model of the object (206) is selected from at least one of the portion of the object (206) in the field of view of the augmented reality device (212) or the portion of the object (206) within a selected distance of the augmented reality device (212).

8. The augmented reality system (202) according to any one of claims 1-2, further comprising: A computer system (236) in communication with the augmented reality device (212), wherein the computer system (236) transmits the model (234) of the object (206) to the augmented reality device (212).

9. The augmented reality system (202) of any one of claims 1-2, wherein output of the active portable anchor (214) is performed using at least one of a wireless transmitter or a display device.

10. The augmented reality system (202) of claim 9, wherein the output is selected from at least one of display of the current physical anchor location (220) on the display device or wireless transmission of the current physical anchor location (220) using a wireless transmitter.

11. The augmented reality system (202) of claim 3, wherein: The external tracking system (216) includes at least one of a laser tracker, a laser scanner, a camera, a displacement sensor, a measurement sensor, or a detector.

12. The augmented reality system (202) according to any one of claims 1-2, wherein the augmented reality information (208) is at least one selected from a schematic diagram, a user input window, an instruction, a graphic for a hidden structure, or a hologram.

13. The augmented reality system (202) according to any one of claims 1-2, wherein: The object (206) is selected from the group consisting of a mobile platform, a fixed platform, a land-based structure, a water-based structure, an air-based structure, an aircraft, a commercial aircraft, a rotorcraft, a surface ship, a tank, a personnel transporter, a train, a spacecraft, a space station, a satellite, a submarine, a car, a power plant, a bridge, a dam, a house, a manufacturing facility, a building, a fuselage, an engine, a wing, a skin panel, a landing gear assembly and a monument.

14. An augmented reality system, comprising: network; An active portable anchor comprising a communication unit including an antenna and an output system configured to visually communicate a current physical anchor position of the active portable anchor, the active portable anchor connected to a tablet connected to a frame configured to communicate with a tracking system, the tracking system comprising a plurality of locators located outside and remote from an object and the active portable anchor, such that the object includes a tangible feature and such that the tracking system is configured to: scanning a volume containing the object and the active portable anchor; identifying the current physical anchor location of the active portable anchor; as well as identifying a current physical object location of the object in a coordinate system of the tracking system; as well as a communication port in the network, wherein the communication port is configured to communicate with the active portable anchor and transmit the current physical anchor position of the active portable anchor relative to the object to a client device.

15. The augmented reality system of claim 14, further comprising an augmented reality device, the augmented reality device comprising a display, the display displaying a real-time view of the object, such that the augmented reality device is configured to: receiving from the active portable anchor the current physical anchor position of the active portable anchor relative to the object; determining a current model anchor position of the active portable anchor in a model of the object using the current physical anchor position; and Augmented reality information is displayed in association with the real-time view of the object in the augmented reality device based on a dynamic update of the current model anchor position of the active portable anchor in the model of the object, the dynamic update reflecting the current physical anchor position of the active portable anchor relative to the object.

Images