Apparatus, computer-implemented method, and computer program product for network-centric augmented reality processing - Patents.com

Abstract

Various embodiments of the present disclosure provide apparatus, methods, and computer program products for network-centric augmented reality processing. Various embodiments provide advantages in network analysis and additional advantages in locating devices and / or objects within a premises to improve network quality at locations within the premises. Exemplary embodiments process received camera data to map locations within an augmented reality environment to a set of networked devices, network access devices, objects, and / or visitors depicted in the camera data. Additionally or alternatively, some embodiments generate an environment plot based on the processed camera data. Some embodiments additionally or alternatively enable initiation of a session for servicing one or more devices within the premises and / or providing device protection program information associated with one or more devices.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. Provisional Patent Application No. 63 / 266,232, filed December 30, 2021, the contents of which are incorporated herein by reference in their entirety.

[0002] Embodiments of the present disclosure generally relate to maintaining and processing augmented reality data, including maintaining augmented reality based on real-world imagery and utilizing augmented reality for one or more actions related to servicing, deploying, or troubleshooting devices and / or networks. [Background technology]

[0003] Traditionally, devices located throughout a site and forming a network can experience a myriad of problems. At any given time, a networked device intended for use with a network access device may not operate in conjunction with the network access device, communication between the networked device and the network access device may be suboptimal, and / or a user may experience other network-level communication errors caused by any of a myriad of possible faults, including network faults caused by device configuration, device positioning, the layout of the site on which the devices are located, etc. Traditional methodologies for diagnosing and / or resolving such faults are often time-consuming, difficult to implement without specialized knowledge, and / or impossible through human interaction alone. Through hard work, ingenuity, and innovation, Applicant has solved many of these identified problems by developing what is embodied in the present disclosure, as described in more detail below. Summary of the Invention

[0004] Generally, embodiments of the disclosure provided herein provide improved network-centric augmented reality processing (e.g., capturing, storing, and processing augmented reality data generally associated with network component presence, network component functionality, and / or network functionality), and related systems, methods, and apparatuses. Other implementations will be, or become, apparent to one of ordinary skill in the art upon examination of the following figures and detailed description. It is intended that all such additional implementations be included herein, within the scope of this disclosure, and protected by the following claims.

[0005] According to a first aspect of the present disclosure, a computer-implemented method for network-centric augmented reality processing is provided. The computer-implemented method can be implemented by any of a myriad of computing devices embodied in hardware, software, firmware, and / or any combination thereof, including entirely in hardware, entirely in software, or entirely in firmware. An exemplary computer-implemented method includes receiving camera data associated with an augmented reality environment representing a lot, the camera data being captured by a camera circuit. The exemplary computer-implemented method further includes receiving at least one instruction associated with a plot corner set including a plurality of plot corners configured to be generated as the camera circuit navigates the lot, the at least one instruction being associated with a portion of the camera data. The exemplary computer-implemented method further includes generating an environment plot by mapping each plot corner in the plot corner set as a corner location in the augmented reality environment associated with the lot.

[0006] In some embodiments of the exemplary computer-implemented method, receiving at least one instruction associated with the plot corner set includes receiving a first instruction in response to user input data indicating a presence of a first plot corner in the camera data, and mapping the first plot corner to a first corner location in the augmented reality environment based on the camera data and the first mapping device position data. In some such embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes receiving second mapping device position data indicating a traverse to a second mapping device position, receiving a second instruction in response to second user input data indicating a presence of the second plot corner in the camera data, and mapping the second plot corner to a second corner location in the augmented reality environment based on the camera data and the second mapping device position data.

[0007] In some embodiments of the exemplary computer-implemented method, receiving at least one instruction associated with the plot corner set includes receiving camera data associated with first mapping device position data, detecting the first plot corner in the camera data, and mapping the first plot corner to a first corner location in the augmented reality environment based on the second mapping device position data and the camera data.

[0008] In some embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes receiving a second indication of the networked device based on the camera data and mapping the networked device with a location of the networked device in the augmented reality environment, where the environmental plot further includes the location of the networked device. In some such embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes receiving a second indication of the networked device, which includes receiving the second indication in response to user input data indicating a presence of the networked device in the camera data and mapping the networked device to a location of the networked device in the augmented reality environment based on the camera data and the first mapping device position data. In some other such embodiments, receiving the second indication of the networked device includes receiving camera data associated with the first mapping device position data, detecting the networked device in the camera data, and mapping the networked device to a location of the networked device in the augmented reality environment based on the camera data and the first mapping device position data.

[0009] In some embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes receiving first mapping device location data; determining first network strength data associated with the first network access device, wherein the first network strength data is associated with the first mapping device location data; receiving second mapping device location data, wherein the second mapping device location data indicates a different location than the first mapping device location data; and determining second network strength data associated with the first network access device, wherein the second network strength data is associated with the second mapping device location data; and determining an environment plot that further includes a first network strength indicator based on the first mapping device location data and the first network strength data; and determining an environment plot that further includes a second network strength indicator based on the second mapping device location data and the second network strength data.

[0010] In some such embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes generating location data for the preferred networked device based on a comparison of at least first network strength data associated with the first mapping device location data and second network strength data associated with the second device positioning data, and causing rendering of a location indicator for the preferred networked device based on the location data of the preferred networked device.

[0011] In some embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes receiving environmental naming data, storing an environmental plot associated with the environmental naming data, receiving an indication of at least one networked device for grouping associated with the environmental naming data corresponding to the environmental plot, and storing networked device identification data for the at least one networked device associated with the environmental naming data.

[0012] In some embodiments of the exemplary computer-implemented method, the exemplary computer-implemented method further includes providing a real-time augmented reality interface including (1) a real-time captured image of the real world represented by the camera data, and (2) at least a portion of an augmented reality environment rendered over the real-world image represented by the camera data, the portion of the augmented reality environment being based on an orientation of the camera circuitry, and the real-time augmented reality interface further includes (3) at least one static interface element for interacting with the augmented reality environment.

[0013] According to a second aspect of the present disclosure, a second computer-implemented method for network-centric augmented reality processing is provided. The second computer-implemented method can be implemented by any of a myriad of computing devices embodied in hardware, software, firmware, and / or any combination thereof, including entirely in hardware, entirely in software, or entirely in firmware. An exemplary embodiment of the second computer-implemented method includes receiving camera data associated with an augmented reality environment representing a site. The exemplary second computer-implemented method further includes receiving, based on the captured camera data, at least one instruction associated with a set of interfering objects, the set of interfering objects including data associated with at least one object including a physical structure, a furniture object, or a signal interferer. The exemplary second computer-implemented method further includes determining, based on the at least one interfering object of the set of interfering objects and the network access device, a reduced network strength location within the augmented reality environment, the reduced network strength location being associated with first network strength data of the network access device. The second exemplary computer-implemented method further includes causing rendering of data associated with the decreased network strength location to notify a user about the decreased network strength location.

[0014] In some embodiments of the exemplary second computer-implemented method, causing the rendering of data associated with the reduced network strength location includes causing the rendering of at least a portion of the augmented reality environment having the reduced network strength location visually distinguished within the augmented reality environment.

[0015] In some embodiments of the exemplary second computer-implemented method, the exemplary second computer-implemented method further includes receiving an indication of the networked device based on the camera data and determining that the networked device is disposed at or within a predetermined distance from the reduced network strength location, wherein causing the rendering of data associated with the reduced network strength location includes causing the rendering of a notification to the user that includes a recommendation to relocate the networked device.

[0016] In some embodiments of the exemplary second computer-implemented method, the exemplary second computer-implemented method further includes detecting second network strength data associated with a second location within the augmented reality environment, and the notification includes at least one interface element indicating that the user should relocate the networked device to the second location.

[0017] In some embodiments of the exemplary second computer-implemented method, causing the rendering of data associated with the reduced network strength location includes rendering at least one interface element indicating that at least one interfering object of the set of interfering objects should be repositioned or removed to improve the first network strength data at the reduced network strength location.

[0018] In some embodiments of the exemplary second computer-implemented method, receiving at least one instruction associated with the set of interfering objects based on the captured camera data includes detecting a first interfering object based on the camera data using an object detection model, wherein the object detection model is configured to detect at least one interfering object type.

[0019] In some embodiments of the exemplary second computer-implemented method, the exemplary second computer-implemented method further includes receiving an indication of the network access device based on the camera data, and mapping the network access device to a network access device position within the augmented reality environment based on the indication of the network access device.

[0020] According to a third aspect of the present disclosure, a third computer-implemented method for network-centric augmented reality processing is provided. The third computer-implemented method can be implemented by any of a myriad of computing devices embodied in hardware, software, firmware, and / or any combination thereof, including entirely in hardware, entirely in software, or entirely in firmware. An exemplary embodiment of the third computer-implemented method includes generating an environment plot based at least on camera data captured by a camera circuit, the camera data representing a site, and the environment plot corresponding to an augmented reality environment. The exemplary third computer-implemented method further includes detecting first network strength data of a first network access device, the first network strength data being associated with a first location within the augmented reality environment. The exemplary third computer-implemented method further includes causing rendering of an augmented reality environment including a network strength indicator located at the first location within the augmented reality environment, the network strength indicator being visually configured based at least on the first network strength data.

[0021] In some embodiments of the exemplary third computer-implemented method, the network strength indicator includes a first network strength indicator, and the computer-implemented method further includes detecting second network strength data of the first network access device, the second network strength data associated with a second location within the augmented reality environment, the first network strength data being different from the second network strength data, and causing rendering of the augmented reality environment including the second network strength indicator located at the second location, the second network strength indicator being visually configured based on at least the second network strength data to be visually distinct from the first network strength indicator. In some such embodiments of the exemplary third computer-implemented method, the network strength indicator includes a first waveform representation in a first color, the first color being selected based on the first network strength data, and the second network strength indicator includes a second waveform representation in a second color, the second color being selected based on the second network strength data.

[0022] In some embodiments of the exemplary third computer-implemented method, the exemplary third computer-implemented method further includes receiving an indication of a networked device based on camera data, where the networked device is disposed at a first location within the augmented reality environment; determining that the first network strength data is weaker than second network strength data associated with a second location within the augmented reality environment; and causing rendering of data indicating that the networked device should be repositioned to the second location.

[0023] In some embodiments of the exemplary third computer-implemented method, the exemplary third computer-implemented method further includes determining a second location for relocating the first network access device to improve first network strength data associated with the first location within the augmented reality environment, and causing rendering of data indicating that the network access device should be relocated to the second location within the augmented reality environment.

[0024] In some embodiments of the exemplary third computer-implemented method, the exemplary third computer-implemented method further includes causing rendering of data indicating that the first networked device should be positioned at a first location within the augmented reality environment.

[0025] According to a fourth aspect of the present disclosure, a fourth computer-implemented method for network-centric augmented reality processing is provided. The fourth computer-implemented method may be implemented by any of a myriad of computing devices embodied in hardware, software, firmware, and / or any combination thereof, including entirely in hardware, entirely in software, or entirely in firmware. An exemplary embodiment of the fourth computer-implemented method includes receiving camera data representing a site associated with an augmented reality environment. The exemplary fourth computer-implemented method further includes detecting networked devices of an associated networked device type from the camera data. The exemplary fourth computer-implemented method further includes mapping the networked devices to device locations within the augmented reality environment. The exemplary fourth computer-implemented method further includes initiating a device-detection action associated with the networked devices and device locations within the augmented reality environment.

[0026] In some embodiments of the exemplary fourth computer-implemented method, the device detection actions include determining that the networked device is connected to a known network access device, establishing a connection with the networked device using the known network access device, and performing a direct data handshake to verify the identity of the networked device, where the data handshake is based on the networked device type.

[0027] In some embodiments of the exemplary fourth computer-implemented method, the device detection actions include determining that the networked device is connected to a known access device; using the known network access device, sending indirect handshake data to cause the networked device to perform an indirect handshake action; capturing indirect handshake authentication data associated with the indirect handshake action; and processing the indirect handshake authentication data to verify performance of the indirect handshake action, wherein verifying the indirect handshake action confirms the identity of the networked device.

[0028] In some embodiments of the exemplary fourth computer-implemented method, the device detection action includes causing rendering of a device grouping interface to enable association of the networked device with at least one other networked device.

[0029] In some embodiments of the exemplary fourth computer-implemented method, the device detection action includes automatically determining a networked device type associated with the networked device and automatically associating the networked device with a device grouping based on the determined networked device type. In some such embodiments of the exemplary fourth computer-implemented method, the networked devices include a first networked device, the device locations include the first device location, and the computer-implemented method further includes detecting a second networked device associated with the second device location, determining that the second device location is within a threshold range from the first device location, and automatically associating the second networked device with the device grouping.

[0030] According to a fifth aspect of the present disclosure, a fifth computer-implemented method for network-centric augmented reality processing is provided. The fifth computer-implemented method may be implemented by any of a myriad of computing devices embodied in hardware, software, firmware, and / or any combination thereof, including entirely in hardware, entirely in software, or entirely in firmware. An exemplary embodiment of the fifth computer-implemented method includes receiving camera data representing a real-world image of a premises, the camera data being utilized to maintain an augmented reality environment associated with mapping at least one location associated with at least one networked device, network access device, and / or at least one interfering object. The exemplary fifth computer-implemented method further includes initiating an augmented reality service session associated with servicing one or more devices associated with the augmented reality environment, the initiating the augmented reality service session enabling communication with an electronic support platform.

[0031] In some embodiments of the exemplary fifth computer-implemented method, the augmented reality service session enables camera data to be transmitted to the electronic support platform for rendering using a display associated with the electronic support platform.

[0032] In some embodiments of the exemplary fifth computer-implemented method, the exemplary fifth computer-implemented method further includes receiving, from the electronic support platform, an electronic support-generated augmented reality indicator associated with the indicator location within the augmented reality environment, and causing rendering of the augmented reality environment including the electronic support-generated augmented reality indicator at the indicator location. In some such embodiments of the exemplary fifth computer-implemented method, the electronic support-generated augmented reality indicator represents a visual indicator identifying a first networked device for servicing the at least one networked device. In some other such embodiments of the exemplary fifth computer-implemented method, the electronic support-generated augmented reality indicator represents a visual indicator identifying a location within the augmented reality environment for locating a new networked device or a first networked device of the at least one networked device. In some other such embodiments of the exemplary fifth computer-implemented method, the exemplary fifth computer-implemented method further includes generating at least one augmented reality element corresponding to network strength data for a first location within the augmented reality environment, the network strength data being associated with the network access device, and generating an electronically supported generated augmented reality indicator representing a visual indicator identifying a second location within the augmented reality environment for positioning the network access device to improve the network strength data at the first location within the augmented reality environment.

[0033] According to a sixth aspect of the present disclosure, an apparatus for network-centric augmented reality processing is provided. In one exemplary embodiment, the exemplary apparatus includes at least one processor and at least one non-transitory memory. The at least one memory includes computer-coded instructions stored therein that, when executed by the at least one processor, cause the apparatus to perform any one of the exemplary computer-implemented methods described herein. In another exemplary embodiment, the exemplary apparatus includes means for performing each step of any one of the exemplary computer-implemented methods described herein.

[0034] According to a seventh aspect of the present disclosure, there is provided a computer program product for network-centric augmented reality processing. In one exemplary embodiment, the exemplary computer program product includes at least one non-transitory computer-readable storage medium having computer program code stored thereon. The computer program code, when executed by at least one computer, configures the computer program product to perform any one of the exemplary computer-implemented methods described herein.

[0035] The above summary is provided solely for the purpose of summarizing some exemplary embodiments to provide a basic understanding of some aspects of the inventions within this disclosure. Accordingly, it will be understood that the above embodiments are merely examples and should not be construed to narrow the scope or spirit of the present disclosure in any way. It will be understood that the scope of the present disclosure and the inventions therein encompasses many potential embodiments in addition to those summarized herein, some of which are further described below. [Brief explanation of the drawings]

[0036] Having thus described embodiments of the present disclosure in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale.

[0037] [Figure 1]1 illustrates a block diagram of a system that may be specially configured within which embodiments of the present disclosure may operate. [Figure 2] 1 illustrates a block diagram of an exemplary device that may be specially configured according to an exemplary embodiment of the present disclosure. [Figure 3] 1 illustrates an example visualization of a site where network-centric augmented reality processing occurs, in accordance with at least one example embodiment of the present disclosure. [Figure 4] 1 illustrates an example augmented reality interface and an example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 5] 10 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 6] 10 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 7] 10 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 8] 10 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 9] 10 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. [Figure 10A] 1 illustrates the operation of an exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 10B] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 11] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 12]10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 13] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 14A] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 14B] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 15] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 16] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 17] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 18] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 19A] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 19B] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 20] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 21] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 22] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 23] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 24]10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 25] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 26A] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 26B] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. [Figure 27] 10 illustrates the operation of another exemplary process for network-centric augmented reality processing in accordance with the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0038] Embodiments of the present disclosure will now be described more fully hereinafter with reference to the accompanying drawings in which some, but not all, embodiments of the present disclosure are illustrated. Indeed, embodiments of the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like numbers refer to like elements throughout.

[0039] overview Embodiments of the present disclosure provide advantageous network-centric functionality through the operation of an augmented reality environment. In this regard, an augmented reality environment may be generated and / or maintained to include real-world imagery along with interface elements associated with such network-centric functionality, for example, to present a user with a real-world image overlaid with one or more virtual representations. An augmented reality interface may thereby be created that includes one or more virtual graphical elements overlaid on a real-world image to visualize various functionality described herein. In some embodiments, the augmented reality environment may include data configured to represent virtual sites and / or virtual objects associated with various real-world sites and / or objects. By interacting with the augmented reality environment and associating it with real-world location information, object information, and / or other information, a data representation of a particular site may be accurately mapped, for example, to generate an environmental plot that accurately represents the site. By utilizing augmented reality, such mapping may be performed in a user-friendly manner that results in more accurate mapping than utilizing alternative, conventional site mapping techniques.

[0040] Additionally or alternatively, devices and / or objects (e.g., interfering objects, networked devices, network access devices, etc.) may be mapped to or otherwise associated with various locations within an environmental plot corresponding to the augmented reality environment. In this regard, a user may interact with the augmented reality environment to advantageously generate an environmental plot with improved accuracy, such that the environmental plot accurately represents the premises on which the user is located and the associated network-centric components therein. In one exemplary context, a user may interact with the augmented reality environment to generate an environmental plot representing one or more rooms of a home, either alone or as a combined space, and may map the locations of networked devices, network access devices, and / or interfering objects within the rooms, including the room's furnishings and permanent features (e.g., walls, doors, windows, etc.). In this regard, such embodiments provide various technical improvements by enabling the generation of an augmented reality environment and / or corresponding environmental plot that embodies an accurate data representation of the premises and can be processed for any of myriad purposes as described herein.

[0041] In some embodiments, the augmented reality environment and / or corresponding environmental plot may be further processed and / or utilized to perform any of a myriad of network-centric processing actions. For example, in some embodiments, the augmented reality environment and / or corresponding environmental plot may be processed to provide a user with network strength data (e.g., wireless network strength, including WiFi, Bluetooth, Zigbee, or any other wireless signal data) at various locations throughout the premises. In this regard, some embodiments may determine network strength data at various locations (e.g., via strength data measured via one or more real-world devices within the premises and / or via simulating the effect of various features mapped to the augmented reality environment on network signal propagation) and process the network strength data values ​​and / or other information (e.g., networked device location data and / or network access device location data) to identify one or more reduced network strength locations and / or networked devices disposed at such locations. Such reduced network strength locations may be shown to the user, for example, via an augmented reality interface, allowing the user to easily and accurately identify such locations within the premises. In some embodiments, advantageous notifications may be generated and rendered to a user associated with, for example, introducing new networked devices, network access points, and / or interfering objects within the premises, improving signal strength received by particular networked devices, and positioning various devices and / or objects within the premises to improve overall network signal strength for the premises. Such embodiments provide technical improvements over conventional network processing implementations, for example, by generating and visualizing network strength data for a user.Such embodiments eliminate any requirement for specialized human knowledge to utilize such data for network optimization and / or object location, and enable the utilization of such data in onboarding, servicing, or otherwise improving the overall performance of one or more devices and / or the network as described herein. Additionally or alternatively, the use of augmented reality enables such benefits to be provided in an efficient and user-friendly manner, thus further reducing the level of technical knowledge required to accurately perform such associated actions as compared to traditional systems associated with network analysis. Additionally or alternatively, in some embodiments, augmented reality enables the use of any such data in any of a myriad of downstream processes, such as providing a device protection program for a detected or otherwise indicated device, processing billing associated with the device protection program, providing instructions regarding the configuration of a device, providing technical support for a detected or otherwise indicated device, etc.

[0042] Additionally or alternatively, in some embodiments, the augmented reality environment and / or corresponding environmental plot are processed and / or utilized to identify and / or group networked devices for user classification and / or management. By grouping networked devices, a computing device and / or system can easily identify that such devices are related, and actions can be performed on all such devices in a batch manner. Additionally or alternatively, in some embodiments, one or more actions can be performed on all grouped networked devices. For example, a user may request the operability status of grouped networked devices associated with a particular grouping (e.g., all devices in a grouping associated with a property's kitchen). Similarly, the processes, systems, and apparatus described herein can be used for efficient onboarding and / or relocation of a network and one or more networked devices (e.g., quickly relocating and re-establishing a home network in a new property) via a comparison of a first property environmental plot associated with a first property and a second property plot associated with a second property. Such embodiments provide further technical improvements over conventional network processing implementations by reducing the amount of computing resources required to perform batch operations associated with defined groupings of devices and facilitating enhanced functionality by detecting problems and / or solutions associated with identified classes. Additionally, by utilizing augmented reality, embodiments further enable the presence of devices to be indicated to computing devices in a computationally efficient and user-friendly manner.

[0043] In some embodiments, the augmented reality environment and / or corresponding environmental plot are processed to enable servicing of one or more networked devices and / or network access devices via communication with an electronic support platform. In some embodiments, the electronic support platform receives captured representations of the real-world premises and / or the augmented reality environment and / or their associated interfaces to provide notifications, information, instructions, and / or other data useful for servicing devices within the premises and / or otherwise improving network strength at one or various locations within the premises. In some embodiments, the electronic support platform provides notifications, indicators, instructions, and / or other data that modify the augmented reality interface (e.g., display text and / or annotations within the representation of the augmented reality environment displayed to the user), for example, to provide easily understandable instructions for the user to follow for servicing. Additionally or alternatively, some embodiments advantageously enable the determination of malfunctioning or otherwise poorly performing devices in situations where the premises are determined not to otherwise adversely affect the device's operation.

[0044] It should be understood that the embodiments described herein rely on particular computing circuitry embodied in hardware, software, firmware, and / or combinations thereof. Additionally or alternatively, particular networked communications circuitry, hardware, software, and / or firmware may be utilized to perform particular signal processing actions described herein.

[0045] definition In some embodiments, some of the above operations may be modified or further expanded. Furthermore, in some embodiments, additional optional operations may be included. Modifications, expansions, or additions to the above operations may be performed in any order and in any combination.

[0046] Many modifications and other embodiments of the disclosures described herein will come to mind to one skilled in the art to which this disclosure pertains having the benefit of the teachings presented in the foregoing description and the associated drawings. It is, therefore, understood that embodiments are not to be limited to the particular embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the appended claims. Furthermore, while the foregoing description and the associated drawings describe exemplary embodiments in the context of certain exemplary combinations of elements and / or functions, it is understood that different combinations of elements and / or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and / or functions than those expressly described above are also contemplated as being set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

[0047] In some embodiments, some of the above operations may be modified or further expanded. Furthermore, in some embodiments, additional optional operations may be included. Modifications, expansions, or additions to the above operations may be performed in any order and in any combination.

[0048] Many modifications and other embodiments of the disclosures described herein will come to mind to one skilled in the art to which this disclosure pertains having the benefit of the teachings presented in the foregoing description and the associated drawings. It is, therefore, understood that embodiments are not to be limited to the particular embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the appended claims. Furthermore, while the foregoing description and the associated drawings describe exemplary embodiments in the context of certain exemplary combinations of elements and / or functions, it is understood that different combinations of elements and / or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and / or functions than those expressly described above are also contemplated as being set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

[0049] The term "user" refers to an individual, group of individuals, entity, and / or other identifiable subpopulation that owns and / or otherwise operates a computing device.

[0050] The term "user device" refers to any computing device embodied in hardware, software, firmware, and / or any combination thereof. Non-limiting examples of user devices include mobile devices (such as smartphones, tablets, laptops, and personal digital assistants), desktop computers, servers, kiosks, terminal devices, Internet of Things-enabled devices, smart home devices, and wearable devices.

[0051] The term "computer-implemented method" refers to a process performed by any computing device, embodied via hardware, software, firmware, and / or combinations thereof. In some embodiments, the computer-implemented method is embodied by computer program code that includes various computer-coded instructions for implementing the process. In at least one example context, a user device is configured to perform any of the computer-implemented methods described herein.

[0052] The term "augmented reality environment" refers to a data representation renderable on a computing device's display of one or more real-world objects in which electronically generated "virtual" objects may be positioned. The virtual objects may be positioned at any coordinate location within the augmented reality environment, e.g., at any x, y, and z location within a three-dimensional coordinate system and / or at x and y locations within a two-dimensional coordinate system. In at least one example context, the augmented reality environment is maintained based on a three-dimensional coordinate system originating from an origin.

[0053] The term "real-time augmented reality interface" refers to electronically managed data rendered on a device's display, including captured representations of real-world images together with any number of representations of virtual objects, to represent an augmented reality environment. The real-time augmented reality interface is configured to be updated in real time as new data representing real-world images is received, for example, from camera circuitry that captures such real-world images. In some embodiments, the real-time augmented reality interface additionally or alternatively includes static interface elements, such as buttons, text and / or audio / video elements, and / or other interface controls.

[0054] The term "camera circuitry" refers to hardware, software, firmware, and / or combinations thereof configured to enable the capture of a data representation of a real-world environment. In some embodiments, the camera circuitry comprises image capture optics, such as one or more lenses, configured in combination with one or more image sensors such that the image sensors capture incident light to generate such data representative of the environment. In some embodiments, the camera circuitry is a sub-module or component of a larger device, such as a user device or a peripheral device associated therewith.

[0055] The term "camera data" refers to electronically managed data representing real-world images of a real-world environment captured by camera circuitry. In some embodiments, the camera data is embodied in video data, and in some embodiments, the video data is captured in real time by the camera circuitry. In some such embodiments, the video camera data includes one or more frames (e.g., images at different time slices of the video data) that may be processed individually or in combination with other frames of the video data. In other embodiments, the camera data includes a single image data object and / or multiple image data objects. In some such embodiments, the multiple image data objects may be processed as individual image data objects or in conjunction with one another.

[0056] The term "network-centric augmented reality processing" refers to providing and / or maintaining an augmented reality environment in which the augmented reality environment is utilized to provide a user with functionality for defining a premises, identifying objects within the premises, performing network analysis and / or optimization actions, and / or enabling device or network service offerings, or any combination thereof. In some contexts, network-centric augmented reality processing involves utilizing the augmented reality environment and / or corresponding renderings for interface output only. In other contexts, network-centric augmented reality processing involves utilizing the augmented reality environment and / or corresponding renderings for interface output and user input.

[0057] The term "instructions" refers to one or more electronic data values ​​that represent a particular state, action, or that can otherwise be processed to implement an electronic decision.

[0058] The term "premises" refers to a real-world environment that is physically defined (e.g., by one or more walls) and / or user-defined. Non-limiting examples of premises include a room, a set of rooms, a house, an office building, an outdoor space, etc.

[0059] The term "plot corner" refers to electronically managed data indicating the junction of two boundaries that define a portion of a lot. In some embodiments, a plot corner represents the junction between two walls that define a portion of a lot. A non-limiting example of a plot corner includes the junction between two walls in a room. The term "plot corner set" refers to one or more electronically managed data objects that represent zero or more plot corners.

[0060] The term "corner location" refers to electronically managed data representing the position of a plot corner within an augmented reality environment. In some embodiments, a includes at least an x ​​coordinate position associated with the plot corner and a y coordinate position associated with the plot corner.

[0061] The term "environmental plot" refers to electronically managed data representing a multi-dimensional plot of a site. In some embodiments, the environmental plot is embodied by electronically managed data that defines the space of the site based on various two-dimensional plotted data points. For example, in at least one exemplary context, the environmental plot is defined by a plot corner set used to define the site. In some embodiments, the plot corner set is configured to include data representing the presence of one or more objects located within the site and / or the location of such objects within the site represented by the environmental plot.

[0062] The term "mapping device position data" refers to electronically managed data representing the absolute or local position of a user device utilized to generate an environmental plot and / or map one or more objects associated therewith.

[0063] The term "networked device" refers to a computing device that can be configured to communicate through a network access device and / or directly with one or more other networked devices and that can be used directly or indirectly by a user. Non-limiting examples of networked devices include mobile devices, desktop computers, servers, smart home devices, data monitoring devices, Internet of Things-enabled devices, smart TVs, wearable devices, home monitoring systems, etc. The term "device identifier data" refers to electronically managed data that uniquely identifies a networked device.

[0064] The term "mapping" refers to a computer-implemented process for associating a data object representing a physical object located at a particular location with location data representing the particular location of the object within a corresponding augmented reality environment and / or corresponding environmental plot. In some embodiments, for example, mapping refers to generating and / or storing a data object together with location data representing the location at which the object is located.

[0065] The term "network strength data" refers to one or more data values ​​that represent the signal strength a user device has when communicating with a network access point. In at least one example context, the network strength data is represented by a received signal strength indicator value (RSSI). It should be understood that the network strength data may be generated and / or otherwise determined using any of a myriad of signal strength determination processes.

[0066] The term "network strength determination process" refers to one or more computer-implemented processes configured to determine network strength data received by a user device at a particular location while communicating with a particular network access device. In at least one example context, the network strength determination process generates and / or determines network strength data that a user device has at a particular location when wirelessly communicating with a premises wireless network (or other network access device and / or networked device). Unless otherwise specified, it should be understood that the network strength data may be generated and / or otherwise determined utilizing any of a myriad of known methodologies for detecting signal strength for devices communicating with a network access device.

[0067] The term "network access device" refers to a computing device configured to provide access to wired and / or wireless communication networks. A network access device may provide access to any of a myriad of private networks (e.g., LANs and / or other local networks), public networks (e.g., the Internet), and / or hybrid networks. Non-limiting examples of network access devices include routers, modems, switches, network extenders, communication relay devices, and cell phone towers.

[0068] The term "waveform representation" refers to renderable data that provides a visual representation of wireless network signal strength located at one or more locations. In some embodiments, the waveform representation is configured to visually represent network strength at such locations using one or more characteristics, such as different colors, transparency values, shapes and / or graphics, rendered element sizes, etc., or combinations thereof. In at least one exemplary context, the waveform representation is visually configured to be rendered to appear as fog within a portion of an augmented reality environment. In some embodiments, the waveform representation is configured to render within the augmented reality environment at a desired z-position relative to a planar surface utilized to initialize the augmented reality environment.

[0069] The term "preferred networked device location data" refers to location data representing a first location determined to be associated with network strength data associated with a particular network access point that is stronger than network strength data associated with a second location. For example, if the first location is associated with a first RSSI of -75 and the second location is associated with a second RSSI of -50, the preferred network device location data may represent the second location. In some embodiments, the preferred networked device location data may represent an optimal location within a premise or a subset thereof.

[0070] The term "preferred networked device location indicator" refers to a data object that represents the location data of the preferred networked device and is rendered within the augmented reality environment. In some embodiments, the preferred networked device location indicator is rendered within the augmented reality environment at a location represented by the preferred networked device location data. In some embodiments, the preferred networked device location indicator may include modifying or otherwise enhancing the appearance of a real-world object and / or portion of a premises via the augmented reality environment (e.g., changing the color of or otherwise highlighting or emphasizing a representation of the networked device within the augmented reality environment).

[0071] The term "environment naming data" refers to electronically managed data representing user-provided and / or automatically generated names that may be associated with environmental plots. In some contexts, environment naming data represents conventional names associated with environmental plots, e.g., the text data "Kitchen" for association with an environmental plot representing an on-site kitchen.

[0072] The term "networked device identification data" refers to one or more electronically managed data values ​​that uniquely identify a networked device. In some contexts, networked device identification data may be associated with environment naming data to represent the networked device identified by the networked device identification data in a particular room, premises, or subdivision thereof.

[0073] The term "interfering object" refers to a physical object that is shown to be associated with one or more characteristics that interfere with the propagation of wireless signals from a network access point. Non-limiting examples of interfering objects include physical structures (e.g., a wall or portion thereof), large pieces of furniture (e.g., a sofa, a cupboard, etc.), or signal interferers as defined herein.

[0074] The term "signal interferer" refers to any electromechanical device that outputs one or more signals that interfere with the wireless signals transmitted from a network access point. Non-limiting examples of signal interferers include another network access point, a networked device (including those capable of accessing alternative network types such as Bluetooth), and an RF-enabled device.

[0075] The term "interference object type" refers to data that represents a particular classification of an interfering object. In at least one example context, the interference object type represents an object type that indicates what the object is (e.g., data that represents a "table," a "wall," a "television," etc.).

[0076] The term "reduced network strength location" refers to electronically maintained data indicating a relative or absolute location where the network strength data is determined to be less than the network strength data expected at an alternative location, less than the average network strength data, and / or less than the second network strength data.

[0077] The term "object detection model" refers to a computer-implemented statistical, algorithmic, machine learning, or other model configured to detect objects and / or portions thereof, such as one or more frames or captured images, from captured camera data. In some contexts, the object detection model is configured and / or specially trained to identify and / or detect interfering objects in the camera data. Additionally or alternatively, in some contexts, the object detection model is configured and / or specially trained to identify and / or detect networked devices in the camera data. It should be understood that the object detection model may be configured and / or otherwise trained to capture any number of object types.

[0078] The term "visually distinct" refers to the state of an element rendered in an interface that includes one characteristic that is different from one or more other elements of the same type. In some embodiments, elements are visually distinct from one another using characteristics of the element's color, size, shape, image, overlay, text, graphics, and / or any combination thereof.

[0079] The term "disposed" refers to being located at or within a given distance from a particular relative or absolute position.

[0080] The term "device detection action" refers to a computer-implemented process that is performed upon detection or other identification of a networked device within the camera data or a portion thereof. It should be understood that any number of device detection actions may be performed upon detection and / or identification of one networked device, or multiple networked devices.

[0081] The term "known network access device" refers to a network access device with which a device is configured to communicate. For example, in the context of an apparatus embodiment, examples of known network access devices include network access devices with which a device is configured to communicate.

[0082] The term "identity" in the context of a networked device refers to electronically managed data that uniquely identifies the networked device. Non-limiting examples of a networked device identity include an IP address, an IMEI, a unique identifier, and / or a user-assigned identifier.

[0083] The term "direct data handshake" refers to a computer-implemented data communication process performed at a networked device, in which data is requested and received from the networked device for use in determining the identity of the networked device. In some embodiments, the data received from the networked device includes sufficient data to be used to determine the identity of the networked device.

[0084] The term “indirect handshake action” refers to a computer-implemented process for verifying an identity associated with a networked device without directly receiving sufficient data to determine such identity through data communication with the networked device. In some embodiments, an indirect handshake action includes processing visual and / or audio data generated by the networked device that is captured by the embodiment for processing. A non-limiting example of an indirect handshake action includes causing the networked device to generate a detectable light pattern or audio output, whereby the networked device may be identified based on the captured data without receiving data communication from the networked device. In some contexts, different types of networked devices perform different indirect handshake actions (e.g., a smart light bulb may flash, while a virtual assistant may output a predetermined audio frequency or message). The term “indirect handshake data” refers to data specifically transmitted to a networked device via a known network access device to cause the networked device to initiate an indirect handshake action. The term “indirect handshake authentication data” refers to electronically managed data utilized to verify the performance of an indirect handshake action by an external system, device, and / or other computing entity. Non-limiting examples of indirect handshake authentication data include captured camera data representing a real-world environment, auditory data representing a real-world environment, and / or combinations thereof. In some embodiments, indirect handshake authentication data includes data representing a single moment in time (e.g., to verify the rendering of a particular machine-readable symbology via a networked device via a single captured image or frame of video data).In other embodiments, the indirect handshake authentication data includes data representing multiple instants in time (e.g., to verify a particular light pattern being emitted by a particular networked device via multiple captured images or multiple frames of video data).

[0085] The term "device grouping" refers to data-lining one or more networked devices with environment naming data. In some embodiments, any number of device identifier data are associated with the environment naming data to instantiate the device grouping.

[0086] The term "device grouping interface" refers to one or more user interfaces configured to enable association of one or more networked devices with environment naming data to form a device grouping. Additionally or alternatively, in some embodiments, the device grouping interface further includes one or more user interfaces for disassociating one or more networked devices from the environment naming data to remove the one or more networked devices from the device grouping.

[0087] The term "threshold range" in the context of multiple network devices refers to a numerical value representing a physical distance such that if the devices are located within the threshold range, the two devices are considered to be close enough to be grouped together, for example, by the same device grouping. In some exemplary embodiments, the threshold range may be a numerical value (e.g., 10 feet) and / or any other criteria (e.g., in the same room, located on the same object, etc.).

[0088] The term "servicing" refers to commanding and / or causing one or more actions to be performed to configure a network, a networked device, and / or a network access device to operate properly, with improved performance compared to previous performance, and / or as otherwise intended, and / or to initialize one or more device protection programs associated with the network access device and / or networked device. In at least one example context, device servicing is performed in conjunction with communication with one or more electronic support platforms.

[0089] The term "augmented reality service session" refers to a state of established communication between a user device and an electronic support platform for the purpose of providing technical support associated with a network, a network access device, a networked device, and / or information associated with any of the network, the networked access device, and / or the networked device.

[0090] The term "electronic support platform" refers to one or more devices embodied in hardware, software, firmware, and / or combinations thereof that are capable of communicating to enable servicing of one or more devices. In some embodiments, the electronic support platform includes a remote device, server, or platform accessed by a customer service representative, with which user devices may establish a connection to receive servicing of the devices through communication with the customer service representative. In some embodiments, the electronic support platform is capable of receiving data (e.g., camera data and / or data representing an augmented reality environment) from connected user devices and / or pushing data to connected user devices to display and / or otherwise process such data (e.g., causing the rendering of one or more elements in the augmented reality environment).

[0091] The term “electronic support-generated augmented reality indicator” refers to data representing electronic data objects transmitted by an electronic support platform for inclusion and / or otherwise rendering in an augmented reality environment maintained by a user device. In some embodiments, an electronic support-generated augmented reality indicator is generated and / or otherwise associated with a location within the augmented reality environment where the electronic support-generated augmented reality indicator will be located. In some embodiments, an electronic support-generated augmented reality indicator is of a pre-defined type (e.g., a pre-defined image, shape, text, overlay, size, color, etc.). In other embodiments, an electronic support-generated augmented reality indicator is entirely generated by a user of the electronic support platform (e.g., user-drawn, uploaded, etc.). In some embodiments, an electronic support-generated augmented reality indicator may include modifying or otherwise enhancing the appearance of a real-world object and / or portion of a site via the augmented reality environment (e.g., changing the color or otherwise highlighting or enhancing a representation of a networked device within the augmented reality environment, or a static image that may represent a particular time frame in the augmented reality environment and / or a captured image representing the real-world environment).

[0092] The term "indicator location" refers to data representing the location of an electronically supported generated augmented reality indicator within an augmented reality environment. In some embodiments, the indicator location further corresponds to a location within an environment plot. Additionally or alternatively, in some embodiments, the indicator location is generated from a predetermined set of choices, e.g., from locations associated with identified network devices, network access devices, interfering objects, network strength data, etc.

[0093] The term "visual indicator identifying a networked device for servicing" refers to an electronically supported generated augmented reality indicator that is associated with a networked device, a networked access device, or an indicator location that is sufficiently close to a location within an augmented reality environment, and that the visual indicator is rendered on a display of a user device to indicate that a user of the user device should perform one or more actions at the location to service the networked device. In some embodiments, the visual indicator identifying a networked device for servicing is associated with an indicator location at a preset distance from the location associated with the networked device (e.g., a preset distance above, below, or to any side of the networked device, or otherwise in any direction from a point location associated with the networked device).

[0094] Exemplary Computing Systems and Apparatus of the Present Disclosure 1 illustrates a block diagram of an exemplary specially configured computing system in which embodiments of the present disclosure may operate. As illustrated, the system includes at least one user device 102, an augmented reality (“AR”) processing server 104, and an electronic support platform 106. In some embodiments, the various devices are configured to communicate over one or more communications networks, such as communications network 108, as illustrated. In some embodiments, user device 102 is configured to communicate with each of AR processing server 104 and electronic support platform 106, although AR processing server 104 and electronic support platform 106 may not communicate with each other. In other embodiments, each of the various computing entities illustrated is configured to communicate with each other. In still other embodiments, AR processing server 104 and electronic support platform 106 are embodied by and / or otherwise controlled by a single computing entity.

[0095] In some embodiments, the user device 102 is embodied by one or more user-facing computing devices embodied in hardware, software, firmware, and / or combinations thereof configured to perform various network-centric augmented reality processing functions described herein. For example, in some embodiments, the user device 102 is embodied by a user device such as a laptop, desktop, smartphone, tablet, etc. In some example contexts, the user device 102 is configured to execute one or more computing programs to perform various functions described herein. For example, the user device 102 may execute a web-based application or applet (e.g., accessible via a website), a software application (e.g., an “app”) installed on the user device 102, or other computer-coded instructions accessible to the user device 102.

[0096] In some embodiments, the user device 102 includes various hardware, software, firmware, etc. for maintaining an augmented reality environment. For example, in some embodiments, the user device 102 includes camera circuitry configured to capture camera data embodying a real-time representation of the grounds around the user device 102. The user device 102 may process such data for any of a myriad of purposes, such as to initialize and / or maintain the augmented reality environment and / or to generate data representing devices, objects, etc. within the augmented reality environment. Additionally or alternatively, in some embodiments, the user device 102 includes a display for rendering various interfaces, including one or more augmented reality interfaces representing the augmented reality environment. For example, the augmented reality interface may include real-time captured camera data augmented by one or more virtual objects. The virtual objects may include interface elements used to generate, visualize, and / or maintain the augmented reality environment, indicate the location of objects and / or devices within the augmented reality environment, initiate one or more processes, network strength indicators and / or data derived therefrom, and / or indicators received from an electronic support platform. For example, in some embodiments, the user device 102 may be utilized as part of a process to generate an environmental plot, such as by processing captured camera data.

[0097] Additionally or alternatively, in some embodiments, the user device 102 is configured to perform one or more processes associated with determining network strength data at various locations and / or derive data therefrom. In at least one exemplary embodiment, the user device 102 is configured to perform a network strength determination process, for example, automatically or in response to user input. The user device 102 may be further configured to derive reduced network strength locations, preferred device locations, etc. Additionally or alternatively, in some embodiments, the user device 102 is configured to generate and / or output an augmented reality interface that includes interface elements associated with the determined network strength data for various locations and / or data derived therefrom. For example, the user device 102 may include at least a portion of the hardware described in connection with apparatus 200 of FIG. 2 and / or any hardware known in the art for user devices.

[0098] In some embodiments, the AR processing server 104 is embodied by hardware, software, firmware, and / or a combination thereof configured to perform various network-centric processing operations and / or store data associated with network-centric augmented reality processing. In some embodiments, for example, the AR processing server 104 is embodied by one or more servers remote from the user device 102. Additionally or alternatively, in some embodiments, the AR processing server 104 includes or is embodied by one or more database servers configured to store data associated with the network-centric augmented reality processing. For example, the AR processing server 104 may include at least a portion of the hardware described in connection with the apparatus 200 of FIG. 2 and / or any hardware known in the art for a user device.

[0099] In some embodiments, the AR processing server 104 is configured to perform any of a myriad of processes associated with the augmented reality environment. For example, in some embodiments, the AR processing server 104 receives generated environment plots and / or data usable to generate the environment plots. For example, in some embodiments, the AR processing server 104 receives locations associated with various objects and / or devices, such as corners, networked devices, network access devices, interfering objects, etc. In some embodiments, the AR processing server utilizes such received locations to generate and / or store an environment plot that includes and / or otherwise represents the locations of the various objects, devices, etc. In some embodiments in which the AR processing server 104 receives the environment plot and / or sub-data thereof, the AR processing server 104 may be configured to store such data (e.g., the environment plot or sub-data thereof).

[0100] In some embodiments, the AR processing server 104 is additionally or alternatively configured to receive camera data from the user device 102 and process the camera data. For example, in some embodiments, the AR processing server 104 is configured to process the camera data to identify objects, devices, and / or other representations therein. In an exemplary context, the AR processing server 104 processes the camera data to identify corners, networked devices, network access devices, and / or interfering objects within the captured data. In some embodiments, some or all of the camera data processing occurs on the user device 102, such that transmitting the camera data is not required.

[0101] In some embodiments, the user device 102 stores and / or maintains all data associated with the augmented reality environment. In some such embodiments, the user device 102 transmits certain data to the AR processing server 104, which may be used to construct site mapping, reconstruct the augmented reality environment, and / or perform one or more network-centric processes associated with the real-world environment and / or one or more networked devices. In this regard, functionality for creating, maintaining, and processing data associated with and / or embodying the augmented reality environment may be divided among such devices in any manner (e.g., all processing functionality may be performed by the user device 102, all processing functionality may be performed by the AR processing server 104, or any division thereof).

[0102] In some embodiments, electronic support platform 106 is embodied by hardware, software, firmware, and / or combinations thereof configured to perform various servicing operations associated with network-centric processing. For example, in some embodiments, electronic support platform 106 comprises one or more application servers and / or database servers remote from user devices 102. Electronic support platform 106 may be configured to provide various functions associated with servicing and / or providing electronic support to devices, e.g., via one or more software applications executing on electronic support platform 106. In some such embodiments, electronic support platform 106 is configured to be used by support users, such as customer service representatives, technical support agents, etc. For example, electronic support platform 106 may include at least a portion of the hardware described in connection with apparatus 200 of FIG. 2 and / or any hardware known in the art for user devices. In some embodiments, AR processing server 104 and electronic support platform 106 may include overlapping hardware and / or software elements configured to perform the processes described herein.

[0103] In some embodiments, for example, user device 102 is configured to establish a connection with electronic support platform 106 to enable a data communication session between user device 102 and electronic support platform 106. In some embodiments, during a communication session, chat and / or audio / visual data may be communicated between user device 102 and electronic support platform 106. In some embodiments, electronic support platform 106 receives camera data from user device 102, for example, to enable a customer support user accessing electronic support platform 106 to view the premises and / or devices, objects, etc., around the user. In some embodiments, electronic support platform 106 and / or AR processing server 104 may facilitate AR visualization of assistance from the electronic support platform at user device 102. In some embodiments, electronic support platform 106 may transmit and / or otherwise render data to an augmented reality interface of user device 102. For example, through interaction with the electronic support platform 106, a customer service user may generate and / or transmit an electronic support-generated augmented reality indicator at a particular location within an augmented reality environment maintained by the user device 102. In this regard, when the user device 102 receives the electronic support-generated augmented reality indicator, the indicator may then be rendered in an augmented reality interface output by the user device 102 when oriented toward the location associated with the indicator.

[0104] In other embodiments, the electronic support platform 106 is configured to additionally or alternatively provide functionality associated with providing, facilitating, and / or fulfilling claims associated with device protection via a device protection program. In this regard, the electronic support platform 106 may provide to the user device 102 information associated with one or more device protection programs available for a device shown and / or otherwise determined within the augmented reality environment and / or environmental plot. The device protection programs may provide device repair, support, tutorials, repairs, and / or other options when a predefined set of circumstances occurs, such as when the device is lost, stolen, or damaged. In some embodiments, the electronic support platform 106 may provide registration for one or more such device protection programs. Additionally or alternatively, in some embodiments, the particular device protection programs made available depend on the particular device shown and / or detected in the augmented reality environment and / or environmental plot. For example, in some embodiments, device protection programs from which user device 102 may receive information correspond to particular device types within the augmented reality environment and / or environmental plot (e.g., a smart TV protection program is provided only when a smart TV is identified or detected, a laptop protection program is provided only when a laptop is identified or detected, etc.).

[0105] In some embodiments, the system includes a network access device 110. In some such embodiments, the network access device 110 facilitates communication between the user device 102, one or more networked devices 114a, b, ..., etc., and / or the communication network 108. In some such situations, the network access device 110 is controlled at the premises to which the user device 102 is mapping. The user device 102 and the network access device 110 communicate over a communication network 112, which may be a subcomponent of the communication network 108 or may be entirely separate from the communication network 108. For example, in at least one exemplary context, the network access device 110 includes a modem and / or a modem and a router to provide wireless networking functionality for the user device 102. In some embodiments, the network access device 110 may include multiple devices, such as a modem and a router, or multiple routers (e.g., multiple independent routers, a mesh WiFi network, a range extender, etc.). In some example contexts, the user device 102 may communicate with the network access device 110 over a shorter range (e.g., using Wi-Fi communications) to facilitate access to the communications network 108, enabling communications over a much wider range (e.g., embodying the Internet or another public network, in some examples). In some contexts, such as when the user device 102 is enabled for cellular data communications, the network access device 110 may not be used to communicate over the communications network 108. In some embodiments, the user device 102 may directly connect with one or more other devices (e.g., networked devices 114a, 114b, ...).

[0106] In some embodiments, the networked devices 114a, 114b,... may be any devices on the communications network 112 and / or may be capable of electronic communication with other devices on the premises. The networked devices may be provided by users independent of the AR system and may include any common devices known in the art, including mobile phones, tablets, personal computers, smart appliances, IoT devices, streaming devices, game consoles, and any other devices capable of the above-described communications. For example, one or more of the networked devices 114a, 114b,... may include at least a portion of the hardware described in connection with the apparatus 200 of FIG. 2 and / or any hardware known in the art for computing devices.

[0107] For example, the AR processing server 104 may include at least a portion of the hardware described in connection with the apparatus 200 of FIG. 2 and / or may include any hardware known in the art for a user device.

[0108] The methods, apparatus, systems, and computer program products of the present disclosure may be embodied by any of a variety of devices. For example, the computer-implemented methods, apparatus, systems, and / or computer program products of the exemplary embodiments may each be embodied by a stationary computing device such as a personal computer, a computing server, a computing workstation, or a combination thereof. Such stationary computing implementations in some circumstances may include or otherwise be communicatively coupled (e.g., wired or wirelessly coupled) to mobile peripherals, components, probes, and / or other devices, for example, to enable mobile image capture and / or signal processing as described herein. Furthermore, the exemplary embodiments may be embodied by any of a variety of mobile terminals, mobile phones, smartphones, laptop computers, tablet computers, or any combination of the aforementioned devices.

[0109] In at least one exemplary embodiment, the user device 102 is embodied by one or more computing systems, such as the device 200 shown in FIG. 2 . The device 200 may include a processor, a memory 204, input / output circuitry 206, communications circuitry 208, and / or a network-centric AR processing circuitry 210. In some embodiments, one or more of such circuits are combined with one or more other circuits of the device 200 such that functionality associated with one or more circuits may be performed by one or more other circuits. Additionally or alternatively, in some embodiments, at least some of the functionality described with respect to the network-centric AR processing circuitry 210 is performed by and / or through communication with another device, such as the AR processing server 104 of another device 200, one or more networked devices 114 a, 114 b, ..., or another device. In various embodiments discussed herein, any device may include one or more circuits of the device 200 shown in FIG. 2 to achieve specific functionality described for such device.

[0110] Although components are described in terms of functional limitations, particular implementations necessarily involve the use of specific hardware. It should also be understood that some of the components described herein may include similar or common hardware. For example, two situations may both utilize the use of the same processor, network interface, storage medium, etc. to perform their associated functions, such that duplicate hardware is not required for each circuit. Thus, use of the terms "module" and / or "circuit" as used herein with respect to components of device 200 should be understood to include specific hardware configured to perform the functions associated with the particular circuit as described herein.

[0111] Additionally or alternatively, the terms "module" and "circuitry" should be broadly understood to include hardware, and in some embodiments, software and / or firmware for configuring hardware. For example, in some embodiments, a "module" and / or a "circuitry" may include processing circuitry, storage media, network interfaces, input / output devices, etc. In some embodiments, other elements of apparatus 200 may provide or supplement the functionality of a particular circuit. For example, processor 202 may provide processing functionality, memory 204 may provide storage functionality, communication circuitry 208 may provide network interface functionality, etc., to one or more of the other circuits.

[0112] In some embodiments, the processor 202 (and / or a coprocessor, or any other processing circuitry assisting or otherwise associated with the processor) may communicate with the memory 204 via a bus for passing information between components of the device. The memory 204 may be non-transitory, e.g., may include one or more volatile and / or non-volatile memories. For example, the memory may be an electronic storage device (e.g., a computer-readable storage medium). The memory 204 may be configured to store information, data, content, applications, instructions, etc. to enable the device 200 to perform various functions in accordance with exemplary embodiments of the present disclosure.

[0113] Processor 202 may be embodied in any one of numerous ways, and may, for example, include one or more processing devices configured to execute independently. Additionally or alternatively, processor 202 may include one or more processors configured in tandem with a bus to enable independent execution of instructions, pipelines, and / or multithreads. Use of the terms "processor," "processing module," and "processing circuitry" may be understood to include single-core processors, multi-core processors, multiple processors within a device, other central processing units ("CPUs"), microprocessors, integrated circuits, and / or remote or "cloud" processors.

[0114] In an exemplary embodiment, processor 202 may be configured to execute computer-coded instructions stored in memory 204 or otherwise accessible to the processor. In some embodiments, processor 202 may be configured to execute hard-coded functions. Whether configured by hardware or software means, or a combination thereof, processor 202 may represent an entity (e.g., physically embodied in circuitry) that, when configured accordingly, is capable of performing operations according to embodiments of the present disclosure. In some embodiments, when the processor is embodied as an executor of software instructions, the instructions, when executed, may specifically configure the processor to perform the algorithms and / or operations described herein.

[0115] In one exemplary context, the processor 202 instantiated on one or more devices may be configured to provide network-centric augmented reality processing functionality. For example, in at least one embodiment, the processor 202 is configured to receive camera data associated with an AR environment and process the camera data. In some such contexts, the processor 202 is additionally or alternatively configured to initialize and / or maintain the augmented reality environment. In some such contexts, the processor 202 is additionally or alternatively configured to receive one or more indications of one or more plot corners represented in the camera data and map each plot corner to a corner location in the augmented reality environment. In some such contexts, the processor 202 is additionally or alternatively configured to generate an environment plot based on the corner location of each plot corner. In some such contexts, the processor 202 is additionally or alternatively configured to receive indications of networked devices in the camera data and map the networked devices to their locations in the augmented reality environment, which may additionally or alternatively be included in the generated environment plot. In some such contexts, additionally or alternatively, processor 202 is configured to receive an indication of a network access device in the camera data and map the network access device with a location of the network access device in the augmented reality environment, which may additionally or alternatively be included in the generated environment plot. In some such contexts, additionally or alternatively, processor 202 is configured to receive an indication of an interfering object in the camera data and map the interfering object with an interfering object location in the augmented reality environment, which may additionally or alternatively be included in the generated environment plot. Processor 202 may additionally or alternatively be configured to perform any of a myriad of actions in response to an indication of any of such objects and / or devices in the camera data.In some embodiments, multiple apparatuses 200, such as the user device 102, the AR processing server 104, and / or another associated device, may perform portions of the above-described processing steps via their respective processors. For example, in some embodiments, all AR display and processing functionality is performed on the user device 102, such that the AR processing server is embodied by a subsystem of the user device 104. Additionally or alternatively, in some embodiments, the user device performs AR-related data capture and display operations as described herein, and the AR processing server performs AR-related data object generation and processing operations as described herein.

[0116] Processor 202 may additionally or alternatively be configured to provide network-centric augmented reality processing functionality associated with network strength data determination and troubleshooting. In some contexts, for example, processor 202 is configured to generate and / or otherwise determine (e.g., via direct measurement and / or via data received from one or more other devices) network strength data at specific locations within the augmented reality environment. Processor 202 may then include data representing the network strength data at the specific locations within the generated environmental plot. Processor 202 may additionally or alternatively be configured to receive mapping device location data such that network strength data may be determined and associated with locations represented by the mapping device location data. In some such contexts, processor 202 may additionally or alternatively be configured to process one or more instances of network strength data associated with various locations, for example, to identify one or more reduced strength locations within the augmented reality environment, identify preferred locations within the augmented reality environment, and / or provide notifications associated with placing new devices within a premises, relocating devices and / or objects within a premises, etc. In some embodiments, the processor 202 is additionally or alternatively configured to render an augmented reality interface including one or more indicators illustrating network strength data values ​​at various locations within the augmented reality environment. In some embodiments, multiple devices 200, such as the user device 102, the AR processing server 104, and / or another associated device, may perform portions of the above-described processing steps via their respective processors.

[0117] The processor 202 may additionally or alternatively be configured to provide network-centric augmented reality processing functionality associated with device servicing and / or protection. For example, in some contexts, the processor 202 is configured to enable generation of environment naming data and / or grouping of devices for association with such environment naming data. In some such contexts, the processor 202 may additionally or alternatively be configured to enable batch actions associated with all devices associated with particular environment naming data to be performed. Additionally or alternatively, in some contexts, the processor 202 is configured to enable communication with an electronic support platform. In some contexts, the processor may additionally or alternatively be configured to provide information associated with a device protection program to any of a myriad of devices identified on the premises. In some embodiments, multiple devices 200, such as the user device 102, the AR processing server 104, and / or another associated device, may perform portions of the above-described processing steps via their respective processors.

[0118] In some embodiments, device 200 may include input / output circuitry 206 that communicates with processor 202 to provide output to a user and, in some embodiments, may receive input, such as instructions for user input, camera input, etc. The input / output circuitry 206 may include one or more user interfaces and may include a display on which the user interfaces may be rendered. Such user interfaces may include static user interface elements that provide an augmented reality interface including representations of real-world images together with virtual objects associated with various locations within the augmented reality environment, and / or a heads-up display including any of various network-centric augmented reality processing information and / or interface controls for initiating any of the myriad actions described herein. In some embodiments, input / output circuitry 206 may include a web user interface, a mobile application, a desktop application, a linked or networked client device, etc. In some embodiments, input / output circuitry 206 may also include a keyboard, a mouse, a joystick, a touch screen, a touch area, softkeys, a microphone, a speaker, or other input / output mechanism. In some such embodiments, the input / output mechanism is configured to allow a user to provide data representing one or more user interactions for processing by device 200. A processor and / or user interface circuitry including a processor, e.g., processor 202, may be configured to control one or more functions of one or more user interface elements through computer program instructions (e.g., software and / or firmware) stored in memory accessible to the processor (e.g., memory 204, and / or the like).

[0119] In some embodiments, input / output circuitry 206 includes hardware, software, firmware, and / or any combination thereof to provide data associated with the real-world positioning of device 200 within an environment. For example, in some embodiments, input / output circuitry 206 includes one or more data sensors integrated into, communicatively coupled to, or otherwise attached to device 200 that provide such data. For example, in some embodiments, input / output circuitry 206 includes inertial sensors, accelerometers, gyroscopes, motion sensors, distance and / or range sensors, LiDAR sensors, etc. that generate data representing the current orientation, position, and / or movement of device 200 and / or determine changes in the orientation, position, and / or movement of device 200. It will be appreciated that these sensors may be utilized to determine changes in a characteristic of device 200, such as current, or orientation, absolute position, position relative to a coordinate system, position relative to another object, range to another object, etc. Additionally or alternatively, in some embodiments, such sensors and / or data derived therefrom are utilized to generate and / or process an augmented reality environment for any of the purposes described herein.

[0120] In some embodiments, input / output circuitry 206 includes camera circuitry 212 configured to enable capture of image data objects representative of the real-world environment around the camera circuitry. The camera circuitry may be embodied by software, hardware, firmware, and / or combinations thereof. For example, in some embodiments, input / output circuitry 206 includes one or more image sensors associated with image capture optics, e.g., one or more lenses that define a particular field of view to be captured by the image sensor, such that light incident on the image sensor through the image capture optics is captured during an exposure of the image sensor. In this regard, the image sensor may output image data objects for subsequent processing by input / output circuitry 206 and / or one or more of the other circuits of device 200, such as processor 202 and / or network-centric AR processing circuitry 210. In some embodiments, the camera circuitry of input / output circuitry 206 is configured such that one or more computer programs executing via device 200 can utilize the camera circuitry to perform image capture functions. Additionally or alternatively, in some embodiments, input / output circuitry 206 includes hardware, software, firmware, and / or combinations thereof that display virtual objects to align such virtual objects within the augmented reality at specific locations that correspond to real-world locations.

[0121] Communications circuitry 208 may be any means, such as a device or circuit embodied in either hardware or a combination of hardware and software, configured to receive and / or transmit data to and from a network and / or other devices, circuits, or modules in communication with apparatus 200. In this regard, communications circuitry 208 may include at least a network interface for enabling communication with, for example, a wired or wireless communications network. For example, communications circuitry 208 may include one or more network interface cards, antennas, buses, switches, routers, modems, and supporting hardware and / or software, or any other devices suitable for enabling communication over a network. Additionally or alternatively, the communications interface may include circuitry for interacting with an antenna to cause transmission of signals via the antenna or for processing reception of signals received via the antenna. For example, communications circuitry 208 may be configured for WiFi, Bluetooth, Zigbee, wired LAN, wireless LAN, cellular, and / or any other communications protocol. In some circumstances, the communications circuitry 208 enables communication with one or more external servers, devices, etc., such as an AR processing server and / or an electronic support platform, in the case where the apparatus 200 corresponds to a user device 102.

[0122] In some embodiments, the network-centric AR processing circuit 210 includes hardware, software, firmware, and / or a combination thereof configured to support network-centric augmented reality processing functions. The network-centric AR processing circuit 210 may utilize processing circuitry, such as the processor 202, to perform these actions. In some contexts, the network-centric AR processing circuit 210 includes hardware, software, firmware, and / or a combination thereof to initialize and / or maintain an augmented reality environment. Additionally or alternatively, in some contexts, the network-centric AR processing circuit 210 includes hardware, software, firmware, and / or a combination thereof configured to receive and / or process camera data for any of a myriad of purposes. In some contexts, the network-centric AR processing circuit 210 is configured to perform various mapping functions, such as mapping objects and / or devices to locations within the augmented reality environment. Additionally or alternatively, in some contexts, the network-centric AR processing circuit 210 includes hardware, software, firmware, and / or a combination thereof configured to generate network strength data for locations within the augmented reality environment. Additionally or alternatively, in some contexts, network-centric AR processing circuitry 210 includes hardware, software, firmware, and / or combinations thereof configured to provide functionality associated with servicing one or more devices through communication with an electronic support platform. Additionally or alternatively, in some contexts, network-centric AR processing circuitry 210 includes hardware, software, firmware, and / or combinations thereof configured to determine device protection programs to serve one or more devices on the premises and / or provide functionality to enable a user to enroll in one or more of such device protection programs.In some embodiments, the network-centric AR processing circuit 210 is embodied entirely on a single system (e.g., the user device or a server remote from the user device). In other embodiments, the network-centric AR processing circuit 210 is embodied partially on each of the user device and a server located remote from the user device, e.g., where hardware, software, firmware, and / or a combination thereof local to the user device displays augmented reality as an overlay on captured camera data based at least in part on data received from the server. It should be understood that in some embodiments, the network-centric AR processing circuit 210 may include a separate processor, a specially configured field programmable gate array (FPGA), or a specially configured application-specific integrated circuit (ASIC).

[0123] In one or more embodiments, the network-centric AR processing circuit 210 is configured to communicate with one or more separate third-party circuits, each of which may in turn be embodied in hardware, software, firmware, and / or a combination thereof. In this regard, one or more of such third-party circuits may be utilized to perform one or more actions related to initializing, generating, and / or otherwise maintaining an augmented reality environment. For example, in one or more embodiments, the third-party circuit may provide functionality for initializing the augmented reality environment (e.g., by scanning a flat surface), identifying the location of a current mapping device (e.g., user device 102), generating virtual objects for inclusion within the augmented reality environment, and / or rendering one or more user interfaces and / or user interface elements associated with the augmented reality environment (e.g., the augmented reality environment). Non-limiting examples of third-party circuits utilized to provide some or all of such augmented reality functionality include "ARKit" available from Apple Inc. of Cupertino, California, and / or "ARCore" available from Google LLC of Mountain View, California.

[0124] In some embodiments, one or more of the above-described components are combined to form a single circuit. The single combined circuit may be configured to perform some or all of the functions described above with respect to the individual circuits. For example, in at least one embodiment, the network-centric AR processing circuit 210 and the processor 202 are combined. Additionally or alternatively, in some embodiments, one or more of the above-described circuits may be configured to perform one or more of the actions described with respect to one or more of the other circuits. In some embodiments, multiple apparatuses 200, such as the user device 102, the AR processing server 104, and / or another associated device, may perform some or all of the functions described in the preceding sections, either alone or through cooperative communication with each other.

[0125] In some embodiments, user device 102 may include some or all of the components of apparatus 200 and at least the components necessary to perform the functions described herein. In some embodiments, networked devices 114a, 114b, ... may each include some or all of the components of apparatus 200 and at least the components necessary to perform the functions described herein. In some embodiments, network access device 110 may include some or all of the components of apparatus 200 and at least the components necessary to perform the functions described herein. In some embodiments, AR processing server 104 may include some or all of the components of apparatus 200 and at least the components necessary to perform the functions described herein. In some embodiments, electronic support platform 106 may include some or all of the components of apparatus 200 and at least the components necessary to perform the functions described herein.

[0126] Example visualization of network-centric expansion Actual processing at an exemplary site 3 illustrates an example visualization of a site where network-centric augmented reality processing occurs, according to at least one example embodiment of the present disclosure. It should be understood that FIG. 3 illustrates one example site and corresponding network-centric augmented reality processing. The specific site and specific devices therein illustrated in FIG. 3 are exemplary and do not limit the scope of the present disclosure to such specifics.

[0127] FIG. 3 illustrates an exemplary premise 300. In the exemplary context, premise 300 represents a room within a building, such as a house, office, apartment, etc. Premises 300 is defined by multiple physical structures and includes multiple objects, devices, etc. at various locations within the premise. For example, as illustrated, the perimeter of premise 300 is defined by walls 314 and doors 316. Windows may also be included and may be detected and mapped via the processes discussed herein. In some contexts, for example, as illustrated in FIG. 3 , premise 300 may further include one or more interior physical structures, such as walls 310. Such interior physical structures may further define a space within the premise that is navigable by a user and / or in which devices and / or objects may be placed. It should be understood that the physical structures within premise 300 may be embodied in any of a myriad of materials.

[0128] In the illustrated embodiment, premises 300 further includes network access device 110. In some example contexts, network access device 110 includes a modem and / or a router that enables access to one or more communications networks, such as the Internet (e.g., communications network 108 shown in FIG. 1 ). In this regard, network access device 110 may be accessible to one or more of the networked devices within premises 300 (e.g., networked devices 114A, 114B, ... shown in FIG. 1 ) to enable such networked devices to access such communications networks. It should be understood that to establish such communications, network access device 110 may be configured to output wireless signals that are received by one or more of the plurality of networked devices and / or to receive wireless signals transmitted from the plurality of networked devices to network access device 110 for further processing.

[0129] Each of the multiple networked devices 114A-114D may establish a connection with the network access device 110 and maintain the connection to enable such continued communication. For example, as illustrated, the premises 300 includes a networked device 114A embodying a smart TV, a networked device 114B embodying a gaming console located near the smart TV 114A, a networked device 114C embodying a home security system, and a networked device 114D embodying a virtual assistant device. As illustrated, each of the networked devices 114A-114D (collectively, "networked devices 114") may be located at different locations in the premises 300. Additionally, as illustrated, each of the networked devices 114 is associated with a different proximity to the network access device 110 and is associated with various levels of interference based on interfering objects within the premises 300.

[0130] In some embodiments, one or more of the networked devices (e.g., networked devices 114A-114D) may be configured to communicate directly with other devices without the network access device 110 (e.g., Bluetooth communication, direct WiFi, etc.) or using a different network access device (e.g., a cellular network, etc.). In such embodiments, the data associated with such communication and the transmission associated therewith may be facilitated by any computing device or network (or combination of computing devices or networks) capable of passing the data and transmission from a desired start point to a desired end point. For example, in one embodiment, the user device 102 may connect directly to one or more of the networked devices (e.g., networked devices 114A-114D) via one or more of the communication technologies described herein.

[0131] The facility 300 may include any of a myriad of interfering objects. Interfering objects may include any furniture, structural objects, devices, etc., including the structure and fixtures of the premises itself (e.g., walls 310, 314, and / or door 316), that interfere with the transmission and / or reception of wireless signals within the premises. As illustrated, the premises 300 includes an interfering object 308 embodying a table. The table 308 may provide a large physical barrier that reduces the strength of wireless signals transmitted from the network access device 110 and / or from one of the networked devices to the network access device 110. In this regard, the interior wall 310 may similarly be identified as an interfering object, for example, by reducing signal strength between the network access device and one or more networked devices (e.g., networked devices 114A and 114B). In embodiments relating to a multi-room premises, the wall 314 may similarly be considered an interfering object.

[0132] A user, such as user 302, may employ one or more embodiments described herein to perform network-centric augmented reality processing. In at least one example context, user 302 may perform such network-centric augmented reality processing using user device 102 (e.g., a tablet, a mobile phone, AR glasses, or other device or set of devices), for example, as embodied by apparatus 200, as a mapping device for mapping a site and / or as a device for displaying an augmented reality interface. In this regard, user 302 may initiate one or more computer programs, executable files, etc. via apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) to access such functionality for network-centric augmented reality processing. During execution, user device 102 may output one or more specially configured user interfaces to a display viewable by user 302 (e.g., via a display of user device 102, which may include circuitry associated with apparatus 200). In at least one example context, such user interfaces include one or more augmented reality interfaces that include images of the real world represented in the captured camera data augmented by one or more virtual objects associated with network-centric augmented reality processing functions. In some embodiments, a user operates and / or otherwise interacts with user device 102 while navigating within premise 300 to perform such functions.

[0133] For example, as illustrated, a user 302 may traverse throughout the premise 300 and map an environmental plot representing the premise 300. In one exemplary context, the user 302 may traverse along a path (e.g., path 312) that may capture and map relevant locations within the facility at least once to perform one or more actions associated with the network-centric augmented reality process. In some embodiments, for example, the user 302 utilizes a mapping device (e.g., user device 102) to capture camera data representing the premise 300 and traverse along path 312 while processing such camera data. The path 312 may be predefined and instructed to the user (e.g., "walk counterclockwise along the wall until you return to your starting position"), or the path may be any course the user selects during the mapping operation. For example, the user device 102 may display a progress graph or visualization of the environmental plot showing the portion of the premise that has been mapped.

[0134] In some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) may be utilized to initialize the augmented reality environment. For example, in some embodiments, the augmented reality environment is initialized by scanning a flat surface (e.g., capturing and processing camera data with camera circuitry) to establish an origin and / or coordinate plane. In this regard, as the mapping device (e.g., the user device 102) traverses the premises 300 (e.g., by the user 302), the device is configured to determine its position relative to the initialized origin and / or coordinate plane to identify its current location within the augmented reality environment. In some embodiments, the initialization process may include calibrating sensors (e.g., the camera circuitry and / or any built-in sensors, such as a gyroscope, compass, GPS, accelerometer, etc.) so that the orientation of the mapping device (e.g., the user device) can be determined and a coordinate system of the augmented reality environment can be established, e.g., with respect to horizontal and vertical directions within the premises. In some embodiments, a user device may be configured to self-calibrate via embedded software and / or hardware, as will be understood by those skilled in the art in light of this disclosure. The location at which a mapping device (e.g., the user device 102) is located during mapping may be referred to as the “mapping device location” and may be represented by “mapping device location data” determined and / or otherwise generated by the device. The mapping device (e.g., the user device 102) may utilize location service-providing circuitry embodied in software, hardware, firmware, and / or combinations thereof to determine and / or otherwise track the mapping device location. Such location service-providing circuitry may be used to identify the mapping device location using any of a myriad of methodologies, including Bluetooth and / or short-range location determination methodologies, global positioning satellite determination, etc.The data identified by the location services providing circuitry may embody an absolute or relative location with respect to a known point (e.g., an intermediate device with a known location) and may additionally or alternatively be utilized to embody and / or derive mapping device position data therefrom (e.g., based on a relationship between current position data for the augmented reality environment and data corresponding to an origin). In some embodiments, at least a portion of the site may already be mapped, and the map data may be loaded into the augmented reality environment for subsequent processing. For example, in some embodiments, a complete map of the site may be stored in memory and loaded from memory. In some embodiments, a skeletal map of the site may be loaded from memory including the permanent outline and fixtures of the site without movable devices and / or objects. In some embodiments, the entire facility may be mapped from scratch. In some embodiments, such as in cases where a user moves to a new location, devices on the network may be known, but their locations may be unknown, and thus the mapping process includes generating a skeletal map of the site and / or assigning locations to known devices on the network.

[0135] A user 302 may utilize apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) to indicate the locations of various objects and / or devices throughout premise 300. In some embodiments, user device 102 may be configured to render an augmented reality interface including camera data representing a real-world image of premise 300, along with one or more interface elements embodied as virtual objects within the augmented reality environment and / or static objects within the augmented reality interface. For example, in at least one example situation, user device 102 generates and / or maintains a reticle and / or other virtual objects within the augmented reality environment, and a user may directly manipulate user device 102 and / or the reticle while viewing the augmented reality interface to reposition the reticle within the augmented reality environment relative to the real-world image captured by the camera circuitry. The mapping device (e.g., user device 102) may automatically or in response to user instruction collect data points based on the known location of the mapping device and calculated locations of the surface where the reticle intersects based on ranging information in the captured camera data. In some embodiments, rather than utilizing a fixed reticle, the user may touch or otherwise indicate a portion of the display to be targeted (e.g., to map to a particular feature or device). In some embodiments, the mapping device may include one or more additional imaging and / or ranging devices, such as a light detection and ranging (Lidar) transmitter and / or receiver.

[0136] Additionally or alternatively, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to enable rendering of one or more interface elements (e.g., static interface elements and / or virtual objects configured to receive user interaction) to indicate objects and / or devices within an augmented reality environment. In some such embodiments, user 302 may position a mapping device (e.g., user device 102) so that a reticle seen on the display overlaid on real-world image data is positioned at a location where the object and / or device is located, and then interact with one or more interface elements indicating that the object and / or device is at that location. For example, in some embodiments, user device 102 outputs an augmented reality interface including an interface element for each type of object and / or device. In an exemplary context, the user device 102 renders an augmented reality interface including at least an interface element for indicating that a reticle is located at a location associated with a corner of the site 300, an interface element for indicating that the reticle is located at a location associated with an interfering object, an interface element for indicating that the reticle is located at a location associated with a networked device, and an interface element for indicating that the reticle is located at a location associated with a network access device. The user may select from listed options to indicate which device or type of device is currently disposed at the reticle's location. In some embodiments, the apparatus 200 may automatically identify one or more devices and / or objects in an image via an image recognition process to quickly map the site. It should be understood that interface elements may be provided to indicate the presence and location of any number of objects, device types, and / or subtypes thereof.

[0137] As an example, the user 302 may navigate along the path 312 any number of times (or may take different routes throughout the premise 300). The user 302 may start next to the network access device 110 and begin by mapping the premise 300 to generate an environmental plot representing the layout of the premise 300. In at least one exemplary embodiment, the user 302 may utilize a mapping device (e.g., the user device 102) to indicate the location of at least each corner within the premise 300. For example, the user 302 may interact with the user device 102 by positioning a reticle at the location of each corner within the premise 300, and upon such positioning (and / or subsequent user engagement with the user device 102 indicating the presence of the corner at a particular position of the user device 102 within the augmented reality environment and / or the location of an associated reticle within the augmented reality environment), the user device 102 may map the corner to corner position data. Additionally or alternatively, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) may store corner position data in an environment plot and / or with data objects within the augmented reality environment. In some embodiments, apparatus 200 generates an environment plot (e.g., locally on the user device or remotely at one or more of the remote computing systems discussed herein) including data connecting each corner position (e.g., the environment plot may include data such as a line connecting a first indicated corner position with a second indicated corner position, a line connecting the second indicated corner position with a third indicated corner position, etc.) as each corner is mapped, whereby the environment plot is generated based on the set of corners mapped by user 302. In some embodiments, generating the environment plot may include connecting adjacent corners (e.g., adjacent by capture order, perimeter tracing, etc.) with straight lines.In light of the present disclosure, it should be understood that interior walls, such as interior wall 310, and / or other structural objects defining the premise may similarly be mapped so that the generated environmental plot accurately represents the premise. With respect to premise 300 and route 312 as illustrated in FIG. 3 , user 302 may use a mapping device (e.g., user device 102) to navigate to the corner location behind network access device 110, then the corner location next to networked device 114C, then the corner location next to networked device 114D, and so on, until reaching the final corner behind networked device 114B. In at least one embodiment, while mapping premise 300, user 302 may additionally or alternatively utilize the mapping device (e.g., user device 102) to indicate the presence of one or more doors, entryways, and / or other gaps in the walls defining premise 300. In embodiments where the premise includes multiple rooms, a common door, entryway, other gap, etc. may be used as a common reference point between the rooms to connect the overall premise map. For example, user 302 may utilize a mapping device (e.g., user device 102) to indicate the location of door 316, and an environmental map may be generated that includes data indicating the presence of door 316 and / or otherwise indicating gaps in the walls that define premise 300. In some embodiments, the mapping is performed at least in part based on a two-dimensional coordinate system, such that location data corresponding to a particular device or the premise itself is represented by a tuple of two data values ​​(e.g., an x-y coordinate pair). In other embodiments, the mapping is performed at least in part based on a three-dimensional coordinate system, such that location data corresponding to a particular device or the premise itself is represented by a tuple of three data values ​​(e.g., an x-y-z coordinate pair that includes an elevation coordinate).

[0138] It will be appreciated that in some embodiments, other notable aspects of the environment may be mapped, some of which may affect signal strength between the networked device and the network access point, for example. In some embodiments, windows, doorways, openings, and / or other changes in the structure of the environment's boundaries are indicated during mapping and / or stored for distinction within the environment plot. In this regard, the environment plot may represent a realistic and / or accurate mapping of the environment. In some embodiments, real-world environmental features (e.g., corners, boundaries, boundary changes, etc.) are indicated manually, while in other embodiments, they are determined automatically using one or more image processing algorithms, machine learning models that perform object detection from the captured data, etc.

[0139] Additionally or alternatively, in some embodiments, while traversing the route 312 or while traversing an alternate route using a mapping device (e.g., user device 102) for the first time or at a later time, the user 302 utilizes the mapping device to map the locations of various devices and / or objects within the premise 300. For example, the user 302 may manipulate the user device 102 (e.g., by moving the user device 102, orienting the user device 102, etc.) so that a reticle is positioned at the location of the network access device 110 within the augmented reality environment, visible to the user 302, for example, via an augmented reality interface rendered on the user device 102. In some such embodiments, the mapping device (e.g., user device 102) may receive an indication of the device and / or object positioned at the reticle, as well as map data indicating that the device and / or object is located at a specified location within the augmented reality environment and / or environment plot. For example, in at least one example context, an environment plot may be generated that includes data objects mapped to the location indicated by the location of the reticle within the augmented reality environment. In some embodiments, the data object is a data object indicating the presence of an interfering object, a data object indicating the presence of a networked device, or a data object indicating the presence of a network access device but not a particular object or device located at that location. In other embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) automatically determines a particular object or device type and / or device identification associated with the object or device and stores the data type in the augmented reality environment and / or environment plot. In some embodiments, the user identifies the object during mapping (e.g., by selecting the object from a drop-down menu and marking the object via a reticle and a positioning algorithm).For example, in some embodiments, apparatus 200 determines, or user 302 indicates, via user device 102 that a network access device is located at the location of network access device 110, that a networked device is located at each of the locations of networked devices 114A, 114B, 114C, and 114D, and that an interfering object is located at the location of objects 308 and 310 in Figure 3. Additionally or alternatively, in some embodiments, the mapping device (e.g., user device 102) allows the user to input a particular object type or a particular device type and / or device identification information associated with the object or device, and stores the particular object type and / or device type in the augmented reality environment and / or environment plot. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) automatically determines and / or user 302 indicates via a mapping device (e.g., user device 102) that there is a router at the location of network access device 110, a home security system at the location of networked device 114C, a virtual assistant device at the location of networked device 114D, a smart TV at the location of networked device 114A, and / or a gaming console at the location of networked device 114B, a table at the location of interfering object 308, and an interior wall at the location of interfering object 310. Additionally or alternatively, in some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) enables, automatically or through user interaction with a mapping device (e.g., the user device 102), device identification information associated with each of the networked devices and / or network access devices to be associated with and stored in association with each of the indicated networked devices and / or network access devices.

[0140] In some embodiments, a mapping device (e.g., user device 102) is utilized to generate and / or otherwise determine network strength data at various locations within premise 300. In some embodiments, the network strength data may be determined by one or more other devices on the premise, either by themselves or via communication with a third device on the premise. For example, network access device 110 and / or networked devices 114A-114D may measure and report their respective signal strengths to user device 102, AR processing server 104, and / or electronic support platform 106. In this regard, the determined network strength data may be mapped to specific locations within the augmented reality environment and / or corresponding environmental plot. In this regard, network strength data may be determined at various locations throughout the premise 300 to enable the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) and / or the user 302 to further process the network strength data at such various locations and / or initiate one or more actions, decisions, etc. based on the determined network strength data at one or more locations. In one example context, the user 302 may initiate a test to determine network strength data associated with a particular location along the route 312. The network strength data may be specifically determined associated with a particular location, for example, by mapping generated and / or otherwise determined network strength data with device location data corresponding to the location of a mapping device (e.g., the user device 102) or other device measuring network strength data within an augmented reality environment corresponding to the premise 300.

[0141] Network strength data may be generated and / or otherwise determined for any number of locations within the premises 300, such as, for example, when one or more various measurement devices (e.g., user device 102, networked devices 114a, 114b, ..., etc.) are utilized to test network strength associated with one or more network access devices at several locations. As illustrated, for example, a user 302 may utilize a mapping device (e.g., user device 102) and / or various other devices within the premises (e.g., networked devices 114a, 114b, ...) to test network strength data for the network access devices 110 at various locations associated with each of the networked devices 114, locations near each of the networked devices 114, and / or locations where the user 302 is considering placing a networked device, and / or otherwise desire to be informed regarding network strength data at such locations. The network access device 110 may likewise be configured to report the signal strength of its connections with various devices. The mapping device (e.g., user device 102) may be configured to perform such network strength tests (e.g., by initiating a network strength determination process) of various locations at predefined intervals, such as at set time intervals, after traveling a predetermined distance, etc. It should be understood that such network strength tests may be initiated during traversal of path 312 to map one or more devices and / or objects, upon subsequent traversals of path 312, and / or at any other time along path 312 or an alternate path.

[0142] In this regard, the various devices described herein enable the generation of data accurately representing the premise 300, such as an augmented reality environment including data objects associated with each of the interference objects, networked devices, and / or network access devices within the premise, and / or an environmental plot similarly representing the premise along with the interference objects, networked devices, and / or network access devices within the premise. The devices may enable the generation of such data including and / or associated with network strength data at various locations within the premise 300, for example, via a mapping device (e.g., user device 102, networked devices 114a, 114b, ..., and / or network access device 110). The generated augmented reality environment and / or environmental plot may be further processed and / or utilized in any of a myriad of actions related to improving the overall network quality associated with one or more network access devices (e.g., improving the average network strength data across all tested locations and / or all locations where networked devices are located), improving the network quality associated with a particular location, locating devices on the premise 300, etc. The conclusions, recommendations, data, analysis, annotations, and other functionality facilitated by the data capture and / or analysis described above may then be rendered back to the user as part of the augmented reality interface or via a separate communication. Additionally or alternatively, such data may likewise be utilized to enable the provision of device protection programs and / or servicing of any of the devices within facility 300, as described herein.

[0143] In some embodiments, the environment plot is mapped in two dimensions. In this regard, the location of any object in the environment, regardless of height, may be determinable from the environment plot. In some other embodiments, some or all of the environment plot is mapped in three dimensions. In this regard, the three-dimensional position and location of any mapped object may be determined in all dimensions via the environment plot. For example, in some embodiments, the locations of corner data objects and / or the boundary of the environment plot may be mapped in two dimensions and an assumed infinite height, while locations corresponding to networked devices are mapped in three dimensions to take into account the z-coordinate (or height) of the location where the networked device is located. In this regard, devices located at various heights in the real-world environment may be mapped accordingly, and the heights of these mapped locations may be taken into account in subsequent processing actions (e.g., to determine network strength, recommended changes, etc., as described herein).

[0144] It should be appreciated that by mapping an accurate representation of premises 300 in a manner that improves upon conventional devices and that is impossible for humans to perform alone, apparatus 200 provides several improvements to the field of network analysis. Additionally, by utilizing the augmented reality environments and augmented reality interfaces described herein, apparatus 200 provides such improvements in a manner that is user-friendly and does not require significant technical knowledge by the end customer to utilize efficiently, effectively, and / or accurately, reducing the level of knowledge and / or time investment traditionally required to utilize existing implementations.

[0145] Exemplary Processing Using Augmented Reality In at least one exemplary embodiment, one or more augmented reality interfaces are provided to enable a user to view, add, edit, or otherwise interact with elements of an augmented reality environment that augments a real-world image representing the property. In this regard, each augmented reality interface may include a representation of a real-world image embodying the user's property along with one or more representations of virtual objects, interface elements, etc. associated with the augmented reality environment. The real-world image and / or corresponding virtual objects from the augmented reality environment may be updated as the user repositions, traverses, and / or otherwise manipulates a user device, e.g., user device 102 embodied by apparatus 200, during mapping. For example, a user may position user device 102 at a particular location within the property that corresponds to a particular location in the augmented reality environment and orient user device 102 at a particular angle (e.g., X, Y, and Z rotation values) so that a particular object or device is within the field of view of camera circuitry associated with user device 102. In this manner, the augmented reality system may track the field of view of the camera circuit, its corresponding location within the augmented reality environment, and display and track both real-world and virtual images overlaid on one another (e.g., rendered to the user via the user device display). Additionally or alternatively, each of the one or more augmented reality interfaces may have any number of static interface elements not associated with the augmented reality environment, such as one or more buttons, text fields, labels, etc. that are not associated with any location within the augmented reality environment. In this regard, the static interface elements may be positioned based on predetermined interface coordinates and / or interface settings relative to the display / interface surface, which are not changed by manipulation, repositioning, reorientation, and / or other movement associated with the user device 102 relative to the premise.Additionally or alternatively, in some embodiments, the augmented reality interface is configured to receive user input in response to user-performed gestures, voice commands, or general interaction with the augmented reality interface (e.g., user engagement such as a tap or click anywhere within the interface, as opposed to a specific interface element).

[0146] FIG. 4 illustrates an exemplary augmented reality interface (left) and an exemplary environment plot visualization (right) in accordance with at least one exemplary embodiment of the present disclosure. For example, as illustrated, FIG. 4 illustrates a first augmented reality interface 400, which may be rendered on a user device 102 embodied by apparatus 200, for example, during mapping of a particular site, such as site 300, as illustrated and described above with respect to FIG. 3. Additionally, FIG. 4 illustrates an exemplary environment plot visualization 450. The environment plot visualization 450 provides a visualization of an environment plot that may be generated when a user performs various mapping operations as described herein, for example, during mapping of the site illustrated in first augmented reality interface 400. It should be understood that in some embodiments, the augmented reality interface 400 is rendered on a display of the user device 102 during mapping, and data representing the environment plot represented by the environment plot visualization 450 may be maintained by one or more apparatus 200 and / or associated servers, for example, the AR processing server 104 described above with respect to FIG. 4. In some such embodiments, the environment plot visualization 450 is not rendered on any display, but is simply embodied in a data object maintained by one or more devices 200, such as the AR processing server 104, and the data may be used to facilitate and / or maintain the rest of the system, such as an augmented reality environment. In other embodiments, the device 200 is configured to enable rendering of the environment plot visualization 450 on a display of the user device 102, for example, simultaneously with the augmented reality interface 400 and / or upon access of a second user interface that includes only the environment plot visualization 450. Additionally or alternatively, in some embodiments, the AR processing server 104 is configured to enable rendering of the environment plot visualization 450 on a display of the AR processing server 104.It should be understood that as data is mapped using user device 102 (e.g., to map the location of a corner, object, device, etc.), an environment plot generated and / or separately maintained by apparatus 200 may be updated, and the corresponding environment plot visualization 450 may likewise be newly generated and / or separately updated to reflect the newly mapped data. For purposes of illustration and explanation, environment plot visualization 450 is updated as data is mapped as described herein with respect to Figures 4-9 to provide a human-understandable visualization of the generation of the updated environment plot as such data is mapped.

[0147] In some embodiments, before commencing mapping, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to initialize an augmented reality environment maintained by apparatus 200. In at least one exemplary embodiment, a user initializes the augmented reality environment by utilizing user device 102 to “scan” a flat surface within the premises. For example, user device 102 may be positioned such that the camera circuitry is oriented toward the flat surface and then rotates along one or more axes to capture the length of the flat surface. In this regard, apparatus 200 may identify the flat surface based on the captured image data as the camera circuitry rotates to capture the length of the flat surface, such as by processing the captured image data to identify the flat surface and corresponding edges (e.g., using one or more edge detection methods known in the art). The apparatus 200 (e.g., the user device 102 and / or a connected server) may additionally or alternatively perform one or more interpolations and / or estimates while initializing the augmented reality environment, e.g., to complete the initialization of the augmented reality environment in situations where at least a portion of a flat surface is obscured within the field of view of the camera circuitry by an object, device, etc. The augmented reality environment may be initialized to a particular origin position, e.g., such that the origin position embodies the location where the user device 102 was located when initialization of the augmented reality environment began. In this regard, as the user device 102 traverses the entire lot (and similarly, the corresponding augmented reality environment), the location of the user device 102 can be determined based on the traversal of the user device 102 from the origin position. The traversal of the user device 102 may be tracked and / or determined using one or more sensors, location service providing circuitry, etc.

[0148] As illustrated, the augmented reality interface 400 includes a reticle 402. In some embodiments, the reticle 402 comprises a static interface element, for example, positioned at the center of the augmented reality interface 400. The position of the reticle may be tracked via correlation between an image of the real world shown on the user device and the static position of the reticle on the user device image. In other embodiments, the reticle 402 embodies a representation of a virtual reticle object in the augmented reality environment 100. In situations where the reticle 402 is embodied as a representation of a virtual reticle object, the position of such virtual reticle object may be maintained by the user device 102 or other user-facing display and associated computing system. In some such embodiments, a user may reposition the reticle 402 by manipulating the user device 102 to reposition the corresponding virtual reticle object. For example, the user may translate the user device 102 (e.g., by navigating throughout a site) to move the virtual reticle object and / or adjust the orientation of the user device 102 to reposition the virtual reticle object. In at least one example context, to reposition a virtual reticle object within an augmented reality environment, a user may manipulate user device 102 by rotating the device along an axis in a first direction to move the virtual reticle object closer to a position associated with user device 102 (e.g., rotating the device so that the camera circuitry is further toward the flat surface and / or tilted downward from user device 102), and by rotating user device 102 along an axis in a second direction to move the virtual reticle object farther from a position associated with user device 102 (e.g., rotating the device so that the camera circuitry is further away from directly on the flat surface and / or tilted upward from user device 102). In this regard, a user may utilize user device 102 to reposition reticle 402 to any desired position.

[0149] As illustrated, reticle 402 is positioned near a corner of the lot, such as corner 404. It should be understood that the location of corner 404 within the lot corresponds to a particular corner location within the augmented reality environment. In this regard, a user may manipulate user device 102 to indicate the presence of a corner (e.g., via clicking static interface element 408) and thus generate an environment plot including data embodying the corner at the corner location corresponding to corner 404. In some embodiments, upon receiving an indication of the presence of a corner, one or more of apparatus 200 (e.g., user device 102 or a connected server or other device) determines a location associated with reticle 402 and generates an environment plot including data embodying the corner located at the location associated with reticle 402. For example, in at least one example context, device 200 is configured to identify the position of reticle 402 by determining the position of a corresponding virtual reticle object in an associated augmented reality environment and mapping that position (or a position with an offset determined based on a determined distance between the reticle and the corner based on image processing of the captured image data) as the corner position of corner 404. As illustrated, for example, an environment plot is generated that includes corner data object 406, which may include or be associated with one or more data object characteristic values ​​indicating that the data object represents a corner and / or one or more data object characteristic values ​​mapping the data object to the determined corner position (e.g., approximately (-9, 20) as shown in environment plot visualization 450, where the coordinates may represent any distance units of measurement and the third vertical axis may optionally be set to 0 for corner mapping along the floor).

[0150] The indication of the presence of a corner within the captured camera data may be received in any of a myriad of manners. In some embodiments, the device 200 automatically receives the indication in response to processing the captured camera data and determining that a corner is present in at least a portion of the camera data (e.g., automatic corner detection in one or more frames of the camera data). The device may determine that a corner is present in at least a portion of the camera data by processing one or more frames using any of a myriad of edge detection and / or other image processing algorithms. In other embodiments, a user may provide user input indicating the presence of a corner within at least a portion of the camera data (e.g., a frame currently being captured and / or rendered in the augmented reality interface 400). For example, the user may, via the user device 102, engage with a predetermined interface element (e.g., static interface element 408) of the augmented reality interface 400 for such purpose, input one or more gestures via the user device 102, provide a voice or audio command, and / or generally provide user engagement with the augmented reality interface 400 (e.g., by tapping or otherwise interacting with any portion of the augmented reality interface including a representation of the camera data). It should be appreciated that in some embodiments, other known implementations for receiving user input may be utilized to indicate the presence of a corner in at least a portion of the camera data.

[0151] The user may continue to map the lot by navigating the lot with the user device 102. In this regard, the user device 102 may be configured to track its position relative to the augmented reality environment as the augmented reality environment moves within the lot. In at least one example context, to continue mapping the lot boundary, the user may navigate with the user device 102 to a new location where a second corner is located. For example, the user may navigate throughout the lot so that the next visited corner is connected (e.g., by a wall) or otherwise proximate to a previously mapped corner 404.

[0152] FIG. 5 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one example embodiment of the present disclosure. For example, as illustrated, FIG. 5 illustrates a second augmented reality interface 500, which may be rendered on user device 102 embodied by apparatus 200, for example, during mapping of a particular lot, such as lot 300, as shown and described herein with respect to FIG. 3. Additionally, FIG. 5 illustrates an example environment plot visualization 550. Environment plot visualization 550 provides a visualization of environment plot visualization 450 updated to include data associated with a second corner, for example, corner 502, as described herein. It should be understood that augmented reality interface 500 and / or environment plot visualization 550 may similarly render and / or operate in a manner similar or identical to that described above with respect to similarly named elements 400 and 450 of FIG. 4.

[0153] As illustrated, the augmented reality interface 500 includes camera data representing an image of the real world at a second location on the property being mapped. As illustrated, the augmented reality interface 500 includes a reticle 402. In at least one exemplary context in which the reticle 402 corresponds to a virtual reticle object within the augmented reality environment, the virtual reticle object corresponding to the reticle 402 may be repositioned within the augmented reality environment as the user device 102 navigates throughout the property (e.g., as the user walks from the first corner 404 to the second corner 502). In some such embodiments, the position of the virtual reticle object corresponding to the reticle 402 may be configured in association with the position and / or orientation of the user device 102 such that the virtual reticle object is always located in a position within the augmented reality environment that is captured by the camera circuitry of the user device 102 or is within a field of view associated with the user device 102. For example, a vertical reticle object may be maintained in a predetermined location on the interface and / or display as the user moves the reticle by reorienting the camera. In some embodiments, instead of or in addition to a reticle, a user may interact with the interface (e.g., via touch on a touch screen display of the user device) to indicate a corner or other noteworthy feature (e.g., a networked device, etc.) regardless of where on the interface the image of the corner or other noteworthy feature is shown.

[0154] As illustrated in augmented reality interface 500, reticle 402 is positioned near a second corner of the property, such as corner 502. It should be understood that the location of corner 502 within the property corresponds to a second specific corner location within the augmented reality environment. In a manner similar to that described with respect to corner 404, the corner location associated with second corner 502 may be determined solely from the position of user device 102 within the augmented reality environment (e.g., mapping device position data) or together with additional data, such as an offset between the mapping device position data and a determined location associated with reticle 402 (e.g., an assumed location of the reticle at its intersection with the targeted feature, in this case corner 502). The offset may be determined based on one or more sensor inputs and / or calculations, such as, for example, one or more locations determined for the user device, as well as one or more sensor inputs and / or calculations, such as the orientation of the user device (e.g., determined via an accelerometer) and / or the range to an identified feature (e.g., via feature identification, such as known fiducials, lidar, binocular triangulation using two camera circuits or multiple images of the same location, and / or any other range detection process). In various embodiments disclosed herein, the offset may include distance, vertical and / or rotational angles, and any other relevant data. In this regard, the user may manipulate the user device 102 to indicate the presence of a second corner in a second portion of the captured camera data (e.g., the portion rendered in the second augmented reality interface 500), thus generating an environment plot including data embodying the second corner at a second corner location corresponding to the second corner 502. In some embodiments, upon receiving an indication of the presence of the second corner, one or more of the apparatuses 200 (e.g., the user device 102, the AR processing server 104, and / or the electronic support platform 106) determine an updated position associated with the reticle 402 and generate an environment plot including data embodying the second corner located at the updated position associated with the reticle 402.For example, in at least one example context, device 200 may be configured to identify an updated position of reticle 402 by determining an updated position of a corresponding virtual reticle object in an associated augmented reality environment and mapping that updated position (or a position having an offset determined based on a determined distance between the reticle and the corner based on image processing of the captured image data) as a second corner position of corner 502.

[0155] As illustrated, for example, as shown in environment plot visualization 550, an environment plot is generated to include a second corner data object 504. The second corner data object 504 may include or be associated with one or more data object characteristic values ​​indicating that the second data object represents a corner and / or one or more data object characteristic values ​​mapping the second data object to the determined second corner location (e.g., approximately (-2.5, 19) as shown in environment plot visualization 550, where coordinates may represent any distance unit of measure). Additionally or alternatively, in some embodiments, the second corner data object 504 is associated with data connecting and / or otherwise linking the second corner data object 504 to one or more other data objects. For example, as shown, the second corner data object 504 is connected to the first corner data object 406 via a line. In some embodiments, the apparatus 200 automatically connects subsequently created and / or otherwise indicated corner data objects. In this regard, for example, the process may include storing one or more separate data objects indicating a connection between the first corner data object 406 and the second corner data object 504, and / or storing one or more data characteristic values ​​within or associated with the first corner data object 406 and / or one or more data characteristic values ​​within or associated with the second corner data object 504 indicating that the first corner data object 406 and the second corner data object 504 are connected.

[0156] The second indication indicating the presence of the second corner 502 in the captured camera data may be received in a manner similar to that described herein with respect to the first corner 404. For example, in some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) automatically receives the indication in response to processing the captured camera data and determining that the second corner 502 is present in at least a portion of the captured camera data. Additionally or alternatively, a user may provide user input indicating the presence of the second corner 502 in the captured data.

[0157] It should be understood that the corner mapping process described with respect to FIGS. 4 and 5 may be repeated for any number of corners. In this regard, FIG. 6 illustrates another exemplary augmented reality interface and another exemplary environment plot visualization in accordance with at least one exemplary embodiment of the present disclosure. For example, as illustrated, FIG. 6 illustrates a third representation of augmented reality interface 600, which may be rendered on user device 102 embodied by apparatus 200, for example, during mapping of a particular lot, such as lot 300, as shown and described herein with respect to FIG. 3. Furthermore, FIG. 6 illustrates another exemplary environment plot visualization 650. Environment plot visualization 650 provides a visualization of environment plot visualization 550 updated to include data associated with a third corner, e.g., corner 602, as described herein. It should be understood that augmented reality interface 600 and / or environment plot 650 may similarly render and / or operate in a manner similar or identical to that described above with respect to similarly named elements 500 and 550 of FIG. 5.

[0158] As illustrated, the augmented reality interface 600 includes camera data representing an image of the real world at a third location on the property being mapped. As illustrated, the augmented reality interface 600 includes a reticle 402. In at least one example context in which the reticle 402 corresponds to a virtual reticle object within the augmented reality environment, the virtual reticle object corresponding to the reticle 402 may be repositioned within the augmented reality environment when the user device 102 is navigated to the location of the third corner 602. As illustrated in the augmented reality interface 600, the reticle 402 is positioned near a third corner of the property, such as corner 602. It should be understood that the location of the corner 602 within the property corresponds to a third particular corner location within the augmented reality environment. It should further be understood that the corner location associated with the third corner 602 may be mapped in a manner similar to that described herein with respect to the first corner 404 and / or the second corner 502.

[0159] As illustrated, for example, as shown in environment plot visualization 650, an environment plot is generated to include a third corner data object 604. The third corner data object 604 may include or be associated with one or more data object property values ​​indicating that the third data object represents a corner and / or one or more data object property values ​​mapping the third data object to the determined third corner location (e.g., approximately (-1.5, 24) as shown in environment plot visualization 650, where coordinates may represent any distance unit of measure). Additionally or alternatively, in some embodiments, the third corner data object 604 is associated with data connecting and / or otherwise linking the third corner data object 604 to one or more other data objects. For example, as shown, the third corner data object 604 is connected to the second corner data object 504. In some such embodiments, the apparatus 200 automatically connects subsequently generated and / or otherwise designated corner data objects to store data connecting the second corner data object 504 with the subsequently mapped third corner data object 604. In light of the present disclosure, it should be understood that connections between such data objects may be stored in any of the manners described above with respect to the connection between the second corner data object 504 and the first corner data object 406.

[0160] The third indication indicating the presence of the third corner 602 in the captured camera data may be received in a manner similar to that described herein with respect to the first corner 404 and / or the second corner 502. For example, in some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) automatically receives the indication in response to processing the captured camera data and determining that the third corner 602 is present in at least a portion of the camera data. Alternatively or additionally, the user may provide user input indicating the presence of the third corner 602 in the captured data (e.g., in some embodiments, by selecting a “mark corner” button embodied by the static interface element 408 or by touching the screen at the location of the corner).

[0161] FIG. 7 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one exemplary embodiment of the present disclosure. For example, as illustrated, FIG. 7 illustrates an augmented reality interface 700 that may be rendered on a user device 102 embodied by apparatus 200, for example, during mapping of a particular lot, such as lot 300, as illustrated and described herein with respect to FIG. 3. The illustrated augmented reality interface 700 is associated with performing a mapping operation associated with networked devices within the lot being mapped. Additionally, FIG. 7 illustrates an example environment plot visualization 750. The environment plot visualization 750 provides a visualization of the environment plot upon completion of mapping of all corners associated with the lot. For example, the environment plot visualization includes a corner set 706 of the environment plot mapped to various corner locations and associated with data connecting each corner data object with subsequently mapped corner data objects, such that the corner set 706 forms and / or otherwise represents the boundary of the lot being mapped. In at least one context, for example, as shown, a user may utilize a user device 102 to map one or more networked devices associated with a premises.

[0162] In some embodiments, the user device may include multiple modes that signify a particular mapping operation in progress. For example, a “boundary” mode may include mapping and connecting corners of a property. A “device awareness” mode may then be used to map nearby network access devices and / or networked devices. An “interferer mode” may be used to map non-boundary objects that are not part of a network. In some embodiments, the augmented reality interface may include selectable options that allow various features (e.g., boundary, network, and interferer features, or any other relevant features) to be selectively mapped based on a user's selection of an associated UI option (e.g., a static interface element as shown). In some embodiments, the associated UI option may be presented and / or removed depending on the selected mode and / or completion of one or more mapping activities (e.g., completion of the full boundary, such as by reconnecting with the first mapped corner, may remove the “mark corner” option from the augmented reality interface).

[0163] As illustrated, the augmented reality interface 700 includes camera data at another location within the mapped premises, such as the location at which the networked device 702 is located. In this regard, the user may utilize the user device 102 to map the networked device 702 to the networked device location and generate an environment plot including networked device location data representing the networked device location associated with the networked device 702.

[0164] The user device 102 may be utilized to map a particular networked device to location data for that particular networked device in a manner similar to that described herein with respect to mapping corners to corner locations. For example, in one or more embodiments, a user positions the user device 102 so that the reticle 402 is rendered at or near a location associated with the networked device 702 (e.g., so that the reticle is rendered on the networked device). It should be understood that the reticle 402 may be repositioned in any of the manners described herein with respect to object and / or device mapping. Furthermore, in some embodiments, a combination of ranging, orientation, and location information from the user device may be used to map the location of each networked device 702 and any other mapped devices, objects, or other features in three dimensions.

[0165] In some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) receives an indication of the presence of a networked device in at least a portion of the captured camera data. For example, apparatus 200 may receive an indication of the presence of a networked device in a particular frame of the captured camera data (e.g., a frame being captured and / or rendered in augmented reality interface 700). In some embodiments, apparatus 200 automatically receives the indication of the presence of a networked device in the camera data. For example, in some contexts, apparatus 200 is configured to process the captured camera data to identify the presence of networked device 702 in at least a portion of the camera data (e.g., within a frame of the captured camera data). In some embodiments, a user may place a physical identifier on a real-world device to be identified and incorporated into the augmented reality environment, and the identifier may be scanned and interpreted by the system via camera circuitry and processing circuitry to detect the location and / or identity of the device. In one or more embodiments, apparatus 200 is configured to utilize one or more object detection models specifically configured to detect networked devices of one or more networked device types from captured camera data. As illustrated, for example, apparatus 200 may utilize one or more object detection models configured to detect laptop devices as shown, alone or in combination with configurations for detecting other networked device types. For example, the models may include computational neural networks trained to classify devices by type (e.g., laptop, mobile device, TV, smart appliance, etc.) and / or by specific manufacturer and / or model. In some embodiments, a user may manually input information about devices, features, or other objects added via the mapping process.In this regard, it will be understood that networked devices may be identified and / or classified manually, automatically, visually, via network communications with network access points, etc. In this regard, devices may be identified manually in response to image processing, based on processing of network data indicative of the device's presence on the network, and / or any combination thereof.

[0166] In some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) receives an indication of the presence of networked device 702 in response to user engagement with user device 102 and / or any associated devices. For example, in at least some exemplary embodiments, apparatus 200 receives an indication of the presence and / or identity of networked device 702 in response to user engagement with augmented reality interface 700 and / or interface elements included therein via user device 102. As illustrated, augmented reality interface 700 includes user interface elements 704 configured for user engagement. In this regard, a user may engage with user interface elements 704 (e.g., by tapping, touching, gesturing, clicking, and / or otherwise interacting with user interface elements 704) to provide such user engagement, and apparatus 200 may receive an indication in response thereto. The apparatus 200 may map the networked device 702 with particular networked device location data that represents a location associated with the networked device 702 .

[0167] In some embodiments, apparatus 200 generates an environmental plot that includes data representing each networked device represented within the premises. For example, in some embodiments, the environmental plot is generated to include a data object or equivalent information for each networked device represented within the premises. In some contexts, the data objects may include one or more data characteristics that each represent an aspect of the networked device (e.g., networked device type, networked device identification, user-entered device name, etc.). In some embodiments, data objects associated with the networked devices are generated and / or otherwise provided in the environmental plot that include values ​​of one or more data characteristics of the data object.

[0168] As illustrated, an environment plot is generated that includes networked device data objects 708. The networked device data objects 708 are located at specific network device locations associated with the environment mapped by the corner set 706 of the environment plot. For example, the environment plot visualization 750 includes a networked device data object located approximately at (0.5, -0.5), as illustrated in the environment plot visualization 750 (coordinates may represent any linear unit of measurement). In this regard, the environment mapped by the corner set 706 of the environment plot may be generated such that the networked device data objects 708 are represented by networked device locations within the environment mapped by the corner set 706 of the environment plot that precisely correspond to the networked device locations of the networked devices within the premise, such as premise 300. It should be understood that the environment plot may be generated with updates that include a networked device data object for each networked device indicated as present within the mapped premise. For example, the environment plot may be updated as each subsequent instruction associated with a networked device is received.

[0169] In some embodiments, an environmental plot is generated that includes data representing other devices within the premises, including the network access devices within the premises being mapped. FIG. 8 illustrates another exemplary augmented reality interface and another exemplary environmental plot visualization, in accordance with at least one exemplary embodiment of the present disclosure. As illustrated, FIG. 8 illustrates an augmented reality interface 800 that may be rendered on a user device 102 embodied by apparatus 200, for example, during mapping of a particular premises, such as premises 300, as shown and described herein with respect to FIG. 3. The requested augmented reality interface 800, as shown, is associated with performing mapping operations associated with network access devices within the premises being mapped to add representations of the network access devices to the augmented reality environment. Additionally, FIG. 8 illustrates an exemplary environmental plot visualization 850. The environmental plot visualization 850 provides a visualization of the environmental plot upon mapping of network access devices associated with the premises. For example, the environmental plot visualization 850 map may be provided upon completion of mapping of all corners associated with the premises, or may be rendered continuously to allow a user to track the mapping operation. As illustrated, the environment plot visualization 850 includes the corner set 706 as mapped and described above with respect to Figure 7 herein. In at least one example context, for example, as shown, a user may utilize a user device 102 to map one or more network access devices associated with (e.g., within) the mapped lot.

[0170] As illustrated, the augmented reality interface 800 includes camera data taken at different locations within the premises being mapped. For example, the camera data represents a location where the network access device 802 is located. In this regard, the user may utilize the user device 102 to map the network access device 802 to the network access device location and generate an environment plot visualized in the environment plot visualization 850 that includes network access device location data representing the network access device location data associated with the network access device 802.

[0171] 7, the user device 102 may be utilized to map a particular network access device to particular network access device location data. For example, in one or more embodiments, the user positions the user device 102 such that the reticle 402 is rendered and oriented (e.g., such that the reticle is rendered on the network access device) at or near a location associated with the networked device 802. It should be understood that the reticle 402 may be utilized and / or repositioned in any of the manners described herein with respect to object and / or device mapping. In some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) is configured to automatically determine the location of the network access device 802 based, for example, on current mapping device location data associated with the user device 102 and an offset from one or more other data inputs, such as WiFi signal strength.

[0172] Apparatus 200 may receive an indication of a network access device in a manner similar to that described herein with respect to an object, a networked device, or any other feature. In some embodiments, apparatus 200 receives an indication of the presence of a network access device in at least a portion of the captured camera data. For example, apparatus 200 may receive an indication of the presence of a network access device in a particular frame of the captured camera data (e.g., a frame being captured and / or rendered in augmented reality interface 800). In some embodiments, apparatus 200 automatically receives the indication of the presence of a network access device in the camera data. For example, in some contexts, apparatus 200 is configured to process the captured camera data to identify the presence of network access device 802 in at least a portion of the camera data (e.g., within a frame of the captured camera data). In one or more embodiments, apparatus 200 is configured to utilize one or more object detection models, such as those described herein, that are specifically configured to detect network access devices of one or more network access device types (e.g., routers, modems, signal repeaters and / or signal extenders, etc.) from the captured camera data. As illustrated, for example, apparatus 200 may utilize one or more object detection models configured to detect router devices as shown, alone or in combination with configurations for detecting other network access device types. In some embodiments, a user may place a physical identifier on a real-world device that is identified and incorporated into the augmented reality environment, which may be scanned and interpreted by the system via camera circuitry and processing circuitry to detect the location and / or identity of the device.

[0173] In some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) receives an indication of the presence of network access device 802 and / or the identity of network access device 802 in response to user engagement with user device 102. In some embodiments, apparatus 200 receives an indication of the presence of network access device 802 in response to user engagement with augmented reality interface 800 and / or interface elements included therein. As illustrated, augmented reality interface 800 includes user interface element 704 configured for user engagement. In this regard, a user may similarly engage with interface element 704 to indicate the presence of a network access device or networked device. In other embodiments, augmented reality interface 800 includes additional and / or alternative interface elements specifically configured to indicate the presence of a network access device, such as interface element 806. In this regard, a user may utilize the user device 102 to interact with the interface element 806 to specifically indicate the identity of a network access device associated with network access device location data representing the presence of the network access device and / or a location associated with the network access device 802, as shown.

[0174] In some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) generates an environment plot that includes data representing each network access device indicated as being within the premises. For example, in some embodiments, the environment plot is generated to include a data object or equivalent information for each network access device indicated as being within the premises. In some contexts, the data objects may include one or more data characteristics that each represent an aspect of the network access device (e.g., network access device type, network access device identification information, user-entered device name, etc.). In some embodiments, the data objects associated with the network access devices are generated and / or otherwise provided in the environment plot that include values ​​of the one or more data characteristics of the data object.

[0175] As illustrated, an environmental plot is generated that includes network access device data objects 804. The network access device data objects 804 are positioned based on network access device location data associated with the environmental plot depicted by environmental plot visualization 850. For example, environmental plot visualization 850 includes a network access device data object location of approximately (45, -5), as depicted in environmental plot visualization 850, where coordinates may represent any distance unit of measurement. In this regard, the environmental plot represented by environmental plot visualization 850 may be generated such that network access device 802 is represented at a network access device location within the environmental plot that accurately corresponds to the location of network access device 802 within a premises, such as premises 300. It should be appreciated that the environmental plot may be generated with updates that include a network access device data object for each network access device indicated as present within the mapped premises. For example, the environmental plot may be updated as each subsequent indication associated with the network access device is received. In some embodiments, data objects representing device and / or network signal strength data may be collected that may be identified via different indicia (e.g., different colors, shapes, etc.) such that both signal strength data and physical object data may be represented, as illustrated in Figure 8. Multiple different types of indicia may be used for various purposes discussed herein. Modified graphics may be used for signal strength measurements at the location of a particular device (e.g., multi-color, graphic, or other visual distinction).

[0176] A user may continue to utilize the camera circuitry 212 to capture any number of devices. For example, a user may capture camera data and receive instructions associated with any number of networked devices and / or any number of network access devices. In this regard, a user may utilize the apparatus 200 to generate an environment plot that precisely maps the boundaries of a property, all devices within the property, and / or all objects within the property.

[0177] In some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) processes captured image data to identify and / or onboard devices (e.g., networked devices, network access devices, offline devices, etc.) on particular applications and / or services. For example, in some embodiments, apparatus 200 utilizes one or more object detection models to detect particular devices within an environment and initiates an onboarding process to associate data identifying such detected devices. For example, in some embodiments, apparatus 200 maintains and / or accesses software applications that enable a user to store indicators of each device within one or more environments and / or perform any number of electronic driving processes associated with such devices. A user can onboard a new device, connect to an electronic support platform, request technical support associated with the onboarded device, initiate a device protection program associated with such detected device, etc., to enable the user to utilize software applications (e.g., software applications providing augmented reality processing functionality described herein and / or separate software applications) to configure such devices. During onboarding, the detected devices may correspond to the user device 102 and / or be associated with a user account through which an authenticated session was initiated (e.g., via logging in and / or otherwise authenticating the particular user account) via the user device 102. Additionally or alternatively, in some embodiments, the user device 102 may access the network to which the user device 102 is connected to detect specific devices that match the device type detected via image processing, and store in one or more software applications specific configurations, identifications, and / or other data associated with the specific devices queried over the network.In some embodiments, the user device 102 and / or apparatus 200 provides access to detected or otherwise identified devices, for example, to enable reconfiguration of the devices, etc. Computing devices may be accessed via detected network data, manually entered devices, etc.

[0178] In some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) processes the captured image data to detect, decode, and / or process machine-readable symbology in the environment. For example, the process may detect and decode machine-readable symbology on or otherwise associated with particular devices in order to onboard such devices into one or more software applications. Non-limiting examples of machine-readable symbology include barcodes, QR codes, image recognition (e.g., via trained models), etc. that are detectable from the captured image and subsequently decodable. In some embodiments, apparatus 200 processes each frame of captured image data to detect machine-readable symbology in the captured image data. The machine-readable symbology may include device identifiers, device types, and / or other data associated with devices (e.g., networked devices and / or network access devices) in the environment. Upon detecting a machine-readable symbology, in some embodiments, device 200 decodes the machine-readable symbology and uses the decoded data to onboard the device as described herein. For example, in some embodiments, device 200 stores data representing the detected device via one or more software applications (e.g., device type, specific device identifier, etc.), data associated with a particular user account, etc. In this regard, a user may utilize such software applications to configure such device, connect to an electronic support platform to request technical support associated with the onboarded device, initiate a device protection program associated with such detected device, and / or perform one or more processes associated with the device after it is onboarded. In some embodiments, the onboarding process may include automatically recognizing the device and configuring the device's connection to a network access device.In some embodiments, the onboarding process may be used to restore network connectivity for previously recognized devices. For example, when a new network access device is added, all devices on the old network access device may be automatically recognized and connected to the new network. Similarly, when setting up a network at a new premises (e.g., after a move), devices previously connected to the network access device at the previous premises may be onboarded into the new augmented reality environment at the new premises.

[0179] In some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) may electronically connect or attempt to connect with one or more devices detected in the captured image data from the camera circuitry. In some embodiments, the user device 102 may attempt to connect via one or more known network access devices to determine whether one or more devices in the captured image data are already connected to a network (e.g., the communications network 112 shown in FIG. 1). In cases where one or more devices are not connected to a network, a process may begin onboarding the captured devices. If onboarding fails, one or more detected devices may be flagged as inoperable or unresponsive.

[0180] In some embodiments, the device 200 may identify or attempt to identify one or more devices on a network (e.g., the communications network 112 shown in FIG. 1 ) within captured image data from the camera circuitry. In such embodiments, devices from multiple premises or associated with multiple users / accounts may be on the same network or otherwise in electronic communication. In some such embodiments, the process may filter out devices that are not detected via visual confirmation with the camera circuitry. For example, an office or apartment building sharing a common WiFi network may include multiple devices on the network that are not under the user's control or that the user otherwise does not wish to be included in premises mapping and / or analysis. In some embodiments, the process may then include a visual onboarding and / or verification step requiring the user to capture image data for each device to be included within the augmented reality environment, and the system may be configured to filter out any other detected devices that are not visually captured. In some embodiments, verification may be a security process to prevent undesired interference between users and / or premises. In some embodiments, the user device 102, the AR processing server 104, the electronic support platform 106, and / or any other associated devices may control access to the network access device (e.g., WiFi security protocols). In such embodiments, visual verification may be required before a device is allowed to connect to a network access device. For example, the visual verification may operate similarly to a WiFi Protected Setup (WPS) system. In some embodiments, the verification may be an option selected by the user and / or provider of the augmented reality system. In some embodiments, the user device 102, the AR processing server 104, the electronic support platform 106, and / or any other associated equipment may passively discover new devices via cameras and / or network monitoring.In some embodiments, the process may include receiving one or more signals from one or more devices and triangulating the location of the one or more devices via the signal data. For example, Bluetooth signals may be received from multiple sources and / or at multiple receiving devices (e.g., user devices, networked devices, and / or associated equipment) to triangulate the location of one or more devices, which may help confirm, distinguish between, and / or otherwise determine the identity of one or more devices in the camera data. Similarly, WiFi signals or other detectable transmissions may be used for triangulation.

[0181] FIG. 9 illustrates another example augmented reality interface and another example environment plot visualization, in accordance with at least one exemplary embodiment of the present disclosure. As illustrated, FIG. 9 illustrates an augmented reality interface 900 that may be rendered on a user device 102 embodied by apparatus 200, for example, during mapping of a particular lot, such as lot 300, as illustrated and described herein with respect to FIG. 3. The illustrated augmented reality interface 900 is associated with performing mapping operations associated with networked devices within the lot being mapped. Additionally, FIG. 9 illustrates an example environment plot visualization 950. The environment plot visualization 950 provides a visualization of the environment plot upon completion of mapping of all corners associated with the lot. For example, the environment plot visualization includes corner sets 706 that have been mapped to various corner locations and associated with data connecting each corner data object with subsequently mapped corner data objects, such that the corner sets 706 form and / or otherwise represent the boundary of the lot being mapped. In at least one context, for example, as shown, a user may utilize a user device 102 to map one or more networked devices associated with a premises.

[0182] As illustrated, environment plot visualization 950 includes data objects associated with multiple devices mapped to locations within the depicted environment plot. In this regard, an environment plot such as that depicted in environment plot visualization 950 may accurately represent the boundaries of the property along with location data for all devices within the property. A user may then utilize device 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) to perform any of a myriad of additional and / or alternative actions upon completing the mapping of the property boundaries and / or devices therein. Additionally or alternatively, in other embodiments, a user may utilize device 200 to perform one or more additional and / or alternative actions before completing the mapping of the property boundaries and / or devices therein.

[0183] For example, in one or more embodiments, the user device 102 and associated equipment are configured to enable mapping of network device strength data at one or more locations within a premises. In some embodiments, the apparatus 200 is enabled to perform one or more network strength determination processes with the mapped locations along with the resulting network device strength data. For example, a user may navigate with the user device 102 through the mapped premises and utilize the user device 102 to determine network strength data at one or more locations during such navigation. In this regard, an environmental plot may be generated that includes such network strength data mapped to each of the tested locations. In some embodiments, one or more of the networked devices and / or network access devices may detect and / or report signal strength data of their respective connections to each other and / or to the network access devices, as described herein.

[0184] As illustrated, for example, FIG. 9 illustrates an environmental plot visualization 950 that includes data objects embodying network strength data tested and determined at various locations within a premises represented by corresponding environmental plots. For example, the user device 102 may render the augmented reality interface 900 during navigation throughout the premises. The user device 102 may then initiate a network strength determination process at specific locations during such navigation. In some embodiments, for example, as illustrated, the user device 102 initiates the network strength determination process in response to user engagement with the augmented reality interface 900 and / or its sub-interface elements. In one exemplary context, a user may engage with the user interface element 902 (e.g., by clicking, tapping, making a gesture, entering a voice command, etc.) to initiate the network strength determination process. The network strength determination process may be utilized to determine network strength data that maps to location data identified by the user device 102 (e.g., at an actual device location where network signal strength may be detected with one or more receivers, such as those included in the communications circuitry 208 shown in FIG. 2). For example, in at least one exemplary embodiment, the user device 102 determines mapping device location data representing the user device 102's current location within the premises being mapped. In this regard, the network strength data determined via the network strength determination process may be mapped to the mapping device location data representing the user device 102's current location. For example, in some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) embodies the network strength data and generates an environment plot including data objects associated with the location data to which the network strength data is mapped. As illustrated in environment plot visualization 950, an environment plot represented by the environment plot visualization 950 is generated that includes data objects 904 that may correspond to locations depicted in the augmented reality interface 900.

[0185] As described herein, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) may be utilized to generate network strength data for any number of locations within a premises being mapped. For example, as illustrated, the environmental plot represented by the environmental plot visualization 950 includes a data object 904 (e.g., associated with the current mapping device position where the user device 102 is located for the captured frame) that embodies network strength data for a location associated with the augmented reality interface 900, and multiple data objects 906, each embodying previously determined network strength data for various locations within the premises being mapped as the user traverses the premises from right to left relative to the orientation of FIG. 9 . Any number of data objects may be mapped to embody network strength data at any number of locations. It should be understood that the user device 102 may generate a data object at each of these locations, as described, in response to user engagement with the user device 102 and / or automatically. For example, in some embodiments, the user device 102 is configured to automatically perform a network strength determination process at predetermined time intervals (e.g., one second between performing each test of network strength data). In other embodiments, the user device 102 is configured to automatically perform a network strength determination process after the user device 102 navigates a predetermined distance (e.g., every three feet from the previous location where such a test was performed). In some such embodiments in which the user device 102 automatically initiates one or more network strength determination processes, the user device 102 may additionally be configured to allow additional network strength determination processes to be initiated via user intervention. In some embodiments, virtual indicators may also be rendered within the augmented reality environment to show the user the location and / or strength of previous measurements.

[0186] The mapped data and / or environmental plots may be processed for any of a myriad of purposes, as described herein. For example, in some embodiments, data objects associated with network strength data, devices, objects, and / or environmental plots may be processed for any of a myriad of network analysis purposes, including visualizing network strength at various locations within a premises, determining locations of reduced network strength within a premises, generating data associated with locating new devices within a premises, and / or generating data associated with relocating existing devices and / or existing objects within a premises. Additionally or alternatively, in some embodiments, data objects associated with network strength data, devices, objects, and / or environmental plots may be processed to provide device protection program information and / or service offerings associated with one or more devices located within a premises. Still additionally or alternatively, in some embodiments, data objects associated with network strength data, devices, objects, and / or environmental plots may provide functionality associated with environment naming, device grouping, and / or batch process initiation for grouped devices.

[0187] In some embodiments, during and / or after mapping the various data objects 906, the augmented reality interface 900 illustrates renderable data indicating the value and / or absolute or relative strength of the network strength data at each respective location. The absolute strength of the network strength data may embody classifications and / or categories of network strength data defined within predefined ranges based at least in part on the value of the network strength data associated with a particular location within the environment. The relative strength of the network strength data may embody classifications and / or categories of network strength data defined within determinable ranges defined at least in part on the network strength data at a particular location and / or other network strength data at other locations within the environment. In this regard, the augmented reality interface 900 may include overlays visually indicating the network strength at each location and / or the variations in network strength throughout the environment.

[0188] For example, during and / or after mapping as described, the user device 102 may render an augmented reality interface 900 with renderable data overlaid on the captured image data (e.g., real-time camera data) that visually illustrates network strength values ​​and / or absolute or relative strengths at locations illustrated in the real-time camera data. In some embodiments, the user device 102 or other associated device detects the floor of the environment and overlays the renderable data at the floor level (e.g., by coloring the floor based at least in part on the network strength data, illustrating a waveform representation representing a layer of “fog” along the floor layer, etc.). In some embodiments, augmented reality elements (e.g., arrows and / or other waypoints) are rendered within the captured image data at specific locations where such network strength data has been determined as virtual objects. For example, such augmented reality elements may include three-dimensional augmented reality elements floating at locations associated with the network strength data, with the image configured (e.g., to show a specific number of bars filled with known Wi-Fi and / or cellular signal strength indicator images, colors, and / or other visual characteristics) based at least in part on the network strength data at each location. It will be appreciated that the augmented reality interface may be dynamically updated as the user device 102 is traversed (e.g., while being carried by the user) throughout the environment.

[0189] In some embodiments, user device 102 outputs network strength data within a static, captured image. For example, in some embodiments, user device 102 utilizes one or more components to capture an image data object within an environment. Additionally or alternatively, in some embodiments, apparatus 200 utilizes image recognition and / or location service providing circuitry to determine a location within the environment depicted in the captured image data object. Apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) may then render one or more image elements on the static image data object that are specifically configured to indicate to the user the network strength at the depicted location based at least in part on the network strength data at the depicted location.

[0190] In some such embodiments, by mapping network strength data at various locations within the premises being mapped, user device 102 allows such network strength data to be made known to the user. Additionally or alternatively, such mapping of network strength data to specific locations allows such data to be processed for purposes of enabling network analysis compared to conventional implementations, such as to determine locations of reduced network strength, improve network strength data at one or more locations (or all locations overall) within the environmental plot, and / or otherwise enable apparatus 200 to improve the placement of current devices (e.g., networked devices and / or network access devices) and / or objects (e.g., interfering objects) within the premises to achieve desired improvements in network quality. Additionally, compared to conventional implementations, the use of augmented reality for such purposes advantageously provides for such actions to be performed utilizing a user-friendly implementation while reducing the amount of additional processing required to map locations associated with the boundaries of the environmental plot and / or the location of each data object to a location within the environmental plot.

[0191] Exemplary Network-Centric Processing Method of the Present Disclosure Having described exemplary systems, devices, apparatus, and interfaces according to the present disclosure, various processes according to the present disclosure are further described herein. Each process described herein may include any number of operational blocks defining a process and / or portions thereof. It should be understood that in some embodiments, the various processes and / or subprocesses described herein may be combined in any manner, such that an embodiment is configured to perform aspects of the various processes in combination, in parallel, and / or sequentially. In some embodiments, at least one additional and / or at least one alternative operation is performed in one or more of the described processes, and / or at least one operation is removed from one or more of the described processes. Additionally, optional operations may be illustrated in a process using dotted lines (or "dashed lines"). In this regard, it should be understood that the processes described herein are exemplary only, and that the scope of the disclosure is not limited to the exact operations illustrated and described, nor should the illustrated and described operations limit the scope and spirit of the embodiments described herein and encompassed by the appended claims.

[0192] In some embodiments, one or more of the devices, apparatus, and / or systems disclosed herein are configured to perform any number and / or combination of the processes described herein, whether alone or in combination, including, but not limited to, the embodiments discussed in Figures 10A, 10B, 11-14A, 14B, 15-18, 19A, 19B, 20-25, 26A, 26B, and / or 27. For example, in one exemplary embodiment, one or more of the devices, apparatus, and / or systems disclosed herein are configured to perform a combination of all or any subset of the processes described by Figures 10A and / or 10B, 16, 20, 23, and 27, and / or a combination of all or any subset of the processes and / or sub-processes associated therewith described with respect to Figures 11, 12, 13, 14A and / or 14B, 15, 17, 18, 19A, 19B, 21, 22, 24, 25, 26A and / or 26B. Any such process, or portion of such a process, may be performed according to various individual embodiments of each process disclosed herein.

[0193] Each of the described processes may be modified or implemented in any of a myriad of ways without departing from the spirit of this disclosure. In some embodiments, for example, the processes are embodied in computer-implemented methods executable by any of a myriad of computing device implementations, or combinations thereof, described herein, including by user device 102, AR processing server 104, electronic support platform 106, or any other apparatus 200 described herein. In some embodiments, the processes are embodied in one or more specially configured apparatuses, such as apparatus 200 configured to include at least one processor and at least one memory having computer-coded instructions stored therein, or other means described herein, that configure the apparatus to perform the operations of such processes when executed by the at least one processor. In some embodiments, a user device may be referred to as performing a particular function (e.g., interface rendering, image capture, signal detection, and / or location detection), and in light of this disclosure, those skilled in the art will understand that such a user device may embody any device that can be used alone or in combination with other devices for the functions disclosed or described herein, and that the term "user device" should not be construed as limiting the scope of these functions.

[0194] 10A illustrates the operation of an exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 10A illustrates the operation of an exemplary process 1000 for generating an environmental plot representing a site according to one or more embodiments of the present disclosure. FIG. 10B further illustrates the operation of a process 1050 for utilizing environment naming data to group one or more devices associated with the environmental plot. One or more of the described operations may be optional, as described herein.

[0195] For example, in some embodiments, one or more devices 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) are configured to perform some or all of the operations of process 1000, alone or in combination with one or more other devices (e.g., the process may be performed in whole or in part by the user device, the AR processing server, and / or the electronic support platform). As illustrated, process 1000 may begin at optional operation 1002. In optional operation 1002, device 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for initializing an augmented reality environment representing a three-dimensional environment. In some embodiments, user device 102 utilizes camera circuitry 212 to capture camera data for use in initializing the augmented reality environment. For example, the user device 102 may utilize the camera circuitry 212 to capture camera data including a representation of a flat surface (e.g., a lot floor) that is utilized to establish an origin and / or a two-dimensional or three-dimensional coordinate plane for placing virtual objects. The origin established during initialization may be used to track data embodying the user device 102's position as it traverses and / or otherwise navigates the lot. For example, in some embodiments, data captured from one or more sensors (e.g., gyroscope, accelerometer, GPS circuitry, signal triangulation circuitry, and / or combinations thereof) may be processed along with simultaneously captured images to determine an offset between the initialized origin and the user device 102's current position to generate mapping device position data representing the user device 102's current location. In some embodiments, the augmented reality environment may include or be modified by existing position and object data. For example, a pre-stored lot map (or portion thereof) may then be updated with the locations of various objects and / or signal strength measurements.

[0196] The initialized augmented reality environment may embody and / or otherwise define a coordinate plane and / or origin utilized in positioning virtual data objects. In this regard, upon initialization, user device 102 may be configured to generate and / or otherwise display an augmented reality interface including an image of the real world represented in the camera data and / or representations of virtual objects generated and / or received by apparatus 200. For example, process 1000 may include determining a portion of the augmented reality environment within the field of view of the camera circuit (e.g., coordinate systems may be correlated between the virtual environment and the real-world environment to create an augmented reality interface having virtual objects from the augmented reality environment appearing at corresponding real-world locations in the interface image), and then causing rendering (e.g., rendering on a display of user device 102) of virtual objects within the determined portion of the augmented reality environment. Such virtual objects may be rendered to augment (e.g., “on top of,” “interact with,” and / or “in addition to”) the real-world image represented in the captured camera data. In some embodiments, the augmented reality environment may be initialized using one or more third-party circuits described herein, which may be running, for example, on the user device 102 or any other device 200.

[0197] In operation 1004, the device 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for receiving at least one instruction associated with a plot corner established as a camera circuit of the device 200 (e.g., the user device 102) for navigating within an augmented reality environment. In some embodiments, each instruction of the at least one instruction is associated with a portion of the camera data. For example, each instruction indicates that a corner is present in the portion of the camera data. In this regard, for example, the portion of the camera data may be processed to automatically receive an indication of the plot corner within the captured camera data. In some embodiments, the device 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) receives each instruction by processing the portion of the camera data using image processing, a trained object detection model, or the like. In other embodiments, the user device 102 receives one or more indications in response to user engagement. For example, the user may engage the user device 102 to indicate the presence of a corner in a corresponding portion of a camera, such as a frame rendered in an augmented reality interface displayed by the user device 102. In some such embodiments, the apparatus 200 receives the indications in response to user engagement with a particular user interface element of the augmented reality interface rendered by the user device 102.

[0198] The corner detection process may be repeated for multiple portions of the captured camera data, such as each frame, image, etc. In some embodiments, multiple captured images, such as from continuous video capture, are processed by apparatus 200 and / or associated devices to determine the location of the corner (e.g., two images of the same corner from different angles may allow triangulation of the corner's location within the augmented reality environment). In some embodiments, each portion of the camera data may be processed (e.g., by apparatus 200) as the portion is captured or received. For example, in some embodiments, user device 102 is configured to capture camera data representing a real-time representation of a lot around user device 102. In some such embodiments, multiple indications may be received in association with multiple frames of camera data, with each indication indicating the presence of a corner in a corresponding frame of camera data. The multiple indications may correspond to a set of plot corners that define the boundary of the lot.

[0199] In operation 1006, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, and the processor 202, for mapping each plot corner within the set of plot corners to a corner location of each plot corner in the plot corner set. In this regard, the plot corners may be mapped to corner locations within the augmented reality environment upon receiving a corresponding instruction. To map the plot corners to the corner locations, the apparatus may generate a data object including one or more values ​​representing the corner locations within the augmented reality environment. In some embodiments, to map the plot corners to the corner locations within the augmented reality environment, the apparatus determines mapping device position data representing the current position of the user device 102. The apparatus may map the plot corners to the corner locations embodied by the mapping device position data. In some embodiments, the process includes determining an offset from the mapping device position data representing the current position of the user device 102 within the augmented reality environment to map the corner locations of the plot corners. For example, user device 102 may maintain and / or otherwise set the position of a virtual reticle object having a determinable offset from mapping device position data (e.g., a determinable intersection point between the reticle and an object represented in the real-world image and the augmented reality environment based on orientation data associated with camera circuitry of user device 102 or an associated camera device, and ranging data to the object targeted by the reticle). In some such embodiments, the device may map plot corners to the position of a virtual reticle object in the augmented reality environment when instructions are received.In this regard, in some such embodiments, as the user device 102 is navigated throughout the augmented reality environment, the apparatus 200 may be configured to update the position of the virtual reticle object, whereby the updated position of the virtual reticle object may be used to map corner locations upon receiving each subsequent indication of the presence of a corner in the captured data. In some embodiments, the user may select a location on the screen of the user device, which may then prompt the apparatus to determine a location in the augmented reality environment that corresponds to the location selected on the screen for identification as a corner.

[0200] In operation 1008, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for generating an environment plot based at least on the corner locations of each plot corner in the plot corner set. The environment plot may be generated to include data embodying the corner locations mapped to each of the depicted plot corners. Additionally or alternatively, the environment plot may be generated such that the plot corners are connected to one or more other plot corners. For example, in some embodiments, the environment plot includes data connecting consecutively depicted plot corners to one another (e.g., indicating that such consecutively depicted plot corners are connected by a wall). In this regard, the various connected plot corners may be positioned and connected in such a manner that the plot corner set is used to generate the environment plot in a manner that accurately represents the lot being mapped.

[0201] The environmental plot may be utilized for any of a myriad of purposes. In some embodiments, the environmental plot is rendered to a user via a display, such as the display of the user device 102, and / or to a user of another device, such as a user of an AR processing server, a customer service representative, etc. In some embodiments, the environmental plot is stored on the user device 102 for storage and / or transmitted to a remote device, such as an AR processing server. The stored environmental plot may be later retrieved for display and / or processing. In some embodiments, the environmental plot may be further generated along with mapped data associated with devices and / or objects and utilized in one or more additional operations, such as for network analysis, device servicing, device protection program enrollment, and / or information provision. For example, the environmental plot may be utilized in one or more of the operations described herein with respect to FIG. 10B and / or FIGS. 11-20.

[0202] 10B illustrates the operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 10B illustrates the operations of an exemplary process 1050 for associating a networked device with environment naming data according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1050, alone or in conjunction with any of the other processes described herein. As illustrated, process 1050 may begin at operation 1052. Operation 1050 may begin after one or more operations of another process, for example, after operation 1008 of process 1000, as illustrated.

[0203] At operation 1052, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, and the processor 202, for receiving environment naming data. The environment naming data may represent a user-readable and / or user-submitted name associated with the premises represented by the environment plot. In at least one example context, the environment naming data represents a room name associated with the premises represented by the environment plot. For example, a user may utilize the apparatus 200 to generate an environment plot representing the user's living room, and the received environment naming data may embody the text "Living Room" for storage associated with the corresponding environment plot. The environment naming data may include numeric, alphabetic, and / or alphanumeric text data, image data, etc.

[0204] In some embodiments, device 200 is configured to receive environment naming data based on user input. For example, a user may utilize device 200 (e.g., via touchscreen input on user device 102) to input environment naming data, such as by typing the environment naming data via user device 102. In some embodiments, device 200 receives environment naming data based on user input previously stored on user device 102 and / or an associated remote device, e.g., device 200 embodying an AR processing server. In this regard, the previously stored environment naming data may be stored in association with a particular user or user account accessed via user device 102, such as by logging in and / or determining that a user account is associated with user device 102.

[0205] In some embodiments, the device 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) receives the environment naming data in response to one or more automatic determinations. In some embodiments, the device determines that the networked devices associated with the environment plot correspond to predetermined environment naming data. For example, the device may determine that a smart TV is included in the generated environment plot and associate the environment plot with environment naming data for the premises where the smart TV is expected to be located, such as a "family room." The process may include determining that a smart toaster is included in the generated environment plot and associating the environment plot with environment naming data representing a "kitchen" where such a networked device is expected to be located.

[0206] At operation 1054, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, the processor 202, etc., for storing the environment plot associated with the environment naming data. In some embodiments, the process may include storing the environment plot associated with the environment naming data locally on the user device and / or on a remote device, such as the AR processing server. In some embodiments, the environment naming data may be used to retrieve the environment plot associated therewith.

[0207] At operation 1056, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communication circuit 208, and the processor 202, for receiving an indication of at least one networked device for grouping associated with environment naming data corresponding to the environment plot. The indication associated with a particular networked device may include device identification information associated with the networked device such that the networked device is uniquely identifiable for association with the environment naming data. In some embodiments, for example, the process may include receiving an indication associated with each networked device mapped within the environment plot. In this regard, all networked devices within a particular environment plot may be associated and grouped with the same environment naming data. In other embodiments, a user may utilize the apparatus 200 (e.g., the user device 102) to provide an indication associated with each networked device to be grouped and associated with the environment naming data. For example, the process may include identifying all networked devices connected to a particular network access device and / or otherwise connected to a particular network, and allowing a user (e.g., via one or more interfaces rendered to the user) to select one or more of the identified devices for association with environment naming data.

[0208] At operation 1058, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for storing networked device identification data of at least one networked device associated with the environment naming data. In some embodiments, a user may input the networked device identification data of each of the at least one networked device, such as by typing the device identification data via a touchscreen display or other input device associated with user device 102. In other embodiments, the process may include automatically determining the networked device identification data associated with each of the at least one networked device. Each received networked device identification data may be stored in local and / or remote memory, a database, etc., so that it is retrievable in association with the environment naming data. In this regard, the environment naming data may be utilized to query the networked device associated therewith. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) may be configured to allow a user to select environment naming data, after which a process may include querying networked devices associated with such selected environment naming data based on associated network device identification data and displaying information associated with such networked devices, and / or allowing batch operations to be performed on some or all of such networked devices.For example, in one exemplary context where the environment naming data represents "kitchen" and a user stores multiple networked devices associated with the environment naming data, the user may subsequently identify such networked devices and computationally instruct the device to perform a particular action for each such networked device (e.g., turn off all networked devices associated with the environment naming data "kitchen"). In another exemplary context, the process may include rendering a user interface that lists all networked devices associated with the particular environment naming data.

[0209] 11 illustrates operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 11 illustrates operations of an exemplary process 1100 for receiving at least one instruction associated with a plot corner set based on user input data according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1100, alone or in conjunction with any of the other processes described herein. As illustrated, process 1100 may begin with operation 1102. Operation 1102 may begin after one or more operations of another process, for example, after operation 1002 of process 1000, as illustrated. Similarly, upon completion of process 1100, flow may proceed to one or more operations of another process, such as operation 1006 of process 1000, as illustrated.

[0210] At operation 1102, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for receiving user input data indicating the presence of a first plot corner within camera data. In one exemplary context, a user provides such user input when the camera circuitry is positioned to view a particular corner within a property being mapped. The user may provide such user input in response to viewing a rendered corner in an augmented reality interface (e.g., via a real-world image captured by the camera circuitry). In some embodiments, the user input data is received in association with a particular portion of the camera data. For example, if the camera data includes images and / or video data captured in real time, the user input data may indicate the presence of a first plot corner within a particular frame or image of the camera data. In some embodiments, the user input data includes interactions with the augmented reality interface, particular user interface elements within the augmented reality interface, gestures, voice commands, and / or any other interactions described herein.

[0211] At operation 1104, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, the processor 202, etc., for mapping the first corner to a first corner location within the augmented reality environment. In some embodiments, the first plot corner is mapped to the first corner location based on first mapping device position data associated with the apparatus 200 (e.g., the location of the user device 102 within the premises). In at least one example context, the first mapping device position data represents a current location of the user device 102 within the augmented reality environment. In this regard, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) may generate and / or store data embodying a first plot corner, for example, within an environment plot, and associate such data with a first corner location that corresponds to or is derived from the first mapping device position data. For example, in at least one exemplary context, the apparatus 200 determines the first corner location based on an offset from the first mapping device position data and maps the first plot corner to the determined plot corner location. In some embodiments, the apparatus 200 determines a position of a virtual object (e.g., a virtual reticle object as described herein) within the augmented reality environment, which may be based on the first mapping device position data, and maps the first corner plot to the determined position of the virtual object as the first corner location. In this regard, the apparatus generates and / or otherwise updates data, such as the augmented reality environment, the environment plot, and / or other data, to represent the presence of the first plot corner at the first corner location.

[0212] In optional operation 1106, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communication circuit 208, the processor 202, etc., for receiving mapping device positioning data indicating a crossing to a second mapping device location. In this regard, the second mapping device location data may differ from the first, previously identified mapping device location data associated with, for example, the first plot corner, and thus indicate a crossing. In some embodiments, for example, the process includes monitoring and / or otherwise tracking current mapping device location data associated with the user device (e.g., the mapping device) in real time. In this regard, the current mapping device location data is updated when the user device crosses the premises (e.g., in response to a user walking around the premises and carrying the device). It should be understood that each update to the mapping device location data may be performed at various times. In some embodiments, for example, updates to the mapping device position data occur at fixed time intervals, distance intervals, and / or other fixed intervals. In some embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) receives the second mapping device position data upon a subsequent user input, such as the user input described with respect to operation 1108.

[0213] At operation 1108, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for receiving second user input data indicating the presence of a second plot corner in the camera data. In some embodiments, the second plot corner is indicated in a second portion of the camera data, which may be separate from the first portion of the camera data in which the first plot corner was indicated. In one exemplary context, the user provides such user input when positioned to view the second corner of the property being mapped by the camera circuitry. Additionally or alternatively, the user may provide such user input in response to viewing the second corner rendered in the augmented reality interface, for example, after traversing near the second corner of the property. In some embodiments, the second user input data includes an interaction with the augmented reality interface, a particular user interface element within the augmented reality interface, a gesture, a voice command, and / or any other interaction described herein. It should be understood that the first user input data and the second user input data may be received in response to different types of user input.

[0214] At optional operation 1110, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communication circuitry 208, processor 202, etc., for mapping a second corner to a second corner location within the augmented reality environment. In some embodiments, the second plot corner is mapped to the second corner location based on second mapping device position data associated with the user device. In this regard, the process may include, for example, generating and / or storing data embodying the second plot corner within the environment plot and associating such data with a second corner location that corresponds to or is derived from the second mapping device position data. For example, in at least one example context, the process includes determining a second corner location based on an offset from second mapping device position data (e.g., including position, orientation, and other data such as inertial data) from a mapping device (e.g., a user device) and mapping the second plot corner to the determined second plot corner location. In some embodiments, the process may include determining a position of a virtual object in an augmented reality environment (e.g., a virtual reticle object described herein based on a position where a reticle intersects on a virtual reality display) that may be based on the second mapping device position data, and mapping the second corner plot to the second determined position of the virtual object as the second corner location. In this regard, the process may include generating and / or otherwise updating data, such as an augmented reality environment, an environment plot, and / or other data, to represent the presence of the second plot corner at the second corner location.

[0215] It should be understood that operations 1106-1110 may be repeated for any number of plot corners. For example, in some embodiments, the process may include receiving subsequent updated mapping device position data indicating a traverse to a third mapping device position, receiving third user input data indicating the presence of the third plot corner in the camera data, and mapping the third plot corner to a third corner location in the augmented reality environment. In this regard, an augmented reality environment and / or environment plot is generated including data representing the subsequent plot corners and corresponding corner locations. The process may include receiving such indications until the site mapping is complete (e.g., when all corners of the site have been mapped, which may be automatically determined or indicated by a user via interaction with the interface). In at least one context, for example, the fully mapped environment plot, augmented reality environment, and / or other data accurately represents the site boundary.

[0216] 12 illustrates operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 12 illustrates operations of an exemplary process 1200 for automatically receiving at least one instruction associated with a plot corner set based on detection in camera data according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 is configured to perform the operations of process 1200 alone or in conjunction with any of the other processes described herein. As illustrated, process 1200 may begin with operation 1202. Operation 1202 may begin after one or more operations of another process, for example, after operation 1002 of process 1000, as illustrated. Similarly, upon completion of process 1200, flow may proceed to one or more operations of another process, such as operation 1006 of process 1000, as illustrated.

[0217] In operation 1202, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, the processor 202, etc., for receiving camera data associated with first mapping device position data. In this regard, the process may include determining and / or otherwise identifying the first mapping device position data based on a current location of the user device 102. In some embodiments, the process may include associating at least a portion of the camera data with the first mapping device position data such that at least a portion of the camera data is determined as having been captured from the first mapping device position data. For example, the camera data and the position data may be associated with each other via a timestamp, and / or the data may be captured simultaneously and processed as a combined data object (e.g., the camera data may include position data automatically added during capture of the image data). In some embodiments, the user device 102 is configured to capture camera data via the camera circuitry of the user device 102. In other embodiments, the user device 102 and / or another device 200 receives camera data from external camera circuitry, for example, associated with a second device communicatively coupled to the user device 102 .

[0218] At operation 1204, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for detecting a first plot corner within the camera data. In some embodiments, the process may include detecting a first plot corner within the camera data and / or a particular captured frame of an image. The process may include utilizing one or more image processing algorithms, machine learning models, algorithmic models, statistical models, etc., to detect the first plot corner within the camera data. For example, in some embodiments, the process may include training and / or utilizing a machine learning model trained to identify corners within the captured camera data. In this regard, the machine learning model (and / or other model or algorithm) may detect edges within the camera data to detect where such edges form corners of a lot.

[0219] At operation 1206, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for mapping a first plot corner to a first corner location within the augmented reality environment. In some such embodiments, the process may include mapping the first plot corner to a first corner location within the augmented reality environment based on at least first mapping device position data associated with the user device 102. In this regard, the process may include, for example, generating and / or storing data embodying the first plot corner within the environment plot and associating such data with a first corner location that corresponds to or is derived from the first mapping device position. For example, in at least one exemplary context, the process includes determining a first corner location based on an offset from the first mapping device position data and mapping the first plot corner to the determined first plot corner location. The offset may be determined based on the distance, and in some embodiments, the angle, between the user device and the first plot corner identified in the real-world image by processing the camera data. It should be understood that the offset may be determined simultaneously and / or in series with detecting the first plot corner in the camera data.

[0220] 13 illustrates operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 13 illustrates operations of an exemplary process 1300 for mapping networked devices within a premises according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1300, alone or in conjunction with any of the other processes described herein. As illustrated, process 1300 may begin with operation 1302. Operation 1302 may begin after one or more operations of another process, for example, after operation 1002 of process 1000, as illustrated. Similarly, upon completion of process 1300, flow may proceed to one or more operations of another process, such as operation 1006 of process 1000, as illustrated.

[0221] At operation 1302, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, the processor 202, etc., for receiving a second instruction of the networked device based on the camera data. In some embodiments, the second instruction is received regarding a specific portion of the camera data, e.g., a single frame of camera data and / or a specific captured image. The instruction may be received in any manner, such as in response to user input and / or automatic detection. An example process for receiving a second instruction of the networked device based on the camera data is described herein with respect to FIGS. 14A and 14B .

[0222] At operation 1110, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communication circuitry 208, processor 202, etc., for mapping a networked device to a location of the networked device within an augmented reality environment. In some embodiments, the process may include mapping the location of the networked device to a location represented by device mapping position data. In this regard, the location of the networked device may represent a current location of the mapping device (e.g., the user device). In other embodiments, the process includes determining an offset between user device 102 and a networked device location associated with the networked device. For example, in some embodiments, the process includes determining a location associated with a virtual object within the augmented reality environment, such as a virtual reticle object, and mapping the networked device to a networked device location representing the location of the virtual object. In some embodiments, the process includes determining an offset between a mapping device (e.g., a user device) and a networked device represented in the camera data, and mapping the networked device to a location of the networked device based on mapping device position data associated with the user device 102 and the determined offset.

[0223] In addition to, or instead of, mapping devices and any other objects via camera data, a user may manually enter the location of one or more devices (e.g., networked devices and / or network access devices) and / or objects (e.g., interferer objects and other associated objects) via manual input, such as by selecting a location on an environment plot (e.g., via touch screen input on the user device). In such embodiments, for example, various onboarding, identification, and device verification operations (e.g., signal and / or camera-based) may be performed to confirm the indicated location.

[0224] 14A illustrates operations of an exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 14A illustrates operations of an exemplary process 1400 for receiving instructions of a networked device based on camera data according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1400, alone or in conjunction with any of the other processes described herein. As illustrated, process 1400 may begin with operation 1402. Operation 1402 may begin after one or more operations of another process, for example, after operation 1006 of process 1000, as illustrated. Similarly, upon completion of process 1400, flow may proceed to one or more operations of another process, such as operation 1110 of process 1300, as illustrated.

[0225] At operation 1402, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for receiving a second indication of the presence of a networked device in the camera data in response to the user input data. In one exemplary context, the user provides such second user input when the camera circuitry of or associated with the user device 102 is positioned to view a networked device within the premises being mapped. Additionally or alternatively, the user may provide such user input in response to or upon viewing the networked device rendered in the augmented reality interface. In some embodiments, the user input data is received along with a particular portion of the camera data. For example, if the camera data includes real-time captured images and / or video data, the user input data may indicate the presence of a networked device in a particular frame or image of the camera data (e.g., via a user tapping on the location of the networked device and / or determining the location of a reticle on the real-world image). In some embodiments, the user input data includes interaction with an augmented reality interface, a particular user interface element within the augmented reality interface, a gesture, a voice command, and / or other interaction described herein. In some embodiments, the augmented reality interface comprises an interface element configured to generate user interaction data specifically indicating the presence of a networked device in the camera data in response to user interaction with a particular interface element (e.g., a "Networked Devices" button). Such an interface element may be rendered alone or together with any of a myriad of other interface elements.In some embodiments, for example, in response to user interaction data, the process continues by mapping networked devices to networked device locations as described herein. It should be understood that in some embodiments, apparatus 200 utilizes any of the methodologies described herein to map networked devices to networked device locations.

[0226] 14B illustrates operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 14B illustrates operations of an exemplary process 1450 for receiving instructions of a networked device based on camera data according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1450, alone or in conjunction with any of the other processes described herein. As illustrated, process 1400 may begin at operation 1452. Operation 1452 may begin after one or more operations of another process, for example, after operation 1006 of process 1000, as illustrated. Similarly, upon completion of process 1450, flow may proceed to one or more operations of another process, such as operation 1110 of process 1300, as illustrated.

[0227] At operation 1452, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for receiving camera data associated with first mapping device position data. In some embodiments, the process includes capturing the camera data utilizing camera circuitry included in and / or otherwise controllable with apparatus 200 (e.g., user device 102). In other embodiments, the camera data is received from camera circuitry and / or other external devices communicatively linked to apparatus 200 (e.g., from a separate camera or other user device over a network). For example, the camera data may be received by the user device or other apparatus from an external user device, a communicatively coupled camera peripheral device, etc. The camera data may be associated with first mapping device position data representing the position of a mapping device (e.g., a user device, a separate camera-bearing device, and / or other device) within the augmented reality environment, or an absolute position of the mapping device that is mappable to the particular augmented reality environment in which the camera data was captured. In at least one exemplary embodiment, the process includes determining the first device mapping position data during capture of the camera data such that the first mapping device position data represents the current position of the mapping device (e.g., a user device) or an associated device at the time of capture. In other embodiments, the apparatus receives the first mapping device position data from another device along with the camera data. In some embodiments, the process includes utilizing the first mapping device position data to map detected objects, devices, etc., into the augmented reality environment.For example, the first mapping device position data may be used to map a networked device detected in the captured camera data to a location of the networked device based on the first mapping device position data associated with the camera data, such as via determining an offset as described herein.

[0228] At operation 1454, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for detecting networked devices in camera data. In some embodiments, the process may include detecting networked devices in particular frames, images, and / or other portions of the camera data. In some embodiments, one or more image processing algorithms, machine learning models, algorithmic models, statistical models, etc. may be trained and / or used to detect networked devices in the camera data. For example, in some embodiments, a machine learning model may be specifically trained to detect networked devices of one or more networked device types in the camera data. In this regard, in some embodiments, the trained machine learning model and / or other algorithmic and / or statistical models may be used to detect such networked devices and / or to detect networked device types associated with such networked devices in captured image data. In some such embodiments, the user device and / or associated equipment may keep mapping the networked devices to the networked device's location as described herein.

[0229] 15 illustrates operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 15 illustrates operations of an exemplary process 1500 for determining network strength data for use in network-centric augmented reality processing according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1500, alone or in conjunction with any of the other processes described herein. As illustrated, process 1500 may begin with operation 1502. Operation 1502 may begin after one or more operations of another process, for example, as illustrated, after operation 1008 of process 1000. Similarly, upon completion of process 1500, flow may proceed to one or more operations of another process.

[0230] At optional operation 1502, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for receiving first mapping device position data. In some embodiments, the first mapping device position data represents a current location of user device 102 and / or associated devices and / or subcomponents within the augmented reality environment. In this regard, in some such embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) tracks current mapping device position data representing a current location of user device 102 and / or associated user devices (e.g., separate camera circuitry). In some embodiments, apparatus 200 utilizes location service providing circuitry, location service provision circuitry, etc., to receive the first mapping device position data. In some other embodiments, the apparatus 200 receives the first mapping device position data from an external device, peripheral device, or the like.

[0231] At operation 1504, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuit 210, input / output circuit 206, communications circuit 208, processor 202, etc., for generating first network strength data associated with a first network access device using a network strength determination process. In some such embodiments, the first network strength data represents a signal strength associated with the first network access device at a particular location within the augmented reality environment (e.g., the signal strength of a signal transmitted from the first network access device). For example, in some contexts, the first network strength data is mapped to a location represented by first mapping device location data, e.g., at operation 1502. In some embodiments, the process includes utilizing one or more received signal strength indication methodologies to determine network strength. For example, in some embodiments, apparatus 200 determines a timestamp of a received message compared to an expected timestamp of the message. In some embodiments, the apparatus 200 utilizes one or more known processes for determining a first network strength, such as measuring a signal received by a user device or networked device (e.g., the networked device may report the received signal strength to a network access device, a user device, and / or another device) and mapping the measured signal strength with a location of reception of the signal. In some embodiments, a theoretical signal strength for a location (e.g., a first location) may be calculated based on the location of features in the augmented reality environment and / or environmental plot. For example, a model may be trained and / or run to compare property boundaries, interfering objects, and the location of one or more devices (e.g., a networked device and a network access device) within the property to determine a predicted signal strength at one or more locations within the property.The model may be trained by running a machine learning algorithm using empirically measured signal strength data associated with training site maps from multiple training datasets. In some embodiments, the model may further consider characteristics of the boundaries, interfering objects, and one or more devices, such as the material of manufacture, shape, size, and density of any potentially interfering objects, and / or the make, model, transmitter strength, and receiver strength of any networked or network access device. In embodiments that rely on theoretical predicted signal values, the user device may not need to traverse the site once mapping is complete. The value of the first network strength data may be based on or influenced by any of a myriad of factors. For example, in some embodiments, the value of the first network strength data is based on one or more of the distance between the network access device and the first mapping device position data, at least one interfering object positioned within the augmented reality environment, and / or the layout of the site.

[0232] At operation 1506, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communications circuit 208, the processor 202, etc., for receiving second mapping device position data. In some such embodiments, the second mapping device position data represents a second position that is different from the first position represented by the first device positioning data. In this regard, in some such embodiments, the second mapping device position data represents a new current position of the user device and / or associated devices and / or subcomponents of the user device within the augmented reality environment, such as after traversing to the second position within the augmented reality environment. In some such embodiments, the process includes tracking current mapping device position data that represents the current position of the mapping device (e.g., the user device) and / or associated devices during such traversal throughout the augmented reality environment. It should be understood that in some such embodiments, location service providing circuitry, location service providing circuitry, etc., may be integral with or separate from the apparatus 200 (e.g., the user device 102) and may be utilized to receive the second mapping device position data. In some embodiments, the second mapping device position data from an external device, peripheral, etc., is associated with the user device.

[0233] At operation 1508, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuit 210, input / output circuit 206, communications circuit 208, processor 202, etc., for determining second network strength data associated with the second mapping device location data using a network strength determination process. In some such embodiments, the second network strength data represents a signal strength associated with a first network access device at a particular location within the augmented reality environment, which may be determined similarly to the first network signal strength data. For example, in some contexts, the second network strength data is mapped to a location represented by the second mapping device location data, e.g., determined in operation 1506. In some embodiments, the same network strength determination process utilized to determine the first network strength data may be used to determine the second network strength data. In some embodiments, a different network strength determination process is utilized than the process utilized to determine the first network strength data. For example, in some embodiments, a received signal strength indication methodology may be used to determine network strength. For example, in some embodiments, the apparatus 200 determines a timestamp of a received message by comparing it with an expected timestamp of a message from a location represented by the second mapping device location data. In some embodiments, one or more other known processes may be used to determine the second network strength. In some embodiments, the second network signal strength may be theoretically determined according to various embodiments discussed herein. The value of the second network strength data is based on any of a myriad of factors.

[0234] At optional operation 1510, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuit 210, input / output circuit 206, communications circuit 208, processor 202, etc., for further generating an environment plot including: (1) a first network strength indicator based on the first mapping device location data and the first network strength data; and (2) a second network strength indicator based on the second mapping device location data and the second network strength data. For example, in some embodiments, the process may include generating and / or otherwise including the first network strength indicator including a data object indicative of the first network strength data at a location represented by the first mapping device location data. Similarly, in some embodiments, the process may include generating and / or otherwise including the second network strength indicator including a data object indicative of the second network strength data at a location represented by the second mapping device location data. In this regard, the environmental plot can be processed to determine and generate further recommendations and analysis based on the network strength at various locations within the mapped premises, and / or can be rendered so that the network strength at various locations within the premises is visible to the user.

[0235] At optional operation 1512, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communications circuit 208, and the processor 202, for generating preferred network device location data based at least on first network strength data associated with the first mapping device location data and second network strength data associated with the second mapping device location data. In some embodiments, the algorithm for generating the preferred network device location data may be configured to identify a recommended location for one or more networked devices by comparing signal strength values ​​within a premises. In some such embodiments, the preferred network device location data represents a location having a stronger network strength between a first location represented by the first mapping device location data and a second location represented by the second mapping device location data. For example, in an exemplary context where the first network strength data represents a stronger network strength than the second network strength data, the preferred network device location data includes and / or is otherwise equal to the first mapping device location data. In another exemplary context where the second network strength data represents a stronger network strength than the first network strength data, the preferred network device location data includes and / or is otherwise equal to the second mapping device location data. In some embodiments, preferred network device location data may be generated for three or more locations. For example, data representing a first location represented by the first mapping device location data and a third location different from the second location represented by the second mapping device location data.In some such embodiments, for example, the process may include a third location between the first location represented by the first mapping device location data and the second location represented by the second mapping device location data, and the process includes determining that the third location is associated with a greater network strength than the first location and the second location. For example, in some such embodiments, the process may include interpolating between the first location and the second location to determine a third location between the first location represented by the first mapping device location data and the second location represented by the second mapping device location data, and generating a location indicator for the preferred networked device representing the third location.

[0236] In some embodiments, the network strength data may be collected from the networked devices and / or network access devices themselves. For example, the networked devices and / or network access devices may be in direct or indirect electrical communication with user devices in accordance with various embodiments herein, and the networked devices and / or network access devices may transmit network strength data to the user devices, where the strength data may be associated with the known location of the respective devices (e.g., locations obtained via mapping functionality discussed herein).

[0237] In some embodiments, any number of network signal strength data points may be collected across any number of locations within a room. In some embodiments, several signal strength samples may be taken, and values ​​between the sample locations may be interpolated to cover or substantially cover the entire premises or a target area within the premises. In some embodiments, any other data representation of signal strength across an area may be used and / or calculated, including infinite gradients. In some embodiments, the algorithm for generating preferred network device location data may recommend an optimal location from all possible locations from the sampled and / or calculated area.

[0238] In some embodiments, an algorithm for generating preferred network device location data may be configured to identify recommended locations for one or more network access devices by comparing signal strength values ​​within a premises. In such embodiments, any of the location sampling and / or interpolation and signal strength calculation processes described above may be used. The preferred network device location data may include recommended locations for one or more network access devices by identifying areas with high and low signal values.

[0239] In some embodiments, the algorithm may be constrained to only currently operating network access devices. In such embodiments, the algorithm may recommend moving the network access device to an optimal location and / or moving an interfering object based on one or more of the following: (1) a determination that a particular area of ​​the premises includes insufficient coverage—the recommendation being to move the network access device closer to the less covered area or to move an interfering object away from the signal path; or (2) a determination that one or more networked devices are receiving less than an optimal signal (e.g., because the signal is insufficient for one or more networked devices or because the network access device could be positioned closer without impairing or significantly impairing the signal for the remaining devices in the premises based on the current distribution of devices in the premises). In the latter embodiment, the networked devices may be concentrated in one area in the premises, such as a room or portion of a room, and the process may include recommending moving the network access device closer to the center of gravity of the networked devices or other calculated location configured to deliver a cumulatively better signal to the networked devices.

[0240] In some embodiments, the algorithm may recommend modifications to the network access devices using a similar process. For example, in one embodiment, the algorithm may recommend stronger or additional network access devices (e.g., range extenders, mesh network satellite devices, or additional routers). This recommendation may be triggered, for example, when a suitable algorithmic solution is not available that provides a sufficient signal (e.g., above a threshold decibel level) to each networked device, or based on any other criteria.

[0241] In some embodiments, the recommendations may include data presented to the user for the user to understand and decide on a solution. For example, a signal plot across the premises may be shown along with an indication of signal values ​​(e.g., a binary indication of signal above / below a minimum threshold for device operation and / or a gradient of signal strength across the premises). In some embodiments, the recommendations may include an indication of areas with sufficient or insufficient signal, without recommending moving or adding devices.

[0242] In some embodiments, recommendations from the algorithm may include multifaceted recommendations, including both networked device and network access device positioning recommendations according to embodiments discussed herein. For example, a recommendation may include instructions that either the signal should be improved for a particular location or that the networked device should be moved, with possible suggestions for each option. Similarly, an additional network access device may be recommended in parallel with or as an alternative to moving an existing network access device based on a calculated optimal location. In some embodiments, the range of possible recommendations may be configurable by the user and / or the provider of the AR system, and any combination of the algorithms discussed herein may be run simultaneously or sequentially to determine preferred network device location data corresponding to the recommendations. In some embodiments, the algorithm may determine preferred network device location data for a new device whose location is unknown within the augmented reality environment and / or environmental plot.

[0243] In some embodiments, preferred network device location data may be constrained to a subset of the premises and / or area being analyzed. A predetermined and / or configurable subset of possible locations may be used during the recommendation process. For example, rather than recommending every possible location within the premises (e.g., recommendations may include the floor, the center of a room, or another inconvenient location), the algorithm may limit itself to known installation locations or a subset thereof (e.g., on shelves, desks, walls, entertainment centers, and other objects).

[0244] At optional operation 1512, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for causing rendering of a location indicator of a preferred networked device based on the positioning data of the preferred networked device. In some such embodiments, the location indicator of one or more preferred networked devices is rendered within an augmented reality interface such that a user can view the location indicator of the preferred networked device within the augmented reality environment. In some embodiments, the location indicator of the preferred networked device may be rendered within an environmental plot. In some embodiments, the location indicator of the preferred networked device may include a gradient or other continuous indication of signal strength over an area. In some embodiments, the preferred networked device location indicator includes a virtual object positioned within the augmented reality environment at the preferred networked device location. In this regard, the location indicator of the preferred networked device may be rendered within the augmented reality interface overlaying an image of the real world at the location represented by the positioning data of the preferred networked device. In some such embodiments, the location indicator of the preferred networked device includes a text indicator (e.g., having the text "Place here"), a pictorial indicator (e.g., having a billboarding arrow or a virtual circle object pointing down to the location represented by the positioning data of the preferred networked device).In one exemplary context, the location indicator of the preferred networked device includes a virtual object positioned within the augmented reality environment at a location represented by the positioning data of the preferred networked device, where the virtual object is configured such that one or more visual characteristics of the virtual object, such as a particular color, shape, size, etc., are configured based on network strength data associated with the location, e.g., first network strength data, second network strength data, etc. As a non-limiting example, dots shown in the environment plot (e.g., points 904, 906 in environment plot visualization 950 of FIG. 9 ) may be adjusted to represent signal strength. For example, the dots on the environment plot may be larger or smaller, colored a different color, or have numbers on them, depending on the signal strength. Similar dots, arrows, waves, or other visualizations may be shown in the augmented reality interface.

[0245] FIG. 16 illustrates the operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 16 illustrates the operations of an exemplary process 1600 for determining reduced network strength location data for use in network-centric augmented reality processing according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1600, alone or in conjunction with any of the other processes described herein. As illustrated, process 1600 may begin with optional operation 1602. Operation 1602 may begin after one or more operations of another process. Similarly, upon completion of process 1600, flow may proceed to one or more operations of another process. In this regard, it should be understood that in some embodiments, apparatus 200 is configured to perform process 1600 and any other of the one or more processes described herein.

[0246] At optional operation 1602, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communication circuitry 208, and the processor 202, for initializing an augmented reality environment representing a three-dimensional environment. In some embodiments, the process utilizes the camera circuitry to capture camera data utilized in initializing the augmented reality environment. For example, the process may use the camera circuitry to capture camera data including a representation of a flat surface (e.g., a venue floor) utilized to establish an origin and / or a two-dimensional or three-dimensional coordinate plane for placing virtual objects. The process may utilize the origin established during initialization to track data embodying the position of the user device 102 as it traverses and / or otherwise navigates through the venue. For example, in some embodiments, the process may utilize data from one or more sensors of the user device (e.g., a gyroscope, an accelerometer, a GPS circuit, a signal triangulation circuit, and / or a combination thereof) to determine an offset between an initialized origin and the current position of the user device to generate mapping device position data representing the current position of the user device. In this regard, the augmented reality environment may be initialized in the manner described herein.

[0247] At operation 1604, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, the processor 202, etc., for receiving camera data representing an augmented reality environment. In some such embodiments, the user device receives the camera data from an external device, peripheral, or other computing entity, such as an associated server, as described herein. In some embodiments, the user device captures the camera data utilizing camera circuitry included in and / or otherwise associated with the user device (e.g., peripheral). In this regard, a user may orient the associated camera circuitry such that data representing a particular portion of the environment around the user device 102 is captured for processing. In some such embodiments, the captured camera data is maintained so that it can be processed and / or utilized to render one or more augmented reality interfaces having images of the real world augmented by generated virtual objects associated with the augmented reality environment. In some embodiments, the camera data includes real-time video stream data. In some embodiments, the camera data comprises a set of image data objects captured in real time, serially, etc. In other embodiments, the camera data comprises a single captured image data object captured via associated camera circuitry. The camera data may include or be captured in conjunction with position data, as described herein.

[0248] At operation 1606, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuitry 210, the input / output circuitry 206, the communications circuitry 208, and the processor 202, for receiving, based on the captured camera data, at least one indication associated with a set of interfering objects. In at least one embodiment, the set of interfering objects includes at least one interfering object, including, but not limited to, one or more of a physical structure, furniture, object, wall, door, signal interferer, etc., that adversely affect network strength associated with one or more network access points at a particular location. In some embodiments, the apparatus 200 receives one or more of the at least one indication of the interfering object in response to user interaction with the user device 102 (e.g., a touchscreen display of the user device). The interfering object may be visually mapped and identified via the camera circuitry, with or without user interaction, in substantially the same manner as the networked devices and / or network access devices discussed herein. For example, in some such embodiments, the user device receives at least one instruction in response to a user interaction with a particular user interface element rendered in the augmented reality interface, the particular user interface element being configured to indicate the presence of an interference object at a location in response to the user interaction with the user device. For example, in some embodiments, the user positions the user device 102 in a manner such that when the user performs a user interaction indicating the presence of an interference object, the camera circuitry is positioned with a virtual reticle object positioned at the location of the interference object within the augmented reality environment. In some embodiments, the apparatus 200 (e.g., the user device 102) automatically receives the at least one instruction in response to processing the captured camera data.For example, in some embodiments, the process may utilize trained machine learning, statistical, and / or algorithmic models to process the captured camera data and identify one or more interfering objects represented therein. In one or more embodiments, the process includes implementing one or more image processing algorithms to automatically identify one or more interfering objects within the camera data and / or particular portions thereof (e.g., particular frames of camera data, particular captured image data objects from a set, etc.). Models may be trained for each of a plurality of different interfering objects. In some such embodiments, the instructions are generated in response to successfully automatically identifying an interfering object represented in the camera data.

[0249] In one or more embodiments, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) maps the interference object associated with the received instruction to a specific location within the augmented reality environment. For example, in some embodiments, the process includes mapping the interference object to a current location of the user device and / or camera circuitry, e.g., as represented by mapping device position data associated with the user device 102. In some embodiments, the process includes mapping data embodying the interference object associated with the interference position data based on the instruction associated with the interference object. For example, in at least one embodiment, the process includes mapping data embodying the interference object to a location associated with a virtual reticle object when the instruction associated with the interference object is received. In some embodiments, the process includes mapping data embodying the interference object to a location automatically determined by processing the camera data and / or a portion thereof. For example, in some embodiments, the process includes determining an offset between the position of the user device 102 and / or associated camera circuitry (e.g., as represented by mapping device position data maintained by the user device 102) and mapping data embodying the interfering object together with the offset to the position represented by the data based on the position of the user device and / or associated camera circuitry, where the offset may be calculated according to any of the embodiments discussed herein.

[0250] At operation 1608, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuit 210, input / output circuit 206, communications circuit 208, processor 202, etc., for determining a reduced network strength location within the augmented reality environment based on at least one interfering object of the interfering object set and the network access device. In this regard, the process includes determining that network strength at the reduced network strength location of a particular network access device is adversely affected by at least one interfering object. In one or more embodiments, the reduced network strength location is associated with first network strength data of the network access device. In some such embodiments, apparatus 200 determines the first network strength data of the network access device, such as when the first network strength data is determined for a location within the augmented reality environment using one or more of the processes described herein. In some embodiments, the process includes receiving the first network strength data of the network access device, for example, via the user device, the networked device, or another device. In this regard, in some such embodiments, the process includes determining that the reduced network strength location is adversely affected by at least one interfering object based on the mapped location of the at least one interfering object and / or the location of the network access device. For example, in some embodiments, the process includes determining the reduced network strength location by determining that one or more interfering objects of the interfering object set are mapped to a location between the network access device location associated with the network access device and the reduced network strength location (e.g., by projecting a propagation path of a signal from the network access device and identifying a low signal in an area in the shadow of the interfering object).In some embodiments, the reduced network strength may be determined through empirical measurements (e.g., identifying areas with poor signal quality and determining whether the poor signal quality is caused by interfering objects or the specific locations of the networked devices and network access devices). In some embodiments, the reduced network strength may be determined by modeling the propagation of signals from the network access devices to interfering objects on the premises. In some embodiments, the process may determine the shape, size, location, material, structure, and other characteristics of the interfering objects (e.g., via user input or image recognition) to determine the object's effect on the network access device signal.

[0251] At operation 1610, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communications circuit 208, the processor 202, etc., for causing rendering of data associated with the reduced network strength location to notify the user about the reduced network strength location. In at least one embodiment, the process includes rendering of the data as described in any of the manners described herein, e.g., with respect to FIG. 17 . In some embodiments, for example, the user device renders one or more interfaces including one or more interface elements on a local screen that notify the user that the reduced network strength location is adversely affected by one or more interfering objects. In one or more embodiments, the process includes rendering an augmented reality interface including one or more augmented reality objects rendered in association with the augmented reality environment. For example, in some embodiments, an augmented reality interface (e.g., presented on a display of a user device) renders a virtual object associated with the reduced network strength location over an image of the real world at the reduced network strength location, the virtual object specifically configured to represent the reduced network strength location. For example, in some embodiments, the virtual object includes one or more visual characteristics (e.g., color, size, etc.) that specifically represent the reduced network strength location. In some embodiments, the device 200 (e.g., the AR processing server 104) sends and / or causes the sending of one or more push notifications, email notifications, and / or other notifications external to a particular executable computer program (e.g., a native software application or a web application) utilized in the network-centric augmented reality processing described herein to another device 200 (e.g., a determined user device 102) associated with the device and / or the associated user.In yet other embodiments, certain images and / or other user interface elements are rendered with reduced network strength locations that indicate, at least in part, locations associated with reduced network strength caused by at least one interfering object. In some embodiments, any of a myriad of known algorithms is utilized to determine network strength at a particular location.

[0252] 17 illustrates the operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 17 illustrates the operations of exemplary process 1700 for causing rendering of data associated with a reduced network strength location to notify a user about the reduced network strength location according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1700, alone or in conjunction with any of the other processes described herein. As illustrated, process 1700 may begin with operation 1702. Operation 1702 may begin after one or more operations of another process, for example, as illustrated, after operation 1608 of process 1600. Similarly, upon completion of process 1700, flow may end or proceed to one or more operations of another process described herein.

[0253] At optional operation 1702, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for causing rendering of an augmented reality environment with visually distinguished reduced network strength locations. In some such embodiments, the process includes generating and / or otherwise positioning virtual objects at the reduced network strength locations that indicate, represent, and / or otherwise inform a user of the reduced network strength. For example, in some embodiments, the process includes rendering visually configured virtual objects using a color, shape, size, and / or other visual characteristic of each virtual object to indicate the network strength associated with the network strength data at each location. In some such embodiments, the process includes indicating one or more reduced network strength locations using a predetermined visual characteristic, for example, by rendering the augmented reality environment with a red object (or another predetermined color at reduced network strength locations) that indicates that the location is a reduced network strength location. It should be appreciated that in some embodiments, the virtual object utilized to visually distinguish reduced network strength locations includes an augmented virtual representation of a real-world image. For example, in some embodiments, the process includes augmenting the visual characteristics of a real-world surface (e.g., generating a modified virtual version of the floor of the premises being mapped) so that the rendering of the augmented reality environment includes the virtual representation of that surface as an augmentation. For example, in some embodiments, the process includes augmenting the color of the floor so that reduced network strength locations are rendered in a different color (e.g., red) than the rest of the floor of the premises.

[0254] At optional operation 1704, the apparatus 200 (e.g., embodied as the user device 102, the AR processing server 104, and / or the electronic support platform 106) includes means, such as the network-centric AR processing circuit 210, the input / output circuit 206, the communications circuit 208, the processor 202, etc., to cause rendering of at least one interface element indicating that one or more actions should be performed associated with the representation of the virtual reality environment and / or objects therein to improve the first network strength data at the reduced network strength location. For example, in at least one embodiment, the user device renders one or more interface elements indicating that at least one interfering object of the interfering object set should be (1) repositioned within the augmented reality environment or (2) removed from the augmented reality environment to improve the first network strength data at the reduced network strength location. In some such embodiments, the process includes identifying an interfering object that adversely affects the reduced network strength location according to any of the various embodiments discussed herein. Such interfering objects may include interfering objects between the location and the network access device, interfering objects located near the location (e.g., in the context of a signal interferer), etc. The at least one interface element may include any of a myriad of interface element types. For example, in some embodiments, the process includes rendering a virtual object positioned within the augmented reality environment, the virtual object including an interface sub-element (e.g., text, image, etc.) indicating that the interfering object should be repositioned, removed, etc. In some such embodiments, such virtual object is positioned within the augmented reality environment at a reduced network strength location, a location of the interacting at least one interfering object, etc. In some embodiments, the process includes rendering one or more interface elements for rendering over a representation of the augmented reality environment in the augmented reality interface.For example, in some embodiments, the process includes generating one or more static text elements, image elements, etc. for rendering within an executed computer application (e.g., a native application executed to provide the network-centric augmented reality processing described herein) executing on the user device and / or associated display. In some embodiments, the process includes rendering a push notification, email notification, pop-up window, and / or other interface that provides such instructions in image, text, and / or other formats.

[0255] 18 illustrates the operations of another exemplary process for network-centric augmented reality processing according to the present disclosure. For example, FIG. 18 illustrates the operations of an exemplary process 1800 for providing a notification to a networked device associated with reduced network strength according to one or more embodiments of the present disclosure. For example, in some embodiments, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) is configured to perform the operations of process 1800, alone or in conjunction with any of the other processes described herein. As illustrated, process 1800 may begin with operation 1802. Operation 1802 may begin after one or more operations of another process, for example, as illustrated, after operation 1610 of process 1600. Similarly, upon completion of process 1700, flow may end or proceed to one or more operations of another process described herein.

[0256] At operation 1802, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for receiving an indication of a networked device based on camera data. In some embodiments, for example, as described herein, the indication of the networked device is received in response to user input data indicating the presence of a networked device in the camera data or a portion of the camera data. In some embodiments, for example, as described herein, the indication of the networked device is received automatically in response to processing the camera data to identify a representation of the networked device within the camera data or a portion thereof. In some such embodiments, the process utilizes one or more object detection models, image processing algorithms, etc. to identify the networked device within the captured camera data. It should be understood that in some embodiments, the indication associated with the networked device may be received in association with a particular location within the augmented reality environment. For example, the instruction may be received in association with particular mapping device position data and / or a determined offset therefrom, or position data representing the position of the networked device as indicated by the user (e.g., based on the position of the virtual reticle object at the time the networked device instruction is received).

[0257] At operation 1804, apparatus 200 (e.g., embodied as user device 102, AR processing server 104, and / or electronic support platform 106) includes means, such as network-centric AR processing circuitry 210, input / output circuitry 206, communications circuitry 208, processor 202, etc., for determining that a networked device is disposed at or within a predetermined distance from a reduced network strength location. In some embodiments, the predetermined distance is small enough that the networked device is positioned to be adversely affected by one or more interfering objects. For example, in some embodiments, the process includes ...

Claims

1. 1. A computer-implemented method for network-centric augmented reality processing, the computer-implemented method comprising: receiving camera data associated with an augmented reality environment representing the site, the camera data being captured by a camera circuit; receiving at least one indication associated with a plot corner set including a plurality of plot corners configured to be generated as the camera circuitry navigates the lot, the at least one indication being associated with a portion of the camera data; and generating an environment plot by mapping each plot corner in the set of plot corners as a corner location in the augmented reality environment associated with the lot.

2. Receiving the at least one indication associated with the plot corner set, receiving a first indication in response to user input data indicating a presence of a first plot corner in the camera data; and mapping the first plot corner to a first corner location within the augmented reality environment based on the camera data and first mapping device position data.

3. The computer-implemented method further comprises: receiving second mapping device position data indicating a traverse to a second mapping device position; receiving a second indication in response to second user input data indicating a presence of a second plot corner in the camera data; The computer-implemented method of claim 2 , further comprising mapping the second plot corner to a second corner location within the augmented reality environment based on the camera data and the second mapping device position data.

4. Receiving the at least one indication associated with the plot corner set, receiving the camera data associated with first mapping device position data; Detecting a first plot corner in the camera data; and mapping the first plot corner to a first corner location within the augmented reality environment based on the second mapping device position data and the camera data.

5. The computer-implemented method further comprises: receiving a second indication of a networked device based on the camera data; and 2. The computer-implemented method of claim 1, further comprising: mapping the networked device with a location of the networked device in the augmented reality environment, the environment plot further comprising a location of the networked device.

6. Receiving the second indication of the networked device receiving the second indication in response to user input data indicating a presence of the networked device in the camera data; and mapping the networked device to a location of the networked device within the augmented reality environment based on the camera data and first mapping device position data.

7. Receiving the second indication of the networked device receiving the camera data associated with first mapping device position data; Detecting the networked device in the camera data; and and mapping the networked device to a location of the networked device within the augmented reality environment based on the first device positioning data and the camera data.

8. The computer-implemented method further comprises: Receiving first mapping device position data; determining first network strength data associated with a first network access device, the first network strength data being associated with the first mapping device location data; receiving second mapping device position data, the second mapping device position data indicating a different position than the first mapping device position data; 2. The computer-implemented method of claim 1, further comprising: determining second network strength data associated with the first network access device, the second network strength data being associated with the second mapping device location data, the environment plot further comprising a first network strength indicator based on the first mapping device location data and the first network strength data, and the environment plot further comprising a second network strength indicator based on the second mapping device location data and the second network strength data.

9. The computer-implemented method further comprises: generating preferred networked device location data based on a comparison of at least the first network strength data associated with the first mapping device location data and the second network strength data associated with second device positioning data; The computer-implemented method of claim 8 , further comprising: causing rendering of a location indicator of a preferred networked device based on the location data of the preferred networked device.

10. The computer-implemented method further comprises: Receiving environment naming data; storing said environmental plots associated with said environment nomenclature data; receiving an indication of at least one grouped networked device associated with the environmental naming data corresponding to the environmental plot; The computer-implemented method of claim 1 , further comprising: storing networked device identification data for the at least one networked device associated with the environment naming data.

11. The computer-implemented method further comprises: providing a real-time augmented reality interface including (1) a real-time captured image of the real world represented by the camera data, and (2) at least a portion of the augmented reality environment rendered over the real-world image represented by the camera data, the portion of the augmented reality environment being based on an orientation of the camera circuitry; The computer-implemented method of claim 1 , wherein the real-time augmented reality interface further comprises: (3) at least one static interface element for interacting with the augmented reality environment.

12. 1. A computer-implemented method for network-centric augmented reality processing, the computer-implemented method comprising: receiving camera data associated with an augmented reality environment representing the site; receiving at least one indication associated with a set of interfering objects based on the camera data, the set of interfering objects including data associated with at least one object including a physical structure, a furniture object, or a signal interferer; determining a reduced network strength location within the augmented reality environment based on at least one interfering object of the set of interfering objects and a network access device, the reduced network strength location being associated with first network strength data of the network access device; and causing rendering of data associated with the reduced network strength location to notify a user regarding the reduced network strength location.

13. Causing the rendering of the data associated with the reduced network strength locations. The computer-implemented method of claim 12 , comprising causing a rendering of at least a portion of the augmented reality environment having the reduced network strength locations visually distinguished within the augmented reality environment.

14. The computer-implemented method further comprises: receiving an indication of a networked device based on the camera data; determining that the networked device is disposed at or within a predetermined distance from the reduced network strength location; and causing rendering of the data associated with the reduced network strength location; The computer-implemented method of claim 12 , further comprising causing the rendering of a notification to the user that includes a recommendation to relocate the networked device.

15. The computer-implemented method further comprises: detecting second network strength data associated with a second location within the augmented reality environment; The computer-implemented method of claim 14 , wherein the notification includes at least one interface element indicating that the user should relocate the networked device to the second location.

16. 13. The computer-implemented method of claim 12, wherein causing the rendering of the data associated with the reduced network strength location includes rendering at least one interface element indicating that the at least one interfering object of the set of interfering objects should be repositioned or removed to improve the first network strength data at the reduced network strength location.

17. receiving the at least one indication associated with the set of interference objects based on the camera data; 13. The computer-implemented method of claim 12, comprising detecting a first interfering object based on the camera data using an object detection model, the object detection model configured to detect at least one interfering object type.

18. The computer-implemented method further comprises: receiving an indication of the network access device based on the camera data; The computer-implemented method of claim 12 , further comprising: mapping the network access device to a network access device location within the augmented reality environment based on the indication of the network access device.

19. 1. A computer-implemented method for network-centric augmented reality processing, the computer-implemented method comprising: generating an environment plot based at least on camera data captured by a camera circuit, the camera data representing a site, and the environment plot corresponding to an augmented reality environment; Detecting first network strength data of a first network access device, the first network strength data being associated with a first location within the augmented reality environment; and causing rendering of the augmented reality environment including a network strength indicator located at the first location within the augmented reality environment, the network strength indicator visually configured based on at least the first network strength data.

20. The network strength indicators include a first network strength indicator, and the computer-implemented method further comprises: detecting second network strength data of the first network access device, the second network strength data associated with a second location within the augmented reality environment, the first network strength data being different from the second network strength data; 20. The computer-implemented method of claim 19, further comprising: causing a rendering of the augmented reality environment including a second network strength indicator located at the second location, the second network strength indicator being visually configured based at least on the second network strength data so as to be visually distinct from the first network strength indicator.

21. 21. The computer-implemented method of claim 20, wherein the network strength indicator includes a first waveform representation in a first color, the first color being selected based on the first network strength data, and the second network strength indicator includes a second waveform representation in a second color, the second color being selected based on the second network strength data.

22. The computer-implemented method further comprises: receiving an indication of a networked device based on the camera data, the networked device being disposed at the first location within the augmented reality environment; and determining that the first network strength data is weaker than second network strength data associated with a second location within the augmented reality environment; 20. The computer-implemented method of claim 19, further comprising: causing the rendering of data indicating that the networked device should be relocated to the second location.

23. The computer-implemented method further comprises: determining a second location for relocating the first network access device to improve the first network strength data associated with the first location within the augmented reality environment; and 20. The computer-implemented method of claim 19, further comprising: causing rendering of data indicating that the first network access device should be relocated to the second location within the augmented reality environment.

24. The computer-implemented method further comprises:

20. The computer-implemented method of claim 19, further comprising causing rendering of data indicating that a first networked device should be positioned at the first location within the augmented reality environment.

25. 1. A computer-implemented method for network-centric augmented reality processing, the computer-implemented method comprising: receiving camera data representative of a site associated with an augmented reality environment; detecting a networked device of a networked device type from the camera data; mapping the networked devices to device locations within the augmented reality environment; and initiating a device detection action associated with the networked device and the device location within the augmented reality environment.

26. The device detection action is: determining that the networked device is connected to a known network access device; establishing a connection with the networked device using the known network access device; 26. The computer-implemented method of claim 25, further comprising: performing a direct data handshake to verify an identity of the networked device, the data handshake being based on the networked device type.

27. The device detection action is: determining that the networked device is connected to a known access device; using a known network access device to transmit indirection handshake data to cause the networked device to perform an indirection handshake action; capturing indirect handshake authentication data associated with the indirect handshake action; and 26. The computer-implemented method of claim 25, comprising: processing the indirect handshake authentication data to verify performance of the indirect handshake action, wherein verifying the indirect handshake action confirms an identity of the networked device.

28. The device detection action is 26. The computer-implemented method of claim 25, comprising causing the rendering of a device grouping interface to enable association of the networked device with at least one other networked device.

29. The device detection action is automatically determining the networked device type associated with the networked device; 26. The computer-implemented method of claim 25, further comprising automatically associating the networked device with a device grouping based on the determined networked device type.

30. The networked devices include a first networked device, the device locations include a first device location, and the computer-implemented method further comprises: Detecting a second networked device associated with the second device location; determining that the second device location is within a threshold range from the first device location; 30. The computer-implemented method of claim 29, further comprising automatically associating the second networked device with the device grouping.

31. 1. A computer-implemented method for network-centric augmented reality processing, the computer-implemented method comprising: receiving camera data representing a real world image of a site, the camera data being utilized to maintain an augmented reality environment associated with mapping at least one location associated with at least one networked device, a network access device, and / or at least one interfering object; and initiating an augmented reality service session associated with servicing one or more devices associated with the augmented reality environment, the initiating the augmented reality service session enabling communication with an electronic support platform.

32. 32. The computer-implemented method of claim 31, wherein the augmented reality service session enables transmission of the camera data to the electronic support platform for rendering utilizing a display associated with the electronic support platform.

33. The computer-implemented method further comprises: receiving, from the electronic support platform, an electronic support generated augmented reality indicator associated with an indicator position within the augmented reality environment; 32. The computer-implemented method of claim 31, further comprising: causing a rendering of the augmented reality environment including the electronically supported generated augmented reality indicator at the indicator location.

34. 34. The computer-implemented method of claim 33, wherein the electronic support generated augmented reality indicator represents a visual indicator identifying a first networked device for servicing the at least one networked device.

35. 34. The computer-implemented method of claim 33, wherein the electronic support generated augmented reality indicator represents a visual indicator identifying a location within the augmented reality environment for placing a new networked device or a first networked device of the at least one networked device.

36. The computer-implemented method further comprises:

34. The computer-implemented method of claim 33, further comprising: generating at least one augmented reality element corresponding to network strength data for a first location within the augmented reality environment, the network strength data being associated with a particular network access device, and the electronic support generated augmented reality indicator representing a visual indicator identifying a second location within the augmented reality environment for positioning the particular network access device to improve the network strength data at the first location within the augmented reality environment.

Images