Network visualization system and method

Abstract

1. A method of network visualization comprising: receiving key performance indicator (KPI) data inputs collected for nodes included in a radio access network (RAN); filtering the KPI data to remove unreliable KPI data inputs; determining whether the KPI data inputs for a predetermined geographic area exceed a threshold sample count; and outputting a graphical user interface (GUI) by a user interface (UI), the GUI including a display of a shape corresponding to the predetermined geographic area layered on a map, the shape representing an indication of network coverage quality based on the filtered KPI data inputs for a location corresponding to the shape corresponding to the predetermined geographic area.

Description

[Background technology]

[0001] A cellular network is a mobile telecommunications system in which mobile devices (e.g., mobile telephone devices) communicate over radio waves through local antennas at cellular base stations (e.g., cell towers). The coverage area served is divided into small geographic areas called "cells." Each cell is served by a separate low-power multi-channel transceiver and antenna at the cell tower. Mobile devices within a cell communicate via that cell's antenna on multiple frequencies and on individual frequency channels assigned by the base station from a common pool of frequencies used by the cellular network.

[0002] A Radio Access Network (RAN) is a part of a communication system. The RAN implements radio access technologies. The RAN resides between devices such as mobile phones, computers, or any remote control machine and provides their connectivity to a Core Network (CN). Depending on the standard, mobile phones and other wirelessly connected devices are variously known as User Equipment (UE), terminal equipment, Mobile Station (MS), etc. Summary of the Invention [Means for solving the problem]

[0003] Aspects of the present disclosure are best understood from the following detailed description read in conjunction with the accompanying drawings. In accordance with standard industry practice, various features are not drawn to scale. In fact, dimensions of various features are arbitrarily expanded or reduced for clarity of discussion. [Brief explanation of the drawings]

[0004] [Figure 1]1 is a schematic diagram of a Network Visualization (NV) system, according to some embodiments. [Figure 2] FIG. 10 is a data flow diagram of the NV module, according to some embodiments. [Figure 3] 1 is a visual representation of a network visualization geographic area according to some embodiments. [Figure 4] 1 is a flow diagram representation of a method for NV, according to some embodiments. [Figure 5] 1 is a visual representation of a NV user interface, according to some embodiments. [Figure 6A] 1 is a visual representation of an aggregation of multiple shapes according to some embodiments. [Figure 6B] 1 is a visual representation of a user device user interface according to some embodiments. [Figure 6C] 1 is a visual representation of a user device user interface according to some embodiments. [Figure 6D] 1 is a visual representation of a user device user interface according to some embodiments. [Figure 7] 1 is a flow diagram representation of a method for NV, according to some embodiments. [Figure 8] 1 is a visual representation of a periodic layered shape presentation according to some embodiments. [Figure 9] FIG. 1 is a high-level functional block diagram of a processor-based system according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0005] The following disclosure provides many different embodiments or examples for implementing different features of the provided subject matter. To simplify the disclosure, specific examples of components, values, operations, materials, arrangements, etc. are described below. These are, of course, examples and are not intended to be limiting. Other components, values, operations, materials, arrangements, etc. are contemplated. For example, the formation of a first feature above or on a second feature in the following description includes embodiments in which the first and second features are formed in direct contact with each other, and also includes embodiments in which an additional feature is formed between the first and second features such that the first and second features are not in direct contact with each other. Additionally, the present disclosure repeats reference numbers and / or letters in various examples. This repetition is for the purposes of brevity and clarity and does not, in itself, dictate a relationship between the various embodiments and / or configurations discussed.

[0006] Additionally, spatially relative terms such as "beneath," "below," "lower," "above," and "upper" are used herein for ease of description to describe the relationship of one element or feature to another element(s) or feature(s), as shown in the figures. Spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation shown in the figures. The device may be otherwise oriented (rotated 90 degrees or otherwise oriented) and the spatially relative descriptors used herein interpreted accordingly.

[0007] In some embodiments, a system and method for network visualization is described. In some embodiments, the system and method are configured to use data analytics for real-time network visualization.

[0008] Telecommunications operators use information about network performance, user experience (UX), and network reachability (e.g., used to understand whether a UE is offline or online and whether it is using Wi-Fi or mobile data) to analyze and monitor their networks and repair coverage gaps (e.g., areas where a user cannot receive a signal from an access point) before they significantly impact UX. To improve network performance, reliable and well-organized analysis allows engineers to make decisions based on geographic coverage areas.

[0009] In some embodiments, a user (e.g., an engineer or network administrator) enables a network visualization (NV) module. In some embodiments, network performance and reachability are monitored through a shaped layer representation (e.g., a shaped layer includes a hexagon, circle, rectangle, or other suitable shape within embodiments of the present disclosure). In some embodiments, network performance in a cluster or geographic area is analyzed based on the shaped layer representation. In some embodiments, filtering of data configured for use in the shaped layer representation is based on network usage. In some embodiments, periodic data updates and visualizations are based on crowd-sourced data to determine the current UX. In some embodiments, a user accesses the NV module via the World Wide Web (WWW) and / or in a mobile view (e.g., accessed on a UE).

[0010] In some embodiments, the NV module provides daily updates on network performance. In some embodiments, the NV module provides daily network reachability. In some embodiments, the NV module provides indoor and outdoor network performance analysis. In some embodiments, the NV module provides an understanding of user density within an area. In some embodiments, the NV module provides troubleshooting of poor coverage areas and optimizes the network. In some embodiments, the NV module provides a useful tool for radio frequency (RF) engineers while determining poor coverage areas. In some embodiments, the NV module allows managers to search geographic areas and visualize network coverage analysis from anywhere in the world. In some embodiments, the NV module provides analysis for clusters, cities, zones, or other suitable regions within embodiments of the present disclosure. In some embodiments, the NV module provides network planning in new coverage areas. In some embodiments, the NV module provides information useful to network customers on a customer care portal.

[0011] FIG. 1 is a schematic diagram of a network visibility (NV) system 100, according to some embodiments.

[0012] The NV system 100 includes a CN 102 communicatively connected to a RAN 104 via a backhaul 106, which is communicatively connected to base stations 108A and 108B (hereinafter, base stations 108) having antennas 110 wirelessly connected to UEs 112 located within geographic coverage cells 114A and 114B (hereinafter, geographic coverage cells 114). The CN 102 includes one or more service providers 116, a KPI server 118, and a NV module 120.

[0013] The CN 102 (also known as a backbone) is the portion of a computer network that interconnects networks, providing a pathway for exchanging information between different local area networks (LANs) or sub-networks. In some embodiments, the CN 102 ties diverse networks together across a wide geographic area, within different buildings in a campus environment, or within the same building.

[0014] In some embodiments, the RAN 104 is a GSM RAN, a GSM / EDGE RAN, a UMTS RAN (UTRAN), an E-UTRAN, an Open RAN (O-RAN), a Virtual RAN (v-Ran), or a Cloud RAN (C-RAN). The RAN 104 resides between user equipment 112 (e.g., a mobile phone, a computer, or any remote control machine) and the CN 102. The RAN 104 is shown as a C-RAN for simplified representation and explanation. In some embodiments, a Base Band Unit (BBU) replaces the C-RAN.

[0015] In traditional distributed cellular networks, BBUs are the pieces of equipment at the bottom and top of base stations at cell sites. BBUs are radio equipment that link UEs to the CN and process billions of bits of information per hour. BBUs are traditionally located in enclosures or shelters at the bottom of base stations. In contrast, C-RAN uses the large signal-carrying capacity of optical fiber to centralize many BBUs in dedicated pool locations or base stations. This reduces the amount of equipment at base stations and offers many other benefits, including lower latency.

[0016] In a hierarchical telecommunications network, the backhaul portion 106 of the NV system 100 includes intermediate links between the CN 102 and the RAN 104. Two primary methods of mobile backhaul implementation are fiber-based backhaul and wireless point-to-point backhaul. Other methods, such as copper-based wireline, satellite communications, and point-to-multipoint wireless technologies, are being phased out as capacity and latency requirements become higher in 4G and 5G networks. Backhaul generally refers to the side of the network that communicates with the global Internet. The connection between the base station 108 and the UE 112 begins with the backhaul 106, which is connected to the CN 102. In some embodiments, the backhaul 106 includes wireline, optical fiber, and wireless components. The wireless section includes using microwave bands, mesh, and edge network topologies that use high-capacity wireless channels to send packets to microwave or fiber links.

[0017] In some embodiments, the base station 108 is a lattice or self-supporting tower, a guyed tower, a monopole tower, and a hidden tower (e.g., a tower designed to resemble a tree, a cactus, a water tower, a sign, a light standard, and other types of structures). In some embodiments, the base station 108 is a cellular-enabled mobile device site where antennas and electronic communications equipment are typically located on a radio mast, tower, or other elevated structure to create a cell (or adjacent cells) in the network. The elevated structure typically supports an antenna 110 and one or more sets of transmitters / receivers (transceivers), digital signal processors, control electronics, remote radio heads (RRHs), primary and backup power sources, and shelters. Base stations are known by other names, such as base transceiver station, mobile telephone mast, or cellular base station. In some embodiments, the base station is replaced by or used in cooperation with an edge device configured to wirelessly communicate with UEs. The edge device provides an entry point to a service provider CN, such as the CN 102. Examples include routers, routing switches, Integrated Access Devices (IADs), multiplexers, and various Metropolitan Area Network (MAN) and Wide Area Network (WAN) access devices.

[0018] In at least one embodiment, antenna 110 is a sector antenna. In some embodiments, antenna 110 is a type of directional microwave antenna with a sector-shaped radiation pattern. In some embodiments, the sector angle of the arc is a 60°, 90°, or 120° design, with a few extra degrees to ensure overlap. Additionally, sector antennas are mounted in multiples if wider or full-circle coverage is desired. In some embodiments, antenna 110 is a rectangular antenna, sometimes referred to as a panel antenna or radio antenna, used to transmit and receive waves or data between mobile devices or other devices and base stations. In some embodiments, antenna 110 is a circular antenna. In some embodiments, antenna 110 operates at microwave or ultra-high frequency (UHF) frequencies (300 MHz to 3 GHz). In other examples, antennas 110 are selected for their size and directionality. In some embodiments, antenna 110 is a MIMO (Multiple-Input, Multiple-Output) antenna that simultaneously sends and receives two or more data signals over the same wireless channel by taking advantage of multipath propagation.

[0019] In some embodiments, the UE 112 is a computer or computing system. Additionally or alternatively, the UE 112 has a Liquid Crystal Display (LCD), Light-Emitting Diode (LED), or Organic Light-Emitting Diode (OLED) screen interface that provides a touchscreen interface with digital buttons and a keyboard or physical buttons along with a physical keyboard. In some embodiments, the UE 112 connects to the Internet and interconnects with other devices. Additionally or alternatively, the UE 112 incorporates an integrated camera, the ability to make and receive voice and video phone calls, video games, and Global Positioning System (GPS) capabilities. Additionally or alternatively, the UE runs an operating system (OS) that allows capability-specific third-party apps to be installed and executed. In some embodiments, the UE 112 is a computer (such as a tablet computer, netbook, digital media player, digital assistant, graphing calculator, handheld game console, handheld personal computer (PC), laptop, mobile internet device (MID), personal digital assistant (PDA), pocket calculator, portable medical player, or ultra-mobile PC), a mobile phone (such as a camera phone, feature phone, smartphone, or phablet), a digital camera (such as a digital camcorder, or digital still camera (DSC), digital video camera (DVC), or front-facing camera), a pager, a personal navigation device (PND), a wearable computer (such as a calculator watch, smart watch, head-mounted display, earphone, or biometric device), or a smart card.

[0020] In at least one embodiment, the geographic coverage cell 114 is any shape and size. In some embodiments, the geographic coverage cell 114 is a macrocell (covering 1 km to 30 km), a microcell (covering 200 m to 2 km), or a picocell (covering 4 m to 200 m). In some embodiments, the geographic coverage cell is circular, oval ( FIG. 1 ), sectored, or lobed, although the geographic coverage cell 114 may be configured in almost any shape or size. The geographic coverage cell 114 represents the geographic area over which the antenna 110 and the UE 112 are configured to communicate. Coverage depends on several factors, including terrain (i.e., mountains) and buildings, technology, radio frequency, and, perhaps most importantly for two-way telecommunications, the sensitivity and transmission efficiency of the UE 112. Some frequencies provide better area coverage, while other frequencies penetrate obstacles such as buildings in a city better. The ability of the UE to connect to a base station depends on the strength of the signal. Coverage gaps can be caused by most things, such as faulty equipment, bad weather, animals, accidents, etc. Coverage gaps arise through the loss of one or more sets of transmitters, receivers, transceivers, digital signal processors, control electronics, GPS receivers, primary and backup power sources, and antennas. Additionally or alternatively, coverage gaps exist due to areas not previously covered by cellular service or areas created by the removal of base stations, etc. In some embodiments, a coverage gap occurs after service covering an area is lost for some reason. In other examples, a coverage gap is any area where there is no cell coverage service to the UE for some reason.

[0021] A service provider 116 is a company, vendor, or organization that sells bandwidth or network access to Internet service providers by providing them with direct Internet backbone access and typically access to their Network Access Points (NAPs). Service providers are sometimes referred to as backbone providers, Internet providers, or vendors. Service providers consist of telecommunications companies, data carriers, wireless communication providers, Internet service providers, and cable television operators that offer high-speed Internet access.

[0022] The KPI server 118 generates both forecasts and live network data. The live network data (KPIs, UE / cell / MDT (minimized drive test) traces, and crowdsourced data) enables modeling of network traffic, hotspot identification, and wireless signal propagation. RF drive test is a method for measuring and evaluating the coverage, capacity, and quality of service (QoS) of mobile wireless networks, such as the RAN 104. This technique consists of using vehicles containing mobile wireless network air interface measurement equipment to detect and record various physical and virtual parameters of mobile cellular service in each geographic area. By measuring what wireless network subscribers experience in any particular area, wireless carriers can make directed changes to their networks that provide better coverage and service to their customers. Drive tests typically consist of a moving vehicle equipped with drive test measurement equipment. The equipment is typically a highly specialized electronic device that interfaces to an original equipment manufacturer (OEM) mobile handset (UE). This ensures that measurements are realistic and comparable to actual user experiences.

[0023] UE / cell / MDT traces collected in an Operations Support System (OSS) or through dedicated tools provide user-level information to the service provider 116. Once geographically located, the UE / cell / MDT traces are used to enhance path loss calculations and prediction plots, and to identify and locate problem areas and traffic hotspots. The KPI server 118 enables the service provider 116 to use the UE / cell / MDT traces with the NV module 120 for network visibility.

[0024] In some embodiments, the NV module 120 collects Reference Signal Received Power (RSRP). RSRP is an acronym for Reference Signal Received Power and is a measurement of the received power level in an LTE cell network. Average power is a measurement of the power received from a single reference signal. RSRP is the power of an LTE reference signal spread across the full bandwidth and narrowband. In some embodiments, the file data is in a specific file format (e.g., a grid-type pattern). In some embodiments, the RSRP is obtained from the KPI server 118.

[0025] In some embodiments, the NV module 120 collects synchronization signal reference signal received power (SS-RSRP). SS-RSRP is defined as the linear average over the power contribution (in watts) of resource elements carrying secondary synchronization signals (SSS). SS-RSRP is the linear average of the received SSS levels. Synchronization signals specific to each cell are transmitted using source elements. RSRP allows for comparison of the strength of signals from individual cells in 5G networks. RSRP is a parameter for cell selection or handover. SS-RSRP is the equivalent of the RSRP parameter used in LTE systems.

[0026] In some embodiments, the NV module 120 collects the Signal-to-Interference-plus-Noise Ratio (SINR), a quantity used to provide a theoretical upper limit on channel capacity (or rate of information transfer) in wireless communication systems. Similar to the Signal-to-Noise Ratio (SNR) often used in wired communication systems, the SINR is defined as the power of a particular signal of interest divided by the sum of the interference power (from other interfering signals) and the power of any background noise.

[0027] In some embodiments, the NV module 120 collects a synchronization signal Signal-to-Interference-plus-Noise Ratio (SS-SINR), which is the linear average over the power contributions (in watts) of resource elements carrying the SSS divided by the linear average of the noise and interference power contributions (in watts) over resource elements carrying the SSS within the same frequency bandwidth. SS-SINR is the linear average of the power contributions of resource elements carrying secondary synchronization signals divided by the linear average of the noise and interference power contributions of resource elements carrying secondary synchronization signals within the same frequency bandwidth (i.e., ETSI TS 138 215 V15.2.0, which is incorporated herein by reference in its entirety). In LTE networks, SINR is reported as a code via measurement reports to the eNodeB (e.g., access point). This is the difference between 3G and 4G.

[0028] In some embodiments, the NV module 120 collects data throughput. When used in the context of a communication network, such as Ethernet or packet radio, throughput or network throughput is the rate of successful message delivery over a communication channel. The data to which these messages belong is delivered over a physical or logical link or passes through a particular network node. Throughput is typically measured in bits per second (bits / s or bps), and sometimes in data packets per second (pps or p / s) or data packets per time slot. Throughput includes downlink and uplink data transmission. The wireless downlink is the transmission path from a cell site to a UE. The wireless uplink is the transmission path from a mobile station (UE) to a base station.

[0029] In some embodiments, the NV module 120 collects information about latency. Network delay is a design and performance characteristic of telecommunications networks. Network delay specifies the latency for a bit of data to travel across a network from one communication endpoint to another. Latency is typically measured in multiples or fractions of a second. Delay varies slightly depending on the location of a particular pair of communication endpoints. Engineers typically report both maximum and average delay and divide delay into several components: (1) processing delay, which is the time it takes a router to process the packet header; (2) queuing delay, which is the time the packet spends in a routing queue; (3) transmission delay, which is the time it takes to push the packet's bits onto the link; and (4) propagation delay, which is the time it takes the signal to propagate through the medium. A certain minimum level of delay is experienced by a signal due to the time it takes to serially transmit packets over the link. This delay is extended by more variable levels of delay due to network congestion. IP network delay ranges from a few milliseconds to hundreds of milliseconds.

[0030] In some embodiments, the NV module 120 collects information from Layer 3 (Network Layer) drivers. The Network Layer is responsible for receiving frames from the Data Link Layer and delivering them to their intended destinations based on the addresses contained within the frames. The Network Layer finds destinations by using logical addresses such as IP (Internet Protocol). At this layer, routers are components used to route information that needs to travel between networks.

[0031] In some embodiments, the NV module 120 collects information from consumers on a network, such as the RAN 104. The NV module 120 collects active and passive connectivity (e.g., reachability). In some embodiments, the NV module 120 collects information from a web performance test (WPT). In some embodiments, the NV module 120 captures signal KPIs during a WPT and uses the signal KPIs to create a shaping layer presentation on a map. In some embodiments, the NV module 120 collects information from YouTube®, network drives, feedback, or 1C drive information. In some embodiments, the NV module 120 collects active and passive data from subscribers and / or users. Non-limiting examples include network quality, related parameters, SINR, RSRP, data throughput, and other suitable parameters within the scope of the present invention.

[0032] In some embodiments, the NV module 120 collects geographically-located KPI sample data. In some embodiments, this geographically-located data is provided by the KPI server 118. In some embodiments, the geographically-located sample data is provided by a database or memory, such as the memory 904 (FIG. 9). In some embodiments, the geographically-located data includes a serving ENodeB ID (i.e., an identifier of the node at the base station). In some embodiments, the geographically-located data is provided and / or collected through a drive test, a UE KPI reported by a UE, such as the UE 112, a base station KPI report through a Central Unit (CU) or Distribution Unit (DU) associated with a base station, such as the base station 108, or other suitable methods of collecting geographically-located data according to some embodiments. For purposes of explanation, each device that provides KPI information is referred to herein as a node (e.g., an antenna, an edge device, a UE, or other suitable device within embodiments of the present disclosure).

[0033] In some embodiments, the NV module 120 collects a Physical Cell ID (PCI). The PCI is used to indicate the physical layer identity of a cell. The PCI is used for cell identification during the cell selection procedure. The goal of PCI optimization is to largely ensure that neighboring cells are assigned different primary sequences. Good PCI assignment reduces call drops by allowing the UE to clearly distinguish one cell from another.

[0034] In some embodiments, the NV module 120 collects the latitude and longitude of a node (e.g., a gNB), a NAP, a base station 108, or an edge device through a location tag.

[0035] In some embodiments, the NV module 120 geographically bins the collected data. Once data is collected, the NV module 120 performs a binning operation on the collected data. In some embodiments, the NV module 120 takes the average of all values ​​within a given region. In some embodiments, the NV module 120 determines the edges of the geographic area (e.g., NW, SW, NE, and SE), divides the geographic area into shapes such as hexagons, looks up the values ​​within each shape, calculates the average, and attributes the average to the latitude and longitude at the center of the shape.

[0036] FIG. 2 is a data flow diagram of the NV module 120, according to some embodiments.

[0037] The NV module 120 includes a NIFI component 202 , a Spark component 204 , an Hbase component 206 , a MySQL component 208 , and an application component 210 .

[0038] In some embodiments, the NIFI component 202 automates the flow of data between the NV module 120 and the KPI server 118. According to some embodiments, the NIFI component 202 ingests data from third-party applications, including latitude and longitude for each base station, such as base station 108, frequency band details, eNB ID, evolved-UTRAN cell global identifier (ECGI), drive test data, KPIs, consumer data, and other suitable data. In some embodiments, the NIFI component 202 is an open-source platform based on the concept of extract, transform, and load. The software design is based on a flow-based programming model and provides features including the ability to operate in clusters, security using Transport Layer Security (TLS) encryption, extensibility (e.g., allowing users to write their own software to extend its functionality), and improved usability features such as a portal used to visually view and modify behavior. The NIFI component 202 is used to schedule jobs, trigger flows, and ingest data from third-party applications, such as raw files from the KPI server 118.

[0039] Spark component 204 is an open source integrated analytics engine for large-scale data processing. Spark component 204 provides an interface for programming across server clusters with implicit data parallelism and fault tolerance. Spark component 204 is a parallel processing framework for running large-scale data analytics applications across clustered computers. Spark component 204 handles both batch and real-time analytics and data processing workloads.

[0040] The HBase component 206 provides a fault-tolerant way to store large amounts of sparse data (e.g., small amounts of information captured within larger collections of empty or unimportant data). The HBase component 206 is a column-oriented, non-relational database management system that runs on the Hadoop Distributed File System (HDFS). HBase provides a fault-tolerant way to store sparse datasets, which are common in many big data use cases.

[0041] The HDFS component (not shown) is a distributed file system that stores data on commodity machines, providing very high aggregate bandwidth across a server cluster. All batched data sources are first stored in the HDFS component and then processed using the Spark component 204. The Hbase component 206 also utilizes HDFS as its data storage infrastructure.

[0042] The MySQL component 208 is an open-source Relational Database Management System (RDBMS). A relational database organizes data into one or more data tables where data types are related to each other and these relationships help structure the data. The MySQL component 208 creates, modifies, and extracts data from the Spark component 204 and controls user access in operation 216. The MySQL component 208 is utilized for Application Programming Interface (Hadoop Distributed File System (API)) searches and to provide any real-time user interface (UI), such as UI 922 (FIG. 9). Aggregated and correlated data is also stored in MySQL.

[0043] The application component 210, in operation 222, enables a user to visualize the network (e.g., retrieve analysis data for visualization) through a UI, such as the UI 922 of FIG. 9 or a UI of a UE (as shown in FIGS. 6B, 6C, and 6D). The user visualizes various aspects of the NV, including analysis report data, in real time, in operation 220. In some embodiments, the user visualizes specified bands and various geographic areas. In some embodiments, the user visualizes individual shapes (e.g., hexagonal geographic areas) based on network analysis. For example, the user determines whether a geographic area (represented by a shape layered on a map) is experiencing insufficient coverage.

[0044] In some embodiments, the user drills down into details within the shapes. In some embodiments, the user hovers or clicks on a layered shape, and a pop-up box reveals information such as the cell ID, cell RSRP, cell SS-RSRP, cell SINR, and the number of samples collected within the grid. In some embodiments, the user visualizes details about the network performance in each layered shape. For example, the user visualizes the layered shape RSRP and the number of sample counts for the layered shape in a pop-up box.

[0045] At operation 212, the spark component 204 retrieves third-party data from the NIFI component 202. In some embodiments, the input third-party data includes site information from a site database, such as the latitude and longitude of all cells in the RAN, frequency band details, eNB IDs, ECGI, and other suitable information. In some embodiments, the input data additionally includes geographically located data, such as RF drive test information, UE KPI data, or other passively collected data. In some embodiments, the geographically located data is collected over a continuously running window of time, such as 24 hours. In some embodiments, the geographically located data is collected over a period of more than 24 hours, and in some embodiments, the geographically located data is collected over a period of less than 24 hours. In some embodiments, the window of time for collection of geographically located data is controlled by a sliding window algorithm. In some embodiments, the collected data is collected in a FIFO (First In, First Out) manner, where new data is collected and older data is removed (e.g., data older than 24 hours).

[0046] The spark component 204 stores the geographically located data in the Hbase component 206 and retrieves the stored data to perform network analysis at operation 214. At operation 218, the spark component 204 stores the network analysis in the Hbase component 206. Continuing with operation 216, the MySQL 208 retrieves site information from the spark component 204 and combines it with the site information in the application 210. The application 210 retrieves the network analysis data from the Hbase component 206 for visualization at operation 222. The application component 210 further retrieves the network analysis report data for visualization at operation 220.

[0047] FIG. 3 is a visual representation of a network visualization geographic area 300 according to some embodiments.

[0048] Network visualization geographic area 300 is a representation of collected data presented by the application described above. Network visualization geographic area 300 is divided into hexagons 302, and in some embodiments, each hexagon 302 represents a geographic area based on the scale 304 of network visualization geographic area 300. Network visualization geographic area 300, including hexagons 302, is layered on a map 308 representing the geographic area of ​​interest. In some embodiments, hexagons 302 combine to form a grid 306. In some embodiments, hexagons 302 are configured in various sizes to provide information about network coverage quality (e.g., good, average, or poor). In some embodiments, the size of grid 302 is adjustable by an engineer or user. In some embodiments, grid 302 has various shapes, including circular, square, and rectangular. In some embodiments, a user selects the shape of grid 302. In some embodiments, the area of ​​hexagon 302 is based on the level of zoom into network visualization geographic area 300. In Table 1 below, the area of ​​hexagon 302 is adjusted based on the zoom level. Continuing with the example of Table 1, the pixel grid size is also adjusted for resolution of detail within hexagon 302. In some embodiments, as the zoom level increases, the area of ​​hexagon 302 decreases. In some embodiments, increasing the zoom level increases the number of pixels in the representation while keeping the area of ​​the hexagon the same, thus providing greater visual clarity without increasing the area of ​​hexagon 302. [Table 1]

[0049] FIG. 4 is a flow diagram representation of a method 400 for network visualization (NV), according to some embodiments.

[0050] Although the operations of method 400 are described and shown as having a particular order, the operations of method 400 are configured to be performed in any order unless specifically specified otherwise. Method 400 is implemented as a set of operations, such as operations 402-418.

[0051] At operation 402 of method 400, KPI data input is received. In some embodiments, the NIFI component 202 collects geographically located KPI samples, including serving eNB ID, NR EARFCN, PCI, cell latitude and longitude, cell RSRP, cell SS-RSRP, and other suitable geographically located samples, according to some embodiments. Operational flow moves from operation 402 to operation 404, where location accuracy is determined.

[0052] At operation 404 of method 400, a determination is made regarding the location accuracy of the received KPI data sample. In some embodiments, the location accuracy is determined based on the known location of the cell, antenna, UE, or other suitable KPI-generating node in embodiments of the present disclosure. In some embodiments, the location accuracy of the KPI data sample is within an acceptable threshold (e.g., less than 5 meters). In some embodiments, in response to the accuracy of the KPI location data being higher than the threshold of known node location data, the KPI location data is not used for network visualization. In response to the location accuracy of the sample being unreliable (the “No” branch of block 404), the process flows to operation 406 where the sample is discarded. In response to the location accuracy of the sample being acceptable (the “Yes” branch of operation 404), operation proceeds from operation 404 to operation 408.

[0053] At operation 408 of method 400, a determination is made as to whether the data sample has a date and timestamp. In some embodiments, KPIs rely on timestamps as part of their calculation. The timestamp is also taken into account as part of the check for changed data. In response to the KPI data sample not having a date and / or timestamp (the "No" branch of block 408), the process flows to operation 406 where the sample is discarded. In response to the data sample including a date and timestamp (the "Yes" branch of block 408), the operation proceeds from operation 408 to operation 410.

[0054] At operation 410 of method 400, a determination is made as to whether the KPI data sample originated from a non-outage node (e.g., an active edge device or a base station). In response to the data sample originating from an outage site (the "No" branch of block 410), the process flows to operation 406 where the sample is discarded. In response to the data sample originating from an active node (the "Yes" branch of block 410), the operation proceeds from operation 410 to operation 412.

[0055] At operation 412 of method 400, a determination is made as to whether the KPI data sample includes latitude and longitude tags. Geographic tagging is the process of adding geographic information about the KPI data, including latitude and longitude coordinates, place names, and / or other location data, into the tags. In response to the data sample not having latitude and longitude tags (the "No" branch of block 412), the process flows to operation 406 where the sample is discarded. In response to the data sample including latitude and longitude tags (the "Yes" branch of block 412), the operation proceeds from operation 410 to operation 412.

[0056] At operation 414 of method 400, a determination is made as to whether the data sample KPI is tagged. A KPI tag is an abbreviated title with a KPI value. Each KPI has a data source, an entity set, and an annotation file. The KPI value changes only in response to actions performed on the transaction content. In response to the KPI sample not having a tag (the "No" branch of block 412), the process flows to operation 406 where the sample is discarded. In response to the data sample including a KPI tag (the "Yes" branch of block 412), the operation proceeds from operation 414 to operation 416.

[0057] At operation 416 of method 400, a total number of KPI data samples for each layered shape is collected, and a determination is made as to whether the KPI samples for the layered shape are greater than a predetermined amount (e.g., enough KPI samples to provide a reliable assessment of network quality). In some embodiments, the total number of data samples per cell is determined by examining the KPI input data at operation 402. In response to there being fewer than 10 KPI samples (the "No" branch of block 416), flow proceeds to operation 406 where the samples are discarded. In response to there being more than a predetermined amount of KPI samples (e.g., over a 24-hour window) (the "Yes" branch of block 416), process flow moves from operation 416 to operation 418.

[0058] Table 2 provides an example of sample criteria that operation 416 determines. [Table 2]

[0059] In some embodiments, operation 416 determines whether 10 RSRP samples, 10 SINR samples, 5 downlink samples, 5 uplink samples, and 5 latency samples are available before proceeding to operation 418. In some embodiments, only one of the sample criteria is met. In some embodiments, most or three of the five sample criteria are available.

[0060] At operation 418 of method 400, a layered shape is created on the map, such as network visualization geographic area 300, with hexagons 302 layered on map 308. In some embodiments, the KPI geographically located data is geographically binned. Binning, also known as discrete binning or bucketing, is a data preprocessing technique used to reduce the impact of minor observation errors. Original data values ​​fall into a given small interval, a bin, and are replaced by a value representing that interval, often the median value. Binning is a form of quantization. In some embodiments, the spark component 204 performs the geographic binning.

[0061] FIG. 5 is a visual representation of a NV user interface 500, according to some embodiments.

[0062] 5, a graphical user interface (GUI) 500 includes a display 501 showing hexagons 502 layered on a map 508 representing a geographic area. The hexagons 502 are grouped into a grid 506, and the size of each hexagon 502 is determined by a scale 504.

[0063] For each hexagon 502 representing good LTE coverage, it is an RSRP between -40 and -105 dBm (decibels (dB) referenced to 1 milliwatt (mW)), an SINR between 30 and 8 dB, a downlink rate between 100 and 10 Mbps, an uplink rate between 50 and 5 Mbps, and / or a latency between 0 and 40 ms.

[0064] For each hexagon 502 representing good 5G coverage, it is an SS-RSRP between -40 and -105 dBm, an SS-SINR between 40 and 17 dBm, a downlink rate between 2,000 and 500 Mbps, an uplink rate between 1,000 and 3 Mbps, and / or a latency between 0 and 40 ms.

[0065] For each hexagon 502 representing average LTE coverage, it is an RSRP between -105 and -115 dBm, an SINR between 8 and -2 dB, a downlink rate between 10 and 2 Mbps, an uplink rate between 5 and 2 Mbps, and / or a latency between 40 and 60 ms.

[0066] For each hexagon 502 representing average 5G coverage, it is an SS-RSRP between -105 and -115 dBm, an SS-SINR between 17 and 1.5 dB, a downlink rate between 500 and 30 Mbps, an uplink rate between 3 Mbps and 100 Kbps, and / or a latency between 40 and 60 ms.

[0067] For each hexagon 502 representing poor LTE coverage, it is an RSRP between -115 and -140 dBm, an SINR between -2 and -20 dB, a downlink rate between 2 and 0 Mbps, an uplink rate between 2 and 0 Mbps, and / or a latency between 60 and 5,000 ms.

[0068] For each hexagon 502 representing poor 5G coverage, it is an SS-RSRP between -115 and -140 dBm, an SS-SINR between 1.5 and -10 dBm, a downlink rate between 30 and 0 Mbps, an uplink rate between 100 and 0 Kbps, and / or a latency between 60 and 5,000 ms.

[0069] FIG. 6A is a visual representation of an aggregation of multiple layered shapes 600A, according to some embodiments.

[0070] As described above with reference to Table 1, a user zooms in and out on a graphical user interface (GUI) display, such as display 501. In response to the user zooming out to see more network coverage, NV module 120 runs an aggregation algorithm to provide coverage data in a layered shape, such as hexagon 502.

[0071] The aggregation logic for combining hexagons based on reduced zoom level uses a weighted average algorithm. In a non-limiting example, the RSRP and the number of samples per hexagon, such as hexagons 602, 604, and 606, are used to determine the RSRP of a larger hexagon, such as hexagon 608. In some embodiments, hexagon 608 includes the same or significant portions of hexagons 602, 604, and 606. Continuing with the example, (23 samples of hexagon 602 multiplied by −83 dBm) are added to (54 samples of hexagon 606 multiplied by −104 dBm) and added to (11 samples of hexagon 604 multiplied by −94 dBm). Continuing with the example, the sum is divided by the total number of samples in hexagons 602, 604, and 606 (e.g., 23 + 54 + 11). The result, -97.26 dBm, becomes the new RSRP for the larger, or zoomed-out, hexagon 608. Because -97.26 dBm is within a good range of RSRP, hexagon 608 is shown as a good coverage hexagon. In some embodiments, the initial data for each layered shape is determined at the lowest zoom level, and then aggregation occurs.

[0072] 6B, 6C, and 6D are visual representations of user device user interfaces according to some embodiments.

[0073] In FIG. 6B, UE UI 600B is a GUI display of network visualization at a zoom level, e.g., zoom level 17. A user has selected hexagon 610, causing hexagon 610 to have a brighter hue compared to the other hexagons surrounding hexagon 610. Additionally, pop-out box 612 presents the user with an RSRP or SS-RSRP value, e.g., −105.36 dBm, which places hexagon 610 as being in average coverage according to the legend in FIG. 5. Additionally, hexagon 610 contains 11 samples (e.g., more than the minimum samples for display) as of the listed date. At the bottom of UI 600B, pop-out box 614 further displays the maximum RSRP, e.g., −65.28 dBm, the minimum RSRP, e.g., −117.61 dBm, and the average RSRP, e.g., −99.48.

[0074] In FIG. 6C, UI 600C displays similar information about hexagon 616, but for a later date; for example, UI 600C is displayed for a date 33 days after the date in UI 600B. Hexagon 616 is adjacent to hexagon 610, as shown in UIs 600B and 600C. In FIG. 6C, a user has selected hexagon 616, causing hexagon 616 to have a lighter hue compared to the hexagons surrounding it. Additionally, a pop-out box 618 presents the user with an RSRP or SS-RSRP value, e.g., −104.08 dBm, which, according to the legend in FIG. 5, positions hexagon 616 as having good coverage. Additionally, hexagon 616 has 12 samples as of the listed date. At the bottom of the UI 600C, a pop-out box 620 further displays the maximum RSRP, eg, −65.28 dBm, the minimum RSRP, eg, −117.61 dBm, and the average RSRP, eg, −99.48.

[0075] In FIG. 6D, UI 600D shows a zoomed-out view, e.g., from 17 to 15 (e.g., 2,500 m within hexagon 622). 2 From 40,000m 26A to 6D) displays a view zoomed out two levels. In accordance with aggregation logic performed by NV module 120, a weighted average of hexagons 610 and 616 is performed over a period of time between the date in UI 600B (e.g., December 3, 2021) and the date in UI 600C (e.g., January 5, 2022) to create hexagon 622. That is, the RSRP value in pop-out box 624 is a representation of the sum of the average RSRP of hexagon 610 multiplied by the number of samples for hexagon 610 and the average RSRP of hexagon 616 multiplied by the number of samples for hexagon 616 over the days, where the sum is divided by the total amount of samples for hexagon 610 and hexagon 616 over the period of time (e.g., 1101 as shown in pop-out box 624) to arrive at a weighted average RSRP of −96.58.

[0076] In the pop-out box 626, the weighted average is also used to determine the maximum RSRP (e.g., −62.19), minimum RSRP (e.g., −111.35), and average RSRP (e.g., −89.86) for the hexagon 622.

[0077] FIG. 7 is a flow diagram representation of a method 700 for network visualization (NV), according to some embodiments.

[0078] Although the operations of method 700 are described and shown as having a particular order, the operations of method 700 are configured to be performed in any order unless specifically specified otherwise. Method 700 is implemented as a set of operations, such as operations 702-720.

[0079] At operation 702 of method 700, previous KPI layered shape data is collected (e.g., determined in method 400 of FIG. 4) from a database or memory, such as non-transitory computer-readable storage medium 904. Operational flow moves from operation 702 to operation 704.

[0080] At operation 704 of method 700, current KPI data input is received. In some embodiments, the NIFI component 202 collects geographically located KPI samples, including serving eNB ID, NR EARFCN, PCI, cell latitude and longitude, cell RSRP, cell SS-RSRP, and other suitable geographically located samples, according to some embodiments. Operational flow moves from operation 704 to operation 706, where location accuracy is determined.

[0081] At operation 706 of method 700, a determination is made regarding the location accuracy of the received KPI data sample. In some embodiments, the location accuracy is determined based on the known location of the cell, antenna, UE, or other suitable KPI-generating node in embodiments of the present disclosure. In some embodiments, the location accuracy of the KPI data sample is within an acceptable threshold (e.g., less than 5 meters). In some embodiments, in response to the accuracy of the KPI location data being higher than the threshold of known node location data, the KPI location data is not used for network visualization. In response to the location accuracy of the sample being unreliable (the “No” branch of block 706), the process flows to operation 708, where the previous KPI data for the layered shape is retained. In response to the location accuracy of the sample being acceptable (the “Yes” branch of operation 706), operation proceeds from operation 706 to operation 710.

[0082] At operation 710 of method 700, a determination is made as to whether the data sample has a date and timestamp (tag). In some embodiments, KPIs rely on timestamps as part of their calculation. The timestamp is also considered as part of the check for changed data. In response to the KPI data sample not having a date and / or timestamp (the "No" branch of block 710), the process flows to operation 708, where the previous KPI data for the layered shape is retained. In response to the data sample including a date and timestamp (the "Yes" branch of block 710), the operation proceeds from operation 710 to operation 712.

[0083] At operation 712 of method 700, a determination is made as to whether the KPI data sample originated from a non-outage node (e.g., an active edge device or a base station). In response to the data sample originating from an outage site (the "No" branch of block 712), the process flows to operation 708, where the previous KPI data for the layered shape is retained. In response to the data sample originating from an active node (the "Yes" branch of block 712), the operation proceeds from operation 712 to operation 714.

[0084] At operation 714 of method 700, a determination is made as to whether the KPI data sample includes latitude and longitude tags. Geographic tagging is the process of adding geographic information about the KPI data, including latitude and longitude coordinates, place names, and / or other location data, to the tags. In response to the data sample not having latitude and longitude tags (the "No" branch of block 714), the process flows to operation 708, where the previous KPI data for the layered shape is retained. In response to the data sample including latitude and longitude tags (the "Yes" branch of block 714), the operation proceeds from operation 714 to operation 716.

[0085] At operation 716 of method 700, a determination is made as to whether the data sample KPI is tagged. A KPI tag is an abbreviated title with a KPI value. Each KPI has a data source, an entity set, and an annotation file. The KPI value changes only in response to actions performed on the transaction content. In response to the KPI sample not having a tag (the "No" branch of block 716), the process flows to operation 708, where previous KPI data for the layered shape is retained. In response to the data sample including a KPI tag (the "Yes" branch of block 716), the operation proceeds from operation 716 to operation 718.

[0086] At operation 718 of method 700, a total number of KPI data samples per layered shape is collected, and a determination is made as to whether the KPI samples for the layered shape are greater than a predetermined amount (e.g., 10 KPI samples to provide a reliable assessment of network quality). In some embodiments, the total number of data samples per cell is determined by examining the KPI input data at operation 704. In response to there being less than the predetermined amount of KPI samples (the "No" branch of block 718), flow proceeds to operation 708, where previous KPI data for the layered shape is retained. In response to there being more than a predetermined amount of KPI samples (e.g., over a 24-hour window) (the "Yes" branch of block 718), process flow moves from operation 718 to operation 720.

[0087] In operation 420 of method 700, a layered shape is created on the map, such as GUI display 501 with hexagons 302 layered on map 508. In some embodiments, the KPI geographically located data is geographically binned. Binning, also known as discrete binning or bucketing, is a data pre-processing technique used to reduce the impact of minor observation errors. Original data values ​​fall into a given small interval, a bin, and are replaced by a value representing that interval, often the median value. Binning is a form of quantization. In some embodiments, the spark component 204 performs the geographic binning.

[0088] FIG. 8 is a visual representation 800 of a periodic layered shape presentation according to some embodiments.

[0089] In visual representation 800, on day 1, hexagon 802 includes 23 samples (more than 10 samples) and an RSRP value of -83 dBm. Hexagon 804 includes 54 samples (more than 10 samples) and an RSRP value of -104 dBm. Hexagon 806 includes 11 samples (more than 10 samples) and an RSRP value of -94 dBm. Hexagon 808 includes 7 samples received (fewer than 10 samples) and an RSRP value of -77 dBm. Because hexagon 808 has fewer than 10 samples, hexagon 808 is not created and remains off a display, such as display 501 (FIG. 5).

[0090] On day 2, hexagon 802 contains 11 samples (more than 10 samples) and an RSRP value of -72 dBm. Hexagon 804 retains its value from day 1 because eight samples (fewer than 10 samples) were collected on day 2 and a value of -84 dBm was received. Therefore, the value for day 2 of hexagon 804 is not displayed; instead, the value for day 1 of hexagon 804 is displayed. Hexagon 806 contains 20 samples (more than 10 samples) and an RSRP value of -116 dBm displayed, but the display has changed because -116 dBm is a bad condition (see legend in FIG. 5 ). Hexagon 808 contains 14 samples (more than 10 samples) and an RSRP value of -106 dBm. Day 2 hexagon 808 contains enough samples to create a layered hexagon shape that is displayed as an average according to the RSRP value of -106 dBm.

[0091] 9 is a block diagram of a network visibility (NV) processing circuit 900, according to some embodiments. In some embodiments, the NV processing circuit 900 is a general-purpose computing device that includes a hardware processor 902 and a non-transitory computer-readable storage medium 904. The storage medium 904 is encoded with, i.e., stores, among other things, computer program code 906, i.e., a set of executable instructions, such as an NV algorithm (e.g., a weighted average algorithm) and methods 400 and 700. Execution of the instructions 906 by the hardware processor 902 represents (at least in part) a network visibility application that implements some or all of the methods described herein (hereinafter, the processes and / or methods) according to one or more embodiments.

[0092] The processor 902 is electrically coupled to a computer-readable storage medium 904 via a bus 908. The processor 902 is electrically coupled to an I / O interface 910 by the bus 908. A network interface 912 is also electrically connected to the processor 902 via the bus 908. The network interface 912 connects to a network 914 such that the processor 902 and the computer-readable storage medium 904 connect to external elements via the network 914. The processor 902 is configured to execute computer program code 906 encoded on the computer-readable storage medium 904 to enable the network visualization processing circuit 900 to perform some or all of the mentioned processes and / or methods. In one or more embodiments, the processor 902 is a central processing unit (CPU), a multiprocessor, a distributed processing system, an application-specific integrated circuit (ASIC), and / or other suitable processing unit.

[0093] In one or more embodiments, computer-readable storage medium 904 is an electronic, magnetic, optical, electromagnetic, infrared, and / or semiconductor system (or apparatus or device). For example, computer-readable storage medium 904 includes a semiconductor or solid-state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk, and / or an optical disk. In one or more embodiments using an optical disk, computer-readable storage medium 904 includes a compact disk-read-only memory (CD-ROM), a compact disk-read / write (CD-R / W), and / or a digital video disk (DVD).

[0094] In one or more embodiments, the storage medium 904 stores computer program code 906 configured to enable the NV processing circuit 900 to perform some or all of the processes and / or methods mentioned. In one or more embodiments, the storage medium 904 also stores information such as NV algorithms that facilitate performing some or all of the processes and / or methods mentioned.

[0095] The centralized coverage management processing circuit 900 includes an I / O interface 910. The I / O interface 910 is coupled to external circuitry. In one or more embodiments, the I / O interface 910 includes a keyboard, keypad, mouse, trackball, trackpad, touch screen, and / or cursor direction keys for communicating information and commands to the processor 902.

[0096] The NV processing circuit 900 also includes a network interface 912 coupled to the processor 902. The network interface 912 enables the NV processing circuit 900 to communicate with a network 914 to which one or more other computer systems are connected. The network interface 912 includes a wireless network interface, such as BLUETOOTH, WIFI, WIMAX, GPRS, or WCDMA, or a wired network interface, such as ETHERNET, USB, or IEEE-864. In one or more embodiments, some or all of the described processes and / or methods are implemented in two or more centralized coverage management processing circuits 900.

[0097] The NV processing circuit 900 is configured to receive information via an I / O interface 910. The information received via the I / O interface 910 includes one or more of instructions, data, design rules, a library of standard cells, and / or other parameters for processing by the processor 902. The information is transferred to the processor 902 via a bus 908. The NV processing circuit 900 is configured to receive information regarding a UI via the I / O interface 910. The information is stored in the computer-readable medium 904 as a user interface (UI) 922.

[0098] In some embodiments, a method of network visualization includes receiving collected key performance indicator (KPI) data inputs for nodes included in a radio access network (RAN); filtering the KPI data to remove unreliable KPI data inputs; determining whether the KPI data inputs for a predetermined geographic area exceed a threshold sample count; and outputting, by a user interface (UI), a graphical user interface (GUI), the GUI including a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data inputs for locations corresponding to the shapes corresponding to the predetermined geographic area.

[0099] In some embodiments, filtering the KPI data to remove unreliable KPI data entries further includes determining whether each KPI data entry corresponding to a node corresponds to a node position within a threshold value.

[0100] In some embodiments, filtering the KPI data to remove unreliable KPI data entries further includes determining whether each KPI data entry includes a date and time tag.

[0101] In some embodiments, filtering the KPI data to remove unreliable KPI data entries further includes determining whether each KPI data entry includes a location tag.

[0102] In some embodiments, filtering the KPI data to remove untrusted KPI data entries further includes determining whether each KPI data entry originates from an active node.

[0103] In some embodiments, filtering the KPI data to remove unreliable KPI data entries further includes determining whether each KPI data entry includes a KPI tag.

[0104] In some embodiments, the network visualization method further includes discarding the KPI data input in response to the KPI data input not satisfying at least one of: including a data-time tag; including a location tag; including a KPI tag; the KPI data input originating from an inactive node; or the KPI data input location being outside a threshold.

[0105] In some embodiments, the indication of network coverage quality is based on one or more of: Reference Signal Received Power (RSRP), Synchronization Signal (SS) RSRP, Signal-to-Interference-and-Noise Ratio (SINR), SS-SINR, downlink rate, uplink rate, and latency.

[0106] In some embodiments, the indication of network coverage quality is indicated as one of: good in response to being within a first range, average in response to being within a second range, and poor in response to being within a third range.

[0107] In some embodiments, the method of network visualization further includes aggregating the plurality of KPI data inputs from the first predetermined geographic area and the second geographic area in a weighted aggregation over a period of time in response to receiving the input to create a larger map representation.

[0108] In some embodiments, an apparatus for network visualization includes: a processor; and a memory storing instructions that, when executed by the processor, cause the apparatus to receive collected key performance indicator (KPI) data inputs for nodes included in a radio access network (RAN); filter the KPI data to remove unreliable KPI data inputs; determine whether the KPI data inputs for a predetermined geographic area exceed a threshold sample count; and output, via a user interface (UI), a graphical user interface (GUI), the GUI including a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data inputs for locations corresponding to the shapes corresponding to the predetermined geographic area.

[0109] In some embodiments, the instructions further cause the processor to determine whether each KPI data entry corresponding to the node corresponds to a node position within a threshold value.

[0110] In some embodiments, the instructions further cause the processor to determine whether each KPI data entry includes a date and time tag.

[0111] In some embodiments, the instructions further cause the processor to determine whether each KPI data entry includes a location tag.

[0112] In some embodiments, the instructions further cause the processor to determine whether each KPI data input originates from an active node.

[0113] In some embodiments, a non-transitory computer-readable medium having stored thereon instructions that, when executed by a processor, cause an apparatus to: receive collected key performance indicator (KPI) data inputs for nodes included in a radio access network (RAN); filter the KPI data to remove unreliable KPI data inputs; determine whether the KPI data inputs for a predetermined geographic area exceed a threshold sample count; and output, via a user interface (UI), a graphical user interface (GUI), the GUI including a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data inputs for locations corresponding to the shapes corresponding to the predetermined geographic area.

[0114] In some embodiments, the instructions further cause the processor to determine whether each KPI data entry includes a KPI tag.

[0115] In some embodiments, the instructions further cause the processor to discard the KPI data input in response to the KPI data input failing to satisfy at least one of: including a data-time tag; including a location tag; including a KPI tag; the KPI data input originating from an inactive node; or the KPI data input location being outside a threshold.

[0116] In some embodiments, the indication of network coverage quality is based on one or more of: Reference Signal Received Power (RSRP), Synchronization Signal (SS) RSRP, Signal-to-Interference-and-Noise Ratio (SINR), SS-SINR, downlink rate, uplink rate, and latency.

[0117] In some embodiments, the indication of network coverage quality is indicated as one of: good in response to being within a first range, average in response to being within a second range, and poor in response to being within a third range.

[0118] The foregoing outlines features of some embodiments so that those skilled in the art may better understand aspects of the present disclosure. Those skilled in the art will readily appreciate that this disclosure may be used as a basis for designing or modifying other processes and structures to carry out the same purposes and / or achieve the same advantages of the embodiments introduced herein. Those skilled in the art should also recognize that such equivalent constructions do not depart from the spirit and scope of the present disclosure, and that they can make various changes, substitutions, and alterations herein without departing from the spirit and scope of the present disclosure.

Claims

1. 1. A method for network visualization, comprising: receiving collected key performance indicator (KPI) data input for nodes included in a radio access network (RAN); filtering the KPI data to remove unreliable KPI data inputs; determining whether the KPI data input for a predetermined geographic area exceeds a threshold sample count over a predetermined time window; causing a user interface (UI) to output a graphical user interface (GUI) if the KPI data input exceeds the threshold sample count over the predetermined time window, the GUI comprising: a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data input for locations corresponding to the shapes corresponding to the predetermined geographic area. and outputting the A method for network visualization, including:

2. said filtering said KPI data to remove said unreliable KPI data inputs; Determining whether each KPI data entry corresponding to a node corresponds to a node position within a threshold. The method of network visualization of claim 1 further comprising:

3. said filtering said KPI data to remove said unreliable KPI data inputs; Determining whether each KPI data entry includes a date and time tag The method of network visualization of claim 1 further comprising:

4. said filtering said KPI data to remove said unreliable KPI data inputs; Determining whether each KPI data entry includes a location tag The method of network visualization of claim 1 further comprising:

5. said filtering said KPI data to remove said unreliable KPI data inputs; Determining whether each KPI data entry originates from an active node The method of network visualization of claim 1 further comprising:

6. said filtering said KPI data to remove said unreliable KPI data inputs; Determining whether each KPI data entry includes a KPI tag The method of network visualization of claim 1 further comprising:

7. KPI data entry Data - including time tag, including location tags, Includes KPI tags, The KPI data input originates from an inactive node; or The KPI data input position is outside the threshold discarding the KPI data entry in response to failure to satisfy at least one of The method of network visualization of claim 1 further comprising:

8. The indication of network coverage quality: Reference Signal Received Power (RSRP), Synchronous signal (SS) RSRP, Signal to Interference and Noise Ratio (SINR), SS-SINR, Downlink rate, uplink rate, and Latency The method of claim 1 , wherein the method is based on one or more of:

9. The indication of network coverage quality: in response to being within the first range, good; In response to being within the second range, an average; and In response to the signal being within the third range, 2. The method of network visualization of claim 1, wherein the method is represented as one of:

10. aggregating the plurality of KPI data inputs from the first predetermined geographic area and the second geographic area in a weighted aggregation over a period of time in response to receiving the input to create a larger map representation. The method of network visualization of claim 1 further comprising:

11. 1. An apparatus for network visualization, comprising: a processor, and When executed by the processor, the device receiving collected key performance indicator (KPI) data input for nodes included in a radio access network (RAN); filtering the KPI data to remove unreliable KPI data inputs; determining whether the KPI data input for a predetermined geographic area exceeds a threshold sample count over a predetermined time window; causing a user interface (UI) to output a graphical user interface (GUI) if the KPI data input exceeds the threshold sample count over the predetermined time window, the GUI comprising: a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data input for locations corresponding to the shapes corresponding to the predetermined geographic area. and outputting the A memory that stores instructions to perform 1. An apparatus for network visualization comprising:

12. The instructions cause the processor to: Determining whether each KPI data entry corresponding to a node corresponds to a node position within a threshold. The apparatus for network visualization of claim 11 , further comprising:

13. The instructions cause the processor to: Determining whether each KPI data entry includes a date and time tag The apparatus for network visualization of claim 11 , further comprising:

14. The instructions cause the processor to: Determining whether each KPI data entry includes a location tag The apparatus for network visualization of claim 11 , further comprising:

15. The instructions cause the processor to: Determining whether each KPI data entry originates from an active node The apparatus for network visualization of claim 11 , further comprising:

16. When executed by the processor, the apparatus receiving collected key performance indicator (KPI) data input for nodes included in a radio access network (RAN); filtering the KPI data to remove unreliable KPI data inputs; determining whether the KPI data input for a predetermined geographic area exceeds a threshold sample count over a predetermined time window; causing a user interface (UI) to output a graphical user interface (GUI) if the KPI data input exceeds the threshold sample count over the predetermined time window, the GUI comprising: a display of shapes corresponding to the predetermined geographic area layered on a map, the shapes representing an indication of network coverage quality based on the filtered KPI data input for locations corresponding to the shapes corresponding to the predetermined geographic area. and outputting the A non-transitory computer-readable medium having stored thereon instructions to cause a

17. The instructions cause the processor to: Determining whether each KPI data entry includes a KPI tag 20. The non-transitory computer-readable medium of claim 16, further comprising:

18. The instructions cause the processor to: KPI data entry Data - including time tag, including location tags, Includes KPI tags, The KPI data input originates from an inactive node; or The KPI data input position is outside the threshold discarding the KPI data entry in response to failure to satisfy at least one of 20. The non-transitory computer-readable medium of claim 16, further comprising:

19. The indication of network coverage quality: Reference Signal Received Power (RSRP), Synchronous signal (SS) RSRP, Signal to Interference and Noise Ratio (SINR), SS-SINR, Downlink rate, uplink rate, and Latency 17. The non-transitory computer-readable medium of claim 16, based on one or more of:

20. The indication of network coverage quality: in response to being within the first range, good; In response to being within the second range, an average; and In response to the signal being within the third range, 17. The non-transitory computer-readable medium of claim 16, wherein the non-transitory computer-readable medium is one of:

Images