Smart missing data imputation for measurement data
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-06-26
- Publication Date
- 2026-08-14
Smart Images
Figure 2026527515000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to systems and methods for collecting measurement data from a plurality of endpoints, and more particularly, to systems and methods for complementing missing data within measurement data.
Background Art
[0002] A centralized control system may be responsible for collecting measurement data from a plurality of endpoints. For example, a head-end system collects readings indicating electricity and / or gas consumption from a plurality of smart meters. In a network where a system collects measurement data from a plurality of endpoints, some of the expected measurement data may not reach the system, and there may be missing data in the measurement data. Such missing data in the collected data may be due to performance problems in the network, and as a result, packets sent from the endpoints to the system may be dropped and not received by the system.
[0003] A control system may analyze measurement data received from various endpoints and determine that there is missing data in the measurement data. For example, each endpoint may be configured to provide a measurement data item to the control system every hour. If the control system receives a measurement data item corresponding to 8 PM and another item corresponding to 10 PM, but does not receive a measurement data item corresponding to 9 PM, the control system determines that there is missing data in the measurement data. When identifying missing measurement data, the control system sends one or more retry requests to the endpoints to fill in the missing measurement data.
Summary of the Invention
[0004] A sharp decline in network performance associated with a specific set of endpoints can result in numerous gaps in the measurement data associated with that endpoint set. The control system attempts to fill these gaps by sending retry requests. However, sending retry requests and returning the corresponding measurement items over the network places an additional load on network performance and causes further packet loss.
[0005] According to the first aspect, a method is provided for collecting measurement data from multiple endpoints over a network. The method includes receiving first measurement data from a first set of endpoints and receiving second measurement data from a second set of endpoints; identifying a first set of missing data in the first measurement data during a first period and, in response to identifying the first set of missing data in the first measurement data, sending one or more retry requests to collect the data contained in the first set of missing data at a collection rate associated with the first set of endpoints; and, during a second period following the first period, identifying a set of missing data in the second measurement data and, in response to identifying the multiple missing data in the second measurement data, associating the second set of endpoints with... This includes sending one or more retry requests to collect data contained in multiple missings in the second measurement data at a reduced collection rate; monitoring network performance for communication with a first set of endpoints; reducing the collection rate associated with the first set of endpoints in response to determining that the network performance for communication with the first set of endpoints is below a threshold; and withholding the collection of at least some of the data contained in the second multiple missings in response to identifying the second multiple missings in the first measurement data in accordance with the reduced collection rate associated with the first set of endpoints during the second period.
[0006] This method enables smart data loss recovery. The control system reduces the percentage of data loss recovered for a specific segment of the network where network performance is degraded (i.e., the segment associated with a first set of endpoints). While reducing the percentage of data loss recovered for that specific segment of the network, the control system continues to recover a higher percentage of data loss for a different segment of the network (i.e., the segment associated with a second set of endpoints).
[0007] In some embodiments, withholding the collection of at least some of the data contained in the second set of missing data includes withholding the collection of all of the data contained in the second set of missing data.
[0008] In some embodiments, the method includes, in response to determining that network performance for communication with a first set of endpoints is below a further threshold, suspending the collection of all data included in a second set of missing data.
[0009] In some embodiments, withholding the collection of at least a portion of the data contained in the second set of missings includes withholding the collection of a portion of the data contained in the second set of missings, and the method includes sending one or more retry requests during the second period to collect the data of the reduced collection rate contained in the second set of missings in the first measurement data.
[0010] In some embodiments, the method includes, in response to determining that network performance for communication with a first set of endpoints is below but not below a further threshold, performing a hold on collecting some of the data included in a second set of missing data.
[0011] In some embodiments, the method includes determining whether network performance is below a further threshold, and reducing the collection rate associated with a first set of endpoints by a level depending on whether network performance is determined to be below a further threshold.
[0012] In some embodiments, the method includes, in response to determining that, following a second period, network performance for communication with a first set of endpoints is no longer below a threshold, restoring the collection rate associated with the first set of endpoints from a reduced collection rate to a previous value, and, in response to identifying a third set of missing data in the first measurement data, sending one or more retry requests to collect data of the restored collection rate included in the third set of missing data in the first measurement data.
[0013] In some embodiments, the method includes receiving first measurement data from a first set of endpoints using a first communication technique, and receiving second measurement data from a second set of endpoints using a second communication technique.
[0014] In some embodiments, determining that network performance for communication with a first set of endpoints is below a threshold includes determining that no packets have been received from the first set of endpoints for a predetermined period of time.
[0015] In some embodiments, each endpoint includes a smart meter.
[0016] In some embodiments, monitoring network performance for communication with a first set of endpoints includes determining the percentage of items in a first set of measurement data that were correctly received from the first set of endpoints, and determining that network performance for communication with the first set of endpoints is below a threshold includes determining that the percentage of items is below a predetermined level.
[0017] In some embodiments, the plurality of endpoints includes a plurality of sets of endpoints, including a first set of endpoints and a second set of endpoints, and the method includes, for each set of endpoints, monitoring network performance for communication with each set of endpoints, storing a network performance metric associated with each set of endpoints, and, in response to determining that the network performance for communication with each set of endpoints is below a threshold, withholding the collection of at least some of the data belonging to missing data in the measurement data received from each set of endpoints.
[0018] In some embodiments, the collection rate associated with a first set of endpoints during a first period is the same as the collection rate associated with a second set of endpoints during a second period.
[0019] According to a second aspect, a data processing system is provided for collecting measurement data from multiple endpoints via a network. The data processing system comprises at least one processor and at least one memory containing a set of computer-readable instructions, the computer-readable instructions, when executed by the at least one processor, cause the data processing system to perform a method according to the first aspect or any embodiment thereof.
[0020] According to a third aspect, a computer program is provided which includes a set of computer-readable instructions, which, when executed by at least one processor of a data processing system, causes the method according to the first aspect or any embodiment thereof to be performed. [Brief explanation of the drawing]
[0021] The embodiments of the present invention are illustrative and will be more fully understood and appreciated from the following detailed description, which is referenced in conjunction with the drawings.
[0022] [Figure 1] An example of a network in which a head-end system is connected to a plurality of endpoints via a plurality of collectors is shown. [Figure 2] An example of a computer system including at least one processor and at least one memory is shown. [Figure 3] An example of a computer system including at least one processor, at least one memory, and a user interface is shown. [Figure 4A] An example of the first part of a method for performing smart missing value completion is shown. [Figure 4B] An example of the second part of a method for performing smart missing value completion is shown. [Figure 5] An example of an alternative set of steps for performing smart missing value completion is shown. [Figure 6] It is a schematic diagram showing data stored by a system belonging to a network. [Figure 7] A set of multiple missing values within the first set of measurement data is shown.
Mode for Carrying Out the Invention
[0023] Embodiments are implemented in a data processing system for connecting to a plurality of endpoints and collecting measurement data from those endpoints.
[0024] Refer to FIG. 1 showing network 100. In network 100, control system 102 is connected to a plurality of endpoints 112 - 122 via a plurality of network devices 104, 106, 108. System 102 and network devices 104, 106, 108 together form a data processing system 130 in which various embodiments are implemented. In some embodiments, system 102 is a head-end system 102, devices 104, 106, 108 are collectors 104, 106, 108, and endpoints 112 - 122 are smart meters 112 - 122.
[0025] Endpoints 112 to 122 are shown divided into several sets 110a to c. Each of sets 110a to c connects to a different collector from among 104 to 108 for the purpose of transmitting measurement data to system 102. Each of sets 110a to c can communicate with system 102 based on various communication technologies such as radio frequency (RF), power line communication (PLC), and cellular communication. For example, each endpoint belonging to the first set 110a transmits measurement data to collector 104 in packets provided according to the first communication protocol and receives commands from collector 104 in packets provided according to the first communication protocol. Similarly, each endpoint belonging to the second set 110b transmits measurement data to collector 106 in packets provided according to the second communication protocol and receives commands from collector 106 in packets provided according to the second communication protocol. Each endpoint belonging to the third set 110c sends measurement data to collector 108 in packets provided according to the third communication protocol and receives commands from collector 108 in packets provided according to the third communication protocol. When each collector 104, 106, or 108 receives a measurement data item from one of the endpoints 112 to 122 to which it is associated, it sends that measurement data item to system 102.
[0026] Each of the endpoint sets 110a to 110c may communicate with system 130 through a different segment of network 100. As network performance can vary between different network segments, as described later, the missing data collection rate is adjusted for each network segment.
[0027] Refer to Figure 2. Figure 2 shows an example of a computer system 200 that provides either system 102, network devices 104-108, or endpoints 112-122. System 200 may also include servers, backend systems, etc.
[0028] System 200 comprises at least one memory 210, 220, at least one data processing unit 230, 240, and an input / output interface 250. At least one memory 210, 220 includes a random access memory 210 and at least one hard drive 220. Memories 210, 220 store computer executable code that, when executed by at least one data processing unit 230, 240, performs steps described as being executed by System 100. Memories 210, 220 are used to store data related to the control application. In particular, memories 210, 220 are used to store log files containing data recorded by the control application.
[0029] At least one processor 230, 240 communicates with memory 210, 220, reads instructions for execution, reads data for processing, and stores the results of processing that data. The system 200 sends and receives messages through interface 250. Messages received through interface 250 include data processed by at least one processor 230, 240. Messages sent from interface 250 are created by at least one processor 230, 240.
[0030] As an alternative to the server-type system 200, one or more of items 102, network devices 104 to 108, or endpoints 112 to 122 can be provided as different types of devices with user interfaces. See Figure 3, which shows an example of such a computing device 300. Device 300 may be a mobile user device (UE), a personal computer (PC), a terminal or workstation, or other form of device.
[0031] Device 300 includes an interface 340 for transmitting and receiving signals. Interface 340 is either a wired or wireless interface. For example, interface 340 may include a wired interface for connection to a wired network (e.g., a local area network and / or the Internet). Alternatively, or in addition to this, interface 340 may include a transceiver configured to transmit and receive communications via a wireless interface. The transceiver may be provided, for example, by a wireless unit and associated antenna configuration. The antenna configuration is located inside or outside system 300.
[0032] System 300 comprises at least one data processing entity 315, at least one random access memory 320, at least one read-only memory 325, and other components 330. These are used for software and hardware assistance in performing tasks that the system is designed to perform. This includes control, access, and communication with access systems and other communication devices. At least one random access memory 320 and a hard drive 325 are capable of communicating with the data processing entity 315, which may be a data processor. Data processing, storage, and other related control devices may be provided on a suitable circuit board and / or within a chipset. The user controls the operation of System 300 by a suitable user interface, such as a keypad 310, or by voice commands. System 300 includes a display 305 for displaying visual content to the user. System 300 may also include a speaker for providing audio content.
[0033] The memory of system 300 (i.e., random access memory 320 and hard drive 325) is configured to store computer-readable instructions executed by data processor 315 for performing data processing functions described herein as being performed by a system, for example, system 102.
[0034] According to the embodiment, the system 130 can detect missing data in the measurement data received from endpoints 112-122, and upon detecting these missing data, it sends a retry request to obtain the corresponding measurement data. The process of sending these requests and obtaining the missing measurement data is known as missing data imputation.
[0035] In certain endpoint sets, network performance may be particularly degraded, resulting in significant data loss in measurement data. Collecting data to address these missing data places an additional load on the network due to the sending of additional retry requests and the acquisition of additional measurement data, resulting in further packet loss. Therefore, system 130 monitors network performance for each endpoint set 110a-c and, in response to determining that network performance for communication with a particular endpoint set is below a threshold, withholds the collection of at least some of the data belonging to the missing measurement data associated with that endpoint set. System 130 continues to collect data belonging to the missing measurement data associated with other endpoint sets (i.e., sets that have not experienced network degradation) at the original collection rate (e.g., 100%).
[0036] Figure 4A shows an example of the first part 400A of a method for collecting measurement data from multiple endpoints. This method is performed by the data processing system 130. The steps are shown in order, but it should be noted that in practice there may be overlaps in the time at which the steps are performed.
[0037] In S405, system 130 receives measurement data (hereinafter referred to as "first measurement data") from a first set of endpoints 110a. The measurement data received in S405 includes multiple measurement data items received from different endpoints belonging to the first set of endpoints 110a. Each measurement data item may include, for example, a meter reading. Each endpoint belonging to the first set 110a may be configured to periodically send measurement data items to system 130 every hour. The measurement data items are received by collector 104 and forwarded to system 102. Each measurement data item is sent from the endpoint to system 130 in packet units.
[0038] In S410, system 130 identifies a first set of missing values in the first set of measurement data received in S405. Each missing value is an instance where a measurement data item that was expected to be received was not received by system 130. System 130 can detect missing values in the measurement data in various ways. For example, each endpoint in the first set 110a may be configured to send measurement data items periodically, for example, every hour. System 102 identifies a measurement data item as lost (i.e., missing) if a measurement data item corresponding to a later time is received but a measurement data item corresponding to an earlier time has not been received. For example, suppose endpoint 112 sends measurements every hour, and system 102 receives a first packet measured at 8 p.m. and a second packet measured at 10 p.m. from endpoint 112, but does not receive a measurement for 9 p.m. Based on this fact, system 102 determines that there is a missing value corresponding to the expected measurement for 9 p.m.
[0039] In one embodiment, system 130 identifies missing data in the measurement data based on the sequence number included in the packet containing the measurement data item. For example, suppose system 102 receives a first packet from endpoint 112 containing sequence number 10 and the associated measurement, and a second packet containing sequence number 12 and the associated measurement, but does not receive a packet containing sequence number 11. Based on this, system 102 determines that there is a missing data corresponding to the measurement that should have been received at sequence number 11.
[0040] In S410, in response to determining that there is one or more missing data points in the first set of measurement data, the system 130 performs a missing data completion process to obtain the missing measurement data. To do so, it sends a request (referred to herein as a retry request) to the relevant endpoint of the first set 110a to obtain the missing measurement data. The retry request is sent from the system 102 via the collector 104 to the endpoint specified in the request. Upon receiving any of these retry requests, the relevant endpoint of the first set 110a returns the requested measurement data to the system 102.
[0041] The missing data imputation process in S410 is performed to collect a certain percentage of the missing measurement data (i.e., the collection rate associated with the first set of endpoints 110a). In an embodiment, the collection rate associated with the first set of endpoints 110a is set to a default value of 100% before it is detected that the degradation in communication with the first set of endpoints 110a is below a threshold. Therefore, if the collection rate is 100%, a retry request is sent to obtain 100% of the data corresponding to the first set of missing data in the measurement data. If the corresponding measurement data is not returned to the system 130 despite the retry request being sent, the system 130 may retry sending the request multiple times until the corresponding measurement data is returned.
[0042] In S415, measurement data (hereinafter referred to as second measurement data) is received by the system 130 from a second set of endpoints 110b. S415 may be the same process as S405, but relating to the second set of endpoints 110b and the associated measurement data collected by the second set of endpoints 110b. Although S415 is shown to be performed after S405, these steps overlap in time.
[0043] In S420, the system 130 identifies missing data in the measurement data received in S415 and performs missing data imputation processing for these missing data. The missing data imputation processing is performed to collect the missing data with the collection rate associated with the second set of endpoints 110b. The collection rate associated with the second set of endpoints 110b may be 100%. S420 may be similar to S410, but may also relate to the second set of endpoints 110b and the associated measurement data collected by the second set of endpoints 110b.
[0044] In S425, system 130 monitors network performance for communication with the first set of endpoints 110a. Monitoring is performed by collector 104, which determines the network performance and then provides this network performance index to system 102. To determine network performance, system 130 calculates the percentage of measurement data items received from endpoints 110a. For example, if system 130 expects to receive 100 measurement data items within a predetermined time period, and only 57 are received, system 130 determines the network performance value to be 57%. Alternatively, system 130 may determine a value representing network performance based on the amount of time during which network failures occurred in communication between the first set of endpoints 110a and system 130. For example, if system 130 does not receive any measurement data from the first set 110a for a predetermined time period (e.g., 10 minutes), system 130 determines the network performance value based on this predetermined time.
[0045] In S430, system 130 determines whether the network performance for communication with the first set 110a of endpoints is below a threshold performance level. This step is performed by system 102 using the performance value determined in S425. For example, system 130 may determine that the network performance value is below a threshold in response to determining that the percentage of measurement data items received within a predetermined time interval is below a predefined threshold. Alternatively, system 130 may determine that the network performance value is below a threshold in response to determining that measurement data has not been received from the first set 110a for a period longer than a predefined period.
[0046] In S430, if system 130 determines that the network performance for communication with the first set of endpoints 110a is below the threshold performance level, the method proceeds to S435. In S435, system 130 reduces the collection rate for the first set of endpoints 110a (for example, from 100% to 50%). If system 130 determines that the network performance for communication with the first set of endpoints 110a is above the threshold performance level, system 130 maintains the default collection rate for the first set of endpoints 110a.
[0047] In S440, system 130 monitors the network performance for communication with the second set of endpoints 110b. In S445, system 130 determines whether the network performance for communication with the second set of endpoints 110b is below the threshold performance level. If system 130 determines in S445 that the network performance for communication with the second set of endpoints 110b is below the threshold performance level, the process proceeds to S450. In S450, system 130 reduces the collection rate for the second set of endpoints 110b. If system 130 determines that the network performance for communication with the second set of endpoints 110b is above the threshold performance level, system 130 maintains the default collection rate for the second set of endpoints 110b.
[0048] Steps S440, S445, and S450 may be similar to steps S425, S430, and S435, but relate to the relevant measurement data collected by the second set of endpoints 110b and the second set of endpoints 110b, rather than the relevant measurement data collected by the first set of endpoints 110a and the first set of endpoints 110a. In Figure 4A, steps S440, S445, and S450 are shown as taking place after steps S425, S430, and S435, although these steps overlap in time.
[0049] After S445 and optionally S450, the method proceeds to S455.
[0050] Figure 4B shows the second part 400B of the method for collecting measurement data from multiple endpoints.
[0051] In addition to the missing data (i.e., the first set of missing data) that is filled in by the system 130 in S410, the first measurement data includes a further set of missing data (i.e., the second set of missing data). The second set of missing data may belong to the latter part of the first measurement data, which is received after the portion of the first measurement data that includes the missing data filled in in S410. If the collection rate of the set 110a of the first endpoints decreases in S435, as shown in S455, the method proceeds to S460. On the other hand, if the collection rate is maintained, the method proceeds to S465.
[0052] When the process proceeds to S460, in S460, the system 130 suspends the collection of at least a portion of the data in the second set of missing data in the first measurement data. The percentage of data collected depends on the reduced collection rate set in S435. For example, if the collection rate decreases from 100% to 50% in S435, in S460, the system 130 collects 50% of the data in the second set of missing data in the first measurement data. In some embodiments, if the collection rate decreases to 0% in S435, the system 130 does not collect any data in the second set of missing data in S460. If the collection rate decreases to a value other than zero, the system 130 sends one or more retry requests to endpoint 110a to obtain a portion of the measurement data items that were determined to be missing.
[0053] When the process proceeds to S465, in S465, the system 130 collects data from the second set of missing data in the first measurement data at the default collection rate. The default collection rate, also called the normal collection rate or original collection rate, is the collection rate applied in steps S410 and S420 without being reduced in response to poor network performance. In this embodiment, the default collection rate is 100%, in which case the system 130 sends a retry request to obtain all data in the second set of missing data in the first measurement data.
[0054] To obtain the measurement items related to the second set in the second measurement data, perform the same procedures S470, S475, and S480 for the second set of endpoints 110b.
[0055] As shown in S470, if the collection rate for the second set of endpoints decreases in S450, the method proceeds to S475. On the other hand, if the collection rate is maintained, the method proceeds to S480.
[0056] In S475, system 130 withholds the collection of at least some of the missing data in the second measurement data. The percentage of data collected depends on the reduced collection rate set in S450. S475 is similar to S460, but applies to the second set of endpoints 110b instead of the first set of endpoints 110a.
[0057] In S480, system 130 collects data for the second set of missing data at a normal collection rate. S480 is similar to S465, but applies to the second set of endpoints 110b instead of the first set of endpoints 110a.
[0058] Therefore, system 130 performs S460 or S465 to collect data for a second set of missing data in the first measurement data, and S475 or S480 to collect data for further missing data in the second measurement data. These steps are performed during a second period, following a first period in which initial missing data completion is performed in S410 and S420.
[0059] The system may again monitor the network performance of the endpoint sets, and if it determines that the collection rate of each endpoint set is no longer below a threshold in the third period following the second period, it may restore the collection rate of each endpoint set to its default value.
[0060] In S485, the system 130 again monitors the network performance for communication with the first set of endpoints 110a. The system determines a value representing the network performance (e.g., the percentage of received measurements). This process of determining the network performance may be the same as that performed as part of S425 described above.
[0061] In S490, system 130 determines whether the network performance determined in S485 is below a threshold. If the network performance is below the threshold, method 400B proceeds to S492. If the network performance is not below the threshold, method 400B proceeds to S497.
[0062] In S492, in accordance with the reduced collection rate (e.g., 50% or 0%), the system 130 withholds the collection of data from at least a portion of the further set of missing data (i.e., the third set of missing data) in the first measurement data.
[0063] In S497, system 130 collects data in the third set of missing data in the first measurement data at a default collection rate (e.g., 100%). If the collection rate for the first set 110a of the endpoint drops in S435, in S497, system 130 increases the collection rate to the default level. In S497, system 130 sends a retry request to the first set 110a of the endpoint to retrieve the measurement data items that were determined to be missing in the third set of missing data in the first measurement data.
[0064] Although not shown in Figure 4B, system 130 further performs the steps of monitoring network performance for communication with the second set of endpoints 110b and readjusting the collection rate of the second set of endpoints 110b depending on whether the determined network performance is below a threshold. In other words, system 130 performs steps equivalent to S485, S490, S492, and S497 for the second set of endpoints 110b, rather than for the first set of endpoints 110a.
[0065] Figures 4A and 4B show embodiments in which the measured network performance is compared to a single threshold (in S430, S445, and S490). In some embodiments, the measured network performance is further compared to another threshold, and the percentage of the collection rate is reduced to one of two lower levels (e.g., 0% and 50%) depending on whether the collection rate is between these two thresholds or below each threshold. Figure 5 shows an example of steps according to such embodiments.
[0066] Steps S405, S410, S415, S420, S425, and S430 in Figure 5 are the same as those shown in Figure 4A. In S500, system 130 determines whether the network performance determined in S425 is below a further threshold. This further threshold is lower than the first threshold applied in S430. If the network performance is not below the further threshold, system 130 reduces the collection rate to an intermediate level (e.g., 50%) in S505. System 130 applies the intermediate collection rate (e.g., 50%) and withholds the collection of some of the data in the second set of missing data in the first measurement data. System 130 sends a retry request to the first set of endpoints 110a to obtain some of the missing measurement data items (e.g., 50%).
[0067] If, in S500, the system 130 determines that the network performance is below a further threshold, in S510, the system 130 reduces the collection rate to a level lower than the intermediate collection rate level (i.e., 0%). Subsequently, the system 130 withholds sending a retry request to collect the measurement data in the second set of missing data in the first measurement data.
[0068] If the network performance determined in S500 is not below the threshold, in S515, system 130 maintains the default collection rate and collects all data in the second set of missing data in the measurement data.
[0069] Although not shown in Figure 5, system 130 may further perform steps of monitoring network performance for communication with the second set of endpoints 110b, and adjusting the collection rate of the second set of endpoints 110b depending on whether the network performance for communication with the second set of endpoints 110b is below a further threshold. In other words, system 130 performs steps equivalent to steps S500, S505, S510, and S515, but the target is the second set of endpoints 110b instead of the first set of endpoints 110a.
[0070] Figure 6 shows an example of data that may be stored in system 102. This data is stored in the memory of system 102 (for example, in storage devices 210, 220, 315, and 330). The data includes table 600, which contains the collected network performance levels for communication with each endpoint set. Table 600 includes network performance values for communication with the first set of endpoints 110a, the second set of endpoints 110b, and the third set of endpoints 110c, as well as network performance values for communication with additional endpoint sets (i.e., 4th through 7th) not shown in Figure 1. These performance values are obtained from the collection devices associated with each endpoint set and may, for example, indicate the percentage of measured data items received by each collection device before missing data imputation is performed. Figure 6 further shows examples of threshold levels set to 80% in this example and a further threshold level set to 50% in this example. As shown in Table 600, System 102 sets the collection rate to 100% if the performance value is not below a threshold level, sets the collection rate to 50% if the performance value is below a threshold level but above a further threshold level, and sets the collection rate to 0% if the performance value is below a further threshold level.
[0071] The above description refers to the first set of missing data, the second set of missing data, and the third set of missing data in the first measurement data.
[0072] Figure 7 shows the first measurement dataset 700 sent from the first set of endpoints 110a to the system 130. Different items of the data 700 are sent from different endpoints.
[0073] A first portion 710 of the measurement data 700 is shown. This first portion 710 is received by the system 130 during a first period. The first portion 710 includes a first set of missing data 715. The system 130 sends a retry request in S410 to obtain the measurement data corresponding to these missing data.
[0074] A second portion 720 of the measurement data 700 is shown. This second portion 720 is received by the system 130 during a second period following the point in time when the collection rate decreased. The second portion 720 includes a second set of missing data 725. In S460, the system 130 withholds the collection of at least a portion of the measurement data corresponding to these missing data 725.
[0075] A third portion 730 of the measurement data 700 is shown. This third portion 730 is received by the system 130 during a third period following the point in time when the acquisition rate decreased. The third portion 730 includes a third set of missing data 735. In S497, the system 130 sends a retry request to obtain the measurement data corresponding to these missing data.
[0076] Although the steps are shown in order, in practice, the time spent performing each step may overlap.
[0077] Embodiments of the subject matter and operation described herein are achievable in digital electronic circuits, or in computer software, firmware, or hardware, and include structures disclosed herein and their structural equivalents, or one or more combinations thereof. For example, hardware may include processors, microprocessors, electronic circuits, electronic components, integrated circuits, etc. Embodiments of the subject matter described herein can be implemented using one or more computer programs, i.e., one or more computer program instruction modules, encoded in a computer storage medium for execution by a data processing device or for controlling the operation of a data processing device. Alternatively, or in addition thereto, the program instructions may be encoded in artificially generated propagating signals. For example, the signals may be machine-generated electrical, optical, or electromagnetic signals generated to encode information to be sent to a receiving device suitable for execution by a data processing device. The computer storage medium may include one or more computer-readable storage devices, computer-readable storage boards, random-access memory arrays or serial-access memory arrays or devices, or combinations thereof. Furthermore, the computer storage medium may not be a propagating signal but may be a source or destination of artificially encoded computer program instructions. Computer storage media may be one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices), or may be contained within them.
[0078] While specific configurations have been described, these are merely illustrative and not intended to limit the scope of protection. The concepts of the invention described herein can be implemented in a variety of other forms. Furthermore, various omissions, substitutions, and modifications to the specific embodiments described herein will not deviate from the scope of protection defined in the following claims. Annex A
[0079] A.1 A method for collecting measurement data from multiple endpoints via a network, The system receives first measurement data from a first set of endpoints and second measurement data from a second set of endpoints. During the first period, identify a first set of missing data in the first measurement data, and in response to the identification of the first set of missing data in the first measurement data, send one or more retry requests to collect the data contained in the first set of missing data in the first measurement data at a collection rate associated with the first set of endpoints, During a second period following the first period, identify a plurality of missing values in the second measurement data, and in response to the identification of the plurality of missing values in the second measurement data, send one or more retry requests to collect the data contained in the plurality of missing values in the second measurement data at a collection rate associated with the second set of endpoints, Monitoring network performance for communication with the first set of endpoints, In response to determining that the network performance for communication with the first set of endpoints is below a threshold, To reduce the collection rate associated with the first set of endpoints, During the second period, in response to identifying a second set of missing data in the first measurement data according to the reduced collection rate associated with the first set of endpoints, the collection of at least a portion of the data contained in the second set of missing data is withheld. Methods that include...
[0080] A.2 The method according to paragraph A.1, wherein withholding the collection of at least some of the data contained in the second set of missings includes withholding the collection of all of the data contained in the second set of missings.
[0081] A.3 The method of paragraph A.2, comprising suspending the collection of all data included in the second set of missings in response to determining that the network performance for communication with the first set of endpoints is below a further threshold.
[0082] A.4 Withholding the collection of at least a portion of the data contained in the second set of missing data includes withholding the collection of a portion of the data contained in the second set of missing data, The method includes, during the second period, sending one or more retry requests to collect the reduced collection rate data included in the second plurality of missings in the first measurement data. The method described in paragraphs A.1 to A.3.
[0083] A.5 The method of paragraph A.4, which includes performing a hold on collecting some of the data included in the second set of missings in response to determining that the network performance for communication with the first set of endpoints is below but not below a further threshold.
[0084] A.6 Determining whether the network performance is below a further threshold, Depending on whether the network performance is determined to be below the further threshold, the collection rate associated with the first set of endpoints is reduced to a certain level. The method described in any of paragraphs A.1 to A.5, including the method described in paragraphs A.1 to A.5.
[0085] A.7 Following the second period described above, In response to determining that the network performance for communication with the first set of endpoints is no longer below the threshold, Restoring the collection rate associated with the first set of endpoints from the reduced collection rate to a previous value, In response to identifying a third set of missing data in the first measurement data, one or more retry requests are sent to collect the recovered collection rate data included in the third set of missing data in the first measurement data. The method described in any of paragraphs A.1 to A.6, including the method described in paragraphs A.1 to A.6.
[0086] A.8 Receiving the first measurement data from the first set of endpoints using the first communication technology, The second communication technology allows for the reception of the second measurement data from the second set of endpoints, The method described in any of paragraphs A.1 to A.7, including the method described in paragraphs A.1 to A.7.
[0087] A.9 The method of any of paragraphs A.1 to A.8, wherein determining that the network performance for communication with the first set of endpoints is below the threshold includes determining that no packets have been received from the first set of endpoints for a predetermined period of time.
[0088] A.10 Each of the endpoints is a smart meter, as described in any of paragraphs A.1 to A.9.
[0089] A.11 Monitoring the network performance for communication with the first set of endpoints includes determining the percentage of items of the first measurement data that were correctly received from the first set of endpoints, Determining that the network performance for communication with the first set of endpoints is below the threshold includes determining that the proportion of the item is below a predetermined level. The method described in any of paragraphs A.1 to A.10.
[0090] A.12 The plurality of endpoints includes a set of plurality of endpoints, which includes a first set of endpoints and a second set of endpoints. The method described above, for each set of endpoints, Monitoring network performance for communication with each set of endpoints, The system stores the network performance metrics associated with each set of endpoints, In response to determining that the network performance for communication with each of the aforementioned sets of endpoints is below the threshold, the collection of at least a portion of the missing data in the measurement data received from each of the aforementioned sets of endpoints is withheld. The method described in any of paragraphs A.1 to A.11, including the method described in any of paragraphs A.1 to A.11.
[0091] A.13 The method according to any of paragraphs A.1 to A.12, wherein the collection rate associated with the first set of endpoints during the first period is the same as the collection rate associated with the second set of endpoints during the second period.
[0092] A.14 A data processing system that collects measurement data from multiple endpoints via a network, The data processing system comprises at least one processor and at least one memory containing a set of computer-readable instructions, and when the computer-readable instructions are executed by the at least one processor, the data processing system The system receives first measurement data from a first set of endpoints and second measurement data from a second set of endpoints. During the first period, identify a first set of missing data in the first measurement data, and in response to the identification of the first set of missing data in the first measurement data, send one or more retry requests to collect the data contained in the first set of missing data in the first measurement data at a collection rate associated with the first set of endpoints, During a second period following the first period, identify a plurality of missing values in the second measurement data, and in response to the identification of the plurality of missing values in the second measurement data, send one or more retry requests to collect the data contained in the plurality of missing values in the second measurement data at a collection rate associated with the second set of endpoints, Monitoring network performance for communication with the first set of endpoints, In response to determining that the network performance for communication with the first set of endpoints is below a threshold, To reduce the collection rate associated with the first set of endpoints, During the second period, in response to identifying a second set of missing data in the first measurement data according to the reduced collection rate associated with the first set of endpoints, the collection of at least a portion of the data contained in the second set of missing data is withheld. A data processing system that performs methods including those mentioned above.
Claims
1. A method for collecting measurement data from multiple endpoints via a network, The system receives first measurement data from a first set of endpoints and second measurement data from a second set of endpoints. During the first period, identify a first set of missing data in the first measurement data, and in response to the identification of the first set of missing data in the first measurement data, send one or more retry requests to collect the data contained in the first set of missing data in the first measurement data at a collection rate associated with the first set of endpoints, During a second period following the first period, identify a plurality of missing values in the second measurement data, and in response to the identification of the plurality of missing values in the second measurement data, send one or more retry requests to collect the data contained in the plurality of missing values in the second measurement data at a collection rate associated with the second set of endpoints, To monitor network performance for communication with the first set of endpoints, In response to determining that the network performance for communication with the first set of endpoints is below a threshold, To reduce the collection rate associated with the first set of endpoints, During the second period, in response to identifying a second set of missing data in the first measurement data according to the reduced collection rate associated with the first set of endpoints, the collection of at least a portion of the data contained in the second set of missing data is withheld. Methods that include...
2. The method according to claim 1, wherein withholding the collection of at least a portion of the data contained in the second plurality of missing data includes withholding the collection of all data contained in the second plurality of missing data.
3. The method of claim 2, comprising, in response to determining that the network performance for communication with the first set of endpoints is below a further threshold, performing a hold on collecting all data included in the second set of missings.
4. Withholding the collection of at least a portion of the data included in the second plurality of missing data includes withholding the collection of a portion of the data included in the second plurality of missing data, The method includes, during the second period, sending one or more retry requests to collect the reduced collection rate data included in the second plurality of missings in the first measurement data. The method according to claim 1.
5. The method of claim 4, comprising, in response to determining that the network performance for communication with the first set of endpoints is below but not below a further threshold, performing a hold on collecting a portion of the data included in the second set of missings.
6. To determine whether the aforementioned network performance is below a further threshold, Depending on whether the network performance is determined to be below the further threshold, the collection rate associated with the first set of endpoints is reduced to a certain level. The method according to claim 1, including the method described in claim 1.
7. Following the second period mentioned above, In response to determining that the network performance for communication with the first set of endpoints is no longer below the threshold, Restoring the collection rate associated with the first set of endpoints from the reduced collection rate to a previous value, In response to identifying a third set of missing data in the first measurement data, one or more retry requests are sent to collect the recovered collection rate data included in the third set of missing data in the first measurement data. The method according to claim 1, including the method described in claim 1.
8. The first communication technology is used to receive the first measurement data from the first set of endpoints, The second communication technology allows for the reception of the second measurement data from the second set of endpoints, The method according to claim 1, including the method described in claim 1.
9. The method according to claim 1, wherein determining that the network performance for communication with the first set of endpoints is below the threshold includes determining that no packets have been received from the first set of endpoints for a predetermined period of time.
10. The method according to claim 1, wherein each of the endpoints includes a smart meter.
11. Monitoring the network performance for communication with the first set of endpoints includes determining the percentage of items of the first measurement data that were correctly received from the first set of endpoints. Determining that the network performance for communication with the first set of endpoints is below the threshold includes determining that the proportion of the item is below a predetermined level. The method according to claim 1.
12. The plurality of endpoints includes a set of plurality of endpoints, which includes a first set of endpoints and a second set of endpoints. The method described above, for each set of endpoints, Monitoring network performance for communication with each set of endpoints, The system stores the network performance metrics associated with each set of endpoints, In response to determining that the network performance for communication with each of the aforementioned sets of endpoints is below the threshold, the collection of at least a portion of the missing data in the measurement data received from each of the aforementioned sets of endpoints is withheld. The method according to claim 1, including the method described in claim 1.
13. The method according to claim 1, wherein the collection rate associated with the first set of endpoints during the first period is the same as the collection rate associated with the second set of endpoints during the second period.
14. A data processing system that collects measurement data from multiple endpoints via a network, The data processing system comprises at least one processor and at least one memory containing a set of computer-readable instructions, and when the computer-readable instructions are executed by the at least one processor, the data processing system The system receives first measurement data from a first set of endpoints and second measurement data from a second set of endpoints. During the first period, identify a first set of missing data in the first measurement data, and in response to the identification of the first set of missing data in the first measurement data, send one or more retry requests to collect the data contained in the first set of missing data in the first measurement data at a collection rate associated with the first set of endpoints, During a second period following the first period, identify a plurality of missing values in the second measurement data, and in response to the identification of the plurality of missing values in the second measurement data, send one or more retry requests to collect the data contained in the plurality of missing values in the second measurement data at a collection rate associated with the second set of endpoints, To monitor network performance for communication with the first set of endpoints, In response to determining that the network performance for communication with the first set of endpoints is below a threshold, To reduce the collection rate associated with the first set of endpoints, During the second period, in response to identifying a second set of missing data in the first measurement data according to the reduced collection rate associated with the first set of endpoints, the collection of at least a portion of the data contained in the second set of missing data is withheld. A data processing system that performs methods including those mentioned above.
15. A non-temporary computer-readable medium for storing a computer program including a set of computer-readable instructions, wherein the computer-readable instructions, when executed by at least one processor of a data processing system, cause a method to be executed. The aforementioned method, The system receives first measurement data from a first set of endpoints and second measurement data from a second set of endpoints. During the first period, identify a first set of missing data in the first measurement data, and in response to the identification of the first set of missing data in the first measurement data, send one or more retry requests to collect the data contained in the first set of missing data in the first measurement data at a collection rate associated with the first set of endpoints, During a second period following the first period, identify a plurality of missing values in the second measurement data, and in response to the identification of the plurality of missing values in the second measurement data, send one or more retry requests to collect the data contained in the plurality of missing values in the second measurement data at a collection rate associated with the second set of endpoints, To monitor network performance for communication with the first set of endpoints, In response to determining that the network performance for communication with the first set of endpoints is below a threshold, To reduce the collection rate associated with the first set of endpoints, During the second period, in response to identifying a second set of missing data in the first measurement data according to the reduced collection rate associated with the first set of endpoints, the collection of at least a portion of the data contained in the second set of missing data is withheld. Non-temporary computer-readable media, including [specific examples of such media].