System and method for smart plug operation
The method uses smart plugs and network data to accurately disaggregate power usage at the device level, addressing the inefficiencies of existing systems by combining power and network monitoring for precise consumption analysis.
Patent Information
- Application Number
- JP2024146246
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2018-11-02
- Filing Date
- 2024-08-28
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-10-01
AI Technical Summary
Existing power monitoring systems struggle to accurately disaggregate electricity usage at the device level, requiring significant manual effort and lacking precision in identifying individual device consumption within a building.
A computer-implemented method using smart plugs and network connections to determine power main association, collect and compare power monitoring signals, and train mathematical models to identify devices and their status changes, combining power and network data for enhanced accuracy.
Improves the accuracy of identifying individual device power usage and status changes by leveraging smart plug and network data, reducing manual effort and enhancing precision in power consumption analysis.
Smart Images

Figure 2024164225000001_ABST
Abstract
Description
[Technical field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application (SAGE-0006-WO) claims priority to U.S. Provisional Patent Application No. 62 / 740,201, filed October 2, 2018, and entitled “POWER MONITORING USING SMART PLUGS” (SAGE-0006-P01).
[0002] This application is also a joint venture with U.S. non-provisional patent application Ser. No. 16 / 179,567 (SAGE-0006-U01), entitled “DETERMINING A POWER MAIN OF A SMART PLUG,” filed on November 2, 2018, U.S. non-provisional patent application Ser. No. 16 / 179,598 (SAGE-0006-U02), entitled “IDENTIFYING DEVICES CONNECTED TO A SMART PLUG,” filed on November 2, 2018, and U.S. non-provisional patent application Ser. No. 16 / 179,598 (SAGE-0006-U02), entitled “TRAINING A MATHEMATICAL MODEL FOR A DEVICE USING A SMART PLUG,” filed on November 2, 2018, This application claims priority to and is a continuation of U.S. Nonprovisional Patent Application No. 16 / 179,619 (SAGE-0006-U03), entitled "PATENT SYSTEM AND METHOD FOR USE IN AN IMPROVED SYSTEM FOR USE IN A COMPLEX ...
[0003] U.S. Nonprovisional Patent Application No. 16 / 179,567, filed November 2, 2018, claims priority to U.S. Provisional Patent Application No. 62 / 740,201, filed October 2, 2018 (SAGE-0006-P01).
[0004] U.S. Nonprovisional Patent Application No. 16 / 179,598, filed November 2, 2018, claims priority to U.S. Provisional Patent Application No. 62 / 740,201, filed October 2, 2018 (SAGE-0006-P01).
[0005] U.S. Nonprovisional Patent Application No. 16 / 179,619, filed November 2, 2018, claims priority to U.S. Provisional Patent Application No. 62 / 740,201, filed October 2, 2018 (SAGE-0006-P01). [Background technology]
[0006] Reducing electricity or power usage provides benefits, among others, including saving money by reducing payments to power companies and protecting the environment by reducing the amount of resources required to generate electricity. Therefore, power users, such as consumers, businesses and other organizations, want to reduce their power consumption to obtain these benefits. Users can reduce their power consumption more effectively if they have information about which devices in their homes and buildings (e.g., refrigerators, ovens, dishwashers, furnaces and light bulbs) are using the most power and what measures can be used to reduce power consumption.
[0007] To obtain information about electricity used by many devices in a building, power monitors can be deployed on electrical panels. Power monitors on electrical panels are convenient because a single monitor provides aggregate usage information about many devices. However, it is more difficult to extract more detailed information about power usage by a single device because the monitor typically measures signals that reflect the collective operation of many devices that may overlap in complex ways. The process of obtaining information about power usage of a single device from electrical signals corresponding to usage by many devices can be called usage disaggregation.
[0008] Individual device power monitors can also be used to measure the power usage of a single device. For example, a device can be connected to a smart plug, which can then be plugged into a wall outlet. Although these smart plugs can provide information about the power usage of the devices they power, monitoring all or many devices in a home or building with these smart plugs may be impractical due to the large number of smart plugs required, which would be costly and would require significant manual effort to deploy. Summary of the Invention [Problem to be solved by the invention]
[0009] There is a need for more accurate usage decomposition methods so that end users receive accurate information regarding the power usage of individual devices in order to provide maximum benefit to the end user. [Means for solving the problem]
[0010] According to an exemplary and non-limiting embodiment, a computer-implemented method for determining a power main associated with a smart plug includes establishing a network connection with a smart plug receiving power from a building electrical main to provide power to one or more devices; receiving a smart plug power monitoring signal over the network connection indicating an amount of power the smart plug is providing to the one or more devices; and determining whether a first power main is associated with a smart plug. acquiring a first mains power monitoring signal using measurements from a first sensor measuring an electrical characteristic of a first electrical main of the building; acquiring a second mains power monitoring signal using measurements from a second sensor measuring an electrical characteristic of a second electrical main of the building; identifying a plurality of event time points corresponding to events in the smart plug power monitoring signal; collecting a smart plug portion of the smart plug power monitoring signal corresponding to each event time point of the plurality of event time points; collecting a first mains portion of the first mains power monitoring signal corresponding to each event time point of the plurality of event time points; collecting a second mains portion of the second mains power monitoring signal corresponding to each event time point of the plurality of event time points; determining that the smart plug is receiving power from the first electrical main by comparing the smart plug portion to the first mains portion and comparing the smart plug portion to the second mains portion; and updating an entry in the data store to indicate that the smart plug is receiving power from the first electrical main.
[0011] According to another exemplary and non-limiting embodiment, a computer-implemented method for determining that a first device is connected to a smart plug includes establishing a network connection with a smart plug supplying power to one or more devices; receiving a smart plug power monitoring signal over the network connection indicating an amount of power the smart plug is supplying to the one or more devices; obtaining the first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of a building; identifying a smart plug power event corresponding to an event time point in the smart plug power monitoring signal; identifying the first mains power event in the first mains power monitoring signal using the event time point; determining that the first mains power event corresponds to the first device by processing the first mains power event using a plurality of power models; determining that the first mains power event corresponds to the first device using the determination that the first mains power event corresponds to the first device; and updating an entry in a data store to indicate that the first device is receiving power from the smart plug.
[0012] According to another exemplary and non-limiting embodiment, a computer-implemented method for training a mathematical model of a first device includes receiving a smart plug power monitoring signal indicative of an amount of power a smart plug is providing to one or more devices including the first device; identifying a plurality of ON actuation time points corresponding to the smart plug power monitoring signal transitioning from zero power to non-zero power; identifying a plurality of OFF actuation time points corresponding to the smart plug power monitoring signal transitioning from non-zero power to zero power; obtaining the first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of a building; and identifying power events in the first mains power monitoring signal, each power event corresponding to an event time point. the power events into a plurality of clusters; selecting a first cluster from the plurality of clusters using (i) the plurality of on-operation times and (ii) event time points of the power events of the first cluster; selecting a second cluster from the plurality of clusters using (i) the plurality of off-operation times and (ii) event time points of the power events of the second cluster; training a first transition model for the first device using one or more of the power events of the first cluster; training a second transition model for the first device using one or more of the power events of the second cluster; and identifying a state change of the device using the first transition model and the second transition model.
[0013] The invention and the following detailed description of some of its embodiments can be understood by reference to the following figures. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is an example system that uses power and network monitoring to identify devices and device state changes. [Diagram 2] FIG. 2 is an example system for power monitoring and network monitoring showing electrical mains and circuits. [Figure 3A] FIG. 3A is an example of power monitoring signals from a mains and a smart plug. [Figure 3B] FIG. 3B is an example of power monitoring signals from a mains and a smart plug. [Figure 3C] FIG. 3C is an example of power monitoring signals from a mains and a smart plug. [Figure 4] FIG. 4 is an example of a system for power monitoring and network monitoring services. [Diagram 5] FIG. 5 shows an example of a device list. [Figure 6] FIG. 6 is a flow chart of an example implementation for identifying the electrical main that supplies power to a smart plug. [Figure 7] FIG. 7 is a flowchart of an example implementation for determining that a device is receiving power from a smart plug. [Figure 8A] FIG. 8A is a flow chart of an example implementation of using mains power monitoring signals and smart plug power monitoring signals to identify device state changes. [Figure 8B] FIG. 8B is a flow chart of an example implementation of using mains power monitoring signals and smart plug power monitoring signals to identify device state changes. [Figure 9] FIG. 9 is a flowchart of an example implementation of training a device transition model using smart plug power monitoring signals. [Figure 10] FIG. 10 is a flowchart of an example implementation of using smart plug power monitoring signals to train a transition model for a device having three or more states. [Figure 11A] FIG. 11A is an example of a state model of a device. [Figure 11B] FIG. 11B is an example of a state model of the device. [Figure 12A] FIG. 12A is an example of a power monitoring signal of a device. [Figure 12B]FIG. 12B is an example of a power monitoring signal for a device. [Figure 13] FIG. 13 is an example of an apparatus for processing a smart plug power monitoring signal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Described herein is a method for identifying devices and determining information about changes in state of devices in a building. One data source in determining information about devices in a building is the power lines that power the devices in the building. Electrical sensors can be placed on the power line (or lines) that power the building and use decomposition methods can be used to determine information about individual devices in the building. For example, electrical measurements can be used to determine information about devices using any of the methods described in U.S. Patent No. 9,443,195, which is incorporated herein by reference in its entirety for all purposes.
[0016] Another data source for identifying devices or determining information about status changes of devices in a building is a computer network in the building. A building can have a network, such as a local area network, and devices can connect to the network via wires (e.g., Ethernet cables) or wirelessly (e.g., Wi-Fi). A building can have multiple networks, such as a local area network coordinated by a wireless router, a mesh network formed by other cooperating devices (e.g., Sonos speakers), or a personal area network (e.g., Bluetooth connections between devices). For example, the network data can be used to determine information about the devices using any of the methods described in U.S. Patent No. 9,699,529, which is incorporated herein by reference in its entirety for all purposes.
[0017] Some devices are powered by the power lines in the building but do not have a network connection (e.g., a traditional refrigerator). Some devices are powered by the power lines in the building and have a network connection (e.g., a "smart" refrigerator). Some devices have a network connection but are not powered by the power line (e.g., a mobile device such as a smartphone), or are only occasionally powered by the power line (e.g., when charging). The methods described herein can provide more and / or more accurate information about the devices in the building by using a combination of information from the power line and information from the network in the building.
[0018] Using information from the power line and from the network within the building, a service can be provided that informs users about the status of devices within the building. A company can provide a power monitoring device (or power monitor) that can be deployed within a building and connected to both the building's power line and computer network. The power monitoring device can use both the power line and network data to determine information about what devices are present within the building and the state of the devices (e.g., on or off). This information can then be made available to the user, such as by a dedicated application or app (e.g., on a smartphone) or presented on a web page. The service can provide users with information about the devices within the building, such as real-time information about the status of the devices, real-time power usage by the devices, and historical information about the activity of the devices.
[0019] A building may also include a device known as a "smart plug." A smart plug may provide information about the power consumption of a device that receives power from the smart plug. For example, a smart plug may be plugged into a conventional power outlet to allow a device to connect to the smart plug. Thus, the device receives power through the smart plug. A smart plug may include functionality that provides information about the power provided to a device connected to the smart plug. For example, a smart plug may include one or more sensors that measure an electrical characteristic (e.g., current, voltage, or power) of the power provided to a device connected to the smart plug. This sensor data may be used to determine the amount of power consumed by the device over a period of time. A smart plug may also have a network connection (e.g., Wi-Fi or Bluetooth) to transmit information about the power usage of a device connected to another device, such as a smartphone. A smart plug may also have other functionality. For example, a smart plug may have a relay that starts and stops the flow of electricity to a device connected to the smart plug, and a user may have an app on the smartphone that allows the user to control this relay.
[0020] The power monitor can receive information from the smart plug to improve the services it provides. For example, the power monitor can have a network connection with the smart plug and receive information from the smart plug regarding the amount of power the smart plug has provided to devices connected to the smart plug.
[0021] For clarity of explanation, the methods described herein use a residence or home as an example of a building to which the methods may be applied, but the methods described herein are equally applicable to any environment in which electricity is used, including, but not limited to, business and commercial buildings, government buildings, and other venues, and references throughout to a home should be understood to include such other venues.
[0022] Power Monitor Environment Figure 1 is an example of a system 100 in which power and network monitoring can be used to determine information about devices in a home. In Figure 1, a power company 120 provides power to a home 110. The power is transmitted to an electrical panel 140 where it can be distributed to different electrical circuits in the home.
[0023] Electrical panel 140 can be any electrical panel found in a building. For example, electrical panel 140 can implement split-phase electric power using a split-phase transformer to convert a 240 volt electrical signal to a three-wire distribution that includes a single ground and two mains (or phases or legs) that each supply 120 volts. Some devices in the home can get 120 volts using one of the two mains, other devices in the home can get 120 volts using the other main, and still other devices can get 240 volts using both mains simultaneously.
[0024] Any type of electrical panel may be used, and the methods described herein are not limited to single-phase, three-wire electrical panels. For example, the electrical panel 140 may be single-phase, two-phase, or three-phase. The methods are also not limited to the number of mains provided by the electrical panel 140. In the following description, the electrical panel 140 is described as having two mains, but any number of mains may be used, including only one main. As will be appreciated by those skilled in the art, other voltage standards, such as for other countries or continents, are intended to be included herein.
[0025] 1 shows devices consuming power provided by electrical panel 140. For example, power monitor 150, refrigerator 160, and stove 165 may consume power provided through electrical panel 140.
[0026] The power monitor 150 may be connected to sensors 130 that measure electrical characteristics of the power lines connected to the residence 110. For example, the sensors 130 may measure the voltage and / or current levels of the power lines that supply power to the electrical panel 140. These measurements may be obtained using any available sensor, and the method is not limited to any particular sensor or to any particular type of value that may be obtained from the sensor. The sensors 130 may include multiple sensors, such as one or more sensors for each main.
[0027] The sensors 130 may provide the power monitor 150 with one or more power monitoring signals, such as current and / or voltage measurements for each main connected to the electrical panel 140. The power monitor 150 may process the power monitoring signals to break them down into usage or obtain information about individual devices in the home. For example, the power monitor 150 may identify changes in the state of devices, such as a television being turned on at 8:30 PM, or a refrigerator compressor starting up at 10:35 AM and 11:01 AM.
[0028] The power monitor 150 may be a device acquired separately from the electrical panel 140 and may be installed by a user or electrician to connect to the electrical panel 140. The power monitor 150 may be part of the electrical panel 140 or may be installed by the manufacturer of the electrical panel 140. The power monitor 150 may also be part of (e.g., integral or integrated with) an electric meter, such as one provided by an electric utility company, sometimes referred to as a smart meter.
[0029] Power monitor 150 may use any suitable method for performing usage decomposition or determining information about the power usage or status of individual devices from the power monitoring signals, for example, power monitor 150 may use any of the methods described in U.S. Patent No. 9,443,195.
[0030] The power monitor 150 can be connected to a computer network in the home. For example, the power monitor 150 can have a wired connection to a router in the home (e.g., LAN Ethernet), a wireless connection to the network (e.g., Wi-Fi), or a direct network connection to other devices (e.g., Bluetooth). In these implementations, the power monitor 150 is also a network monitor, but for clarity of explanation, the following description continues to use the term power monitor.
[0031] FIG. 1 illustrates a network connection between the power monitor and other devices in the home. In this example, the power monitor 150 has a network connection with a network device 115, which may be any device that facilitates networking in the home, such as a modem, router, or hub. Other devices in the home may also be connected to the network device 115. For example, a television 125 (e.g., a smart television), a computer 135 (e.g., a personal computer), a smart plug 145 (e.g., a Phillips Hue or Belkin Wemo switch), and a phone 170 (e.g., an Android phone or iPhone) may also be connected to the home network. The power monitor 150 may connect to other devices in the home using any suitable wired or wireless network configuration, such as a LAN Ethernet or a direct connection with other devices. In some implementations, the power monitor 150 may communicate on multiple networks simultaneously (e.g., a Wi-Fi connection with a home router and a Bluetooth connection to a specific device).
[0032] 2 is an example of a system 200 showing two mains and four circuits in a home such as the home of system 100. However, the methods described herein apply to any number of mains and circuits.
[0033] 2, power company 120 provides two electrical mains of power, e.g., a first electrical main and a second electrical main that is 180 degrees out of phase. Power monitor 150 can have a first sensor 231 that measures an electrical characteristic of the first main to obtain a first main power monitoring signal, and a second sensor 232 that measures an electrical characteristic of the second main to obtain a second main power monitoring signal.
[0034] The two power mains can be distributed to devices in the home via multiple electrical circuits. For example, a first-main bus bar 211 can distribute first main power to circuits 221 and 222, and a second-main bus bar 212 can distribute second main power to circuits 233 and 234. A variety of devices can receive power from the electrical circuits shown in Figure 2. It is noted that multiple devices can receive power from a single circuit, and some devices can receive power using both the first and second mains, but these configurations are not shown in Figure 2 for clarity.
[0035] The power monitor 150 may have a network connection with the smart plug 145 and may receive a smart plug power monitoring signal from the smart plug 145 that provides information regarding the power consumption of one or more devices, such as device 155, connected to the smart plug 145. Thus, the power monitor may receive information regarding the power consumption of the device 155 from two sources: (1) a first mains power monitoring signal obtained via the first sensor 231, and (2) a smart plug power monitoring signal obtained from the smart plug 145.
[0036] 3A-3C show examples of a hypothetical first mains power monitoring signal 301, a second mains power monitoring signal 302, and a smart plug power monitoring signal 303 that the power monitor 150 can process.
[0037] In Figure 3A, a first mains power monitoring signal 301 indicates power events resulting from state changes of two devices, a toaster oven and an incandescent light bulb, both of which receive power from a first electrical main in a building. In Figure 3A, a power event labeled HE1 corresponds to the heating element of the toaster oven turning on, and a power event labeled HE0 corresponds to the heating element of the stove turning off (although the toaster oven may appear to the user that the heating element is on, the toaster oven may periodically switch the heating element on and off to maintain a desired temperature). A power event labeled I1 corresponds to the incandescent light bulb turning on, and a power event labeled I0 corresponds to the incandescent light bulb turning off.
[0038] At power event 310, the toaster oven turns on and the heating element consumes electricity, thus increasing the power usage in the first mains power monitoring signal 301. At power event 320, while the heating element is on, the incandescent light bulb also turns on, further increasing the power usage. At power events 330, 340, 350 and 360, the heating element cycles off, on, off, on. At power event 370, the incandescent light bulb turns off, and at power event 380, the toaster oven turns off and the heating element stops consuming electricity.
[0039] In Figure 3B, the second mains power monitoring signal 302 indicates a power event 390 due to a change in state of a device that receives power from a second electrical main in the building. For example, the power event 390 may correspond to the charging of an electric vehicle. Because the devices that change state in Figures 3A and 3B each receive power from a single electrical main, a power event due to the device's change in state will only appear in one of Figures 3A or 3B. For a device that receives power from both electrical mains (e.g., an electric dryer), a power event due to the device's change in state can appear in both Figures 3A and 3B.
[0040] Figure 3C is a smart plug power monitoring signal 303 received from a smart plug connected to the toaster oven of Figure 3 A. Thus, for every state change of the toaster oven, a power event appears on both the first mains power monitoring signal 301 and the smart plug power monitoring signal 303.
[0041] Although the power events resulting from the toaster oven appear in both power monitoring signals (first mains and smart plug), these power events may appear differently in the two power monitoring signals. For example, these two power monitoring signals may measure different electrical properties (e.g., current and voltage), may use different types of physical sensors that produce different readings, may be shifted or transformed in time due to network transmission or other delays, may be scaled differently (e.g., due to different sensor gains), or may be digitally sampled at different sampling rates. For example, in some smart plugs, power events 330, 340, 350, and 360 may not appear in the smart plug power monitoring signal 303 at low sampling rates, and the smart plug power monitoring signal may have a relatively constant value between power event 310 and power event 380.
[0042] Power Monitoring The power monitor 150 may process the first mains power monitoring signal 301 and the second mains power monitoring signal 302 (which may both be referred to as power monitoring signals) to identify devices and / or determine state changes of the devices. Some state changes may correspond to a person turning a device on or off, and some state changes may correspond to a change in the functionality of the device (e.g., a heating element cycling or a washing machine changing from wash mode to spin mode). The power monitor 150 may identify devices and determine state changes of devices from the power monitoring signals using any suitable method, such as any of the methods described in U.S. Pat. No. 9,443,195.
[0043] In some implementations, power monitor 150 may process the power monitoring signals using mathematical models to identify devices and determine device state changes. Such models are referred to as power models. For example, power monitor 150 may have power models for different types of devices (e.g., stoves, dishwashers, refrigerators, etc.), different models of devices (e.g., Kenmore dishwashers, Maytag dishwashers, etc.), different versions of devices (e.g., Kenmore 1000 dishwashers), and specific devices (e.g., 100 Main St. dishwashers). Power monitor 150 may also have power models for specific state changes, such as a device turning on, a device turning off, or a device changing operation differently (the dishwasher's water pump turns on or off). In general, the "1000" in a Kenmore 1000 dishwasher may be referred to as a "model" of the dishwasher, but to avoid confusion with the mathematical models, a "model" of a dishwasher is referred to herein as a "version" instead.
[0044] When a power monitoring signal is processed using a power model, such as any of the power models described above, the power model can generate a score (e.g., probability, likelihood, confidence, etc.) indicative of a match between the power model and the power monitoring signal. When a power event (such as any of the events in Figures 3A-3C) occurs in the power monitoring signal, the portion of the power monitoring signal that includes the power event can be processed by various power models, each of which can generate a score. These power model scores can be used to identify devices in the home and / or determine state changes of devices in the home.
[0045] In some implementations, power monitoring may proceed as follows: The power monitoring signal may be continuously processed to identify power events in the power monitoring signal. A power event detection component may detect changes in the electrical signal that are likely to correspond to a change in state of the device, such that those portions of the power monitoring signal are further processed. The power event detection component may be implemented using any suitable technique, such as a classifier.
[0046] After a power event is detected, a feature generation component can be used to generate features from the portion of the power monitoring signal that includes the power event. Any suitable features can be calculated, such as any of the features described in U.S. Patent No. 9,443,195.
[0047] The features can then be processed by one or more power models to identify the device or to determine a state change of the device corresponding to the power event. Any suitable power model can be used, such as a transition model, a device model (also referred to herein as a state model), a wattage model, and a conventional model such as that described in U.S. Patent No. 9,443,195. For example, each power model can generate a score, and the state change of the device can be determined by selecting the power model with the highest score.
[0048] The following describes how power models can be used to identify devices in a home. In some implementations, the power monitor 150 can be populated with an initial set of power models that correspond to devices that are likely to be present in the home.
[0049] In some implementations, power monitor 150 may identify a device as present in the home if the score generated by the power model is above a threshold. For example, a dishwasher model may generate a score above a threshold when processing a portion of a power monitoring signal corresponding to the dishwasher starting. The threshold may be specific to the dishwasher model or may be the same for all power models. In some implementations, a confidence level may be calculated in addition to or instead of the score, and a device is identified when the confidence level is above a threshold.
[0050] In some implementations, further criteria may be considered before identifying the device. For example, power monitor 150 may have multiple dishwasher power models corresponding to different types of dishwashers (e.g., normal dishwashers and energy-efficient dishwashers), or there may be power models for different makes of dishwashers. When processing a power monitoring signal corresponding to starting a dishwasher, multiple dishwasher models may generate scores (or confidence levels) above a threshold. Rather than identifying multiple dishwashers, a single dishwasher may be identified corresponding to the model with the highest score above the threshold. For example, power monitor 150 may have power models for Kenmore dishwashers and Bosch dishwashers. Each model may generate a score above the threshold, but the Kenmore model may have a higher score than the Bosch model. Thus, the Kenmore dishwasher may be identified.
[0051] In some implementations, after a device is identified, power monitor 150 may be updated with additional power models. For example, after it is determined that a dishwasher is present in the home, a power model corresponding to the most common type of dishwasher may be added to power monitor 150. The power monitoring signals may then be processed using power models for different types of dishwashers, and the highest scoring power model may be used to identify the type of dishwasher in the home. This process may be repeated to determine additional information, such as the version of the dishwasher (e.g., a Kenmore 1000 dishwasher).
[0052] After the devices in the home are identified, power monitor 150 can process the power monitoring signals to determine state changes of the identified devices. In addition to having power models for particular devices, power monitor 150 can also have models for particular state changes of the devices and can use these models to determine when the devices change state.
[0053] As described above, the power monitoring signal may be processed using a power model for the device state change to generate a score of a possible state change. If the score (or confidence level) is above a threshold, the power monitor 150 may determine that a state change corresponding to the model has occurred. For example, the power monitor 150 may have power models for the start-up and end-of-life operations of a dishwasher. If the power model for starting the dishwasher produces a score above a threshold, the power monitor 150 may determine that the dishwasher has started. Similarly, if the power model for ending the dishwasher produces a score above a threshold, the power monitor 150 may determine that the dishwasher has completed its cycle.
[0054] The power model for determining a state change need not be the same as the power model for identifying a device, and the thresholds used to determine a state change need not be the same as the thresholds used to identify a device. The models and thresholds can be adjusted to obtain a desired tradeoff between accuracy and error rate.
[0055] Aspects of the operations for identifying devices and determining state changes for devices described above may also be performed by another computer (e.g., a server computer operating in conjunction with the power monitor) instead of power monitor 150. For example, in some implementations, power monitor 150 may provide power monitoring signals to another computer (e.g., a server), which may identify devices and state changes. In some implementations, the other computer may identify devices and power monitor 150 may determine state changes for devices.
[0056] Network Monitoring In some implementations, the power monitor 150 can be connected to a computer network in the home. For example, the power monitor 150 can have a wired connection to a router in the home (e.g., LAN Ethernet), a wireless connection to the network (e.g., Wi-Fi), or a direct network connection to other devices (e.g., Bluetooth). In these implementations, the power monitor 150 is also a network monitor, but for clarity, the following description continues to use the term power monitor. The power monitor 150 can identify devices from the network data and determine device state changes using any suitable method, such as any of the methods described in U.S. Pat. No. 9,699,529.
[0057] The power monitor 150 can learn about devices in the home using data transmitted over a computer network. For example, the power monitor 150 can listen for broadcast messages from other devices, poll other devices, or listen for network data generated by other devices. In some implementations, the power monitor 150 can indirectly learn about other devices in the home via a network outside the home. For example, devices in the home can send information to a third-party server that operates with the device, and the third-party server can send information to a server that operates with the power monitor 150. Each of these methods can be used to identify devices in the home and determine state changes of the devices (e.g., whether the device is on or off).
[0058] In some implementations, devices in the home may transmit data containing information about themselves (e.g., in broadcast messages or in response to polls). For example, the network transmission may include any of the following: status (e.g., the device was just turned on or is about to be turned off), the services the device offers, a user-assigned name (e.g., "John's Mac"), model, hardware version, software version, network address (e.g., IP address), identification number (e.g., MAC address, device serial number, universally unique identifier, globally unique identifier, or temporary identifier), or other information (e.g., a protocol-specific identification (such as a Zeroconf service name) or a resource locator used with the SSDP protocol).
[0059] Power monitor 150 can learn information about other devices by listening to broadcast messages from other devices (broadcast equipment). Some devices can be configured to broadcast information throughout the network that informs of services or capabilities that the device offers to other devices on the network. For example, a television may offer a service that allows other devices (e.g., phones or personal computers) to stream video content that the television displays to the television, and can broadcast a message on the network so that other devices know that this service is available.
[0060] Information from the broadcast message can be used to identify devices in the home. For example, the message can include data that can be used to identify the device, such as text or an identifier that describes the device. Information from the broadcast message can also be used to determine the state of the device. For example, a service availability notification can indicate that the device is on, and a service withdrawal notification can indicate that the device is off. In some implementations, the broadcast message can provide some information about the device, and when the power monitor 150 receives the broadcast message, it can poll the device to obtain additional information about the device's state. For example, a network speaker system can broadcast that a service is available, and the power monitor 150 can then poll the network speaker system to discover that it is currently playing music and information about the music being played (e.g., the name of the song, the volume, etc.).
[0061] The power monitor 150 may also use polling techniques to learn information about other devices. Polling a device may be done using any suitable polling technique. In some implementations, the broadcast techniques described above may also enable polling. For example, SSDP may allow a device to poll other devices on the network to determine what services they offer, and the devices may respond with messages similar to the broadcast messages described above. In some implementations, low-level protocol polling such as Internet Control Message Protocol (ICMP) pings or Address Resolution Protocol (ARP) pings may also be used.
[0062] Information from the poll response can also be used to identify devices in the home. For example, the poll response can include data that can be used to identify the device, such as text or an identifier that describes the device. The poll response can also be used to determine the state of the device. For example, no response to a poll request can indicate that the device is off, a response can indicate that the device is on, and the information in the response can provide additional information (e.g., the song that is playing).
[0063] Power monitor 150 can also learn information about other devices by monitoring network data that the devices have sent to other devices. In some implementations, individual device monitoring can be used only with an explicit opt-in by a user, or it can use only network packet headers (and no packet bodies) to avoid collecting too much information or to avoid collecting sensitive information. Power monitor 150 can passively receive this network data over the network, such as by passively receiving network packets.
[0064] The power monitor 150 can process the received data to determine information about the device being monitored. Information in this received data, such as text or an identifier describing the device, can be used to identify the device. The received data can also be used to determine the state of the device. For example, the fact that the device is transmitting data can indicate that the device is on, and if the device does not transmit any data for a period of time, it can be determined that the device is off.
[0065] In some implementations, the power monitor 150 may have information about publicly available APIs of third-party devices and may use these APIs to determine whether such third-party devices are present in the home. For example, the power monitor 150 may use the Nest Thermostat API to periodically send requests to determine whether a Nest Thermostat is present in the home. After determining that a Nest Thermostat is present in the home, it may poll more frequently to determine the status of the Nest Thermostat or the status of the heating / cooling system. These APIs may allow other devices to determine, for example, the temperature of the home, the desired temperature setting by the user, or the status of the heating or cooling system (e.g., whether the boiler is currently running or the start and stop times of the boiler operation). The power monitor 150 may determine the status of the device itself (e.g., the Nest Thermostat) and other devices (e.g., the boiler) connected to it by querying the devices using specialized APIs.
[0066] In some implementations, the power monitor 150 can subscribe to notifications sent by third-party devices, referred to herein as notification devices. Notification devices can be configured to send notifications to other devices (e.g., periodically or upon state change) so that other devices can subscribe to receiving notifications using an API. When the power monitor 150 determines that a notification device is present in the home, it can subscribe to receiving notifications from the device. The power monitor 150 can send a request to receive notifications from a notification device without knowing that the notification device exists, and subscribe to receiving notifications if the notification device is present. Some notification devices can have a pairing procedure that requires user assistance, and the power monitor 150 can be configured to receive input from the user to assist in the pairing process, such as receiving a username and password to pair with the notification device.
[0067] Other third party devices may also provide information about connected or controlled devices, such as the smart switch 340 or smart light bulbs (e.g., Phillips Hue or Belkin Wemo). The smart switch may have an API that allows other devices to interact with the smart switch, and the power monitor 150 may use this API to determine the state of the switch and therefore whether the device connected to the smart switch is consuming power (e.g., the device is on, the device is off, or a dimmer switch is at 40%). Other examples include a smart thermostat that can control a heating or cooling system and send network packets containing information about the state of the heating or cooling system, a device that can control a light (e.g., an LED light) and send network packets containing information about the state of the light, a device that can control a speaker and send network packets containing information about the state of the speaker, a network-connected plug that can control the flow of power to a device connected to the plug and send network packets containing information about whether the power flow is enabled for the connected device, or a car charger that can charge an electric car and send network packets containing information about the car's power consumption.
[0068] In some implementations, the power monitor 150 can receive information about devices in the home via a server outside the home, such as a third-party server that operates with third-party devices in the home. The power monitor 150 can operate with the power monitor server, and the third-party devices in the home can operate with the third-party server. For example, the Nest thermostat can send information about the state of the thermostat or the heating / cooling system of the home to a server operated by Nest. The third-party server can allow a user to provide configuration information that triggers the sending of information from the third-party server to the power monitor server, for example, using the power monitor server's or the third-party server's API. For example, the Nest server can send information received from the Nest thermostat in the home to the power monitor server periodically or when the state of the thermostat changes (or the state of the heating / cooling system changes), etc. In some implementations, the power monitor server can send a request to the third-party server for information about the third-party devices instead of receiving notifications from the third-party server. In some implementations, the third-party devices can communicate directly with the power monitor server, or the power monitor 150 can communicate directly with the third-party server.
[0069] In some implementations, information received in a network transmission from the device can be used to obtain further information about the device. For example, the network transmission can include a unique identifier, such as a media access control (MAC) address. The unique identifier can be used to determine additional information about the device using a data store or repository of information about the device using the unique identifier. The data store can provide information about the type, model, and / or version of the device based on the unique identifier. For example, in a MAC address, a block of contiguous MAC addresses can be unique to a type of device (e.g., a television), manufacturer, or version of the device (e.g., a particular model of television). In some implementations, a data store of MAC address information can be available, such as through a third-party service, and the MAC address can be used to obtain information about the device. To obtain information about the device from the identifier, a data store of identifiers can be created, purchased, or accessed (e.g., using a third-party server).
[0070] In some implementations, a user device such as a smartphone can be used to determine information about devices in the home, and the smartphone can relay this information to the power monitor 150. For example, a speaker (e.g., a portable Bluetooth speaker) may not have a network connection with the network device 115 and instead communicate with other devices using another network, such as a Bluetooth network. The speaker may be too far away from the power monitor 150 for the power monitor to detect the speaker's network. When a user device such as a phone 170 is brought into the same room as the speaker, the phone 170 can use a direct network connection to determine the presence of the speaker and / or the operating state of the speaker. The phone 170 can then relay information about the presence and / or operating state of the speaker to the power monitor 150 or a server working with the power monitor 150.
[0071] In some implementations, a network model can be used to process network data to identify a device or determine the device's status. The network model can include any suitable mathematical model, such as a classifier, a neural network, a self-organizing map, a support vector machine, a decision tree, a random forest, a logistic regression, a Bayesian model, linear and nonlinear regression, and a Gaussian mixture model. The network model can receive data obtained from a network transmission as input and output the device's identification or the device's status change along with any score. For example, the network model can receive information about broadcast messages, poll responses received from the device (or lack thereof), or network data generated by the device. In some implementations, the network model can receive only the header of the network transmission or all the data from the network transmission.
[0072] In some implementations, the network models can be used to identify devices or determine the state of the devices using messages broadcast by the devices. For example, a device may send a certain number and / or type of messages before turning off and a different number and / or type of messages when entering a sleep mode. A first network model can be created that describes the expected messages when the device is about to turn off and a second network model can be created that describes the expected messages when the device is about to enter a sleep mode. When a broadcast message is received from a device, both network models can be used to process the message to generate a score for each network model, and the state transition can be determined by the network model with the highest score.
[0073] Network models can also be created that describe other aspects of the network transmissions described above. For example, a network model can be created that describes how often a device responds to a poll request and the expected delay between sending a poll request and receiving a response. In another example, a network model can be created that describes the expected network transmissions of a device in a particular state and this network model can be applied when passively monitoring the device's network transmissions.
[0074] In some implementations, a rules-based approach may be used to identify devices in the home or to determine the status of the devices. The power monitor 150 (or a server operating with the power monitor) may have rules created to identify the type of device, the model of device, or the version of the device, rules to determine state changes of the device, and rules to determine other aspects of the device. Rules may also be created for any of the methods described above, such as processing broadcast messages from the device, polling the device, or monitoring network data generated by the device.
[0075] Some rules may output a Boolean value indicating whether the conditions of the rule are met. For example, a rule may be created to determine whether the device that transmitted the network data is a television, and if the conditions of the rule are met, the device may be determined to be a television. Some rules may output a score, for example, on a scale of 1 to 100, indicating a match between the network data and the rule. For example, a rule may be created to determine whether the device that transmitted the network data is a television, and the score generated by the rule may be used to make a determination, such as by comparing the score to a threshold or combining the score with other scores as described herein.
[0076] There may be multiple rules for making the determination. For example, there may be multiple rules for determining whether the device that transmitted the network data is a television, and if any one of these rules is satisfied, the device may be determined to be a television.
[0077] Any data in or associated with a network transmission can be used as input to a rule. For example, information extracted from a network transmission (such as a network address, identifier, header, string, etc.) can be used as input to a rule. Information not present in the network transmission but associated with it, such as the time the network transmission was received, can also be used.
[0078] In some implementations, a rule may include one or more conditions that must be met to match the rule. For example, a condition may include any comparison of data, such as not equal, equal, greater than, or less than. A rule may employ any combination of conditions, including but not limited to combinations using Boolean algebra. Examples of rules include that a device broadcasting Zerconf services, including AFP, HTTP, and SSH, is an Apple Mac computer; structured data returned as part of a NetBIOS STATUS poll request provides a user-visible hostname; a device with a previously unknown MAC address making a DHCP request is a new device joining the network for the first time; and the vendor of the device is determined using a known MAC address vendor prefix.
[0079] In some implementations, device fingerprinting can be used to identify devices on a network. Device fingerprints can be created for known devices, such as MAC computers, Windows computers, and Linux computers, and potentially for each different operating system version. The fingerprints can be created by sending multiple requests to each device (e.g., using a program such as Nmap) using, for example, different protocols and port numbers. The responses of each device can be recorded to create a fingerprint for each device. Any suitable data can be used in creating a device fingerprint, such as the number and type of network protocols broadcast by the device, broadcast behavior, the number or frequency of different types of broadcasts, or parameters used for network transmissions (e.g., TCP window size).
[0080] For unknown devices in the home, a similar request can be sent to the device and the response can be used to create a fingerprint of the unknown device. This fingerprint of the unknown device can be compared to fingerprints of known devices to determine information about the unknown device. For example, if the fingerprint of the unknown device closely matches the fingerprint of a MAC laptop, the unknown device can be identified as a MAC laptop. In some implementations, after identifying devices on the network using the Address Resolution Protocol (ARP), each identified device can be fingerprinted using the methods described above.
[0081] Any of the methods of identifying devices or determining device status using network data described above may generate a score indicating a match between the data and the identified device or status change. For example, applying a rule to a broadcast message may determine that it is a Toshiba television with a score of 80% or a Sony television with a score of 60%. As described in further detail below, the scores generated by these network models may be combined with scores generated by the power model.
[0082] Combining power and network monitoring 4 illustrates a system 400 that uses one or both of power and network monitoring to provide a user with information about devices in a home. In FIG. 4, a power monitor 150 can have any of the functions described above. For example, the power monitor 150 can identify the presence of devices in a home, can determine the status of devices in the home, and can determine the power consumption of devices in the home. The power monitor 150 can transmit information about devices in the home to a server 410 using any known network technology. For example, the power monitor can have a wireless connection to a router that connects to the server 410.
[0083] The server 410 can process the information received from the power monitor 150 and present the information to a user, such as through a user device 440. The server 410 can maintain a device list of devices in the home and update the device list with newly identified devices or the latest device status. Additionally, the server 410 can log device status changes, record the history of home and individual device power consumption, and perform any of the other operations described in U.S. Pat. No. 9,443,195. The server 410 can access other resources, such as a third party server 430 and a device information data store 420, to perform some operations.
[0084] A user can obtain information about devices in the home using the user device 440. The user device 440 can be any device that provides information to a user, including, but not limited to, a phone, a tablet, a desktop computer, and a wearable device. The user device 440 can present information to the user, such as device status changes and real-time power usage. For example, the user device 440 can present a web page to the user, or a dedicated app can be installed on the user device 440. The information presented by the user device 440 can include any of the information described in U.S. Pat. No. 9,443,195.
[0085] To provide a user with information about devices in the home, a list of devices in the home can be maintained. Figure 5 shows an example device list 500. The list of devices can include any information about the devices in the home, including, but not limited to, a device ID (which can be specific to all devices known to the home or to a business providing a service), a name (e.g., a user-specified name), a type, model, version, one or more power models used to identify changes in the device's state, a network ID (e.g., a network address or other identifier such as a MAC address), one or more network models used to identify changes in the device's state, the main that supplies power to the device (e.g., primary, secondary, both, or one (e.g., for portable devices that can be plugged into different power outlets)), an identifier of the smart plug to which the device is connected (or an indication that the device is not connected to a smart plug), and the state of the device.
[0086] The device list 500 may be stored in one or more locations. For example, the device list 500 may be stored in one or more of the power monitor 150, the server 410, the device information data store 420, or the user device 440. Different locations may store different versions of the device list corresponding to the processing at that location. For example, the power monitor 150 may not store the device name, type, model, or version because they may not be necessary to determine device state changes. The user device 440 may not store information about the power model and network model because they may not determine device state changes.
[0087] In Figure 1, power monitor 150 may process one or more power monitoring signals and network data to identify devices in the home and identify status changes of devices in the home. Power monitor 150 may receive one or more power monitoring signals from sensors 130 that measure electrical characteristics of the power supplied to residence 110. Power monitor 150 is also connected to a network in residence 110 via network device 115. Power monitor 150 may receive network data from other devices via network device 115 (as indicated by the dotted line) or may receive network data directly from other devices (not shown in Figure 1).
[0088] For some devices in the home, either or both of the power monitoring and the network monitoring may be less accurate or have a higher error rate than desired in identifying the device or a change in the device's state. By using both power monitoring and network monitoring in a coordinated or simultaneous manner, the performance of identifying the device or a change in the device's state may be improved. The simultaneous execution of power monitoring and network monitoring may be performed using any suitable method, such as combining scores, rules, or voting techniques, as described in further detail below.
[0089] In some implementations, the operation of power monitor 150 may vary depending on whether a user is interacting with user device 440 to view information about devices in the home. If a user is using user device 440 to view information about devices in the home, it may be desirable to identify new devices or changes in device status more quickly than when no user is viewing information about devices in the home.
[0090] When a user begins to view information about devices in the home using the user device 440, the user device 440 can establish a network connection with the server 410, which can send information about the devices to the user device 440. The server 410 can also have a network connection (direct or indirect) with the power monitor 150. Thus, the server 410 can send information to the power monitor 150 to cause an operation change of the power monitor 150. Any operation of the power monitor 150 can be changed to improve the user experience of the end user. In some implementations, the power monitor 150 can change its operation to identify new devices and new device state changes more quickly. For example, the power monitor can increase the polling frequency used to poll other devices in the home. If no users are viewing information about the devices, a polling frequency of 5 minutes may be sufficient to check for updates. When a user begins to view information about the devices, the polling frequency can be increased (e.g., 10 seconds) to check for updates more quickly.
[0091] 1 and 2 are merely illustrative of one example of how the methods described herein may be performed, and other configurations are possible. For example, power monitor 150 may perform some or all of the operations of server 410 and may provide information directly to user device 440. In another example, power monitor 150 may include some or all of the functionality of user device 440, and a user may directly interact with power monitor 150 to obtain information regarding device events and power consumption.
[0092] Device Identification When the power monitor 150 is first installed in a home, a device list of devices in the home can be created. In some implementations, an empty device list can be created. In some implementations, the device list can be initialized with devices based on input from one or more people in the home. For example, a user can specify any of the types, models, and / or versions of devices in the residence.
[0093] Power monitor 150 may use either or both of power monitoring and network monitoring to add or update devices in the device list using any of the methods described herein. Devices may be added to the device list after they are identified by the power monitor, and devices on the device list may be further updated as additional information about them is determined. For example, power monitor 150 may first determine that a dishwasher is present in the residence, and subsequently determine that a Kenmore 1000 dishwasher is present in the residence.
[0094] In some implementations, power monitor 150 may add multiple devices to the device list in response to processing a power event of a power monitoring signal. For example, if two power models produce scores above a threshold, a device corresponding to each power model may be added to the device list. In some implementations, the scores produced by the power models may be included in the device list as well.
[0095] Power monitor 150 can also process the network data to identify devices in the home and add them to a device list. For example, power monitor 150 can use any of the methods described above to obtain information about devices connected to the network in the home and then add the devices to the home's device list.
[0096] In some implementations, power monitor 150 may add multiple devices (optionally with scores) to the device list in response to processing a network data transmission. For example, in response to processing a broadcast message, a Toshiba television may be added to the device list with a first score and a Sony television may be added to the device list with a second score.
[0097] The scores of the devices on the device list may be updated over time. For example, processing a first power event may add a first device and a second device to the device list with corresponding scores. At a later point in time, power monitor 150 may process a second power event to generate a second set of scores for the first and second devices. The second set of scores generated using the second power event may be used to update the overall scores of the first and second devices on the device list.
[0098] Similarly, network data transmissions at a later time may be used to update the scores of devices on the device list. For example, a first and second device may be added to the device list with corresponding scores based on processing a first network transmission. At a later time, the power monitor 150 may process a second network transmission to generate a second score for the first and second devices. As described above, a second set of scores generated using this second power transmission may be used to update the overall scores of the first and second devices on the device list.
[0099] In some implementations, a device on the device list can have a score generated using both power monitoring and network monitoring. After processing a power event, a first device can be added to the device list with a corresponding score. The score of the first device can then be updated by processing a first network transmission. Any combination of processing the power event and processing the network transmission event can generate an overall score for the devices on the device list.
[0100] The scores can be combined using any suitable method. In some implementations, the overall score for a device can be the average of all the individual scores generated for that device. In some implementations, the variance for each score can be determined and the scores can be normalized (e.g., Z-scored) before being combined.
[0101] In some implementations, the power monitor can use both power monitoring and network monitoring simultaneously to identify devices. For devices that are connected to the power line and have a network connection, the device can trigger a power event of the power monitoring signal around the time of state change and send data over the network (network event). The power monitor 150 can also process both power events and network events simultaneously to identify devices.
[0102] The power event and the network event can occur in any order. For example, the power event can correspond to a television turning on and the network event can correspond to a broadcast message by the television subsequently announcing the availability of the service. In another example, a user can turn off the television and the network event can be a broadcast message withdrawing the service and the power event can correspond to the television subsequently turning off.
[0103] When processing a power event, the power monitor 150 may look for network events that are close in time to the power event (e.g., within a certain time interval, such as within 1 second) and process them simultaneously. For example, the power monitor 150 may process a network event where the difference between the time of the power event and the time of the network event is less than a threshold. Similarly, when processing a network event, the power monitor 150 may also look for power events that are close in time to the network event.
[0104] In some implementations, power monitor 150 can process the power event and generate a score for the corresponding power model. Power monitor 150 can then look for a network event that is close in time to the power event and use information from the network event to adjust the score generated by the power model. For example, assume that the two highest scoring power models are for a Toshiba television and a Sony television, and their scores are close to each other. Assume that a network event occurs immediately after the power event, and the network event corresponds to the Toshiba television. Power monitor 150 can identify the Toshiba television and add it to the device list after using the network event to increase the score for identifying the Toshiba television.
[0105] The time difference between a power event and a network event can also be used to identify a device. A device may transmit a network event with a consistent delay after triggering a power event, or vice versa. For example, a television, when turned on, may consistently transmit a network event (e.g., broadcast a service) about 3.5 seconds after triggering a power event. The timing of the power event and the network event can be a feature that can be used with any of the identification methods described herein.
[0106] In some implementations, a device identification model may be used that receives both information about power events and information about network events as inputs and then generates a score indicating a match between the inputs and the device. For example, a device identification model may be created for a device type, a device model, or a device version. In some implementations, the power monitor 150 may calculate a score for each device identification model, select the device identification model with the highest score, and use the highest scoring device identification model to identify the device. The device identification model may be created using any suitable classification method, such as neural networks, self-organizing maps, support vector machines, decision trees, random forests, logistic regression, Bayesian models, linear and nonlinear regression, and Gaussian mixture models.
[0107] In some implementations, a confidence level may be calculated in addition to the score and used in determining whether to add a device to the device list or whether to update information about the device in the device list. For example, if only one score is above the threshold and this score is significantly higher than all other scores, the confidence level may be high. If multiple scores are above the threshold, if there are no scores above the threshold, or if the highest score is close to the second highest score, the confidence level may be low. Any suitable method may be used to determine the confidence level of the state change of the highest scoring device. If the highest scoring model (e.g., power model, network model, or device identification model) has a low confidence level, the device list may not be updated.
[0108] Devices can also be removed from the device list. For example, a user can review the device list and remove devices that are not in the home. Devices can also be automatically removed from the device list. For example, devices can be removed if they have not been identified for longer than a threshold period of time, if their overall score is below a threshold, or if enough data has been acquired to distinguish the device from other devices (e.g., enough data has been collected to confidently determine that a television is a Toshiba television and not a Sony television).
[0109] The above described method uses a combination of power and network monitoring to improve identification of devices in a building over methods based on power monitoring alone. Some devices may not be identified at all or may be identified with low accuracy by power monitoring alone. Combining network and power monitoring allows more devices to be identified (such as network devices that do not include mechanical components) and may also identify devices with high accuracy. Using information from both power and network monitoring allows for the creation of models and / or classifiers with lower error rates than models and / or classifiers that only use information from power monitoring.
[0110] Identifying changes in equipment status In addition to identifying devices in the home, power monitor 150 can also determine the state of devices in the home using one or both of power and network monitoring. Some devices (e.g., light bulbs) may have only two states, on and off. Other devices may have multiple states. For example, a washing machine may have a select cycle, a rinse cycle, and a spin cycle. A television may have an on state, an off state, and a sleep state.
[0111] Power monitoring can be used to identify state changes using any of the methods described herein and in U.S. Patent No. 9,443,195. For example, power monitor 150 can process the power monitoring signals, select the power model that produced the highest score, determine the state changes of the devices from this model, and update the states of the devices in the device list.
[0112] Network monitoring can also be used to identify state changes using any of the methods described herein, for example, as described above, a power monitor can process broadcast messages, poll devices, and monitor device network data to determine device state from such network data.
[0113] In some implementations, the power monitor can use both power monitoring and network monitoring simultaneously to identify a state change of the device. For a device connected to both a power line and a network connection, the device can trigger a power event of the power monitoring signal around the time of the state change and send data over the network (network event). The power monitor can process both power events and network events to identify the state change. As mentioned above, the power events and network events can occur in either order.
[0114] As described above, when the power monitor is processing a power event, it can look for network events that are close in time to the power event and process them simultaneously. For example, the power monitor can process a network event where the difference between the time of the power event and the time of the network event is less than a threshold. Similarly, when the power monitor is processing a network event, it can also look for power events that are close in time to the network event.
[0115] In some implementations, the power monitor can process the power event and generate a score for the corresponding power model. The power monitor can then look for a network event that is close in time to the power event and use information from the network event to adjust the score generated by the power model. For example, assume that the two highest scoring power models are a Toshiba TV turning on and a computer turning on, and that their scores are close to each other. Assume that a network event occurs immediately after the power event and corresponds to a Toshiba TV turning on. The power monitor can use the network event to increase the score for the Toshiba TV turning on. For example, the score can be increased by a certain amount, a percentage, or can be combined with the score generated by the network event processing to generate an overall score for the device state change. The power monitor can then identify the state change as corresponding to a Toshiba TV turning on. The timing of the power event and the network event can also be used as a feature of any of the methods for determining a state change of a device described herein.
[0116] For some devices, the exact timing between a device state change and a network event may not be known. For example, in some implementations, a device may be determined to be off when it has not transmitted any network data for a period of time. Thus, it may be determined that the device was turned off some time after its last network transmission, but the time when it was turned off may not be known. In some implementations, the power monitor may process the network events to determine a score that varies over time. For example, if the device's last network transmission was made at a first time point, the power monitor may output a high score for a period of time immediately following the first time point, and a lower score, such as a score with an exponential decay, for the time thereafter.
[0117] Some devices may have a known rebroadcast window during which they rebroadcast the services they provided at set intervals of time. If the device has sent a broadcast but has not sent another broadcast within the rebroadcast window, it may be determined that the device has been turned off.
[0118] In some implementations, a state change model may be used that receives both information about power events and information about network events as inputs and then generates a score indicating a match between the inputs and a state change of the device. For example, a state change model may be created for each state change of the device (e.g., a state change of a device type, a device model, or a device version). In some implementations, the power monitor may calculate a score for each state change model, select the state change model with the highest score, and use the highest-scoring state change model to identify the state change. The state change model may be created using any suitable classification method, such as neural networks, self-organizing maps, support vector machines, decision trees, random forests, logistic regression, Bayesian models, linear and nonlinear regression, and Gaussian mixture models.
[0119] As described above, a confidence level may be calculated in addition to the score and used in determining whether a state change has occurred. If the highest scoring model (e.g., the power model, the network model, or the state change model) has a low confidence level, the state change may not be identified.
[0120] The power monitor 150 may use a list of known states of the device and possible transitions between states of the device in determining a state change of the device. For example, a television may have three states: on, off, and sleep. However, due to the way the television operates, it is believed that not all state transitions are possible. With three states, there are six possible state transitions (on to off, on to sleep, off to on, off to sleep, sleep to on, and sleep to off). From the "off" state, only a transition to the "on" state is believed to be possible (off to sleep is not possible). From the "sleep" state, only a transition to the "on" state is believed to be possible (sleep to off is not possible). Thus, the power monitor may implement a method (e.g., a model or rule) that recognizes all possible state changes of the device. In determining a state change of the device, the power monitor may select one state change from the list of possible state changes of the device and determine the current state from the end state of the state change (e.g., if the state change from off to on is selected, the power monitor determines that the device is currently on). Upon determining the state of the device, the power monitor may select a state from a list of possible states for the device. The power monitor may select a state change or state depending on the implementation and / or the device being monitored.
[0121] Any of the device identification methods described above may be used to determine a device state change. Similarly, any of the device state change determination methods described above may be used to identify a device.
[0122] The above described method uses a combination of power and network monitoring to improve identification of device state changes in a building over methods based on power monitoring alone. Some device state changes may not be identified at all or may be identified with low accuracy using power monitoring alone. Combining network and power monitoring allows more device state changes to be identified (such as state changes in network devices that do not include mechanical components) and may also identify device state changes with high accuracy. Using information from both power and network monitoring allows for the creation of models and / or classifiers with lower error rates than models and / or classifiers that only use information from power monitoring.
[0123] Smart plug power monitoring A smart plug in a home can provide power to one or more devices that receive power from the smart plug, such as smart plug 145 of Figures 1 and 2. A smart plug can have a single receptacle that allows a single device to connect to the smart plug, or it can have multiple receptacles that allow multiple devices to connect to the smart plug (this can also be called a smart power strip). If the smart plug has a single receptacle, a traditional power strip can be plugged into the smart plug so that multiple devices can receive power from the smart plug. A smart plug can also be wired directly into a home's power grid in combination with a traditional power outlet.
[0124] As used herein, a smart plug is a device that receives power from a building circuit (e.g., circuit 222 in FIG. 2), supplies power to one or more other devices (connected devices), has sensors that measure information about the power delivered to the one or more connected devices, and has a network connection (wired or wireless) to transmit information about the measured power to other devices, such as a power monitor. Smart plugs may also provide other functionality, such as allowing a user to effectively turn off a connected device by opening a relay in the smart plug.
[0125] Smart plugs in a home provide additional information about the power consumption of devices that can be used to improve the operation of a power monitor. Because smart plugs provide information about a subset of devices in a home, it may be more effective to use information received from the smart plug (such as the smart plug power monitoring signal) to determine information about devices connected to the smart plug (compared to the mains power monitoring signal, which contains information about many more devices). However, for some smart plugs, the information provided by the smart plug may be less detailed (e.g., lower sampling rate) and / or less accurate than the mains power monitoring signal obtained by the power monitor. Thus, it may be advantageous to use both information from the smart plug and information from the electrical mains.
[0126] The power monitor can obtain information from the smart plug using any suitable network connection and method. For example, the power monitor can establish a direct network connection with the smart plug (e.g., using Bluetooth or Wi-Fi Direct) or can connect through the home's local area network. In some implementations, the power monitor can receive information from the smart plug via a server computer outside the home. For example, the smart plug can send information to the server computer, which in turn sends information to the power monitor. The server can be operated by the company providing the power monitor or the company providing the smart plug. In some implementations, the smart plug can send information to a smart plug server operated by the company providing the smart plug, which in turn sends information to a power monitor server operated by the company providing the power monitor. The power monitor server can perform necessary processing on the information received from the smart plug or send the information to the power monitor for processing.
[0127] Comparing power events with power monitoring signals The methods described herein may compare a mains power monitoring signal (e.g., a first or second mains power monitoring signal) to a smart plug power monitoring signal (if the smart plug is receiving power from this mains). For example, if a power event appears in the mains power monitoring signal, it may be desirable to know whether this mains power event matches a power event in the smart plug power monitoring signal. If the two power events match, it may be determined that the mains power event was likely caused by a device that received power from the smart plug. If the two power events do not match, it may be determined that the mains power event was likely caused by a device that did not receive power from the smart plug.
[0128] The comparison of the mains power monitoring signal and the smart plug power monitoring signal can be made by comparing a portion of each power monitoring signal, for example using Euclidean distance (the sum of squared differences between the two power monitoring signals), cosine similarity, or any other suitable comparison.
[0129] In some implementations, the smart plug portion or the main piping portion may be modified before performing the comparison. If the two portions being compared have different sampling rates, one portion may be resampled to match the sampling rate of the other portion. For example, if the main piping portion has a higher sampling rate than the smart plug portion, the main piping portion may be downsampled to the sampling rate of the smart plug portion. One or both portions may be scaled using an appropriate metric. For example, one or both portions may be modified so that each portion has the same L2 norm. To obtain a more accurate comparison, one or both portions may be transformed in time. For example, a time translation that maximizes the similarity between the portions may be determined (e.g., the transformation may be determined by performing a convolution of the portions), and the comparison may be performed using this time translation.
[0130] In some implementations, the comparison can be calculated using a baseline value of the smart plug power monitoring signal and / or the mains power monitoring signal. The mains power monitoring signal can indicate the power consumption of many devices in the home that are not connected to the smart plug and therefore may contain values that are not directly comparable to the smart plug. To obtain an improved comparison, the baseline power consumption of the mains can be calculated as the power value of the mains power monitoring signal at a time point before the power event. For example, the baseline power consumption of the mains can be the power value at a time point before the power event (e.g., 3 seconds) or the average power consumption (or any other suitable statistical value such as the median or mode) during a time window before the power event (e.g., 3 to 13 seconds before the power event). When comparing the smart portion to the mains portion, the mains portion can be normalized by subtracting the baseline of the mains from each power value of the mains portion. A comparison can then be performed between the smart plug portion and the normalized mains portion.
[0131] For example, in Figure 3A, a first main portion may be collected around power event 310. Prior to this power event, the amount of power consumed by the first main was approximately 1000 watts. Therefore, a baseline value of 1000 watts may be used to normalize the first main portion by subtracting 1000 watts from each time series value of the first main portion.
[0132] The comparison of the mains power monitoring signal and the smart plug power monitoring signal can be made by comparing features of the power events of the respective power monitoring signals. Any suitable features can be calculated, such as any of the features described in U.S. Pat. No. 9,443,195. For example, one feature can be a time difference or time delay between a power event of the mains power monitoring signal and a power event of the smart plug power monitoring signal. In another example, the feature of the power event can be a change in the amount of power before and after the power event. The amount of power before the power event can be determined by taking a power measurement at a time before the power event, or an average (or median or some other statistical value) over a time window before the power event. The amount of power after the power event can be determined similarly. To compare the mains power monitoring signal with the smart plug power monitoring signal, a first power change representative of a first power event of the mains power monitoring signal can be compared to a second power change representative of a second power event of the smart plug power monitoring signal. In some implementations, a first feature vector can be created for the power event of the smart plug power monitoring signal and a second feature vector can be created for the power event of the mains power monitoring signal. These feature vectors can be used to compute a comparison, such as by computing a distance or similarity between the feature vectors.
[0133] The mains power monitoring signal can be compared to the smart plug power monitoring signal using a wattage model of the device. Any suitable wattage model can be used, such as the wattage model described in U.S. Patent No. 9,443,195. The wattage model can indicate the expected power consumption of the device over a period of time after the device changes state. The mains power monitoring signal can include power events from different devices that occur at similar times such that two power events overlap each other. These wattage models can be used to separate the two power events of the mains power monitoring signal so that each power event can be compared to the smart plug power monitoring signal.
[0134] Deciding on the smart plug's hosting In some implementations, it may be desirable or useful to know which main in a home a smart plug is connected to. For example, knowing which main a smart plug is receiving power from may improve other methods of using information from the smart plug, as described in more detail below. Although a smart plug (such as a smart plug for 240V devices) can potentially receive power from multiple mains in a home, the following description focuses on a smart plug that receives power from a single main, although similar methods may be applied to smart plugs that receive power from multiple mains.
[0135] The electrical mains of the smart plug can be determined by comparing a smart plug power monitoring signal received from the smart plug to the first mains power monitoring signal and the second mains power monitoring signal. In a device connected to the smart plug, a power event from a change in state of the device can appear in the smart plug power monitoring signal and in either the first or second mains power monitoring signal.
[0136] For example, consider the power monitoring signals of Figures 3A-3C. In Figure 3C, the smart plug power monitoring signal shows a power event from a toaster oven connected to the smart plug. Because the smart plug is receiving power from a first mains, the toaster oven power event also appears in the first mains power monitoring signal of Figure 3A. The first mains power monitoring signal also includes power events for other devices (e.g., light bulbs) on the first mains that are not connected to the smart plug, and thus the smart plug power monitoring signal includes only a subset of the power events that appear in the first mains power monitoring signal. Because the smart plug is not receiving power from a second mains, the toaster oven power event does not appear in the second mains power monitoring signal.
[0137] Although power events from the smart plug also appear in the first mains power monitoring signal, it may not be easy to determine which main the smart plug power event appears in. For example, the mains power monitoring signal may include many power events that overlap with each other, there may be devices in the home that are not connected to the smart plug that have power events with similar signatures as the power events of devices connected to the smart plug, and / or the smart plug power monitoring signal may have a different delay time, resolution (e.g., sampling rate) or amplitude relative to the mains power monitoring signal.
[0138] Figure 6 is a flow chart of an example implementation for determining which main is providing power to a smart plug. In Figure 6 and other flow charts herein, the order of steps is exemplary and other orders are possible, not all steps are required, and some implementations may omit some steps or add others. The processes of the flow charts may be performed, for example, by any of the computers or systems described herein.
[0139] At step 610, a network connection between the power monitor and the smart plug is established. Any suitable network connection (e.g., wired or wireless, Wi-Fi, Bluetooth) may be used, and the network connection may be direct or indirect. For example, the network connection may be through a home router or a computer outside the home. The network connection may be established using any suitable method. For example, a user may configure one or both of the power monitor and smart plug to form a network connection, or the power monitor and / or smart plug may automatically establish a network connection without requiring personal configuration.
[0140] At step 615, the power monitor receives a smart plug power monitoring signal from the smart plug. In some implementations, the smart plug power monitoring signal may provide a real-time (or near real-time) measurement of the amount of power (or other electrical characteristic) delivered to a device connected to the smart plug. In some implementations, the smart plug may only transmit a power monitoring signal if the amount of power delivered is zero or above some other threshold. Signal 303 in FIG. 3C is an example of a smart plug power monitoring signal.
[0141] In step 620, a first mains power monitoring signal is obtained using a measurement of an electrical characteristic (e.g., current or voltage) of the first mains of the residence by the first sensor. The first mains power monitoring signal may provide a real-time (or near real-time) measurement of the amount of power (or other electrical characteristic) provided to a device receiving power from the first main. Signal 301 of FIG. 3A is an example of a first mains power monitoring signal.
[0142] In step 625, a second sensor obtains a second mains power monitoring signal using a measurement of an electrical characteristic (e.g., current or voltage) of a second mains in the residence. The second mains power monitoring signal can provide a real-time (or near real-time) measurement of the amount of power (or other electrical characteristic) provided to a device receiving power from the second main. Signal 302 in FIG. 3B is an example of a second mains power monitoring signal.
[0143] At step 630, a power event in the smart plug power monitoring signal is detected and the event time of the power event is identified. The power event may correspond to a change in state of any device connected to the smart plug, such as the device turning on, turning off, or an event between an on event and an off event (such as the cycling of a heating element of a toaster oven while the toaster oven is on). The power event may be identified using any suitable method, such as any of the methods described in U.S. Patent No. 9,443,195.
[0144] Any subset of the power events can be used. For example, all on events can be used, all off events can be used, all on and off events can be used, or all events can be used. An event time for each event can be identified, such as a start time, a middle time, or an end time of the event. For example, the detected power event can be any of the power events 310, 330, 340, 350, 360, and 380 of FIG. 3C.
[0145] An on-event may be determined as a transition from providing zero power to providing non-zero power. Similarly, an off-event may be determined as a transition from providing non-zero power to providing zero power. An appropriate threshold may be used in determining the transition between zero power and non-zero power. For example, even if all devices connected to the smart plug are off, the smart plug may still indicate that a relatively small amount of power is being provided by a device connected to the smart plug or by leakage current in the smart plug itself. A power level below the threshold may be determined to be zero power, even if it is not exactly zero.
[0146] When multiple devices are connected to a smart plug, it is possible that a first device is on and a second device is later on. Thus, when the second device is on, the smart plug power monitoring signal will transition from non-zero power to a greater amount of power. Thus, when multiple devices are connected to a smart plug, when selecting all on events, only on events from zero power to non-zero power can be used, or other methods can be used to capture all on events.
[0147] In step 635, a portion of the smart plug power monitoring signal (or smart plug portion) corresponding to the event time is collected. For example, a window of the smart plug power monitoring signal around the event time (e.g., a 10 second window) can be collected, or a portion of the smart plug power monitoring signal from a time before the on-event to a time after the off-event can be collected. For example, possible smart plug portions 311, 331, 341, 351, 361, and 381 are shown in FIG. 3C.
[0148] In step 640, a portion of the first mains power monitoring signal (or the first mains portion) that corresponds to the event time is collected, and in step 645, a portion of the second mains power monitoring signal (or the second mains portion) that corresponds to the event time is collected. These portions may be collected using a similar time frame as the smart plug portion or a different time frame.
[0149] The smart plug portion is compared to the first main portion and the second main portion at step 650. The comparison of the smart plug portion to the first main portion and the second main portion can be performed using any of the methods described herein.
[0150] A comparison may be made between the smart plug portion and the first main portion for each power event, and a comparison may be made between the smart plug portion and the second main portion for each power event. For example, if there are 50 power events, then 50 comparisons may be made between the smart plug portion and the first main portion, and 50 comparisons may be made between the smart plug portion and the second main portion. Each comparison may be represented using any suitable method, such as by representing the comparison as a number (e.g., the distance between the portions).
[0151] In step 655, the result of the comparison is used to determine whether the smart plug is powered by the first main or the second main. Any suitable method can be used. For example, a comparison between the smart plug portion and the first main portion can be used to calculate a first score, and a comparison between the smart plug portion and the second main portion can be used to calculate a second score. Any suitable score can be calculated, such as a Euclidean distance statistic between the portions. The statistic can be a mean, median, sum of squares, or any other suitable statistic. In some implementations, it can be determined that the smart plug is receiving power from the first main if the first score is greater than the second score, or if the first score minus the second score is greater than a threshold. In some implementations, if the first score and the second score are too close to each other, the decision can be withheld as being less confident and more data can be collected to obtain a more confident decision.
[0152] In step 660, a device list, such as the device list of Figure 5, is updated to indicate that the smart plug is receiving power from the main identified in step 655. The device list may be stored in any suitable data store. Any other suitable information, such as the determination date, may also be stored.
[0153] At step 665, information is provided to the user informing them that the smart plug is receiving power from the identified main, such as using any of the methods described herein or in U.S. Patent No. 9,443,195. In some implementations, step 665 may not be performed and the user may not be informed of the main from which the smart plug is receiving power.
[0154] Because at least some smart plugs can be plugged into different power outlets and receive power from different mains, the process of Figure 6 can also be repeated at other times, for example once a day or once a week.
[0155] In some implementations, an artificial neural network can be used to determine which mains are providing power to the smart plug. Any suitable neural network can be used, such as a recurrent neural network. The neural network can be trained using a training corpus of data, where the training corpus includes a plurality of training examples. Each training example can include a smart plug power monitoring signal, one or more mains power monitoring signals, and an indication of which mains are providing power to the smart plug. For example, the smart plug monitoring signal and the mains power monitoring signal can be collected over a period of time, such as a day or a week.
[0156] The parameters of the neural network may be trained using any suitable method, such as backpropagation and stochastic gradient descent. To train the neural network, the input of the neural network may be set to the power monitoring signal and the output of the neural network may be set to indicate the mains that are powering the smart plug (e.g., the mains that are powering the smart plug may be set to a value of 1 and other mains may be set to a value of 0). The parameters of the neural network may then be trained by iterating through the training data.
[0157] After training the neural network, it can be used to determine which mains are providing power to the smart plug. Smart plug monitoring signals and mains power monitoring signals can be collected from the home for processing by the trained neural network. The neural network can process the power monitoring signals to output a score for each main indicating whether the main is providing power to the smart plug. For example, these scores can be probabilities or likelihoods. These scores can be used to identify the mains providing power to the smart plug, such as by selecting the main with the highest score.
[0158] In some implementations, additional power monitoring signals may be collected to increase confidence in the results. For example, after processing one day's worth of power monitoring signals, the scores may be a probability of 0.6 for the first main and a probability of 0.4 for the second main. These scores may not provide sufficient confidence, and therefore additional data may be collected. After processing one week's worth of power monitoring signals, the scores may be a probability of 0.9 for the first main and a probability of 0.1 for the second main. These scores may provide sufficient confidence to make a determination, and therefore the first main may be selected as providing power to the smart plug.
[0159] In some implementations, the mains supplying power to the smart plug may be identified as described in the following clauses and any combination of two or more of them:
[0160] Identifying devices connected to a smart plug In some implementations, it may be desirable to know which devices in a home are receiving power from a smart plug. For example, knowing which devices are connected to a smart plug can present that information to a user. This information can be used to provide a benefit to the user or to improve the functionality of the power monitor.
[0161] For example, if a user plugs a toaster oven into a smart plug, the power monitor may be able to detect the change in state of the toaster oven but may not know that the device connected to the smart plug is a toaster oven. The power monitor may have power models for detecting state changes of devices that contain heating elements (such as a toaster oven, stove, aquarium heater, or hair iron), and these models may detect the change in state of the toaster oven without knowing that the device is a toaster oven. The power monitor may report to the user that a "heating element 1" is connected to the smart plug. The user may see this and provide information indicating that the device connected to the smart plug is a toaster oven. The power monitor may then report that the toaster oven is on instead of reporting that "heating element 1" is on.
[0162] Knowing that the device connected to the smart plug is a toaster oven can also help identify changes in the state of other users' toaster ovens. For example, a company that provides a power monitoring service can use the information received from the user to create a power model of the toaster oven that can be used with the user's toaster oven and with other users' toaster ovens.
[0163] In some cases, information provided by a user can be used to correct errors made by the power monitor and improve the power monitor's operation for the user and other users. For example, a power monitor may erroneously determine that a hair iron is connected to a smart plug and inform the user. The user can then correct this information by indicating that the device connected to the smart plug is in fact a toaster oven and not a hair iron. Companies providing power monitoring services may be able to use this information to improve their power models for toaster ovens and hair irons to better distinguish between these two types of devices.
[0164] 7 is a flow chart of an example implementation of determining that a first device is receiving power from a smart plug. Before performing the steps of FIG. 7, it can be confirmed that the smart plug is receiving power from a first main, such as by performing the steps of FIG. 6. In step 710, a network connection between a power monitor and the smart plug is established, in step 715, the power monitor receives a smart plug power monitoring signal from the smart plug, and in step 720, the first main power monitoring signal is obtained using a measurement of an electrical characteristic of the first main of the residence by the first sensor. These steps can be performed using any of the methods described above for steps 610, 615, and 620.
[0165] At step 725, a smart plug power event is identified that occurs in accordance with the event time of the smart plug power monitoring signal. Identifying the power event may be done using any suitable method, such as any of the methods described in U.S. Patent No. 9,443,195. In some implementations, the power event may be identified by detecting a transition from zero power to non-zero power in the smart plug power monitoring signal (e.g., caused by a device connected to the smart plug turning on). Any suitable method may be used to determine the event time, such as the start, middle or end of the power event.
[0166] In some implementations, multiple smart plug power events may be identified in step 725. For example, the smart plug power monitoring signal may be processed over a period of time, such as 24 hours or 7 days, to identify multiple smart plug power events. The identified smart plug power events may correspond to the same type of power event (e.g., a device turning on or a transition from zero power to non-zero power) or may include multiple types of power events (e.g., a device turning on and a device turning off).
[0167] Knowing that the smart plug is receiving power from the first mains, the device that caused the smart plug power event will also cause a power event on the first mains power monitoring signal around the time of the event.
[0168] In step 730, the event time determined in step 725 is used to identify a first mains power event in the first mains power monitoring signal. The first mains power event may be selected using any suitable method. For example, the first mains power monitoring signal may include multiple power events near the event time, and the power event closest to the event time may be selected. In some implementations, there may be a known delay time, or the delay time between the smart plug power monitoring signal and the first mains power monitoring signal may be measured. This known or measured delay time may be used in selecting the first mains power event.
[0169] In some implementations, multiple power events of the first mains power monitoring signal may be identified as step 730. For example, the first mains power monitoring signal may include a first mains power event and a second mains power event that is close in time to the event time. The first mains power event and the second mains power event may each be compared to the smart plug power event (or the portion of the power monitoring signal that includes the power event). The first mains power event having the closest comparison result to the smart plug power event may be selected.
[0170] If multiple smart plug power events are identified in step 725, then a first mains power event can be identified for each smart plug power event using the methods described above in step 730. Thus, after step 730, multiple pairs of smart plug power events and first mains power events are available for further processing.
[0171] In step 735, the identified first mains power event is processed to determine a first mains power event corresponding to a first device. For example, the first mains power event may be processed by multiple power models, with each power model corresponding to a device (e.g., a type of device (television), a make / version of device (Toshiba television), or a specific device (living room television)). Each power model may output a score indicating a match between the first mains power event and the device corresponding to the power model. The scores may be processed, such as by selecting the power model with the highest score, to select the first device.
[0172] In some implementations, a state change of the device can be identified, and the device can be identified from the state change. For example, each power model can correspond to a state change of the device, the model score can be used to select a power model, and if the state change corresponds to a state change of the first device, it can be determined that the power event corresponds to the first device.
[0173] If multiple pairs of smart plug power events and first mains power events are identified in steps 725 and 730, step 735 may be performed for each first mains power event to identify a device (which may be the first device or a different device) that corresponds to the power event.
[0174] In step 740, it is determined that the first device is receiving power from the smart plug. If only one first mains power event was processed in step 735, it can be determined that the first device is receiving power from the smart plug as a result of the first mains power event corresponding to the first device and the first mains power event corresponding to the smart plug power event.
[0175] If multiple first mains power events have been identified and processed in steps 725-735, other methods may be used to determine that the first device is receiving power from the smart plug.
[0176] In some implementations, the number of devices identified for the plurality of first mains power events in step 735 may be used to determine that the first device is receiving power from the smart plug. For example, assume that 100 first mains power events are processed in step 735 and it is determined that 75 correspond to the first device, 15 correspond to the second device, and 10 correspond to the third device. Since the number of the first device is the greatest, the first device may be selected as receiving power from the smart plug.
[0177] In some implementations, a comparison between the smart plug power event and the first mains power event can be used to make the determination in step 740. Any of the methods described herein can be used to compare the smart plug power event and the first mains power event (or the portion of the power monitoring signal that includes the power event). Each comparison can produce a distance between the power events (or the corresponding portion of the power monitoring signal). These distances can then be used to determine that the first device is receiving power from the smart plug.
[0178] For example, for each first mains power event determined in step 735 to correspond to a first device, a distance between the first mains power event and the corresponding smart plug power event may be calculated. As a result, multiple distances may be calculated for the first device. The multiple distances for the first device may be combined and scored, such as by using any of the methods described above for step 655. The score for the first device may then be used to determine whether the first device is receiving power from the smart plug. For example, the score for the first device may be compared to a threshold value, or the value for the first device may be compared to similar scores calculated for other devices, and the device with the highest score may be selected.
[0179] In some implementations and cases, a smart plug can provide power to multiple devices (e.g., a smart power strip). In such cases, multiple devices can be selected as receiving power from the smart plug. For example, all devices having a score (e.g., calculated from distance as described above) above a threshold can be selected as receiving power from the smart plug.
[0180] In step 745, a device list, such as the device list of Figure 5, is updated to indicate that the first device is receiving power from the smart plug. The device list may be stored in any suitable data store. Any other suitable information, such as a determination date, may also be stored.
[0181] At a later time, the first device can be removed from the smart plug and plugged directly into a power outlet. It can then be determined that the first device is no longer receiving power from the smart plug, and the device list can be updated to indicate that the first device is no longer receiving power from the smart plug. For example, a power event can be detected in the first mains power monitoring signal at the time of the event. The power event can be processed using the power model to determine that the power event corresponds to the first device transitioning from an off state to an on state, and thus the first device is receiving power after the power event. The smart plug power monitoring signal can then be processed to determine whether the signal includes a power event corresponding to the first device being turned on around the time of the event. If not (e.g., the smart plug power monitoring signal indicates that no power is being provided to any devices), it can be determined that the first device is no longer connected to the smart plug.
[0182] In step 750, information is provided to the user informing them that the first device is receiving power from the smart plug, such as using any of the methods described herein or in U.S. Patent No. 9,443,195. In some implementations, step 750 may not be performed and the user may not be informed that the first device is receiving power from the smart plug.
[0183] In some implementations, devices connected to the smart plug can be identified as described in the following clauses and combinations of any two or more of them:
[0184] Identifying Device State Changes Using Smart Plugs Information regarding which devices are connected to the smart plug can be used to improve identification of state changes of devices in the home. For example, assume that a first device is known to be connected to the smart plug (e.g., using the method of FIG. 7) and a second device is known to be not connected to the smart plug.
[0185] Knowledge of which devices are connected to the smart plug, in combination with the smart plug power monitoring signal, can be used to increase the accuracy of identifying state changes of devices in the home. The first device and the second device can have similar electrical characteristics, and therefore it may be possible that a state change of the first device is erroneously identified as a state change of the second device (or vice versa). Knowing that the first device is connected to the smart plug and the second device is not, this information can be used to reduce the probability of making a mistake in identifying state changes of the first and second devices.
[0186] For example, a first mains power event may be detected in a first mains power monitoring signal at the time of the event. When information from the smart plug is not available, the first mains power event may be processed using a first power model for the first device and a second power model for the second device (and possibly other power models) to identify a state change of the devices corresponding to the first mains power event. Because the first and second devices have similar characteristics, a first mains power event caused by the first device may be erroneously identified as a state change of the second device, or vice versa.
[0187] The smart plug power monitoring signal can be used to reduce this error rate. For example, if the smart plug power monitoring signal indicates that the connected device is not being powered at or around the time of the event, this information can be used to increase the accuracy of identifying the device's state change from the first mains power event. Since the smart plug indicates that it is not providing power, it can be deduced that the first device is off and therefore the first mains power event cannot correspond to the first device. Thus, the first mains power event can be processed by a subset of all available power models except the power model corresponding to the first device. Since the power model corresponding to the first device is excluded, the error rate in identifying the state change can be reduced. Since the first power model for the first device is not used, for example, if the first mains power event corresponds to a state change of the second device, it cannot be erroneously identified as a state change of the first device.
[0188] Figure 8A is a flow chart of an example implementation of using a smart plug power monitoring signal to determine a state change of a device. Prior to performing the steps of Figure 8A, it may be verified that the smart plug is receiving power from the first main, such as by performing the steps of Figure 6. It may also be verified that a first device is connected to the smart plug, such as by performing the steps of Figure 7.
[0189] At step 870, information indicating that the first device is connected to the smart plug and that the second device is not connected to the smart plug is obtained. For example, this information may be obtained from a device list, such as any of the device lists described herein.
[0190] In step 872, a network connection between the power monitor and the smart plug is established, in step 874, the power monitor receives a smart plug power monitoring signal from the smart plug, and in step 876, the first sensor uses a measurement of an electrical characteristic of a first main in the residence to obtain a first main power monitoring signal. These steps may be performed using any of the methods described above for steps 610, 615 and 620.
[0191] A first mains power event in the first mains power monitoring signal is identified in step 878. Identifying the first mains power event may be done using any suitable method, such as any of the methods described in U.S. Patent No. 9,443,195.
[0192] At step 880, it is determined that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event. Any suitable method may be used. A first time point of the first mains power event may be used to process a portion of the smart plug power monitoring signal that includes or is close to the time point of the first mains power event. In some implementations, it may be determined that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event if the smart plug power monitoring signal has a zero (or near-zero) value during a time window about the first time point.
[0193] In some implementations, the first mains power event can be compared to a power event in the smart plug power monitoring signal proximate to the first time, such as by using any of the methods described herein. If the first mains power event is not similar to any of the power events in the smart plug power monitoring signal, it can be determined that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event.
[0194] At step 882, a subset of power models is selected from the plurality of power models that includes at least one power model for the second device and excludes at least one power model for the first device. The power model for the first device may be excluded, for example, because the first device is connected to a smart plug and the smart plug indicates that no power is being consumed for a device connected to the smart plug.
[0195] In step 884, it is determined that the second device has changed state by processing the first mains power event using the selected subset of power models. For example, each power model may calculate a score indicating a match between the first mains power event and the state change of the device, and the state change of the device corresponding to the highest score may be selected.
[0196] In step 886, the device list is updated with the state changes of the devices identified in step 884. The device list may be stored in any suitable data store.
[0197] In step 888, the user may be provided with information regarding the change in status of the device identified in step 884, such as using any of the methods described herein or in U.S. Patent No. 9,443,195. In some implementations, step 888 may not be performed and the user may not be informed of the change in status of the device.
[0198] A variation of the flowchart of FIG. 8A may also be used when identifying a state change of a first device connected to the smart plug. Instead, in step 880, it may be determined that the smart plug power monitoring signal includes a power event corresponding to a first mains power event. For example, the first mains power event may be compared to the power events of the smart plug power monitoring signal to determine that the characteristics of the first mains power event are closer to the characteristics of the smart plug power event. In step 882, at least one power model of the first device may be included to the exclusion of at least one power model of the second device. In step 884, it may be determined that the first device has changed state by processing the first mains power event using a selected subset of power models. Thus, the process of FIG. 8A may be used to distinguish between state changes of devices connected to the smart plug and state changes of devices not connected to the smart plug.
[0199] In some implementations, changes in state of the device may be identified as described in the following clauses and combinations of any two or more of them:
[0200] Clause 1. A computer-implemented method of identifying a change in status of devices in a building, comprising the steps of: obtaining information from a device list indicating that a first device in the building is connected to a smart plug and a second device in the building is not connected to the smart plug; establishing a network connection with the smart plug supplying power to one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicating an amount of power the smart plug supplies to the one or more devices over a period of time; obtaining the first mains power monitoring signal using measurements from a sensor that measures an electrical characteristic of a first electrical main of the building; and receiving, in response to the change in status of the second device, a smart plug power monitoring signal indicating an amount of power the smart plug supplies to the one or more devices over a period of time. determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event; selecting a subset of power models from the plurality of power models including (i) excluding at least one power model corresponding to the first device and (ii) including at least one power model corresponding to the second device; processing the first mains power monitoring signal using the selected subset of power models to determine that the first mains power event corresponds to a change in state of the second device; and updating an entry for the second device in a device list to indicate a current state of the second device.
[0201] Clause 2. The computer-implemented method of clause 1, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes determining that the smart plug power monitoring signal indicates that the smart plug is not providing power to a device connected to the smart plug during a time window around the first mains power event.
[0202] Clause 3. The computer-implemented method of clause 1, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes determining that the smart plug power monitoring signal has a value of zero during a time window about the first mains power event.
[0203] Clause 4. The computer-implemented method of clause 1, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes comparing the first mains power event to one or more power events of the smart plug power monitoring signal.
[0204] Clause 5. The computer-implemented method of clause 4, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes calculating a first feature vector including features of the first mains power event, calculating a second feature vector including features of the power event of the smart plug power monitoring signal, and comparing the first feature vector and the second feature vector.
[0205] Clause 6. The computer-implemented method of clause 1, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes calculating a distance between a portion of the first mains power monitoring signal that includes the first mains power event and a portion of the smart plug power monitoring signal.
[0206] Clause 7. The computer-implemented method of clause 1, wherein determining that the smart plug power monitoring signal does not include a power event corresponding to the first mains power event includes determining a time difference between the first mains power event and the power event in the smart plug power monitoring signal.
[0207] Clause 8. The computer-implemented method of clause 1, comprising: identifying a second first mains power event in the first mains power monitoring signal corresponding to a state change of the first device; determining that the smart plug power monitoring signal includes a power event corresponding to the second first mains power event; selecting a second subset of power models from the plurality of power models, the second subset of power models including (i) including at least one power model corresponding to the first device and (ii) excluding at least one power model corresponding to the second device; processing the first mains power monitoring signal using the selected subset of power models to determine that the power event corresponds to a state change of the first device; and updating an entry for the first device in the device list to indicate a current state of the first device.
[0208] However, it is conceivable that the information in the device list is out of date and the first device is removed from the smart plug and plugged directly into a power outlet. After the first device is removed, completely excluding the first power model when processing the first mains power event may result in errors. In some implementations, weights may be used to reduce the probability of errors instead of completely excluding the power model. The weights may be selected using any suitable method. For example, if the smart plug indicates that it is not providing power to any connected devices, a weight of 1 may be used for the second device and a weight less than 1 may be used for the first device. Instead of making a hard decision as described above, these weights may be used to influence the decision. For example, a first weighted score may be calculated by combining the first weight with a first score calculated by the first power model for the first device (as described above), and a second weighted score may be calculated by combining the second weight with a second score calculated by the second power model for the second device. These weighted scores may then be used to select a state change for the device corresponding to the power event.
[0209] In some implementations, the first mains power event can be compared to the smart plug power event to determine the weight of the model. For example, a first mains power event can occur at the event time. The first mains power event can be compared to smart plug power events that are closer to the event time. If the first mains power event is closer to the smart plug event, a higher weight can be given to the power model of the device receiving power from the smart plug and a lower weight can be given to the power model of the device not receiving power from the smart plug. Conversely, if the first mains power event is not closer to the smart plug event, a lower weight can be given to the power model of the device receiving power from the smart plug and a higher weight can be given to the power model of the device not receiving power from the smart plug. The weight can be calculated using, for example, the distance between the first mains power event and the smart plug power event. The weight can also be calculated using the time difference between the first mains power event and the smart plug power event.
[0210] 8B is a flow chart of an example implementation of using a smart plug power monitoring signal to determine a state change of a device. Prior to performing the steps of FIG. 8B, it may be verified that the smart plug is receiving power from the first main, such as by performing the steps of FIG. 6. It may also be verified that a first device is connected to the smart plug, such as by performing the steps of FIG. 7.
[0211] At step 810, information indicating that the first device is connected to the smart plug and that the second device is not connected to the smart plug is obtained. For example, this information may be obtained from a device list, such as any of the device lists described herein.
[0212] In step 815, a network connection between the power monitor and the smart plug is established, in step 820, the power monitor receives a smart plug power monitoring signal from the smart plug, and in step 825, the measurement of an electrical characteristic of a first main in the residence by the first sensor is used to obtain a first main power monitoring signal. These steps may be performed using any of the methods described above for steps 610, 615 and 620.
[0213] A power event in the first mains power monitoring signal is identified at step 830. Identifying the power event may be done using any suitable method, such as any of the methods described in U.S. Patent No. 9,443,195.
[0214] In step 835, the first mains power event and the smart plug power monitoring signal are used to calculate a match score indicating a degree of similarity between the first mains power event and the smart plug power monitoring signal. The match score may be calculated using any of the methods described herein. For example, the match score may be calculated as a distance between a portion of the first mains power monitoring signal that includes the power event and a portion of the smart plug power monitoring signal. The match score may also be calculated by comparing the first mains power event to the smart plug power event of the smart plug power monitoring signal (e.g., comparing the change in power due to the power event).
[0215] In step 840, a first weight is calculated for the first device and a second weight is calculated for the second device using the match score and information that the first device is connected to the smart plug and the second device is not connected to the smart plug. Weights may also be calculated for any other devices in the home. The weights may be calculated using any suitable method.
[0216] In some implementations, since the first device is connected to the smart plug, the first weighting can be high when the match score is high (indicating a close match between the first mains power event and the smart plug power monitoring signal) and low when the match score is low. For example, the first weighting can be equal to the match score. Conversely, the second weighting can be low when the match score is high and high when the match score is low. For example, if the match score is in the range of 0 to 1, the second score can be 1 minus the match score.
[0217] In some implementations, it may be determined that the smart plug power monitoring signal is not providing any power during a time window about the event time of the first mains power event, and thus the first weight may be set to zero because the first device is likely not consuming power and therefore likely did not cause the first mains power event.
[0218] In step 845, the first main power event is processed using a power model, where each model can accommodate a state change of a device. Each power model can output a score indicative of a match between the first main power event and the state change of the corresponding device. For example, the power models can include a first power model representing the state change of the first device and outputting a first score, and a second power model representing the state change of the second device and outputting a second score. If the weight is zero, processing of the power model can be skipped since a weight of zero can indicate that the corresponding device is excluded from consideration.
[0219] In step 850, the first weight, the second weight, and the score from step 845 are used to identify device state changes. For example, the first score and the first weight may be used to calculate a first weighted score (e.g., by multiplying them or applying any other suitable combination), and the second score and the second weight may be used to calculate a second weighted score. The weighted scores may then be used to select device state changes, such as by selecting the device state change corresponding to the highest weighted score. For example, the first device state change may be selected if the first weighted score is highest, and the second device state change may be selected if the second weighted score is highest.
[0220] In step 855, the device list is updated with the state changes of the devices identified in step 850. The device list may be stored in any suitable data store.
[0221] In step 860, the user may be provided with information regarding the change in status of the device identified in step 850, such as using any of the methods described herein or in U.S. Patent No. 9,443,195. In some implementations, step 860 may not be performed and the user may not be informed of the change in status of the device.
[0222] In some implementations, changes in state of the device may be identified as described in the following clauses and combinations of any two or more of them:
[0223] Clause 1. A computer-implemented method of identifying status changes of devices in a building, comprising the steps of: obtaining information from a device list indicating that a first device in the building is connected to a smart plug and a second device in the building is not connected to the smart plug; establishing a network connection with the smart plug supplying power to one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicating an amount of power the smart plug supplies to the one or more devices over a period of time; obtaining the first mains power monitoring signal using measurements from a sensor that measures an electrical characteristic of a first electrical main in the building; and, of the first mains power monitoring signal, 11. A computer-implemented method comprising: identifying a first mains power event corresponding to a state change of a first device; calculating a match score using the first mains power event and a smart plug power monitoring signal; calculating a first weight of a first power model for the first device and a second weight of a second power model for a second device using the match score, the first weight being less than the first weight; processing the first mains power event using the first power model, the first weight, the second power model, and the second weight to determine that the first mains power event corresponds to a state change of the first device; and updating an entry for the first device in a device list to indicate a current state of the first device.
[0224] Clause 2. The computer-implemented method of clause 1, wherein calculating the match score includes identifying a smart plug power event in the smart plug power monitoring signal and comparing the first mains power event with the smart plug power event.
[0225] Clause 3. The computer-implemented method of clause 1, wherein calculating the match score includes calculating a distance between a portion of the first mains power monitoring signal that includes the first mains power event and a portion of the smart plug power monitoring signal.
[0226] Clause 4. The computer-implemented method of clause 1, wherein calculating the match score includes using a time difference between a first mains power event and a smart plug power event of the smart plug power monitoring signal.
[0227] Clause 5. The computer-implemented method of clause 1, wherein the first weight is one and the second weight is zero.
[0228] Clause 6. The computer-implemented method of clause 1, wherein the step of processing the first main power event using the first power model, the first weight, the second power model and the second weight to determine that the first main power event corresponds to a state change of the first device includes the steps of processing the first main power event using the first power model to generate a first score, calculating a first weighted score using the first score and the first weight, processing the first main power event using the second power model to generate a second score, calculating a second weighted score using the second score and the second weight, and using the first weighted score and the second weighted score to determine that the first main power event corresponds to a state change of the first device.
[0229] Clause 7. The computer-implemented method of clause 1, comprising: identifying a second first mains power event in the first mains power monitoring signal that corresponds to a state change of the second device; calculating a second match score using the second first mains power event and the smart plug power monitoring signal; calculating a third weight of the first power model for the first device and a fourth weight of the second power model for the second device using the second match score, the third weight, the second power model and the fourth weight to determine that the second first mains power event corresponds to a state change of the second device; and updating an entry for the second device in the device list to indicate a current state of the second device.
[0230] Training a model using a smart plug The smart plug can assist in training a mathematical model of the device. To train the mathematical model of the device, a training corpus of power monitoring signals that includes examples of the device changing state (e.g., turning on and off) can be obtained. For some devices, it may be relatively easy to collect a sufficient amount of training data to train a model of the device. For example, these devices may change state relatively frequently or may have power events that are relatively easy to identify in the mains power monitoring signal (e.g., by large power changes or distinctive state transition features).
[0231] However, for some devices, it may be more difficult to collect a sufficient amount of training data to train a model. For example, these devices may change state relatively infrequently, have relatively small power changes for state transitions, or have state change characteristics similar to the state changes of other devices. A smart plug can facilitate the collection of training data for such devices.
[0232] A user may intentionally connect a device to a smart plug for the purpose of training a model of the device. For example, a user may connect a device to a smart plug and then submit a request to train a model of the device to a company providing a power monitoring service. Alternatively, a user may connect a device to a smart plug for other reasons, and the power monitor may determine that a mathematical model of the device connected to the smart plug is not available and continue to collect data from the smart plug for the purpose of training a mathematical model of the device.
[0233] Trainable power models for devices include any of the mathematical models described in US Pat. No. 9,443,195, such as transition models, device models (herein referred to as state models), and wattage models.
[0234] 9 is a flow chart of an example implementation of using a smart plug power monitoring signal to train a mathematical model of a device. In step 910, a power monitor receives a smart plug power monitoring signal from a smart plug. This step can be performed using any of the methods described above for step 615. For example, a network connection between the power monitor and the smart plug can be established before receiving the smart plug power monitoring signal from the smart plug.
[0235] At step 915, the on-activation time point is identified by processing the smart plug power monitoring signal. For example, the on-activation time point may be determined as a time point corresponding to a transition from zero power to non-zero power in the smart plug power monitoring signal. As discussed above, an appropriate threshold may be used such that zero power need not be exactly zero corresponding to an amount of power below the threshold. The on-activation time point may be identified by processing the smart plug power monitoring signal over a period of time, such as a day, a week, or a month. The on-activation time points may all correspond to on-activations of a first device, or may correspond to on-activations of multiple devices (e.g., if multiple devices are connected to the smart plug).
[0236] At step 920, an operation-off time point is identified by processing the smart plug power monitoring signal. For example, the operation-off time point may be determined (e.g., using an appropriate threshold) as a time point corresponding to a transition of the smart plug power monitoring signal from non-zero power to zero power. The operation-off time point may be identified by processing the smart plug power monitoring signal over a period of time, such as a day, a week, or a month. The operation-off time point may correspond to the operation-off of all of a first device, or may correspond to the operation-off of multiple devices (e.g., if multiple devices are connected to the smart plug).
[0237] At step 925, a first mains power monitoring signal is obtained. This step may be performed using any of the methods described above for step 620. In some implementations, the first mains power monitoring signal may be selected from among other power monitoring signals (e.g., a second mains power monitoring signal) if the smart plug has previously been determined to be receiving power from the first mains, such as by using the methods described herein.
[0238] At step 930, a power event is identified in the first mains power monitoring signal. A power event may indicate that a device (which may or may not be receiving power from the smart plug) has changed state, such as switching on or off. The power event may be identified using any suitable method, such as any of the methods described herein or in U.S. Pat. No. 9,443,195. Each power event may be associated with an event time, and the event time may be stored for each power event. The power events may be identified by processing the first mains power monitoring signal over a period of time, such as a day, a week, or a month.
[0239] In step 935, the power events are clustered into a number of clusters. The power events can be clustered using any suitable method, such as by computing features from the power events and then clustering using these features. The features can be any suitable, such as matches between the power events and templates, Fourier coefficients, features of neural networks, or changes in power, current, voltage, or phase before and after the power event. The clustering method can be any suitable, such as k-means clustering, hierarchical clustering, centroid clustering, or density clustering.
[0240] Clustering of power events can allow similar power events to be in the same cluster and dissimilar power events to be in different clusters. For example, all ON power events of a particular device can be in the same cluster. In some cases, a cluster can include only a particular power event of a particular device, such as a power event for ON of a toaster oven. In some cases, a cluster can include power events from multiple devices, such as a power event for ON of a toaster oven and a power event for ON of a hair iron.
[0241] In step 940, a first cluster of the plurality of clusters is selected using the on activation time and the event time of the power event in the first cluster. The first cluster may be selected using any suitable method. For example, the event time of the power event of the first cluster may be compared to the on activation time. In some implementations, a score may be calculated for each cluster of the plurality of clusters that indicates a match between the event time of the power event of the cluster and the on activation time, and the cluster with the highest score may be selected. For example, the score of a cluster may be a proportion or percentage of the power events in the cluster that are within a certain time window of the on activation time, such as 5 seconds around the on activation time. If many event times of a cluster are close to the on activation time, it is considered that the cluster is likely to correspond to the on activation of a device connected to the smart plug.
[0242] A second cluster of the plurality of clusters is selected using the power off time and the event time of the power event in the second cluster in step 945. The second cluster may be selected using any suitable method, such as the method described in step 940.
[0243] In step 950, a first transition model is trained using one or more power events of the first cluster. Any suitable transition model may be trained using any suitable method, such as any transition model or method described herein or in U.S. Pat. No. 9,443,195. In some implementations, the first transition model may be trained using a subset of the power events in the first cluster. For example, the first transition model may be trained using only power events that are within a certain time window of the ON activation time.
[0244] A second transition model is trained using one or more power events of the second cluster in step 955. The second transition model may be trained using any suitable method, such as the method described in step 950.
[0245] In step 960, the first and second transition models are used to identify state changes of the devices. For example, the first and second transition models may be deployed to a power monitor in the same building that obtained the smart plug monitoring signal and the first mains power monitoring signal. The first and second transition models may be used to identify state changes (e.g., switching on and off) of devices connected to the smart plug or of devices not (or no longer) connected to the smart plug.
[0246] In some implementations, the first and second transition models may be used in a different building than the building in which the smart plug monitoring signal and the first mains power monitoring signal were obtained. For example, the first and second transition models may be trained from power events corresponding to a toaster oven turning on and off in a first building, and these first and second transition models may be used in a second building to identify power events from a toaster oven turning on and off.
[0247] For some devices, it may be desirable to train more than two transition models. For devices that have only two states (on and off), such as a light bulb, two transition models may be sufficient. A first transition model may represent the transition from an off state to an on state, and a second transition model may represent the transition from an on state to an off state. In comparison, an air conditioner may have a first state that is an off state, a second state in which the capacitor motor is running and the blower motor is not running, and a third state in which both the capacitor motor and the blower motor are running. For an air conditioner, it may be desirable to have a first transition model that represents the transition from the first state (off state) to the second state (where only the capacitor motor is running), a second transition model that represents the transition from the second state to the third state (where the blower motor is on in addition to the capacitor motor), and a third transition model that represents the transition from the third state back to the first state. For other devices, additional device states and transition models may be desirable.
[0248] 10 is a flow chart of an example implementation of using smart plug power monitoring signals to train more than two mathematical models of a device. The process of FIG. 10 can be used in conjunction with the process of FIG. 9, for example.
[0249] At step 1010, a state model having two states for a device receiving power from the smart plug is initialized. For example, a first state can correspond to the device being off and a second state can correspond to the device being on. The state model can include a first transition from the first state to the second state and a second transition from the second state to the first state. Figure 11A shows an example of a state model having two states, where, for example, state 1 can be an off state and state 2 can be an on state.
[0250] In step 1015, a first cluster of power events representing a first transition is selected, and in step 1020, a second cluster of power events representing a second transition is selected. Steps 1015 and 1020 can use any of the methods described herein, such as any of the methods of Figure 9. For example, on-times and off-times of the power monitoring signal can be identified, power events of a first mains power monitoring signal can be identified, the power events can be clustered into a plurality of clusters, and the on-times, off-times, and event times of the power events can be used to select the first and second clusters.
[0251] The goodness of fit between the state model and the device being modeled is determined in step 1025. The goodness of fit may be determined using any suitable method.
[0252] If a device has only two states (e.g., on and off), the device may consume zero power when off and a relatively constant amount of power when on. A first transition may be from zero power to a typical power usage of the device. The device may continue to consume a typical power usage until a second transition from the typical power usage to zero power. FIG. 12A shows an example of a power monitoring signal for a two-state device that consumes 0 watts when off and 100 watts when on. A state model including two states fits the device of FIG. 12A.
[0253] If the device has more than two states, the amount of power the device consumes over a period of time can change while on. A first transition can be from zero power to a first typical power usage of the device (e.g., a capacitor motor). The device can continue to consume a typical power usage until a second transition from the first typical power usage to a second typical power usage (e.g., both the capacitor motor and the blower motor). A third transition can be back to zero power. FIG. 12B shows an example of a power monitoring signal for a device with three states that consumes 0 watts when off, consumes 50 watts after being turned on, and consumes 100 watts at a later point in time. A state model that includes two states would not fit the device of FIG. 12B.
[0254] The goodness of fit can be determined, for example, by creating a wattage model of the device. Any suitable wattage model can be used, such as any of the wattage models described herein or in U.S. Patent No. 9,443,195. The wattage model can be created by calculating an expected change in power consumption corresponding to a transition from a first state to a second state.
[0255] The expected change in power consumption corresponding to the transition can be determined using any suitable method, and the expected change can be calculated from one or both of the smart plug power monitoring signal and the first mains power monitoring signal. For each power event corresponding to a transition, the amount of power can be determined both before and after the power event. The amount of power can be, for example, the amount of power at a particular point in time (e.g., 2 seconds before and 2 seconds after the power event) or an average of the power consumption over a certain time window (e.g., a window from 1-3 seconds before to after the power event). The power change can be determined for each power event by calculating the change in power before and after the power event.
[0256] The expected power consumption change of a transition can be calculated from the power changes of the power events corresponding to the transition. Any suitable method can be used, such as calculating a statistic of the power changes of the power events. For example, the statistic can be the average or median of the power changes of the power events (and outliers can be filtered out).
[0257] The wattage model for the device may be one in which the device consumes a relatively constant amount of power while in a particular state, and the expected power amount may correspond to the power change for a transition to this particular state.
[0258] The fit of the state model can be determined by comparing the wattage model to the actual power consumption indicated by the power monitoring signal. For example, the wattage model of the device in FIG. 12A may indicate that the device is expected to consume 99 watts while on (as indicated by the dashed line). In the power monitoring signal in FIG. 12A, the device is actually consuming 100 watts, so the wattage model is close to the power monitoring signal and the state model matches the power monitoring signal. In contrast, the wattage model of the device in FIG. 12B may indicate that the device is expected to consume 90 watts while on (as indicated by the dashed line). In the power monitoring signal in FIG. 12B, the device is actually consuming 50 watts or 100 watts, so the state model does not match the power monitoring signal.
[0259] The goodness of fit between the state model and a particular power monitoring signal may be calculated using any suitable method, for example, the distance between the wattage model and a particular power monitoring signal may be calculated by sampling the power monitoring signal at successive intervals and calculating the sum of squares of the differences between those samples and the expected amount of power indicated by the wattage model.
[0260] The smart plug power monitoring signal may have multiple instances of the device being on and off, and a goodness of fit may be calculated for each instance of the device being on and off. The goodness of fit between the state model and the device may be calculated by combining the goodness of fit between the state model and each instance of the smart plug power monitoring signal. For example, the goodness of fit between the state model and the device may be the average or median of the goodness of fit values calculated for each instance of the device in the on state of the smart plug power monitoring signal (and outliers may be filtered out).
[0261] This fitness can be used to determine whether another state should be added to the state model. For example, the fitness can be compared to a threshold. If the fitness calculated in step 1025 is not sufficient, processing can proceed to step 1030.
[0262] In step 1030, a new state is added to the state model. For example, FIG. 11B shows a state model with a third state inserted after the second state of FIG. 11A. For example, state 1 can still correspond to the off state, state 2 can correspond to a first operating state (e.g., only the capacitor motor is running), and state 3 can correspond to a second operating state (e.g., both the capacitor motor and the blower motor are running). Thus, a transition from state 1 to state 2 can correspond to the device turning on, a transition from state 2 to state 3 can correspond to a change in operation while the device is on, and a transition from state 3 to state 1 can correspond to the device turning off. In this example, the state model includes only the three transitions shown in FIG. 11B, but in some implementations, more transitions can be included, such as by adding transitions between state pairs.
[0263] After adding a third state, a first cluster of power events can be assigned to the transition from state 1 to state 2 (device turning on) and a second cluster of power events can be assigned to the transition from state 3 to state 1 (device turning off).
[0264] In step 1035, a cluster of power events is selected for a transition to a new state (e.g., a change from state 2 to state 3 in FIG. 11B). Because the transition to the new state occurs while the device is already on, the transition should generally occur between the on-activation time and the subsequent off-activation time. Thus, the third cluster can be selected by comparing the event time of the power events of the selected cluster with the time during which the device connected to the smart plug is in the on state (e.g., between the on-activation time and the subsequent off-activation time obtained from the smart plug power monitoring signal). In some implementations, a score can be calculated for each cluster of the multiple clusters that indicates a match between the event time of the power events of the cluster and the time between the on-activation time and the subsequent off-activation time. The cluster with the highest score can then be selected. For example, the score of a cluster can be the proportion or percentage of power events in the cluster that exist between the on-activation time and the subsequent off-activation time. If many event times of the cluster exist within this range, it is considered that the cluster likely corresponds to a transition to a new state.
[0265] After step 1035, the process returns to step 1025 to determine the fit of the state model (now having three states) with the device. Because the state model now has two operating states (states 2 and 3), a wattage model can be calculated for each operating state, and each wattage model can be compared to a portion of the smart plug power monitoring signal. For example, the wattage model for state 2 can be compared to portion 1210 of FIG. 12B, and the wattage model for state 3 can be compared to portion 1220. Portions 1210 and 1220 can be identified from the power monitoring signal using any suitable method, such as by identifying these portions using power events or by selecting portions that match the wattage model. If the fit is still not sufficient, the process can again proceed to step 1030 to add another state to the model. If the fit is sufficient, the process can proceed to step 1040.
[0266] A transition model is trained for each selected cluster in step 1040, and the transition model is used to identify device state changes in step 1045. Steps 1040 and 1045 can use any of the methods described herein, such as any of the methods of FIG.
[0267] In some implementations, instead of initializing the state model with two states as described above, the state model may be initialized with more than two states. The number of initial states may be determined using any suitable method.
[0268] In some implementations, the number of initial states can be determined by looking for transitions in an example smart plug power monitoring signal. For example, portions of the smart plug power monitoring signal can be obtained where each portion starts near a zero power to non-zero power transition (device ON) and ends near a subsequent non-zero power to zero power transition (device OFF). For each of these smart plug power monitoring signal portions, any of the methods described herein can be used to identify power events (internal power events) between the device ON and OFF. For each portion, the number of states for that portion can be determined to be two more than the number of internal power events. For example, if there are no internal power events, the number of states for that portion can be two (ON and OFF), and if there is one internal power event, the number of states can be three. The number of states for these smart plug power monitoring signal portions can be combined to determine the initial number of states for the state model. For example, the initial number of states can be a statistic (e.g., average or median) or a maximum or minimum value of the states of these portions.
[0269] In some implementations, the time points of the power events in the clusters can be used to determine the number of initial states. For example, the first cluster can be selected using the on-operation time point as described in step 940, and the second cluster can be selected using the operation off time point as described in step 945. For each of the other clusters, the frequency of the power events of the cluster between the on-operation time point and the subsequent operation off time point can be determined. If a high percentage or proportion of the power events in the cluster between the on-operation time point and the subsequent operation off time point (e.g., above a threshold) exists, the cluster is likely to correspond to a state change of the device while the device is on, and the device can be determined to have multiple operating states (in addition to the on state). The number of initial states of the state model can be determined to be two more than the number of clusters that are likely to correspond to a state change of the device while the device is on. For example, the number of initial states can be two (on and off) if there is no cluster that is likely to correspond to a state change of the device while the device is on, and the number of initial states can be three if there is one cluster that is likely to correspond to a state change of the device while the device is on.
[0270] After determining the number of initial states, if the number of initial states is greater than two (e.g., there are multiple operating states), the process of FIG. 9 can be adapted to train additional transition models. As shown in FIG. 9, a first transition model can be trained using a cluster corresponding to an ON operating time, and a second transition model can be trained using a cluster corresponding to an OFF operating time. For each state in addition to the two states, an event time of the cluster can be used to select a cluster (e.g., by comparing the event time with the ON operating time and the OFF operating time), and the power events of the selected cluster can be used to train the transition model. In some implementations, the process of FIG. 10 can be used to determine to add additional states, increasing the number of states beyond the initial number of states.
[0271] In some implementations, it may be determined that the number of initial states was too large, and therefore the number of states may be reduced. For example, when selecting clusters, it may be determined that no clusters are suitable for a state transition (e.g., based on comparing the event time points with the on-actuation time points and actuation off-actuation time points of the available clusters), and therefore the number of states may be reduced.
[0272] In some implementations, the transition model may be trained as described in the following clauses and combinations of any two or more of them.
[0273] implementation Variations of the above-described methods are also contemplated. Although the above-described methods refer to a single smart plug, these methods may be adapted for use with multiple smart plugs in a building. For example, a power monitor may establish a network connection with two or more smart plugs, receive a smart plug power monitoring signal from each smart plug, and perform any of the above-described methods on each smart plug power monitoring signal.
[0274] Any of the above methods can also be implemented using a smart circuit breaker instead of a smart plug. A smart circuit breaker can provide information about the power consumption of a device receiving power from the circuit breaker. For example, a smart circuit breaker can be installed in an electrical panel to provide power to one or more devices through an electrical circuit connected to the smart circuit breaker. A smart circuit breaker can include functionality that provides information about the power provided to a device receiving power from the smart circuit breaker. For example, a smart circuit breaker can include one or more sensors that measure an electrical characteristic (e.g., current, voltage, or power) of the electricity provided to the circuit. These sensor data can be used to determine the amount of power consumed over a period of time by a device connected to the circuit. A smart circuit breaker can also have a network connection (e.g., Wi-Fi or Bluetooth) to transmit information about the power usage of the connected device to another device, such as a smartphone. A smart circuit breaker can also have other functions. For example, a smart circuit breaker can have a relay that starts and stops the flow of electricity to the circuit, and a user can have an application (or app) on the smartphone that allows the user to control the relay.
[0275] As used herein, a smart circuit breaker is a device that receives power from a building main (e.g., via first main bus 211 in FIG. 2), supplies power to a circuit, has sensors that measure information about the power delivered to one or more devices connected to the circuit, and has a network connection (wired or wireless) for transmitting information about the measured power consumption to other devices, such as a power monitor. Smart circuit breakers may also provide other functions, such as allowing a user to effectively disconnect power to a circuit by opening a relay in the smart circuit breaker.
[0276] The power monitor may establish a network connection with the smart circuit breaker (or multiple smart circuit breakers) to receive smart circuit breaker power monitoring signals from the smart circuit breaker. When deployed near the smart circuit breaker (e.g., in or near an electrical panel), the power monitor may receive sensor data directly from the smart circuit breaker, thus eliminating the need for a network connection.
[0277] The smart circuit breaker power monitoring signal can be processed using any of the methods described above for the smart plug power monitoring signal. Because a smart circuit breaker provides power to a circuit (as opposed to a smart plug, which provides power to one or more devices connected to the smart plug), the smart circuit breaker power monitoring signal can indicate the power consumption of more devices than the smart plug power monitoring signal. It would be easy for one skilled in the art to extend the methods described above to the smart circuit breaker power monitoring signal.
[0278] Figure 13 illustrates components of some implementations of a computing device 1300 that may be used for either a power monitor or a server operating with a power monitor. Although Figure 13 illustrates the components as residing on a single computing device, the components may also be distributed across multiple computing devices, such as across any of the devices discussed above or across multiple server computing devices.
[0279] The computing device 1300 may include any of the components typical of a computing device, such as one or more processors 1311, volatile or non-volatile memory 1310, and one or more network interfaces 1312 for connecting to a computer network. The computing device 1300 may also include any of the input and output components, such as a display, a keyboard, and a touch screen. The computing device 1300 may also include various components or modules that provide specific functions, and these components or modules may be implemented in software, hardware, or a combination thereof. Several example components are described below for one example implementation, and other implementations may include additional components or exclude some of the components described below.
[0280] The computing device 1300 can include a power event processing component 1320 that can be used to process the power monitoring signals to determine information about the device, such as identifying the device and device state changes from the power monitoring signals. The computing device 1300 can include a network event processing component 1321 that can be used to process data from a computer network to determine information about the device, such as identifying the device and device state changes from the network data. The computing device 1300 can include a mains identification component 1322 that can be used to identify a mains from which the smart plug is receiving power. The computing device 1300 can include a device identification component 1323 that can be used to identify a device receiving power from the smart plug. The computing device 1300 can have a state change component 1324 that can be used to determine a state change of a device corresponding to a power event using the mains power monitoring signals and the smart plug power monitoring signals. The computing device 1300 can have a model training component 1325 that can be used to train a mathematical model of a device using the mains power monitoring signals and the smart plug power monitoring signals.
[0281] The computing device 1300 may include or have access to various data stores, such as data stores 1330, 1331, and 1332. The data stores may use any known storage technology, such as files, relational databases, non-relational databases, or any non-transitory computer-readable medium. For example, the computing device 1300 may have a power model data store 1330 that stores power models or information about power models. The computing device 1300 may have a network model data store 1331 that stores network models or information about network models. The computing device 1300 may have a device information data store 1332 that may be used to store information about devices, such as a device list for one or more buildings.
[0282] While only a few embodiments of the present invention have been shown and described, it will be apparent to those skilled in the art that many changes and modifications can be made thereto without departing from the spirit and scope of the present disclosure as set forth in the following claims. All patent applications and patents, both foreign and domestic, and all other publications referenced herein are incorporated herein in their entirety to the maximum extent permitted by law.
[0283] The methods and systems described herein may be deployed in part or in whole through a machine that executes computer software, program codes and / or instructions on a processor. The processor may be part of a server, cloud server, client, network infrastructure, mobile computing platform, fixed computing platform or other computing platform. The processor may be any type of computational or processing device capable of executing program instructions, codes, binary instructions and the like. The processor may be or include any variant such as a signal processor, digital processor, embedded processor, microprocessor, or coprocessor (such as a mathematical coprocessor, a graphic coprocessor and a communication coprocessor) and the like that may directly or indirectly facilitate the execution of stored program codes or program instructions. The processor may also enable the execution of multiple programs, threads and codes. The threads may be executed simultaneously to increase the processor's performance and facilitate the simultaneous operation of applications. As an implementation, the methods, program codes and program instructions described herein may be implemented in one or more threads. The threads may spawn other threads that may have associated priorities assigned, and the processor may execute these threads based on the priorities or any other order based on instructions provided in the program code. The processor may include a memory that stores the methods, codes, instructions and programs as described herein and elsewhere. The processor may access a storage medium through an interface that may store the methods, codes and instructions as described herein and elsewhere.Storage media associated with a processor that stores methods, programs, code, program instructions or other types of instructions executable by a computing device or processing unit may include, but are not limited to, one or more of the following: CD-ROM, DVD, memory, hard disk, flash drive, RAM, ROM, cache, and the like.
[0284] A processor may include one or more cores that can increase the speed and performance of a multiprocessor. In embodiments, a process may be a dual-core processor, a quad-core processor, other chip-level multiprocessor, and the like that combines two or more independent cores (called chips).
[0285] The methods and systems described herein may be deployed in part or in whole through machines executing computer software on a server, cloud server, client, firewall, gateway, hub, router, or other such computer hardware and / or networking hardware. The software programs may be associated with a server, which may include file servers, print servers, domain servers, internet servers, intranet servers, and other variants such as secondary servers, host servers, and distributed servers. A server may include one or more of the following: memory, processor, computer readable media, storage media, ports (physical and virtual), communication devices, and interfaces that may access other servers, clients, machines, devices, and the like, via wired or wireless media. The methods, programs, or codes as described herein and elsewhere may also be executed by a server. Also, other devices necessary for the execution of the methods described in this application may be considered as part of the infrastructure associated with the server.
[0286] The server may provide an interface to other devices, including but not limited to clients, other servers, printers, database servers, print servers, file servers, communication servers, and distributed servers. This coupling and / or connection may also facilitate remote program execution across a network. The networking of some or all of these devices may facilitate parallel processing of a program or method in one or more locations without departing from the scope of the present disclosure. Any device connected to the server via an interface may also include at least one storage medium capable of storing methods, programs, code and / or instructions. Program instructions to be executed on different devices may be provided by a central repository. In this implementation, the remote repository may act as a storage medium for program code, instructions and programs.
[0287] The software programs may be associated with a client, which may include file clients, print clients, domain clients, internet clients, intranet clients, and other variants such as secondary clients, host clients, and distributed clients. A client may include one or more of the following: memory, processor, computer readable media, storage media, ports (physical and virtual), communication devices, and interfaces that allow access to other clients, servers, machines and devices, etc., via wired or wireless media. Methods, programs, or codes as described herein and elsewhere may also be executed by a client. Also, other devices necessary for execution of the methods described in this application may be considered part of the infrastructure associated with the client.
[0288] The clients may provide interfaces to other devices, including but not limited to servers, other clients, printers, database servers, print servers, file servers, communication servers, and distributed servers. This coupling and / or connection may also facilitate remote program execution across a network. The networking of some or all of these devices may facilitate parallel processing of a program or method in one or more locations without departing from the scope of the present disclosure. Any device connected to a client via an interface may also include at least one storage medium capable of storing methods, programs, applications, code and / or instructions. Program instructions to be executed on different devices may be provided by a central repository. In this implementation, the remote repository may act as a storage medium for program code, instructions, and programs.
[0289] The methods and systems described herein may be deployed in part or in whole through a network infrastructure. The network infrastructure may include elements such as computer devices, servers, routers, hubs, firewalls, clients, personal computers, communication devices, routing devices, and other active and passive devices, modules and / or components known in the art. The computer device(s) and / or non-computer devices associated with the network infrastructure may include storage media such as flash memory, buffers, stacks, RAM and ROM, among other components. The processes, methods, program codes, instructions as described herein and elsewhere may be executed by one or more of these network infrastructure elements.
[0290] The methods, program codes and instructions as described herein and elsewhere may be implemented on a cellular network having multiple cells. The cellular network may be either a Frequency Division Multiple Access (FDMA) network or a Code Division Multiple Access (CDMA) network. The cellular network may include mobile devices, cell sites, base stations, repeaters, antennas and towers, etc. The cellular network may include GSM, GPRS, 3G, EVDO, mesh or other network types.
[0291] Methods, program codes and instructions as described herein and elsewhere may be implemented on or through a mobile device. Mobile devices may include navigation devices, cellular phones, mobile phones, personal digital assistants, laptops, palmtops, netbooks, pagers, e-book readers and music players, and the like. These devices may include storage media, such as flash memory, buffers, RAM, ROM and one or more computing devices, among other components. A computing device associated with the mobile device may execute the stored program code, methods and instructions. Alternatively, the mobile device may be configured to execute instructions in cooperation with other devices. The mobile device may communicate with a base station configured to execute the program code in conjunction with a server. The mobile device may communicate over a peer-to-peer network, mesh network or other communication network. The program code may be stored in a storage medium associated with the server and executed by a computing device embedded in the server. The base station may include a computing device and a storage medium. The storage device may store program code and instructions executed by a computing device associated with the base station.
[0292] The computer software, program code and / or instructions may be stored on and / or accessed in a machine-readable medium, which may include other computer memory such as computer components, devices and recording media that hold digital data used for computation over some interval of time, semiconductor storage known as random access memory (RAM), mass storage, usually for more permanent storage, such as optical disks, hard disks, tapes, drums, cards and other types of magnetic storage forms, processor registers, cache memory, volatile memory, non-volatile memory, optical storage such as CDs, DVDs, flash memory (e.g., USB sticks or keys), floppy disks, magnetic tape, paper tape, punch cards, standalone RAM disks, Zip drives, removable mass storage and offline, dynamic memory, static memory, read / write storage, mutable storage, read only, random access, sequential access, position addressable, file addressable, content addressable, network attached storage, storage area networks, bar codes, magnetic ink, etc.
[0293] The methods and systems described herein can transform physical and / or intangible items from one state to another. The methods and systems described herein can also transform data representing physical and / or intangible items from one state to another, such as from usage data to a normalized usage data set.
[0294] The elements described and illustrated herein, including those shown in flow charts and block diagrams throughout the figures, imply logical boundaries between the elements. However, in accordance with software or hardware engineering practices, the illustrated elements and their functions may be implemented on a machine through a computer executable medium having a processor capable of executing stored program instructions as a monolithic software structure, an independent software module, or a module employing external routines, codes and services, etc., or any combination thereof, and all such implementations may be within the scope of the present disclosure. Examples of such machines include, but are not limited to, personal digital assistants, laptops, personal computers, mobile phones, other handheld computing devices, medical devices, wired or wireless communication devices, transducers, chips, calculators, satellites, tablet PCs, e-books, gadgets, electronic devices, devices with artificial intelligence, computing devices, networking devices, servers and routers, etc. Furthermore, the elements shown in the flow charts and block diagrams or any other logical components may be implemented on a machine capable of executing program instructions. Thus, while the figures and description above illustrate functional aspects of the disclosed system, no particular configuration of software implementing those functional aspects should be inferred from those descriptions unless expressly indicated or otherwise apparent from the context. Similarly, it will be understood that the various steps identified and described above can be varied and the order of steps can be adapted to a particular application of the techniques disclosed herein. All such variations and modifications are intended to be within the scope of the present disclosure. Thus, the illustration and / or description of the order of various steps should not be understood as requiring a particular order of performance of those steps unless necessary for a particular application or unless expressly indicated or otherwise apparent from the context.
[0295] The methods and / or processes described above, and steps thereof, may be implemented in hardware, software, or any combination of hardware and software suitable for a particular application. Hardware may include general purpose computers and / or special purpose computing devices, or specific computing devices or specific aspects or components of specific computing devices. The processes may be implemented in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices, with internal and / or external memory. Additionally or alternatively, the processes may be embodied in application specific integrated circuits, programmable gate arrays, programmable array logic, or any other device or combination of devices that can be configured to process electronic signals. It will be further understood that one or more of the processes may be implemented as computer executable code that can be executed on a machine readable medium.
[0296] Computer executable code can be written using a structured programming language such as C, an object-oriented programming language such as C++, or any other high-level or low-level programming language (including assembly languages, hardware description languages, and database programming languages and techniques) that can be stored, compiled, or interpreted to be executed on one of the above devices, as well as heterogeneous combinations of processors, processor architectures, or combinations of different hardware and software, or any other machine capable of executing program instructions.
[0297] Thus, in one embodiment, each method and combination of methods described above may be embodied in computer executable code that performs the steps of the method when executed on one or more computing devices. In another embodiment, the methods may be embodied in a system that performs the steps, distributed across multiple devices, or all functions may be integrated into a dedicated stand-alone device or other hardware. In another embodiment, the means for performing the steps associated with the processes described above may include any of the hardware and / or software described above. All such permutations and combinations are intended to be within the scope of the present disclosure.
[0298] All documents referenced herein are incorporated by reference.
Claims
1. 1. A computer-implemented method for determining a power main associated with a smart plug, comprising: establishing a network connection with the smart plug receiving power from a building's electrical main to power one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a first sensor measuring an electrical characteristic of a first electrical main of the building; obtaining a second mains power monitoring signal using measurements from a second sensor measuring an electrical characteristic of a second electrical main of the building; identifying a plurality of event time points corresponding to events in the smart plug power monitoring signal; collecting smart plug portions of the smart plug power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a first mains portion of the first mains power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a second mains portion of the second mains power monitoring signal corresponding to each event time of the plurality of event time points; determining that the smart plug is receiving power from the first electrical main by comparing the smart plug portion with the first main and comparing the smart plug portion with the second main; updating an entry in a data store to indicate that the smart plug is receiving power from the first electrical main; A computer-implemented method comprising:
2. the event corresponds to the smart plug transitioning from supplying zero power to supplying non-zero power.
10. The computer-implemented method of claim 1.
3. The method comprises: calculating a plurality of first base power consumptions of the first mains power monitoring signal, each first base power consumption corresponding to an event time point among the plurality of event time points; calculating a plurality of second base power consumptions of the second mains power monitoring signal, each second base power consumption corresponding to an event time point among the plurality of event time points; Further equipped with determining that the smart plug is receiving power from the first electrical main includes using the plurality of first base power consumption rates and the plurality of second base power consumption rates.
10. The computer-implemented method of claim 1.
4. calculating a first baseline power consumption includes calculating an average value of the first mains power monitoring signal over a period of time prior to a corresponding event time; The computer-implemented method of claim 3 .
5. modifying the first main pipe portion by downsampling the first main pipe portion to match a sampling rate of the smart plug portion.
10. The computer-implemented method of claim 1.
6. and converting the first mains portion or the smart plug portion prior to comparing the first mains portion and the smart plug portion.
10. The computer-implemented method of claim 1.
7. Comparing the first main pipe portion and the smart plug portion includes calculating a distance between the first main pipe portion and the smart plug portion.
10. The computer-implemented method of claim 1.
8. Comparing the first main portion and the smart plug portion includes: calculating a first feature vector for the first main pipe portion; Calculating a second feature vector for the smart plug portion; Calculating a distance between the first feature vector and the second feature vector; The computer-implemented method of claim 1 , comprising:
9. 1. A system for determining a power main associated with a smart plug, comprising: At least one computer including at least one processor and at least one memory, the at least one computer comprising: establishing a network connection with the smart plug, the smart plug receiving power from a building's electrical main to power one or more devices; receiving a smart plug power monitoring signal via the network connection indicative of the amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a first sensor measuring an electrical characteristic of a first electrical main of the building; obtaining a second mains power monitoring signal using measurements from a second sensor measuring an electrical characteristic of a second electrical main of the building; identifying a plurality of event time points corresponding to events in the smart plug power monitoring signal; collecting smart plug portions of the smart plug power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a first mains portion of the first mains power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a second mains portion of the second mains power monitoring signal corresponding to each event time of the plurality of event time points; determining that the smart plug is receiving power from the first electrical main by comparing the smart plug portion to the first main and comparing the smart plug portion to the second main; updating an entry in a data store to indicate that the smart plug is receiving power from the first electrical main; The system is configured as follows:
10. The at least one computer is configured to compare the first main portion and the smart plug portion by calculating a distance between the first main portion and the smart plug portion. The system of claim 9.
11. The at least one computer comparing the smart plug portion to the first main portion by calculating a first plurality of distances between the first main portion and the smart plug portion; comparing the smart plug portion to the second main portion by calculating a second plurality of distances between the second main portion and the smart plug portion; The system of claim 9 , configured to:
12. The at least one computer calculating a first value from the first plurality of distances; calculating a second value from the second plurality of distances; comparing the first value with the second value; and determining that the smart plug is receiving power from the first electrical main by The system of claim 11.
13. the first value is an average or median of the first plurality of distances; The system of claim 12.
14. The at least one computer is configured to scale an amplitude of the first main portion or the smart plug portion prior to comparing the first main portion and the smart plug portion. The system of claim 9.
15. One or more non-transitory computer-readable media containing computer-executable instructions that, when executed, cause at least one processor to: Establishing a network connection with a smart plug receiving power from a building's electrical main to power one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a first sensor measuring an electrical characteristic of a first electrical main of the building; obtaining a second mains power monitoring signal using measurements from a second sensor measuring an electrical characteristic of a second electrical main of the building; identifying a plurality of event time points corresponding to events in the smart plug power monitoring signal; collecting smart plug portions of the smart plug power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a first mains portion of the first mains power monitoring signal corresponding to each event time of the plurality of event time points; acquiring a second mains portion of the second mains power monitoring signal corresponding to each event time of the plurality of event time points; determining that the smart plug is receiving power from the first electrical main by comparing the smart plug portion with the first main and comparing the smart plug portion with the second main; updating an entry in a data store to indicate that the smart plug is receiving power from the first electrical main; 23. A computer-readable medium for causing a computer to perform operations including:
16. Comparing the first main pipe portion and the smart plug portion includes calculating a distance between the first main pipe portion and the smart plug portion.
16. The computer readable medium of claim 15.
17. Comparing the first main portion and the smart plug portion includes: calculating a first feature vector for the first main pipe portion; Calculating a second feature vector for the smart plug portion; Calculating a distance between the first feature vector and the second feature vector; 20. The computer readable medium of claim 15, comprising:
18. The operations further include identifying a second plurality of time points corresponding to a second event in the smart plug power monitoring signal.
16. The computer readable medium of claim 15.
19. the second event corresponds to the smart plug transitioning from supplying non-zero power to supplying zero power.
20. The computer readable medium of claim 18.
20. Determining that the smart plug is receiving power from the first electrical main includes: calculating a first baseline power consumption from the first mains power monitoring signal corresponding to an event time; calculating a normalized first main portion by subtracting the first base power consumption from a first main portion corresponding to the event time; Calculating a first distance between the smart plug portion corresponding to the event time and the normalized first main pipe portion; calculating a second baseline power consumption from the second mains power monitoring signal corresponding to the event time; calculating a normalized second main portion by subtracting the second base power consumption from a second main portion corresponding to the event time; Calculating a second distance between the smart plug portion and the normalized second main portion corresponding to the event time; Including, determining that the smart plug is receiving power from the first electrical main includes using the first distance and the second distance.
16. The computer readable medium of claim 15.
21. 1. A computer-implemented method for determining that a first device is connected to a smart plug, comprising: Establishing a network connection with the smart plug providing power to one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of the building; identifying a smart plug power event corresponding to an event time in the smart plug power monitoring signal; identifying a first mains power event in the first mains power monitoring signal using the event time; determining that the first mains power event corresponds to the first device by processing the first mains power event using a plurality of power models; using the determination that the first mains power event corresponds to the first device, determining that the first device is connected to the smart plug; updating an entry in a data store to indicate that the first device is receiving power from the smart plug; A computer-implemented method comprising:
22. determining that the first device is connected to the smart plug includes comparing the first mains power event to the smart plug power event; 22. The computer-implemented method of claim 21.
23. comparing the first mains power event to the smart plug power event includes comparing a power change of the first mains power event to a power change of the smart plug power event.
23. The computer-implemented method of claim 22.
24. Comparing the first mains power event with the smart plug power event includes performing one or more of downsampling, time conversion, or amplitude scaling.
23. The computer-implemented method of claim 22.
25. Comparing the first mains power event with the smart plug power event comprises: obtaining a smart plug portion of the smart plug power monitoring signal corresponding to the smart plug power event; obtaining a first mains portion of the first mains power monitoring signal corresponding to the first mains power event; Calculating a distance between the smart plug portion and the first main pipe portion; 23. The computer-implemented method of claim 22, comprising:
26. using the event time to identify a second first mains power event corresponding to a state change of a second device in the first mains power monitoring signal; determining that the first mains power event corresponds to the smart plug power event by comparing the smart plug power event to the first mains power event and comparing the smart plug power event to the second mains power event; 22. The computer-implemented method of claim 21, comprising:
27. determining that the first mains power event corresponds to the smart plug power event includes using a wattage model of the first device and a wattage model of the second device.
27. The computer-implemented method of claim 26.
28. determining that the first mains power event corresponds to the first device includes: (1) processing the first mains power event using the plurality of power models to generate a score for each power model of the plurality of power models; and (2) selecting a power model corresponding to a highest score.
22. The computer-implemented method of claim 21.
29. 1. A system for determining that a first device is connected to a smart plug, comprising: At least one computer including at least one processor and at least one memory, the at least one computer comprising: Establishing a network connection with the smart plug providing power to one or more devices; receiving a smart plug power monitoring signal via the network connection indicative of the amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a sensor that measures an electrical characteristic of a first electrical main of the building; identifying a smart plug power event corresponding to an event time in the smart plug power monitoring signal; using the event time to identify a first mains power event in the first mains power monitoring signal; determining that the first mains power event corresponds to the first device by processing the first mains power event using a plurality of power models; using the determination that the first mains power event corresponds to the first device to determine that the first device is connected to the smart plug; updating an entry in a data store to indicate that the first device is receiving power from the smart plug; The system is configured as follows:
30. the at least one computer is configured to determine that the first device is connected to the smart plug by comparing the first mains power event with the smart plug power event.
30. The system of claim 29.
31. the at least one computer is configured to compare the first mains power event to the smart plug power event by comparing a power change of the first mains power event to a power change of the smart plug power event; 31. The system of claim 30.
32. The at least one computer obtaining a smart plug portion of the smart plug power monitoring signal corresponding to the smart plug power event; obtaining a first mains portion of the first mains power monitoring signal corresponding to the first mains power event; Calculating the distance between the smart plug portion and the first main pipe portion. and configured to compare the first mains power event with the smart plug power event by 31. The system of claim 30.
33. The at least one computer identifying a plurality of smart plug power events in the smart plug power monitoring signal occurring at a plurality of event time points, each smart plug power event corresponding to an event time point among the plurality of event time points; using the plurality of event time points to identify a plurality of first mains power events in the first mains power monitoring signal; processing the plurality of first mains power events using the plurality of power models to determine a device corresponding to each first mains power event; counting a number of times the first device corresponds to a first mains power event of the plurality of first mains power events; It is structured as follows: the at least one computer is configured to determine that the first device is receiving power from the smart plug by using the number of times corresponding to a first mains power event of the plurality of first mains power events.
30. The system of claim 29.
34. The at least one computer identifying a second first mains power event in the first mains power monitoring signal corresponding to a second time point; determining that the second first mains power event corresponds to a state change of the first device; determining that the first device is no longer connected to the smart plug; updating the entry in the data store to indicate that the first device is not receiving power from the smart plug; 30. The system of claim 29, configured to:
35. the at least one computer is configured to determine that the first main power event corresponds to the first device by: (1) processing the first main power event using the plurality of power models to generate a score for each power model of the plurality of power models; and (2) selecting the power model corresponding to the highest score.
30. The system of claim 29.
36. One or more non-transitory computer-readable media containing computer-executable instructions that, when executed, cause at least one processor to: Establishing a network connection with a smart plug that is powering one or more devices; receiving, via the network connection, a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to the one or more devices; obtaining a first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of the building; identifying a smart plug power event corresponding to an event time in the smart plug power monitoring signal; identifying a first mains power event in the first mains power monitoring signal using the event time; determining that the first mains power event corresponds to a first device by processing the first mains power event using a plurality of power models; using the determination that the first mains power event corresponds to the first device, determining that the first device is connected to the smart plug; updating an entry in a data store to indicate that the first device is receiving power from the smart plug; 23. A computer-readable medium for causing a computer to perform operations including:
37. determining that the first device is connected to the smart plug includes comparing the first mains power event to the smart plug power event; 37. The computer readable medium of claim 36.
38. comparing the first mains power event to the smart plug power event includes comparing a power change of the first mains power event to a power change of the smart plug power event.
38. The computer readable medium of claim 37.
39. Comparing the first mains power event with the smart plug power event comprises: obtaining a smart plug portion of the smart plug power monitoring signal corresponding to the smart plug power event; obtaining a first mains portion of the first mains power monitoring signal corresponding to the first mains power event; Calculating a distance between the smart plug portion and the first main pipe portion; 40. The computer readable medium of claim 37, comprising:
40. The operations include obtaining information from a data store indicating that the smart plug is receiving power from the first electrical main of the building.
37. The computer readable medium of claim 36.
41. 1. A computer-implemented method for training a mathematical model of a first device, comprising: receiving a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to one or more devices, including the first device; identifying a plurality of on-activation time points corresponding to the smart plug power monitoring signal transitioning from zero power to non-zero power; identifying a number of power-off time points corresponding to a transition of the smart plug power monitoring signal from non-zero power to zero power; obtaining a first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of the building; identifying power events in the first mains power monitoring signal, each power event corresponding to an event time; clustering the power events into a plurality of clusters; selecting a first cluster of the plurality of clusters using (i) the plurality of on-activation time points and (ii) an event time point of a power event of the first cluster; selecting a second cluster from the plurality of clusters using (i) the plurality of power off time points and (ii) an event time point of a power event of the second cluster; training a first transition model for the first device using one or more of the power events of the first cluster; training a second transition model for the first device using one or more of the power events of the second cluster; identifying a state change of a device using the first transition model and the second transition model; A computer-implemented method comprising:
42. selecting the first cluster includes determining a closest on-activation time for each event time of the power event of the first cluster.
42. The computer-implemented method of claim 41.
43. creating a state model of the first device including two states; Calculating a wattage model of the first device; calculating a score indicative of a fit between the wattage model of the first device and the smart plug power monitoring signal; determining, using the score, to add a third state to a state model of the first device; 42. The computer-implemented method of claim 41, comprising:
44. selecting a third cluster of the plurality of clusters using (i) the plurality of on-activation time points, (ii) the plurality of off-activation time points, and (iii) an event time point of the power event of the third cluster.
44. The computer-implemented method of claim 43.
45. determining, for each event time of the power events of the third cluster, whether the event time is between an on-time of operation and a subsequent off-time of operation; 45. The computer-implemented method of claim 44.
46. calculating a wattage model of the first device includes calculating an expected amount of power that the first device will consume from the first mains power monitoring signal.
44. The computer-implemented method of claim 43.
47. the expected amount of power is an average or median value of power in the first mains power monitoring signal after the power event for the first cluster; 47. The computer-implemented method of claim 46.
48. The expected amount of power is an average or median value of power in the smart plug power monitoring signal after the on-activation time.
47. The computer-implemented method of claim 46.
49. 1. A system for training a mathematical model of a first device, comprising: At least one computer including at least one processor and at least one memory, the at least one computer comprising: receiving a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to one or more devices, including the first device; Identifying a plurality of on-activation time points corresponding to the smart plug power monitoring signal transitioning from zero power to non-zero power; identifying a plurality of actuation-off time points corresponding to a transition of the smart plug power monitoring signal from non-zero power to zero power; obtaining a first mains power monitoring signal using measurements from a sensor that measures an electrical characteristic of a first electrical main of the building; identifying power events in the first mains power monitoring signal, each power event corresponding to an event time; clustering the power events into a plurality of clusters; selecting a first cluster of the plurality of clusters using (i) the plurality of on-activation time points and (ii) an event time point of a power event of the first cluster; selecting a second cluster of the plurality of clusters using (i) the plurality of power off time points and (ii) an event time point of a power event of the second cluster; training a first transition model for the first device using one or more of the power events of the first cluster; training a second transition model for the first device using one or more of the power events of the second cluster; identifying a state change of a device using the first transition model and the second transition model; The system is configured as follows:
50. the at least one computer is configured to deploy the first transition model and the second transition model to a second building.
50. The system of claim 49.
51. the at least one computer is configured to select the first cluster by determining a closest on-activation time for each event time of the power event of the first cluster.
50. The system of claim 49.
52. The at least one computer creating a state model of the first device including two states; Calculating a wattage model of the first device; Calculate a score indicative of a fit between the wattage model of the first device and the smart plug power monitoring signal; using the score to determine to add a third state to a state model of the first device; 50. The system of claim 49, configured to:
53. the at least one computer is configured to determine to add a fourth state to the state model of the first device.
53. The system of claim 52.
54. the at least one computer is configured to calculate the score indicative of the goodness of fit of the wattage model by calculating a distance between the wattage model and a plurality of portions of the smart plug power monitoring signal.
53. The system of claim 52.
55. the at least one computer configured to calculate a feature for each one of the power events; the at least one computer is configured to cluster the power events using the features.
50. The system of claim 49.
56. the features calculated for the power event include one or more of a match between the power event and a template, a Fourier coefficient, a neural network feature, or a change in power, current, voltage or phase before and after the power event; 56. The system of claim 55.
57. One or more non-transitory computer-readable media containing computer-executable instructions that, when executed, cause at least one processor to: receiving a smart plug power monitoring signal indicative of an amount of power the smart plug is providing to one or more devices, including the first device; identifying a plurality of on-activation time points corresponding to the smart plug power monitoring signal transitioning from zero power to non-zero power; identifying a number of power-off time points corresponding to a transition of the smart plug power monitoring signal from non-zero power to zero power; obtaining a first mains power monitoring signal using measurements from a sensor measuring an electrical characteristic of a first electrical main of the building; identifying power events in the first mains power monitoring signal, each power event corresponding to an event time; clustering the power events into a plurality of clusters; selecting a first cluster of the plurality of clusters using (i) the plurality of on-activation time points and (ii) an event time point of a power event of the first cluster; selecting a second cluster from the plurality of clusters using (i) the plurality of power off time points and (ii) an event time point of a power event of the second cluster; training a first transition model for the first device using one or more of the power events of the first cluster; training a second transition model for the first device using one or more of the power events of the second cluster; identifying a state change of a device using the first transition model and the second transition model; 23. A computer-readable medium for causing a computer to perform operations including:
58. selecting the first cluster includes determining a closest on-activation time for each event time of the power event of the first cluster.
58. The computer readable medium of claim 57.
59. Clustering the power events includes using hierarchical clustering, centroidal clustering, or density clustering.
58. The computer readable medium of claim 57.
60. The operations include computing a feature for each power event of the power events; and clustering the power events includes clustering the power events using the features.
58. The computer readable medium of claim 57.
Citation Information
Patent Citations
Life information collecting system
JP2005354794A
Data estimation device, data estimation method, and data estimation system
JP2011154679A
Display unit, method and program
JP2014055798A
Apparatus information system
JP2014081336A
Arithmetic unit
JP2015108953A
