Voice Responsive In-Wall Devices

Abstract

A voice-responsive in-wall device is provided. In one example embodiment, a power switch includes a housing that can be mounted on a surface or at least partially mounted within a surface. The housing can have a front panel. The power switch can include an interface element disposed on the front panel and operable to receive user input. The power switch can include a power interrupter that can be operated to control the delivery of power to a powered load based at least in part on interaction with the interface element. The power switch can include one or more microphones that can be operated to obtain audio input. The power switch can include one or more speakers configured to provide audio output. The power switch can include a communication interface that can be operated to communicate data associated with the audio input via a communication link.

Description

[0001] Priority claim

[0002] This application is based on and claims the benefit of priority of U.S. Provisional Application No. 62 / 608,107, filed December 20, 2017, entitled “VOICE RESPONSIVE IN-WALL DEVICE,” which is incorporated herein by reference. This application is also based on and claims the benefit of priority of U.S. Provisional Application No. 62 / 640,274, filed March 8, 2018, entitled “VOICE RESPONSIVE IN-WALL DEVICE.” In addition, this application is based on and claims the benefit of priority of U.S. Provisional Application No. 62 / 673,229, filed May 18, 2018, entitled “VOICE RESPONSIVE IN-WALL DEVICE.” Technical Field

[0003] The present invention generally relates to in-wall devices, such as power switching devices. Background Art

[0004] In-wall devices may include devices that can be mounted on a wall or other surface or at least partially disposed in a wall or other surface (e.g., in a wall-mounted electrical box). Example in-wall devices may include power switches for controlling various powered devices such as electronic devices, light sources, appliances, power outlets, and other devices. The power switch may control the power delivered to the load, for example, by interrupting the conductor that delivers the power to the load. Example power switches may include, for example, single or multiple on / off toggle switches, foot or rocker switches, single or multiple pole dimmer switches, power outlets, etc.

[0005] As Internet of Things (IoT) technology advances, power switches and other in-wall devices can communicate with other electronic devices via one or more communication links. For example, the power switch can communicate using communication technologies such as low-power Bluetooth, Bluetooth mesh networking, near field communication, Wi-Fi, ZigBee, Ethernet, etc. Summary of the invention

[0006] Aspects and advantages of embodiments of the invention will be set forth in part in the description which follows, or may be learned from the description, or may be learned through practice of the embodiments.

[0007] An example aspect of the present invention relates to a power switch for controlling a powered load. The power switch may include a housing that can be mounted on a surface or at least partially mounted within a surface. The housing may have a front panel. The power switch may include an interface element disposed on the front panel and operable to receive user input. The power switch may include a power interrupter that is operable to control the delivery of power to the powered load based at least in part on interaction with the interface element. The power switch may include one or more microphones operable to obtain audio input. The power switch may include a speaker configured to provide an audio output. The power switch may include a communication interface operable to communicate data associated with the audio input via a communication link.

[0008] Another example aspect of the invention relates to a method for processing audio data received at a power switch. The method includes obtaining audio data by one or more microphones in the power switch in a passive mode. The method includes processing the audio data by one or more processors in the power switch to identify a trigger condition. The method includes determining, by one or more processors in the power switch, that the trigger condition corresponds to an out-of-band condition. The method includes operating, by the one or more processors, in a response mode in response to determining that the trigger condition corresponds to the out-of-band condition. The method includes implementing, by the power switch in the response mode, at least one control action.

[0009] Another aspect of the present invention relates to a power switch for controlling a powered load. The power switch includes a housing that can be mounted on a surface or at least partially mounted within a surface. The housing may have a front panel. The power switch may include a rocker button or switch disposed on the front panel. The rocker button is operable to receive user input. The power switch may include a first button and a second button. The first button may be disposed below an interface element in a vertical direction. The second button may be disposed below the interface element in a vertical direction. The power switch may include a first microphone and a second microphone. The first microphone may be disposed in the first button. The second microphone may be disposed in the second button. The power switch may include a speaker disposed behind the interface element. The power switch may include a power interrupter that is operable to control the power delivery to the powered load based at least in part on an interaction with the rocker button. The power switch may include a communication interface that is operable to communicate data associated with an audio input via a communication link.

[0010] These and other features, aspects and advantages of various embodiments will be better understood with reference to the following description and appended claims.The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the relevant principles. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] A detailed discussion of embodiments for those of ordinary skill in the art is set forth in the specification with reference to the accompanying drawings, in which:

[0012] Figure 1 Depicting a perspective view of an example power switch according to an example embodiment of the present invention;

[0013] Figure 2 Depicting a front view of an example power switch according to an example embodiment of the present invention;

[0014] Figure 3 Depicting an exploded view of an example power switch according to an example embodiment of the present invention;

[0015] Figure 4 Depicting a first button and a second button assembly of a power switch according to an example embodiment of the present invention;

[0016] Figure 5 Depicting a front view of an example power switch with the rocker button removed according to an example embodiment of the present invention;

[0017] Figure 6 Depicting an example acoustic gap defined between a rocker button and a footrest housing according to an example embodiment of the present invention;

[0018] Figure 7 depicts an example halo indicator on a rocker button according to an example embodiment of the present invention;

[0019] Figure 8 depicts an example night light indicator on a rocker button according to an example embodiment of the present invention;

[0020] Fig. 9 Depicting an example access door for accessing to program a power switch according to an example embodiment of the present invention;

[0021] Fig.10 A block diagram depicting example components of a power switch according to an example embodiment of the present invention;

[0022] Fig.11 Depicting an example computing environment for use in conjunction with a power switch according to an example embodiment of the present invention;

[0023] Fig.12 A flowchart depicting an example method according to an example embodiment of the invention;

[0024] Fig.13 A flowchart depicting an example method according to an example embodiment of the invention;

[0025] Fig.14 Depicting an example lighting system having a plurality of power switches according to an example embodiment of the present invention;

[0026] Fig.15 Depicting a rear view of an example light blocker according to an example embodiment of the present invention; and

[0027] Fig.16 Depicted is a front view of an example light blocker according to an example embodiment of the invention. DETAILED DESCRIPTION

[0028] Reference will now be made in detail to the embodiments, one or more examples of which are illustrated in the drawings. Each example is provided in a manner that explains the embodiments and not to limit the invention. In fact, it will be apparent to those skilled in the art that various modifications and variations may be made to the embodiments without departing from the scope or spirit of the invention. For example, a feature illustrated or described as part of one embodiment may be used with another embodiment to produce yet another embodiment. Therefore, it is contemplated that aspects of the invention encompass such modifications and variations.

[0029] Example aspects of the invention are directed to an in-wall device for controlling and / or powering one or more other devices, such as electrical loads. In some embodiments, the in-wall device may be a power switch, such as a single or multiple on / off toggle switches, a foot or rocker button, a single or multiple pole dimmer switch, a power outlet, or other device capable of controlling the delivery of power to one or more powered loads. For example, the power switch may be configured to interrupt power delivered to one or more loads by interrupting or controlling power to conductors that deliver power to the loads.

[0030] For purposes of illustration and discussion, embodiments of the present invention will be discussed with reference to a power switch. One of ordinary skill in the art using the disclosure provided herein will appreciate that aspects of the present invention may be applicable to other in-wall devices. As used herein, an "in-wall device" is an electrical or electronic device that may be mounted on and / or in a wall or other surface, such as a panel, ceiling, floor, or other surface. In some embodiments, the in-wall device may be installed in an electrical box secured to and / or in a wall or other surface.

[0031] It should be understood that the in-wall device can be installed in any suitable type of electrical box. For example, in some embodiments, the in-wall device can be installed in a single-gang electrical box. As another example, the in-wall device can be installed in a double-gang electrical box. As yet another example, the in-wall device can be installed in a triple-gang electrical box.

[0032] The power switch may be a "smart" device. For example, the power switch may include one or more processors and one or more memory devices. One or more processors may execute computer-readable instructions stored in one or more memory devices to provide desired functionality. Example functionality may include communicating with other devices via one or more communication links. For example, the power switch may communicate with an electrical load (e.g., a lighting fixture, a ceiling fan, an appliance, an electronic device, an electrical socket, a household device, etc.) to control the operation of the electrical load. The power switch may communicate with one or more other computing devices (e.g., a server, a cloud computing device, a user device such as a smart phone, a tablet computer, a wearable device, etc.) to receive data, access processing resources, store data, receive user input or control, access models, access services (e.g., a digital audio assistant service), receive software updates or other updates, etc.

[0033] Example communication technologies and / or protocols may include, for example, Bluetooth Low Energy, Bluetooth mesh networking, near field communication, Thread, Transport Layer Security (TLS), Wi-Fi (e.g., IEEE 802.11), Wi-Fi Direct (for peer-to-peer communications), Z-Wave, ZigBee, HaLow, cellular communications, LTE, low power wide area networking, VSAT, Ethernet, Multimedia over Coax Alliance (MoCA), power line communications (PLC), digital line transmission (DLT), etc. Other suitable communication technologies and / or protocols may be used without departing from the scope of the present invention.

[0034] According to an example embodiment of the present invention, the power switch is capable of performing one or more actions based at least in part on audio data (e.g., a voice command) received at the power switch. For example, the power switch may include at least one microphone configured to obtain audio input. The audio input may be, for example, a voice command received from a user. In response to the audio input, the power switch may be configured to take one or more actions. For example, one or more processors located in the power switch may perform audio processing on the audio input to recognize the voice command and control the power switch to take one or more actions. Additionally and / or in an alternative, the audio input may be communicated to one or more other devices (e.g., a cloud computing device) for audio processing to recognize the voice command.

[0035] In some embodiments, in response to the audio input, the power switch may be configured to take an action associated with controlling and / or providing power to one or more devices powered by the in-wall device. As an example, the power switch may be configured to control the delivery of power to or otherwise provide a control signal to a powered device, such as one or more lighting fixtures, appliances, electronic devices, user devices, etc., in response to an audio command received as an audio input at the power switch.

[0036] In some embodiments, the audio input may be used to take actions that facilitate the operation of the power switch or a load powered by the power switch. For example, the audio input may be communicated to one or more devices for implementing a digital audio assistant service. The digital audio assistant service may process the audio input to identify one or more voice commands and take actions in response to the search command. As examples, the digital audio assistant may access search results, conduct online shopping, play music, set appointments / reminders, perform tasks, control networked devices, and the like.

[0037] In some embodiments, the audio input may be processed (e.g., using a classifier model, such as a machine learning model) to recognize certain sounds. For example, the audio input may be processed to recognize sounds associated with, for example, smoke alarms, environmental sensor alarms, breaking glass, etc. The power switch may be configured to take appropriate actions in response to the sounds. For example, the power switch may provide an audio output that alerts a user to a dangerous condition. The power switch may communicate data associated with the dangerous condition to a monitoring service and / or a user so that an appropriate response may be implemented. The power switch may control one or more powered loads in response to the dangerous condition, such as irradiating a space, de-energizing one or more appliances, etc.

[0038] The power switch may include an audio output device (e.g., a speaker) for providing an audio output in response to an audio input. In some embodiments, the audio output device may be a 20 millimeter (mm) speaker. The audio output may be in response to one or more audio commands received as audio input by one or more microphones located on the in-wall device. The audio output device may also be used, for example, to play music or play sounds associated with a connected media device (e.g., a television).

[0039] In some embodiments, the user may interface with the power switch via a user device, which is connected to the power switch via a communication link. For example, the user may access an application implemented on a user device (e.g., a smart phone, a tablet computer, a laptop computer, a wearable device, a display with one or more processors, etc.). The application may present a graphical user interface or other user interface (e.g., an audio interface) to the user. The user may interact with the graphical user interface to control the setting and / or operation of the power switch. The signal associated with the user interaction may be communicated to the power switch, for example, via a network, to control and / or adjust the setting of the power switch. Additionally and / or in an alternative, data collected by the power switch (e.g., one or more sensors, a power meter, etc. associated with the power switch) may be communicated to the user device for presentation to the user.

[0040] In some example embodiments, the power switch may include a housing that can be mounted on or at least partially within a surface, such as a wall, panel, ceiling, floor, or other surface. The housing may include a front panel. When the power switch is mounted on a surface, at least a portion of the front panel may be visible to a user.

[0041] The power switch may include an interface element disposed on the front panel. The interface element may be operable to receive user input to control the operability of the power switch. For example, in some embodiments, the interface element may be a rocker button or a switch. When the rocker button is pressed in a first direction, the power switch may be controlled to deliver power to the powered load. When the rocker button is pressed in a second direction, the power switch may be controlled to disconnect the power to the powered load. In this way, the user may interact with the interface element to control the delivery of power to one or more powered loads. Other suitable interface elements may be used without departing from the scope of the present invention, such as a toggle switch, a dimmer knob, a slider, a touch screen, a touch pad, etc.

[0042] The power switch may include a power interrupter that is operable to control the delivery of power to the powered load based at least in part on a user interaction with an interface element. The power interrupter may be any suitable device configured to interrupt and / or release the interruption of power to the powered load. For example, in some embodiments, the power interrupter may be a thyristor (e.g., a TRIAC device), a semiconductor switching element (e.g., a transistor), a relay, a contactor, etc., which is controlled to provide power or not to provide power to the powered load. The power interrupter may be controlled at least in part based on a user interaction with an interface element. The power interrupter may also be controlled based on a signal received at the power switch via, for example, a communication interface (e.g., in response to a signal received via a network from a user device such as a smart phone, a tablet computer, a wearable device, a laptop computer, or other device).

[0043] The power switch may include one or more microphones configured to obtain audio input. For example, the power switch may include a first microphone and a second microphone. The power switch may include an audio output device such as a speaker. The first microphone, the second microphone, and the speaker may be arranged in the power switch to provide enhanced audio performance of the power switch.

[0044] For example, in some embodiments, the front panel of the power switch may include a front panel with a rocker button. A speaker may be located behind the rocker button. The location of the speaker behind the rocker button may allow the sound emitted from the speaker to be amplified, thereby reducing the need for a large speaker. In this way, a smaller speaker may be used while maintaining the loud, full sound that is typically available from a larger speaker. An acoustic gap may be incorporated around the sides of the rocker button to allow sound to escape from the power switch while hiding the appearance of the speaker from the front of the power switch.

[0045] The front panel may further include a first button and a second button located vertically below the rocker button. In some embodiments, a Fresnel lens may be disposed between the first button and the second button. The first button may be used, for example, to pair the power switch with one or more powered loads via a communication link (e.g., Bluetooth low energy, etc.). The second button may be used as an air gap switch. One or more sensors (e.g., a passive infrared sensor, an ambient light sensor, etc.) may be located behind the Fresnel lens.

[0046] The first microphone may be disposed in the first switch. The second microphone may be disposed in the second switch. In this way, the positioning of the first microphone and the second microphone may be used, for example, for beam sweeping to determine the origin of the sound in space. In addition, the positions of the first microphone and the second microphone may be positioned away from the speaker so that there is less sound projected from the speaker to the microphone. More specifically, the first microphone and the second microphone may be located in the lower left and lower right corners of the power switch, respectively, so as to be separated from the speaker located near the top of the power switch. This can achieve efficient operation of audio echo cancellation using microphones. In some embodiments, the sound deflector may be positioned relative to the speaker to deflect the sound away from the microphone to increase performance (e.g., increase the ability of audio cancellation).

[0047] In some embodiments, the power switch may include one or more indicators, such as a light ring and / or light bar. For example, the power switch may include a ring of light emitting diodes (LEDs) or other light sources positioned behind the rocker button. The rocker button may be made of a plastic material that acts as a light pipe and light diffuser for the light emitted from the LED ring, such that a light ring is depicted on the rocker button.

[0048] In some embodiments, the light ring can be controlled in response to various actions, such as in response to voice commands. For example, in some embodiments, the light ring can be controlled to be displayed in response to a voice command received via one or more microphones. Once the voice command is completed, the light ring can be turned off or no longer illuminated. In some embodiments, various different animation sequences can be displayed in response to detecting different voice commands or other user inputs. For example, a circular animation configured to simulate a rotating circle can be displayed in response to detecting a voice command.

[0049] In some embodiments, a night light (e.g., a light bar) may be positioned in front of the rocker button. The night light may provide ambient lighting at night, allowing the user to easily locate the power switch in the dark. The color and / or brightness of the night light may be specified as part of the settings associated with the power switch (e.g., via an application implemented on the user device). In some embodiments, the night light may be positioned in the center of the light ring.

[0050] The power switch may have various other features to enhance the functionality of the device. For example, in some embodiments, the power switch may have power metering incorporated into the power switch. Power metering may be implemented, for example, by measuring the voltage and / or current flowing through the load wires passing through the power switch. The current may be measured, for example, using a sense resistor. The voltage may be measured, for example, using a voltage divider. The power flowing through the load wires may be calculated (for example, using one or more processors located on and / or remote from the power switch) based on the measured current and voltage.

[0051] The information obtained from power metering can be used for a variety of purposes. For example, in some embodiments, data indicating power consumption can be communicated to a user device (e.g., via a network) to provide the user with feedback (e.g., real-time feedback) on the power consumption of one or more powered loads powered by the power switch. As another example, in some embodiments, the power switch and / or a device communicating with the power switch can process data indicating power consumption to detect when the power delivered to the powered load exceeds the rated power associated with the powered load. The power switch can be configured to automatically reduce the power delivered to the powered load to a safe level. In addition, a warning can be communicated to the user.

[0052] As used herein, an "alert" provided by a power switch may be an audio alert, a visual alert, an electronic data communication, a display on a user interface associated with a device that communicates with the power switch, and the like. For example, an audio alert may be provided via a speaker in the power switch. A visual alert may be provided via one or more indicators (e.g., a light ring, a night light, etc.). A visual alert may also be provided by controlling one or more lighting devices powered by the power switch. An alert may be provided by communicating data from the power switch to another device via a communication link. For example, data associated with the alert may be communicated to a user device. The user device may then provide an audio alert, a visual alert (e.g., via a graphical user interface), a tactile alert, and the like.

[0053] In some embodiments, the power switch may include a near field communication (NFC) tag. The NFC tag may allow the power switch to be paired with another device (e.g., a user device) for communication without requiring, for example, a pairing code. The NFC tag may be located, for example, behind a rocker button, allowing it to be positioned in front of the power switch. This may allow the NFC tag to interface with an NFC-compatible user device.

[0054] In some embodiments, the power switch may include an ambient light sensor. Signals from the ambient light sensor may be used, for example, to implement a control action (e.g., control power delivery to one or more powered loads) based on ambient lighting in the space. In some embodiments, the ambient light sensor may be located, for example, behind a Fresnel lens.

[0055] In some embodiments, the power switch may include a passive infrared (PIR) sensor. The PIR sensor may, for example, be located behind a Fresnel lens disposed in front of the power switch. The PIR sensor may, for example, be used to detect motion in the vertical and / or horizontal directions. This may be used for gesture-based control of the power switch.

[0056] In some embodiments, gesture control may allow a user to operate the power switch without having to physically touch the power switch. As an example, a user may turn on the power switch to deliver power to a powered load by moving their hand in a vertical direction from the bottom of the power switch toward the top of the power switch. A user may turn off the power switch to interrupt power to a powered load by moving their hand in a vertical direction from the top of the power switch toward the bottom of the power switch. Dimming of the power switch may be achieved, for example, by rotating a finger in a clockwise or counterclockwise direction in front of the power switch. Other suitable non-touch gestures may be used without departing from the scope of the present invention.

[0057] Referring now to the drawings, example embodiments of the present invention will now be described. Figures 1 to 3 An example power switch 100 is depicted according to an example embodiment of the invention. Figure 1 A perspective view of a power switch 100 is depicted. Figure 2 A front view of the power switch 100 is depicted. Figure 3 An exploded view of the power switch 100 is depicted.

[0058] The power switch 100 may be a wall mounted device that may be mounted on a surface or at least partially mounted in a surface, such as a wall, floor, panel, ceiling, or other surface. The power switch 100 includes a housing 102. The housing 102 houses and / or contains one or more components of the power switch 100. The housing 102 may include a front panel 105 and a frame 106. The front panel 105 may be a visible portion of the power switch 100 when mounted on a surface or at least partially mounted in a surface. The frame 106 may house various components of the power switch 100, such as one or more circuit boards 150, 160 having electronic components associated with the power switch 100.

[0059] One or more of the circuit boards 150 and 160 may contain various electronic components associated with the power switch 100, such as one or more processors, one or more memory devices, one or more circuits for wireless communication, and other components. Fig.10 Example electronic components associated with the power switch 100 are discussed.

[0060] Still refer to Figures 1 to 3, the power switch 100 may receive conductors 202, 204, and 206 for delivering power to one or more powered loads. For example, power may be delivered to the power switch 100 from a power source (e.g., a circuit breaker, a panel, etc.) via conductors 204 and 206. In some embodiments, conductor 204 may be a hot conductor. Conductor 206 may be a neutral conductor. Conductor 202 may be a load conductor (e.g., a load wire) for delivering power to one or more powered loads (e.g., a lighting fixture, an electronic device, a powered socket, an appliance, a machine, etc.).

[0061] The power switch 100 can control the delivery of power to one or more powered loads via the conductor 202 via a power interrupter. The power interrupter controls whether power is delivered via the conductor 202. Figures 1 to 3 In the example embodiment of the power switch 100 shown in , the power interrupter is a thyristor 155 (e.g., TRIAC). When the thyristor 155 is in a first state, power is conducted to one or more powered loads via the conductor 202. When the thyristor 155 is in a second state, power is not conducted to one or more powered loads via the conductor 202.

[0062] Various aspects of the present invention are discussed with reference to thyristor power interrupters for purposes of illustration and discussion. Other suitable devices and / or components, such as power semiconductors, relays, contactors, mechanical switches, etc., may be used to control power delivery via conductor 202 without departing from the scope of the present invention.

[0063] The state of the thyristor 155 may be controlled based on various inputs. For example, the state of the thyristor 155 may be controlled based on user input received at an interface element, such as a rocker button or switch 110 of the power switch 100. The state of the thyristor 155 may also be controlled based on signals received from other devices (e.g., a user device such as a smart phone, tablet computer, wearable device, laptop computer, display with one or more processors) received via a communication link.

[0064] For example, refer to Figures 1 to 3 , the front panel 105 may include a rocker button 110, a foot housing 108, and a heat sink 112. The rocker button 110 may be received in the foot housing 108. The rocker button 110 may rotate about an axis passing through the center of the rocker button 110, so that the rocker button 110 may rotate in a first direction when a user presses a top portion of the rocker button 110, and may rotate in a second direction when a user presses a bottom portion of the rocker button 110.

[0065] The rocker button 110 may interface with a rocker plunger 114. The rocker plunger 114 may pass through an aperture 109 defined in the foot housing 108 and an aperture 113 defined in the heat sink 112. The rocker plunger 114 may engage an actuator 116 located on the circuit board 150. The actuator 116 may provide a signal for controlling the thyristor 155 based on a user input via the rocker button 110. For example, when a user presses the rocker button 110 to rotate the rocker button 110 in a first direction, the thyristor 155 may be controlled to be in a first state to allow power to be delivered to one or more powered loads via the conductor 202. When the user presses the rocker button 110 to rotate the rocker button 110 in a second direction, the thyristor 155 may be controlled to be in a second state to stop delivering power to one or more powered loads via the conductor 202.

[0066] like Figures 1 to 3 As shown in FIG. 1 , the front panel 105 may further include a first button 122 and a second button 124. A Fresnel lens 126 may be disposed between the first button 122 and the second button 124. A user may interact with the first button 122 and the second button 124 to control various operations of the power switch 100.

[0067] In some embodiments, the first button 122 may be a pairing button. More specifically, a user may interact with the first button 122 (e.g., press and / or pull out the first button 122) to initiate a pairing sequence with another device, such as a powered load, another power switch, or a user device. The pairing sequence is used to enable communication between the power switch 100 and another device. For example, the pairing sequence can be used to allow communication between the power switch 100 and another device using a direct peer-to-peer communication protocol. Without departing from the scope of the present invention, any of a number of suitable interactions (e.g., a user interaction sequence) via the first button can be used to initiate the pairing sequence.

[0068] In some embodiments, the second button 124 may be an air gap switch. User interaction with the air gap switch may be used to remove power from the power switch 100 and / or one or more powered loads. In some embodiments, the user may interact with the second button 124 by pulling the second button 124 away from the front panel 105. The second button 124 may be associated with a long plunger arm so that when the second button 124 is pulled away from the front panel 105, power to the power switch 100 and one or more connected loads is removed. In some embodiments, the user may interact with the second button 124 by pushing the second button 124 toward the front panel 105. For example, the user may push the second button 124 toward the front panel 105 to perform one or more functions. As an example, the one or more functions may include activating a digital voice assistant service.

[0069] Figure 4A perspective view of an example assembly including a first button 122 and a second button 124 according to an example embodiment of the present invention is depicted. As shown, the first button 122 and the second button 124 can be coupled to a single flexure plate 125. The single flexure plate 125 can be connected to a printed circuit board 150 ( Figure 3 ), thereby reducing the complexity of the power switch 100.

[0070] Return to reference Figures 1 to 4 , the power switch 100 may include a first microphone 142 and a second microphone 144. The first microphone 142 may be disposed in the first button 122. The second microphone 144 may be disposed in the second button 124. The first microphone 142 may be sealed with plastic. The first microphone 142 may be coupled to the printed circuit board 150 using a flexible printed circuit (FPC) cable that allows the first button 122 to be pressed up and down while still maintaining a connection to the printed circuit board 150. The second microphone 144 may be coupled to the printed circuit board 150 using a flexible printed circuit (FPC) cable that allows the second button 124 to be pressed up and down while still maintaining a connection to the printed circuit board 150.

[0071] Audio data received at the first microphone 142 and / or the second microphone 144 may be communicated to one or more processors (eg, on and / or remote from the power switch 100). As described in more detail below, the audio data may be processed to provide audio responsiveness functionality.

[0072] In some embodiments, the first microphone 142 and / or the second microphone 144 may each be covered with a membrane. More specifically, the membrane may include a water-resistant material. In this way, the membrane may prevent moisture from reaching the microphones 142, 144.

[0073] Figure 5 Depiction Figures 1 to 3 100, wherein the rocker button 110 is removed. As shown, the power switch 100 includes an antenna 175. The antenna 175 can be used to wirelessly transmit and receive data and other signals via one or more communication links. The antenna 175 is positioned behind the rocker button 110 to achieve increased communication capabilities. This can be important when the power switch 100 is installed in a metal electrical box (e.g., single-gang, double-gang, triple-gang, etc.). Positioning the antenna 175 as forward as possible allows the antenna to remain outside the metal electrical box, thereby preventing a reduction in signal strength.

[0074] In some embodiments, antenna 175 may be a multi-band antenna capable of transmitting and / or receiving information via multiple frequency bands, so that data and other signals can be communicated to other devices using different protocols and / or communication channels. For example, antenna 175 may be configured for communication via a Wi-Fi band (e.g., approximately 2.4 GHz) and a Bluetooth band (e.g., approximately 5 GHz). As used herein, the term "about" used in conjunction with a numerical value is intended to refer to within 20% of the stated amount.

[0075] Still refer to Figure 5 The power switch 100 may include an audio output device, such as a speaker 130. The speaker 130 may be circular in shape. The speaker 130 may be disposed on the rocker button 110 ( Figure 1 ) rear. Speaker 130 may be housed in a recess defined in footrest housing 108. As will be described in more detail below, speaker 130 may be configured to provide audio output. In some embodiments, speaker 130 may include a ported speaker box. In some embodiments, speaker 130 may be a 20 mm speaker. In some embodiments, speaker 130 may include a sealed chamber speaker box.

[0076] In some embodiments, the power switch 100 may include a sound deflector 135. The sound deflector 135 may deflect sound emitted from the speaker 130 away from the first microphone 142 and the second microphone 144. The sound deflector 135 may be disposed around a bottom portion of the speaker 130. The sound deflector 135 may reduce the amount of sound projected downward toward the first microphone 142 and the second microphone 144. This may increase the performance of audio echo cancellation.

[0077] like Figure 6 As shown in , in some embodiments, a gap may be defined between an interface element (eg, rocker button 110) in the front panel 105 of the power switch 100 and the foot housing 108. For example, Figure 6 Depiction Figure 1 100. As shown, a gap 134 is defined around at least a portion of the edge of the rocker button 110 and the foot housing 108. The gap 134 may be a "sound gap" that allows sound to emanate from the speaker 130 behind the rocker button 110.

[0078] Return to reference Figure 5 , the power switch 100 may include an LED board 170. The LED board 170 may include a display for displaying a signal through the rocker button 110 ( Figure 1) provide multiple LEDs of indicators. More specifically, the rocker button 110 can be made of a material such that the rocker button 110 diffuses light emitted from the multiple LEDs to the front of the rocker button 110 to provide one or more indicators. For example, the rocker button 110 can be formed of a plastic material that can act as a light pipe and a light diffuser. In some embodiments, the light blocking housing can extend from the LED board 170 to the rocker button 110 ( Figure 1 ) to prevent light leakage.

[0079] Specific references Figure 5 , the LED board 170 may include an LED ring 172 having a plurality of LEDs arranged in a ring. The LED ring 172 may be used to provide a light ring indicator. The LED board 170 may also include an LED 174 in the center portion of the LED board 170 within the LED ring 172, which may be used to act as a night light indicator.

[0080] Figure 7 100 ( FIG. 101 ) depicts a front view of an example power switch according to an example embodiment of the present invention, wherein a light ring indicator 210 is illuminated on the rocker button 110. Figure 1 ) and display the halo indicator 210 in response to one or more voice commands received at ). For example, the halo indicator 210 can be used in conjunction with an implementation of a digital voice assistant service.

[0081] As an example, the light ring indicator 210 can be displayed when a voice command is detected. Various animations can be implemented using the light ring indicator 210 in response to the voice command. For example, during the completion of the voice command, the light ring indicator 210 can be controlled to provide a spinning ring animation. Once the voice command is completed, the light ring indicator 210 can be turned off and not visible.

[0082] In some embodiments, when a user approaches the power switch 100 as detected by one or more sensors (e.g., a PIR sensor), a light ring indicator 210 may be displayed. The presence of the light ring indicator 210 may provide an indication that the power switch 100 is ready to receive and respond to voice commands from the user. Other suitable configurations of indicators may be used without departing from the scope of the present invention.

[0083] Figure 8 Depicted is a front view of an example power switch according to an example embodiment of the present invention, wherein a night light indicator 220 is illuminated on the rocker button 110. The night light indicator 220 is illustrated as a horizontal bar. However, other suitable configurations of the night light indicator 220 may be used without departing from the scope of the present invention.

[0084] The night light indicator 220 can be normally turned on, allowing ambient lighting. In some embodiments, the night light indicator 220 can be illuminated when the ambient light sensor (e.g., located behind the Fresnel lens 126) determines that the light in the space has dropped below a threshold. In this way, the night light indicator 220 can help the user easily locate the power switch 100 when lighting is reduced.

[0085] Return to reference Figures 1 to 3 , the power switch 100 may include one or more sensors located behind the Fresnel lens 126. For example, the power switch 100 may include a passive infrared (PIR) sensor 180. The PIR sensor 180 may be coupled to the printed circuit board 150. A PIR cover 182 may be disposed over the PIR sensor 180. The PIR sensor 180 may be used to detect motion in the vertical and / or horizontal directions.

[0086] In some embodiments, the PIR sensor 180 may be used to detect contactless user gestures in front of the power switch 100 to allow the user to operate the power switch 100 without touching the power switch 100. Example gestures may include vertical swiping in front of the power switch 100. An upward vertical swipe may be used to place the power switch 100 in a first state to allow power to be delivered to one or more powered loads. A downward vertical swipe may be used to place the power switch 100 in a second state to stop power delivery to one or more powered loads. Circular gestures in a clockwise and / or counterclockwise direction may be used to control, for example, dimming of one or more light sources powered by the power switch 100. Other example gestures may be used to generate actions for the power switch 100.

[0087] The power switch 100 may further include an ambient light sensor (not shown) disposed behind the Fresnel lens 126. The ambient light sensor may be used to detect ambient lighting in a space. A signal indicative of ambient lighting may be used by the power switch 100 for a variety of purposes. For example, when the ambient light drops below a threshold, the power switch 100 may cause a night light indicator to illuminate. The power switch 100 may automatically turn on or off a light source powered by the power switch 100 based on the detected ambient light. The power switch 100 may be placed in one or more operating modes (e.g., a listening mode) based at least in part on the detected ambient light.

[0088] Fig. 9 1 depicts a side view of an example power switch 100 according to an example embodiment of the present invention. Fig. 9As described in , the frame 106 of the power switch 100 may include an access door 190. The access door 190 may allow access to a programming head on a printed circuit board disposed within the frame 106. A user may access the programming head to program the power switch 100, and / or otherwise modify software, firmware, or other computer-readable instructions executed by one or more processors on the power switch 100. In this way, the access door 190 may allow a technician to easily access the power switch 100 without disassembly. In some embodiments, a tamper-proof sticker may be placed above the door to hide the appearance of the access door 190. A removed sticker may indicate unauthorized access to the power switch 100 via the access door 190. In some embodiments, the frame 106 may include a series of holes configured to be suitable for accessing a programming head used to program the power switch 100.

[0089] Fig.10 A block diagram of an example control system 200 of an example power switch 100 according to an example embodiment of the present invention is depicted. The control system includes one or more processors 240 and one or more memory devices 260. For example, the one or more processors 240 may include dual (e.g., two) processors. Alternatively, the one or more processors 240 may include quad (e.g., four) processors.

[0090] The one or more processors 240 may be any suitable processing device that performs operations to control a component (e.g., any of the components described herein), such as a microprocessor, an integrated circuit (e.g., an application specific integrated circuit), a field programmable gate array, etc. One or memory devices 260 may be any suitable medium for storing computer-readable instructions and data. For example, the one or more memory devices 260 may include random access memory, such as dynamic random access memory (DRAM), static memory (SRAM), or other volatile memory. Additionally and / or in the alternative, the one or more memory devices may include non-volatile memory, such as ROM, PROM, EEPROM, flash memory, optical storage device, magnetic storage device, etc.

[0091] The one or more memory devices 260 may store computer-readable instructions that, when executed by the one or more processors 240, cause the one or more processors 240 to perform operations, such as any of the operations described herein (e.g., Fig.12 and 13 The instructions may be software written in any suitable programming language, or may be implemented in hardware.

[0092] The one or more memory devices 260 may also store data that may be obtained, received, accessed, written, manipulated, created, and / or stored. As an example, the one or more memory devices 260 may store data associated with one or more classifier models (e.g., machine learning classifier models) that may be used to classify audio data received at the power switch 100 into one or more sounds (e.g., smoke alarm, breaking glass, etc.). Storing the classifier models locally in the one or more memory devices 260 may allow local processing of the audio data to identify potential out-of-band conditions.

[0093] refer to Fig.10 , one or more processors 240 may communicate with the audio circuit 230 and / or may be configured to control the operation of the audio circuit. The audio circuit 230 may be configured to receive and process audio data received from, for example, the first microphone 142 and the second microphone 144. The audio circuit 230 may also provide an audio output for the speaker 130. In some embodiments, the audio circuit 230 may include one or more of a digital signal processor (DSP), a codec, an amplifier, etc. For example, the audio circuit 230 may be a low-power smart codec with a dual-core audio DSP. In some embodiments, the audio circuit 230 may include a CS47L24 smart codec with a dual-core DSP manufactured by Cirrus Logic.

[0094] One or more processors 240 may communicate with the microcontroller 280 and / or may be configured to control the operation of the microcontroller. The microcontroller 280 may be configured to control the TRIAC 155 and / or provide a signal to the processor 240 for controlling components based on input received via an interface element on the power switch 100, such as the rocker button 110, the first button 122, the second button 124, or other interface elements. The microcontroller 280 may also receive a signal from the PIR sensor 180. The signal from the PIR sensor 180 may be processed to implement gesture-based control (e.g., control based on non-contact gestures) of the power switch 100. In some embodiments, the microcontroller 280 may be a STM32F031G4U6 microcontroller manufactured by STMicroelectronics.

[0095] One or more processors 240 may communicate with a power meter 244 and / or may be configured to control the operation of the power meter. The power meter 244 may measure the voltage and / or current flowing through the load wire passing through the power switch 100. The current may be measured, for example, using a sensing resistor. The voltage may be measured using, for example, a voltage divider. The power flowing through the load wire may be calculated (e.g., using one or more processors 240 located on and / or away from the power switch 100) based on the measured current and voltage. In some embodiments, the power meter may be a STPM32 metering circuit manufactured by STMicroelectronics.

[0096] One or more processors 240 may communicate with an ambient light sensor 242. Signals from the ambient light sensor 242 may be used, for example, by the processor 240 to implement control actions (e.g., control power delivery to one or more powered loads) based on the ambient lighting in the space. In some embodiments, the ambient light sensor 242 may be a LTR-329ALS-01 digital light sensor manufactured by Mouser Electronics.

[0097] The one or more processors 240 may communicate with the LED driver circuit 270 and the LED board 170 to control the operation of the indicator for the power switch 100. The LED driver circuit 270 may provide power to the LED board 170 for driving a plurality of LEDs. The one or more processors 240 may control the light emission from the LEDs on the LED board to provide various indicators (e.g., light rings, night lights, etc.) as described herein. In some embodiments, the LED driver circuit 270 may be an IS31FL3235 LED driver manufactured by Integrated Silicon Solutions.

[0098] The one or more processors 240 may communicate with a communication interface 272. The communication interface 272 may allow data communication using the antenna 175 via, for example, one or more wireless links. The communication interface 272 may include any circuits, components, software, etc. for communicating via various communication links (e.g., networks). In some embodiments, the communication interface 272 may include, for example, one or more of a communication controller, a receiver, a transceiver, a transmitter, a port, a conductor, software, and / or hardware for communicating data. In some embodiments, the communication interface 272 may include a SX-SDPAC module manufactured by Silex Technology.

[0099] Example communication technologies and / or protocols may include, for example, Bluetooth Low Energy, Bluetooth mesh networking, near field communication, Thread, Transport Layer Security (TLS), Wi-Fi (e.g., IEEE 802.11), Wi-Fi Direct (for peer-to-peer communications), Z-Wave, ZigBee, HaLow, cellular communications, LTE, low power wide area networking, VSAT, Ethernet, Multimedia over Coax Alliance (MoCA), power line communications (PLC), digital line transmission (DLT), etc. Other suitable communication technologies and / or protocols may be used without departing from the scope of the present invention.

[0100] Fig.11 An example computing environment 300 is depicted in which a power switch 100 may be integrated according to an example embodiment of the present invention. As shown, the power switch 100 may communicate with various devices, such as a powered load 310 and / or one or more user devices 320, 360. The powered load 310 may be any device powered by the power switch 100, such as one or more lighting fixtures or other light sources, appliances, electronic devices, consumer devices, ceiling fans, machines, systems, or other powered loads. The user devices 320, 360 may be, for example, one or more smart phones, laptops, desktop computers, tablet computers, wearable devices, media devices, displays with one or more processors, or other suitable devices.

[0101] The power switch 100 can communicate with the powered load 310, for example, via a direct communication link (e.g., a direct wired or wireless communication link) or via a network such as a local area network 340. The direct communication link can be implemented, for example, using low-power Bluetooth or other suitable communication protocols. The power switch 100 can control the delivery of power to the powered load 310 via the load conductors. In some embodiments, the power switch 100 can provide control signals via the direct communication link to control the operation of the powered load (e.g., fan speed, dimming level, etc.).

[0102] The power switch 100 may communicate with the user devices 320, 360, for example, via a direct communication link (e.g., a direct wired or wireless communication link) or via a network such as a local area network 340. The direct communication link may be implemented, for example, using Bluetooth low energy or other suitable communication protocols. In some embodiments, a user may control, view information, and / or specify one or more settings associated with the power switch 100 via a graphical user interface implemented on a display of the user device 320, 360. For example, a user may access an application implemented on the user device 320. The application may present a graphical user interface on a display of the user device 320. The user may interact with the graphical user interface to control the operation of the power switch 100 and / or one or more powered loads 310.

[0103] The local area network 340 may be any suitable type of network or combination of networks that allows communication between devices. In some embodiments, the network may include one or more of a secure network, a Wi-Fi network, an IoT network, a mesh network, one or more peer-to-peer communication links, and / or some combination thereof, and may include any number of wired or wireless links. Communication via the network 340 may be implemented, for example, via a communication interface using any type of protocol, protection scheme, encoding, format, encapsulation, etc.

[0104] The computing environment 300 may include a gateway 355 that may allow access to a wide area network 350. The wide area network 350 may be, for example, the Internet, a cellular network, or other network, and may include any number of wired or wireless links. Communication via the wide area network 350 may be implemented, for example, via a communication interface using any type of protocol, protection scheme, encoding, format, encapsulation, etc. As shown, the power switch 100 may communicate information to remote computing systems 380 and 390 and other remote computing systems via the network 350 via the gateway 355.

[0105] The computing environment 300 may include a remote computing system 380. The remote computing system 380 may be associated with a cloud computing platform for implementing one or more services for the power switch 100. Data collected by the cloud computing platform may be processed and stored and provided, for example, to the user device 320 (e.g., for presentation in a graphical user interface).

[0106] The computing environment 300 may include a remote computing system 390. The remote computing system 390 may be associated with a service accessed by the power switch 100, such as a digital audio assistant service. Audio data collected by the power switch 100 may be communicated to the remote computing system 390 for processing voice commands. Data responsive to the voice commands may be communicated to the power switch 100 for output (e.g., by the speaker 130) and / or to the user device 320 (e.g., for display in a graphical user interface). In this way, the power switch 100 may act as a source of voice commands for a digital voice assistant service.

[0107] Computing systems 380 and 390 may include one or more computing devices (e.g., servers) having one or more processors and one or more memory devices. Computing systems 380 and 390 may be distributed so that their components are located in different geographic regions. The techniques discussed herein refer to computer-based systems and actions taken by computer-based systems and information sent to and from computer-based systems. Those of ordinary skill in the art will recognize that the inherent flexibility of computer-based systems enables a large number of possible configurations, combinations, and division of tasks and functionality between and among components. For example, the processes discussed herein may be implemented using a single computing device or multiple computing devices working in combination. Databases, memories, instructions, and applications may be implemented on a single system or distributed across multiple systems. Distributed components may operate sequentially or in parallel.

[0108] Fig.12 A flow chart depicts an example method 400 for processing audio according to an example embodiment of the present invention. The method 400 may, for example, use the power switch 100 and / or Fig.11 One or more aspects of the computing environment 300 may be implemented. Fig.12 The steps are depicted as being performed in a particular order for purposes of illustration and discussion. One of ordinary skill in the art, using the disclosure provided herein, will understand that various steps of any method described herein may be omitted, expanded to include other steps, performed simultaneously, rearranged, and / or modified in various ways without departing from the scope of the present invention.

[0109] At (402), method 400 includes obtaining audio data via one or more microphones (e.g., microphones 142 and 144) disposed on the power switch. The audio data may be obtained when the power switch is operated in a passive mode. In the passive mode, the power switch may be configured to process the audio data to listen for a trigger condition, such as a voice prompt command and / or a trigger condition associated with an out-of-band condition. In some embodiments, the audio data is not recorded, stored, or otherwise processed when operating in the passive mode.

[0110] At (404), method 400 may include processing audio data to identify a trigger condition. For example, audio data obtained via one or more microphones may be processed locally on the power switch to identify whether the audio data indicates a trigger condition. According to example aspects of the invention, the trigger condition may be a voice prompt command and / or audio data indicating an out-of-band condition. When the trigger condition is a voice prompt command, the power switch may operate in an active listening mode. When the trigger condition is associated with an out-of-band condition, the power switch may operate in a responsive mode.

[0111] More specifically, the voice prompt command may be a preset voice command intended to invoke the active listening functionality of the power switch when in use. For example, the voice prompt command may be a recognizable term or phrase, such as "hello switch", "listening now", "hey, power device". In some embodiments, the voice prompt command may be associated with a digital assistant service, such as a digital assistant service provided by Amazon ("Alexa"), Apple ("Hey Siri"), Google ("Ok Google"), or other services.

[0112] like Fig.12 As shown in , method 400 may include determining whether the trigger condition is a prompt command at (406). If so, method 400 may include entering an active listening mode at (408). During the active listening mode, audio data is recorded, communicated, and / or processed using speech recognition technology to identify a request from a user. At (410) of method 400, data responsive to the request may be determined, and one or more control actions responsive to the request may be performed to implement the active listening mode.

[0113] Fig.13 A flow chart depicting example operations associated with an active listening mode at (410) according to an example embodiment of the present invention. At (412), the power switch may be controlled to listen to audio data via one or more microphones. Additionally, one or more indicators (e.g., a light ring indicator with animation) may be provided to the user to indicate that the power switch is operating in an active listening mode.

[0114] At (414), the audio data may be processed at the power switch. For example, the audio data may be formatted into one or more data packets for communication to a digital assistant service.

[0115] At (416), the audio data may be communicated to the digital assistant service (e.g., via an API). In some embodiments, aspects of the digital assistant service may be implemented locally at the power switch and / or at a device remote from the digital assistant service (e.g., a cloud computing system).

[0116] At (418), the digital assistant service may receive the audio data. At (420), the digital assistant service may process the audio data using a speech recognition algorithm to identify one or more voice commands from the user.

[0117] At (422), the digital assistant service may determine responsiveness data to the voice command. The responsiveness data may be any data used by the digital assistant service to respond to the voice command or other audio data. For example, the responsiveness data may include a text string of a voice command provided by a user. The responsiveness data may include data associated with a voice response that will be played to the user (e.g., via a speaker in the power switch) in response to the user's voice command. The responsiveness data may include data in response to a request provided by the user via the voice command. For example, if the user asks about the weather via a voice command, the responsiveness data may include the weather. If the user requests that a reminder item be set, the responsiveness data may include a confirmation that the reminder item has been set in the user's calendar. The above examples are provided by way of example. The responsiveness data may include data associated with any of a number of different actions that can be implemented using the digital assistant service. At (424), the responsiveness data may be communicated to the power switch.

[0118] At (426), the method may include receiving processing data. At (430), the responsiveness data may be processed to determine one or more control actions based on the voice command or audio data received at the power switch during the active mode. The control action may include, for example, controlling power delivery to one or more powered devices, replaying a voice response to a user, playing music requested by a user, or other suitable control actions. At (432), the control action may be implemented by the power switch.

[0119] An example application of the active mode of the power switch may be controlling the lighting in a space. For example, the power switch may control the power delivery to one or more light sources in the space. The user may use a preset voice command to put the power switch into active mode. When the switch is in active mode, the power switch may obtain an instruction to "turn off the lights" from the user via one or microphones. The power switch may communicate audio data to a digital assistant service. The digital assistant service may process the audio data using speech recognition and send responsive data associated with turning off the lights to the power switch. The power switch may then control the power delivery to the light source to turn off the lights. A responsive audio output (e.g., in the form of human speech) may be provided to the user, such as "turn off the lights now."

[0120] Another example application of the active mode of the power switch may be to perform actions that help control the delivery of power to one or more powered devices. For example, a user may use a preset voice command to put the power switch into active mode. When the switch is in active mode, the power switch may obtain a command from the user via one or microphones, "Tell me what the weather is like." The power switch may communicate the audio data to a digital assistant service. The digital assistant service may process the audio data using speech recognition and send responsive data associated with the current weather. The power switch may then provide a responsive audio output (e.g., in the form of human speech) to the user, such as "Sunny, 65 degrees."

[0121] Return to reference Fig.12 At (440), the power switch may determine whether the triggering condition is an out-of-band condition. An out-of-band condition may be any triggering condition other than those specified conditions that cause the power switch to enter the active mode. In some embodiments, the out-of-band condition may indicate the presence of a hazard, such as a fire, theft, natural disaster, or other hazard.

[0122] In some embodiments, a classifier model stored locally on one or more memory devices associated with the power switch may be used to identify out-of-band conditions. In some embodiments, the classifier model may be a machine learning model. The classifier model may classify audio data received during the passive listening mode of the power switch into one or more categories. An example category may indicate, for example, a fire alarm, a theft alarm, a crying baby, a barking dog, glass breaking, or other conditions. Locally storing the classifier model may also allow for detection of out-of-band conditions in situations where the power switch is offline. In this way, the power switch may respond to out-of-band conditions even when the communication link is disabled.

[0123] In some embodiments, the classifier model may be updated periodically. For example, a locally stored classifier model may be updated from a remote source (e.g., a cloud computing device) via a communication link to continuously optimize the model.

[0124] If it is determined that there is no out-of-band condition, the method 400 may continue to operate the power switch in the active mode. If the out-of-band condition is detected, the method 400 may proceed to (442) and operate the power switch in the responsive mode. At (444), during the responsive mode, the power switch may implement a control action in response to the out-of-band condition. The control action may include, for example, communicating a notification and / or an alert to a user or a monitoring service. The control action may include controlling the delivery of power to a powered device (e.g., a flashlight source). The control action may include issuing an audio alert via a speaker in the power switch. Other suitable control actions may be implemented in the responsive mode without departing from the scope of the present invention.

[0125] In some embodiments, notifications and / or alerts may be provided to one or more members of a notification tree. For example, a notification tree may include a first group of emergency contacts and a second group of emergency contacts. In some embodiments, the notification may be an email and / or text message sent to a mobile device associated with one or more members of the first group. Alternatively or in addition, the notification may be a phone call. If one or more members of the first group receiving the notification do not respond (e.g., accept the call), the notification may be provided to one or more members of the second group. In this way, members of the notification tree may be notified of an out-of-band condition.

[0126] For example, the out-of-band condition may be indicative of a fire. The fire out-of-band condition may be identified using one or more classifier models capable of classifying audio data as belonging to a fire out-of-band condition category. For example, the power switch may be configured, such as in a test or training mode, to classify audio data, such as audio data associated with the sounding of one or more fire alarms near the power switch, as indicative of a fire. For example, audio data comprising a three-repeating pattern of a "beep" (e.g., a constant tone, such as a high frequency tone) followed by a brief silence or pause, such as may be emitted by a fire alarm in response to the presence of a fire, may be classified as a fire alarm out-of-band condition.

[0127] As another example, one or more of the classifier models may be machine learning models that have been trained using audio data containing patterns indicative of fire alarm soundings. For example, one or more classifier machine learning models may be trained using audio data indicative of a fire near a power switch (e.g., one or more fire alarms sounding near the power switch), the audio data being associated with proximity (e.g., from testing of the one or more fire alarms). As another example, one or more classifier machine learning models may be trained using audio data from a fire alarm that is not near the power switch. For example, one or more classifier machine learning models may be configured on the power switch prior to installation and may be "pre-trained" prior to installation.

[0128] As another example, an out-of-band condition may indicate theft. The theft out-of-band condition may be identified using one or more classifier models capable of classifying audio data as belonging to a theft out-of-band condition category. For example, the power switch may be configured, for example, in a test or training mode, to classify audio data, such as audio data associated with the sounding of one or more burglar alarms near the power switch and / or audio data indicating glass breaking, as indicating theft. For example, audio data containing a repeating pattern of short high frequency "beeps," such as may be emitted by a burglar alarm in response to the presence of a theft, may be classified as a theft alarm out-of-band condition.

[0129] As another example, one or more of the classifier models may be machine learning models that have been trained using audio data containing patterns indicative of burglar alarms sounding. For example, one or more classifier machine learning models may be trained using audio data indicative of a theft alarm near a power switch (e.g., one or more burglar alarms sounding near the power switch), the audio data being associated with proximity (e.g., from testing of the one or more burglar alarms). As another example, one or more classifier machine learning models may be trained using audio data from a burglar alarm that is not near the power switch. For example, one or more classifier machine learning models may be configured on the power switch prior to installation of the power switch and may be "pre-trained" prior to installation.

[0130] As another example, one or more of the classifier models may be machine learning models that have been trained using audio data that includes patterns indicative of broken glass. In some embodiments, one or more classifier machine learning models may be trained using audio data indicative of one or more types of broken glass objects to distinguish between different types of broken glass objects. For example, a machine learning model may be trained using audio data associated with broken windows, broken glasses, or other suitable broken glass objects. For example, a broken window may be classified as an out-of-band condition indicative of theft, while a broken glass may not be classified as theft. One or more classifier machine learning models may be configured on the power switch prior to installation of the power switch and may be "pre-trained" prior to installation.

[0131] In response to detecting the out-of-band condition, the power switch may implement a control action in response to the out-of-band condition. For example, the power switch may provide a notification to the user. For example, the power switch may provide a visual notification on the power switch (e.g., via the LED panel 170). As another example, the power switch may provide an audible notification (e.g., via the speaker 130), such as sounding an alarm, or providing a responsive audio output (e.g., in the form of human speech). Additionally or alternatively, the power switch may control the power delivered to the powered device to provide a notification, such as by flashing one or more light sources (e.g., repeatedly providing and interrupting power provided to one or more light sources), providing power to an auxiliary device such as an alarm device, a warning light, or any other suitable notification provided via controlling the power to the powered device, or a combination thereof.

[0132] In some embodiments, the control action may be different for the type of out-of-band condition. For example, if an out-of-band condition is detected that indicates a fire, the power switch may control power to one or more light sources to cause the one or more light sources to flash in a manner that indicates a fire (e.g., simulating an audio output from a fire alarm). As another example, if an out-of-band condition is detected that indicates a theft, the power switch may control power to the one or more light sources to turn on the light sources, flash the light sources rapidly, etc. and / or may additionally provide power to an alarm light, alarm buzzer or speaker, or other alarm device.

[0133] Additionally or alternatively, the power switch may provide a notification to a monitoring service. For example, if an out-of-band condition indicative of a fire is detected, the power switch may provide a notification indicative of a fire to a monitoring service and / or directly to a fire department and / or hospital. As another example, if an out-of-band condition indicative of a theft is detected, the power switch may provide a notification indicative of a theft to a monitoring service and / or directly to a police station.

[0134] The notification to the monitoring service may be provided automatically (e.g., immediately or momentarily after the out-of-band condition is detected) and / or based on a user response to the notification provided to the user. For example, if an out-of-band condition associated with a fire is detected, the power switch may provide a visual and / or audio output to the user (e.g., a voice message such as “The fire alarm appears to be sounding, do you need help?” and / or an interactive indication such as “Swipe up for ‘yes’ and swipe down for ‘no’”), and may provide a notification to the monitoring service based on the user response (e.g., swipe up or swipe down).

[0135] In some embodiments, an automatic decision may be made after a certain time without a user response, such as a default decision (e.g., defaulting to yes or no). The automatic decision may be preconfigured and / or user specified. Additionally or alternatively, the automatic decision may be specific to the type of out-of-band condition. For example, an out-of-band condition indicating a fire may have an automatic yes decision, while an out-of-band condition indicating a theft may have an automatic no decision. As another example, an out-of-band condition corresponding to a fire alarm or a theft alarm may have an associated automatic yes decision, while an out-of-band condition corresponding to broken glass may have an associated automatic no decision.

[0136] Once the power switch has implemented one or more control actions in the response mode and / or after the time period expires, the power switch can return to the passive mode. Once in the passive mode, the power switch can continue to listen for other trigger conditions.

[0137] Fig.14An example lighting system 500 incorporating a plurality of power switches is depicted according to an example embodiment of the present invention. The lighting system 500 includes a plurality of lighting fixtures 502 (e.g., luminaires) operable to provide illumination to a space 510 (e.g., a room). The lighting system 500 may include a first power switch 520 and a second power switch 530. The first power switch 520 and / or the second power switch 530 may include one or more aspects of any of the power switches described herein. The first power switch 520 may be disposed proximate a first entrance 512 of the space 510. The second power switch 530 may be disposed proximate a second entrance 514 of the space 510.

[0138] The first power switch 520 and / or the second power switch 530 may be configured to control the delivery of power to one or more lighting fixtures 502 (or other powered loads) to control lighting within the space 510. In some embodiments, the first power switch 520 and the second power switch 530 may provide 3-way switching functionality (or other multi-directional switching functionality in the presence of other switches, such as 4-way switching functionality).

[0139] In an example embodiment, the first power switch 520 may be a master power switch. The second power switch 530 may be a slave power switch that communicates with the first power switch via a wireless communication link 540 (e.g., a low-power Bluetooth communication link or other suitable communication link). User interaction with the second power switch 530 may cause data to be transmitted to the first power switch 520 via the communication link 540 to control the light source 502. The first power switch 520 may also be configured to communicate with other devices (e.g., user devices, cloud computing systems, servers, etc.) via the second communication link 550 via one or more networks. The user may interact with the second power switch 530 remotely by communicating with the first power switch 520, which then forwards data and other information to the second power switch 530 via the communication link 530. The relationship between the first power switch 520 and the second power switch 530 has been described as a master-slave relationship. However, other suitable relationships (e.g., peer-to-peer) may be used without departing from the scope of the present invention.

[0140] In an example embodiment, the first power switch 520 and the second power switch 530 can be paired with each other via user interaction with one or more interface elements of the first power switch 520 and the second power switch 530. For example, in some embodiments, the user can manipulate the second button 124 ( Figure 1 More specifically, the user may move (eg, pull) the second button 124 away from the front panel 105 ( Figure 1 After pulling the second button 124 away from the front panel 105, the user can manipulate the first button 122 of the first power switch 520 ( Figure 1 ). More specifically, the user may press the first button 122 (e.g., a pairing button). Then, while still pressing the first button 122, the user may move (e.g., push) the second button 124 toward the front panel 105. After moving (e.g., pushing) the second button 124 toward the front panel 105, the user may continue to press the first button 122 until a notification is received from one or more output devices of the first power switch 520. For example, the user may continue to press the first button 122 until the LED 174 ( Figure 5 ) until a light having a predetermined color (e.g., blue) flashes.

[0141] After receiving the notification, the user may perform the same sequence of steps on the second power switch 530. More specifically, the user may move (eg, pull) the second button 124 of the second power switch 530 away from the front panel 105 ( Figure 1 ). After pulling the second button 124 away from the front panel 105, the user may press the first button 122 (e.g., pairing button) of the second power switch 530. Then, while still pressing the first button 122, the user may move (e.g., push) the second button 124 toward the front panel 105. After moving (e.g., pushing) the second button 124 toward the front panel 105, the user may continue to press the first button 122 until a notification is received from one or more output devices of the second power switch 530. For example, the user may continue to press the first button 122 until the LED 174 of the LED board 170 included in the second power switch 530 flashes light having a predetermined color (e.g., blue).

[0142] After receiving the notification (e.g., flashing blue light) from the second power switch 530, the first power switch 520 and the second power switch 530 may provide a notification (e.g., audible, visible) to indicate that the first power switch 520 and the second power switch 530 have successfully paired with each other. For example, the notification may include a speaker 130 (e.g., a flashing blue light) associated with the first power switch 520. Figure 3 ), and the speaker 130 associated with the second power switch 530 ( Figure 3 ) each emit an audible noise (e.g., a beep). More specifically, the speaker 130 may emit a predetermined number of beeps, such as 5 beeps. Alternatively or in addition, the notification may include the LED 174 ( Figure 5 ), and LED 174 of the second power switch 530 ( Figure 5 ) flashes a predetermined number of times (e.g., 5 times). More specifically, the LEDs 174 of the first power switch 520 and the second power switch 530 may flash green.

[0143] Reference again Figure 1 , via user interaction with one or more interface elements of the power switch 100, the power switch 100 may be configured as a switch (e.g., a fan switch). For example, in some embodiments, the user may manipulate the second button 124 of the power switch 100 to configure the power switch 100 as a switch. More specifically, the user may move (e.g., pull) the second button 124 away from the front panel 105. After pulling the second button 124 away from the front panel 105, the user may move the rocker button 110 to the first position. Then, while still holding the rocker button 110 in the first position, the user may move (e.g., push) the second button 124 toward the front panel 105 of the power switch 100. After moving (e.g., pushing) the second button 124 toward the front panel 105, the user may continue to hold the rocker button 110 in the first position for a predetermined amount of time (e.g., 5 seconds) until the power switch 100 provides some indication (e.g., audible, visual) indicating that the configuration is complete. For example, the sign may include an audible noise (e.g., one or more beeps) emitted via the speaker 130. Alternatively or in addition, the sign may include an LED ring 172 ( Figure 5 ) pulses a predetermined number of times (e.g., 3 times).

[0144] In an example embodiment, the power switch 100 may be configured as a dimmer via user interaction with one or more interface elements of the power switch 100. For example, in some embodiments, the user may manipulate the second button 124 of the power switch 100 to configure the power switch 100 as a dimmer. More specifically, the user may move (e.g., pull) the second button 124 away from the front panel 105. After pulling the second button 124 away from the front panel 105, the user may move the rocker button 110 to the first position. Then, while still holding the rocker button 110 in the first position, the user may move (e.g., push) the second button 124 toward the front panel 105. After moving (e.g., pushing) the second button 124 toward the front panel 105, the user may continue to hold the rocker button 110 in the first position for a predetermined amount of time (e.g., 5 seconds) until the power switch 100 provides a certain sign (e.g., audible, visual) indicating that the configuration is complete. For example, the sign may include an audible noise (e.g., one or more beeps) via the speaker 130. Alternatively or in addition, the sign may include an LED ring 172 ( Figure 5 ) is pulsed from 0% to 100% a predetermined number of times (e.g., 3 times).

[0145] In an example embodiment, when the user brings the user device 320 into physical contact with the power switch 100, a pairing sequence for enabling communication between the power switch 100 and the user device 320 may be initiated. More specifically, the user may initiate the pairing sequence by tapping the user device 320 against the power switch 100 a predetermined number of times, for example three times. In this way, situations where the user device 320 and the power switch 100 are inadvertently paired with each other may be reduced or eliminated. In some embodiments, the user may need to press the first button 122 of the power switch 100 immediately before tapping the user device 320 against the power switch 100.

[0146] In an example embodiment, both the power switch 100 and the user device 320 may include accelerometers configured to detect a user tapping the user device 320 against the power switch 100 to initiate a pairing sequence. More specifically, one or more processors of the power switch 100 may be configured to process data received from the accelerometer of the power switch 100. Alternatively or in addition, one or more processors of the user device 320 may be configured to process data received from the accelerometer of the user device 320. In this manner, the physical contact (e.g., tap) required to initiate a pairing sequence may be detected by the power switch 100, the user device 320, or both the power switch 100 and the user device 320.

[0147] In an example embodiment, one or more microphones of the power switch 100 may detect an audible noise associated with tapping the user device 320 against the power switch 100. More specifically, the one or more microphones may provide one or more data signals indicative of the audible noise associated with tapping the user device 320 against the power switch 100. One or more processors of the power switch 100 may be configured to process the data signals to detect that the user tapped the user device 320 against the power switch 100. It should be appreciated that the one or more processors of the power switch 100 may process the data signals to recognize the audible noise associated with the user tapping the user device 320 against the power switch 100.

[0148] Reference now Fig.15 and 16 , provides an example embodiment of a light blocker 900 according to an example embodiment of the present invention. In some embodiments, the light blocker 900 can be positioned at the LED ring 172 ( Figure 5 ). When the light blocker 900 is positioned above the LED ring 172, as will be discussed in more detail below, the light blocker 900 can improve the indication light ring 210 ( Figure 7 )’s visual appearance.

[0149] As shown, the light blocker 900 includes a body 910. The body 910 may include a first plurality of segments 912 and a second plurality of segments 914. In some embodiments, the light transmittance of the first plurality of segments 912 may be different from the light transmittance of the second plurality of segments 914. For example, the light transmittance of the first plurality of segments 912 may be greater than the light transmittance of the second plurality of segments 914. In this way, more light may pass through the first plurality of segments 912 than the second plurality of segments 914.

[0150] In some embodiments, the first plurality of segments 912 and the second plurality of segments 914 are arranged in an alternating manner such that each segment in the first plurality of segments 912 is positioned between two adjacent segments in the second plurality of segments 914. As an example, the first plurality of segments 912 and the second plurality of segments 914 may be arranged in an alternating manner to form a ring 920. The light blocker 900 may be positioned on the LED board 170 ( Figure 5 ) so that the ring 920 of the main body 910 is aligned with the LED ring 172 ( Figure 5 ). More specifically, the light blocker 900 can be positioned above the LED board 170 so that each segment of the second plurality of segments 914 is aligned with a corresponding LED of the LED ring 172 (e.g., each segment is positioned above a corresponding LED). Because the light transmittance of the second plurality of segments 914 is less than the light transmittance of the first plurality of segments 912, the light blocker 900 can reduce or eliminate hot spots in the indicator light ring 210. In this way, the light blocker 900 can improve the visual appearance of the indicator light ring 210.

[0151] In some embodiments, the body 910 of the light blocker 900 may include a segment 930 positioned at the center of the ring 920. In this way, the segment 930 may be aligned with the LED 174 ( Figure 5 ). In some embodiments, the light transmittance of segment 930 can be different from the light transmittance of the second plurality of segments 914. For example, the light transmittance of segment 930 can be greater than the light transmittance of the second plurality of segments 914. Thus, more light can pass through segment 930 compared to the second plurality of segments 914.

[0152] In some embodiments, the first plurality of segments 912 can be one or more apertures defined by the body 910 of the light blocker 900. Alternatively or additionally, the segments 930 can be apertures defined by the body 910 of the light blocker 900.

[0153] It should be appreciated that the wall-mounted device of the present invention may be implemented in any suitable environment. For example, the wall-mounted device may be implemented in one or more rooms of a hotel. In this manner, a guest may control one or more features of the room via the wall-mounted device. For example, a guest may control the operation of a television via one or more voice commands received at the wall-mounted device. As another example, a guest may control the operation of one or more lighting fixtures in the room.

[0154] Although the subject matter of the present invention has been described in detail with respect to specific example embodiments of the present invention, it will be appreciated by those skilled in the art that such embodiments may be easily modified, altered, and equivalents may be produced based on an understanding of the foregoing. Therefore, the scope of the present invention is by way of example and not limitation, and as will be readily apparent to those skilled in the art, the present invention does not exclude the inclusion of such modifications, alterations, and / or additions to the subject matter of the present invention.

Claims

1. A power switch for controlling a powered load, the power switch comprising: a housing capable of being mounted on a surface or at least partially mounted within a surface, the housing having a front panel; an interface element disposed on the front panel, the interface element being operable to receive user input; a power interrupter operable to control the delivery of power to the powered load based at least in part on user interaction with the interface element; one or more microphones configured to receive audio input; one or more speakers configured to provide audio output; one or more processors configured to switch the power switch to a responsive mode in response to an out-of-band condition, wherein the power interrupter is further operable to control power delivery to the powered load based on the out-of-band condition; as well as a communications interface operable to communicate data associated with the audio input via a communications link; wherein a gap is defined between an edge of the interface element and an edge of the front panel, the gap allowing audio output from the one or more speakers to be emitted from behind the interface element, and The power switch is a wall-mounted power switch.

2. The power switch of claim 1, further comprising a sound deflector disposed behind the interface element.

3. The power switch of claim 2, wherein the sound deflector is positioned relative to the speaker to deflect the audio output from the one or more speakers away from the one or more microphones.

4. The power switch according to claim 1, wherein: The front panel includes a first button and a second button; and The one or more microphones include a first microphone disposed in the first button and a second microphone disposed in the second button.

5. The power switch according to claim 4, wherein: The first button is a pairing button; and The one or more processors of the power switch are configured to initiate a pairing process with a remote device when a user interacts with the first button. The power switch of claim 4 , wherein the second button is an air-gap switch. 7 . The power switch of claim 4 , further comprising a Fresnel lens disposed between the first button and the second button.

8. The power switch of claim 7, further comprising a passive infrared sensor disposed behind the Fresnel lens.

9. The power switch of claim 1, further comprising an indicator light disposed behind the interface element.

10. The power switch of claim 9, wherein the indicator light comprises a light ring having a plurality of light emitting diode (LED) light sources.

11. The power switch of claim 10, wherein the indicator light further comprises an LED light source positioned at the center of the light ring.

12. The power switch of claim 11, further comprising a light blocker positioned above the light ring, the light blocker comprising: a body having a first plurality of segments and a second plurality of segments, wherein the first plurality of segments and the second plurality of segments are arranged in an alternating manner to form a ring, and Each of the second plurality of segments is positioned above a corresponding light emitting diode (LED) light source of the light ring. 13 . The power switch of claim 12 , wherein a light transmittance of each segment in the second plurality of segments is smaller than a light transmittance of each segment in the first plurality of segments.

14. The power switch of claim 1, wherein the communication interface comprises an antenna operable for RF communications in a first frequency band and a second frequency band.

15. A method for processing audio data received at a power switch, the method comprising: obtaining audio data by one or more microphones of the power switch in a passive mode; processing the audio data by one or more processors of the power switch to identify a trigger condition; determining, by the one or more processors, that the trigger condition corresponds to an out-of-band condition; operating, by the one or more processors, in a responsive mode in response to determining that the trigger condition corresponds to the out-of-band condition; selecting, by the one or more processors, at least one control action to implement; and performing, by the one or more processors, at least one control action in the response mode, wherein the control action controls the delivery of power to the powered load based at least on the out-of-band condition by a power interrupter in electrical communication with the power switch, wherein the trigger condition is specified as a frequency range or pattern of audible sound, Wherein the trigger condition corresponding to the out-of-band condition is different from an active listening trigger specified for causing the power switch to enter an active listening mode.

16. The method according to claim 15, wherein the method further comprises: determining, by the one or more processors in the power switch, that the active listening trigger is an audio prompt command; as well as The active listening mode is entered when the active listening trigger is a prompt command. The method of claim 16 , wherein no audio data is recorded in the passive mode.

18. The method of claim 15, wherein determining the trigger condition is an out-of-band condition comprises: accessing, by the one or more processors, one or more classifier models stored in one or more memory devices in the power switch; classifying, by the one or more processors, audio data as the out-of-band condition based on the classifier model; as well as When the audio data is classified as the out-of-band condition, determining, by the one or more processors, that the trigger condition corresponds to the out-of-band condition.

19. The method of claim 15, wherein the out-of-band condition comprises one or more of a smoke alarm, breaking glass, a crying baby, a barking animal, or a sirens.

Images