Camera module with electrostatic discharge protection

Abstract

Described herein is a camera module with electrostatic discharge (ESD) protection. In particular, the camera module includes a lightning rod structure that directs ESD currents to a safe location (e.g., system ground) when an ESD spark strikes the lens retainer of the camera module. The lightning rod structure does not physically contact the lens retainer due to the risk of impacting camera focus adjustment and scraping and buzzing noises. Thus, a gap separates the lightning rod structure from the lens retainer. When the lens retainer is stressed by an ESD spark, the gap breaks down, establishing a conductive path that directs the ESD currents through the lightning rod structure to a safe location. In this way, the ESD current flows along a controlled path, rather than jumping to an arbitrary location, protecting nearby sensitive circuitry.

Description

[Background technology]

[0001] background Cameras with adjustable lenses are widely used in consumer electronics such as video recording doorbells, surveillance devices, etc. In many devices, the camera lens is enclosed within a lens retainer, usually made of metal. However, metal lens retainers are prone to attracting electrostatic discharge (ESD) sparks, which can affect the operation of the camera. For example, devices with cameras subject to ESD damage may exhibit issues such as erratic display, interruptions in video streaming, abnormal performance of applications ("apps"), or permanent loss of functionality.

[0002] One conventional solution to provide ESD protection for cameras includes sealing the lens retainer with a plastic cover, but this approach leads to high cost, large product size, and optical performance may be affected due to another object in front of the camera. Another conventional solution includes using a grounding structure to tie the metal retainer to the ground of the camera board, but because the lens retainer is an adjustable (e.g., moving) part during focus adjustment, problems arise when trying to ground the moving part. Thus, the adjustment and focusing performance of the camera may be affected due to extra force from the grounding structure. Another conventional solution is to add ESD protection components (e.g., transient-voltage-suppression (TVS) diodes) to protect sensitive signals and components in the camera board, but this approach may require high component cost, more printed circuit board (PCB) space, and extensive trial and error to tune the protection during failure analysis, which may significantly lengthen the development cycle and time to market. Summary of the Invention

[0003] overview Described herein is an ESD protected camera module. In particular, the camera module includes a lightning rod structure that directs ESD current to a safe location (e.g., system ground) when an ESD spark strikes the lens retainer of the camera module. To eliminate impacts on camera focus and the risk of scraping and buzzing noises, the lightning rod structure does not physically contact the lens retainer. Therefore, the lightning rod structure is separated from the lens retainer by a gap (e.g., an insulator). When the lens retainer is stressed by an ESD spark, the gap undergoes electrical breakdown and becomes a conductor, establishing a conductive path that directs the ESD current through the lightning rod structure to a safe location. In this way, the ESD current flows along a controlled path rather than jumping to an arbitrary location, protecting nearby sensitive circuitry.

[0004] In aspects, a camera module for an electronic device is disclosed. The camera module comprises a camera lens and an image sensor aligned with the camera lens. The camera module also comprises a retainer surrounding the camera lens. The retainer is movable during focusing of the camera module. The camera module further comprises an ESD bridge component arranged to provide a controlled path for electrostatic discharge current to travel from the retainer to a system ground of the electronic device. In an implementation, the ESD bridge component is separated from the retainer by a gap and arranged to guide ESD current away from the image sensor.

[0005] In some embodiments, an electronic device is disclosed. The electronic device includes a housing, a system ground, and an IR cover disposed on an outer surface of the housing. In some implementations, at least a portion of the IR cover is configured to be substantially transparent to infrared light. Furthermore, the IR cover is separate from the retainer and has an opening through which the retainer extends. The electronic device also includes one or more infrared light sources disposed within the housing behind the IR cover and configured to generate infrared light that is projected through the IR cover. Furthermore, the electronic device includes a camera module as disclosed above.

[0006] This Summary is provided to introduce a simplified concept of the ESD protected camera module, which is further described below in the Detailed Description. This Summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.

[0007] The details of one or more aspects of the ESD protected camera module are described herein with reference to the following drawings, in which like numbers are used throughout to reference like features and components: [Brief description of the drawings]

[0008] [Figure 1A] FIG. 1 illustrates an exemplary network environment in which various aspects of an ESD-protected camera module can be implemented. [Figure 1B] FIG. 1B illustrates the example environment of FIG. 1A in greater detail. [Figure 2A] FIG. 1 illustrates an exemplary home area network system in which various aspects of an ESD-protected camera module can be implemented. [Figure 2B] FIG. 1 illustrates an exemplary operating environment in which a server system interacts with client devices and smart devices according to some implementations. [Diagram 3]1 is a block diagram illustrating an exemplary video server system according to some implementations. [Figure 4] FIG. 1 is a block diagram illustrating an example smart device according to some implementations. [Diagram 5] FIG. 2 is a block diagram illustrating an example client device according to some implementations. [Figure 6] 1 is an isometric view of an exemplary video recording doorbell with a camera module according to some implementations. [Figure 7] FIG. 7 is a front view of the example doorbell of FIG. [Figure 8] FIG. 7 is a right front view of the example doorbell of FIG. 6 in accordance with some implementations. [Figure 9] FIG. 7 is an exploded view of the example doorbell of FIG. [Figure 10] FIG. 2 illustrates an example implementation of a camera module. [Figure 11] FIG. 11 is an exploded view showing the camera module of FIG. [Figure 12] 8 is a cross-sectional view of the doorbell device of FIG. 7 taken along line AA of FIG. 7. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Detailed Description Described herein is an ESD protected camera module. In particular, the camera module of an electronic device includes an ESD bridging component (also called a lightning rod structure) that serves as a bridge between a metallic movable lens retainer and a heat sink to direct ESD currents to the system ground of the electronic device. The ESD bridging component is separated from the lens retainer by a gap to avoid the risk of affecting the camera's focus and producing scraping and buzzing noises. When the lens retainer is stressed by an ESD spark (e.g., when a statically charged person touches the lens retainer or touches a location on the electronic device), a conductive path is established across the gap from the retainer to the ESD bridging component and further to the heat sink, which is safely grounded. In this way, the ESD current flows along a controlled path rather than jumping to random locations, protecting nearby circuitry that is susceptible to ESD currents.

[0010] Implementation of the described technology allows for more robust construction of small form factor devices (e.g., video recording doorbells) because it provides ESD protection without the use of TVS diodes in nearby circuitry, thus reducing component costs and space requirements, resulting in lower manufacturing costs and smaller or thinner devices.

[0011] Although the features and concepts of the described technology for an ESD-protected camera module may be implemented in any number of different environments, aspects are described in the context of the following example.

[0012] Exemplary Environments and Devices 1A illustrates an exemplary network environment 100 (e.g., network environment) in which an ESD-protected camera module may be implemented. The network environment 100 includes a home area network (HAN). The HAN includes wireless network devices 102 (e.g., electronic devices) disposed around a structure 104, such as a home, and connected by one or more wireless and / or wired network technologies, as described below. The HAN includes a border router 106 that connects the HAN to an external network 108, such as the Internet, via a home router or access point 110.

[0013] To provide user access to the functionality realized using the wireless network devices 102 in the HAN, a cloud service 112 connects to the HAN via a border router 106 through a secure tunnel 114 via an external network 108 and an access point 110. The cloud service 112 uses a web-based application programming interface (API) 118 to facilitate communication between the HAN and internet clients 116, such as apps on mobile devices. The cloud service 112 also manages a home graph that describes the connections and relationships between the wireless network devices 102, the elements of the structure 104, and users. The cloud service 112 hosts a controller that orchestrates and mediates the home automation experience, as described in more detail below.

[0014] A HAN may include one or more wireless network devices 102 functioning as hubs 120. The hubs 120 may be general-purpose home automation hubs or application-specific hubs, such as security hubs, energy management hubs, heating, ventilation, and air conditioning (HVAC) hubs, etc. The functionality of the hubs 120 may be integrated into any wireless network device 102, such as a smart thermostat device or a border router 106. In addition to hosting the controller on the cloud service 112, the controller may be hosted on any hub 120 in the structure 104, such as a border router 106. A controller hosted on the cloud service 112 may be dynamically moved to a hub 120 in the structure 104, such as moving an HVAC zone controller to a newly installed smart thermostat.

[0015] Hosting functionality on a hub 120 within the structure 104 can improve reliability when a user's Internet connection is unreliable, can reduce latency for operations that would normally require connecting to a cloud service 112, and can satisfy system and regulatory constraints regarding local access between wireless network devices 102.

[0016] The wireless network devices 102 in a HAN may be from a single manufacturer that also offers cloud services 112, and the HAN may include partner wireless network devices 102. These partners may also offer partner cloud services 122 that provide services related to the wireless network devices 102 via partner web APIs 124. The partner cloud services 122 may optionally or additionally provide services to Internet clients 116 via web-based APIs 118, cloud services 112, and secure tunnels 114.

[0017] The network environment 100 can be realized on a variety of hosts, such as battery-powered microcontroller-based devices, line-powered devices, and servers hosting cloud services. Protocols operating on the wireless network devices 102 and cloud services 112 provide a number of services that support the operation of home automation experiences in the distributed computing environment 100. These services include, but are not limited to, real-time distributed data management and subscription, command and response control, real-time event notification, historical data logging and storage, cryptographically controlled security groups, time synchronization, network and service pairing, and software updates.

[0018] 1B illustrates an exemplary environment 130 in which aspects of a home area network and ESD-protected camera module as described with reference to FIG. 1A may be implemented. In general, the environment 100 includes a home area network (HAN) implemented as part of a home or other type of structure having any number of wireless network devices (e.g., wireless network device 102) configured for communication in a wireless network. For example, the wireless network devices may include a thermostat 132, a hazard detector 134 (e.g., for smoke and / or carbon monoxide), a camera 136 (e.g., indoor and outdoor), a lighting unit 138 (e.g., indoor and outdoor), and any other type of wireless network device 140 implemented inside and / or outside the structure 142 (e.g., in a home environment). In this example, the wireless network devices may include any of the devices previously described, such as a border router 106, as well as an electronic device 202.

[0019] In the environment 100, any number of wireless network devices may be implemented for wireless interconnection to wirelessly communicate and interact with one another. The wireless network devices are modular, intelligent, multi-sensing, network-connected devices that may seamlessly integrate with one another and / or with a central server or cloud computing system to provide any of a variety of useful automation purposes and implementations. An example of a wireless network device that may be implemented as any of the devices described herein is shown and described with reference to FIG.

[0020] In an implementation, the thermostat 132 may include a Nest® learning thermostat that detects ambient climate characteristics (e.g., temperature and / or humidity) and controls an HVAC system 144 in a home environment. The learning thermostat 132 and other network-connected devices "learn" by incorporating occupant settings into the device. For example, the thermostat learns preferred temperature set points for mornings and evenings, when the occupants of the structure are asleep or awake, and when the occupants are typically away or at home.

[0021] Hazard detectors 134 can be implemented to detect the presence of hazardous materials or materials indicative of hazardous materials (e.g., smoke, fire, or carbon monoxide). In a wireless interconnection example, the hazard detectors 134 can detect the presence of smoke indicative of a fire in a structure, in which case the hazard detector that first detects the smoke can broadcast a low power attention signal to all of the connected wireless network devices. Other hazard detectors 134 can then receive the broadcast attention signal, initiate a high power state regarding the hazard detection, and receive wireless communication of a warning message. Additionally, lighting units 138 can receive the broadcast attention signal and activate in the area of ​​the detected hazard to illuminate and identify the problem area. In another example, the lighting units 138 can activate with one lighting color to indicate a problem location or area in the structure, such as a detected fire or intrusion, and activate with a different lighting color to indicate a safety area and / or an escape route from the structure.

[0022] In various configurations, the wireless network device 140 may include an aisle interface device 146 that works in conjunction with a networked door lock system 148 and detects and responds to people approaching or leaving locations such as exterior doors of the structure 142. The aisle interface device 146 may interact with other wireless network devices based on whether someone approaches or enters the smart home environment. The aisle interface device 146 may control a doorbell function, announce approaching or leaving people via audio or visual means, and control settings of a security system, such as to arm or disarm the security system when an occupant enters or exits. The wireless network device 140 may also include other sensors and detectors, such as for detecting ambient lighting conditions, detecting room occupancy (e.g., with an occupancy sensor 150), and controlling the power and / or dimming state of one or more lights. In some examples, the sensor and / or detector may also control the power state or speed of a fan, such as a ceiling fan 152. Additionally, sensors and / or detectors may detect occupancy of a room or enclosure and may, for example, control the supply of power to an outlet or device 154 when the room or structure is unoccupied.

[0023] The wireless network devices 140 may also include connected appliances and / or control systems 156, such as refrigerators, stoves and ovens, washers, dryers, air conditioners, pool heaters 158, irrigation systems 160, security systems 162, and the like, as well as other electronic and computing devices, such as televisions, entertainment systems, computers, intercom systems, garage door openers 164, ceiling fans 152, control panels 166, and the like. When plugged into an electrical outlet, the appliances, devices, or systems may announce themselves to the home area network, as described above, and may automatically integrate with the home area network controls and devices within the home, and the like. Additionally, the wireless network devices 140 may include devices that are physically located outside the structure but within wireless communication range, such as devices controlling the swimming pool heater 158 or irrigation system 160.

[0024] As mentioned above, the HAN includes a border router 106 that interfaces for communication with external networks outside the HAN. The border router 106 connects to an access point 110 that connects to an external network 108, such as the Internet. Cloud services 112 connected via the external network 108 provide services related to and / or using devices in the HAN. As an example, the cloud services 112 may include applications for connecting end user devices 168, such as smartphones, tablets, etc., to devices in the home area network, applications for processing and presenting data captured in the HAN to end users, applications for linking one or more devices in the HAN to a user account in the cloud service 112, applications for provisioning and updating devices in the HAN, etc. For example, a user may use a networked computer or a portable device, such as a mobile phone or tablet device, to control a thermostat 132 and other wireless network devices in a home environment. Additionally, the wireless network devices may communicate information to any central server or cloud computing system via the border router 106 and the access point 110. Data communications can be performed using any of a variety of custom or standard wireless protocols (e.g., Wi-Fi, ZigBee for low power, 6LoWPAN, Thread, etc.) and / or using any of a variety of custom or standard wired protocols (CAT6 Ethernet, HomePlug, etc.).

[0025] Any of the wireless network devices in the HAN can function as low power nodes and communication nodes to create a HAN in a home environment. Each low power node of the network can periodically send a message about what it is sensing, and other low power nodes in the environment can repeat the message in addition to sending their own messages, thereby propagating messages between nodes (e.g., between devices) throughout the home area network. The wireless network devices can be implemented to conserve power, especially if battery powered, and can utilize low power communication protocols to receive messages, convert messages to other communication protocols, and transmit the converted messages to other nodes and / or a central server or cloud computing system. For example, the occupancy sensor 150 and / or the ambient light sensor 170 can detect occupants in a room as well as measure the ambient light, activating a light source if the ambient light sensor 170 detects that the room is dark and if the occupancy sensor 150 detects that someone is in the room. Additionally, the sensors may include low-power wireless communication chips (e.g., IEEE 802.15.4 chips, Thread chips, ZigBee chips) that periodically transmit messages regarding room occupancy and the amount of light in the room, including instantaneous messages that occur simultaneously when the occupancy sensor detects that someone is in the room. As discussed above, these messages can be transmitted wirelessly between nodes in the home environment (e.g., between network-connected devices) using a home area network, as well as transmitted over the Internet to a central server or cloud computing system.

[0026] In other configurations, various wireless network devices can act as "trip wires" for an alarm system within a home environment. For example, if a perpetrator avoids detection by alarm sensors installed at windows, doors, and other entry points of a structure or environment, an alarm can still be triggered by receiving occupancy, motion, heat, sound, etc., messages from one or more low-power mesh nodes in the home area network. In other implementations, the home area network can be used to automatically turn on and off lighting units 138 as a person moves from room to room within a structure. For example, a wireless network device can detect a person's movement through the structure and communicate a corresponding message through a node in the home area network. Using a message indicating which room is occupied, other wireless network devices receiving the message can be activated and / or deactivated accordingly. As discussed above, the home area network can also be utilized to provide exit lighting in an emergency, such as by illuminating appropriate lighting units 138 leading to a safe exit. The lighting units 138 can also be illuminated to indicate a direction along an exit route that a person should travel to safely exit the structure.

[0027] Various wireless network devices may also be implemented to integrate with and communicate with wearable computing devices 172, such as may be used to identify and locate occupants of a structure and adjust temperature, lighting, sound systems, etc. accordingly. In other implementations, radio frequency identification (RFID) sensing (e.g., a person with an RFID bracelet, necklace, or key fob), synthetic vision technology (e.g., a video camera and facial recognition processor), voice technology (e.g., voice, sound pattern, vibration pattern recognition), ultrasonic sensing / imaging technology, and infrared or near-field communication (NFC) technology (e.g., a person wearing an infrared or NFC enabled smartphone), along with rule-based inference engines or artificial intelligence techniques, may derive useful conclusions from sensed information regarding the location of occupants within a structure or environment.

[0028] In other implementations, the service robot's personal comfort zone network, personal health zone network, personal safety zone network, and / or other such human-oriented functions can be enhanced by logically integrating with other wireless network devices and sensors in the environment according to rule-based reasoning or artificial intelligence techniques to achieve better performance of these functions. In an example related to the personal health zone, the system can detect (e.g., using any of the wireless network devices and sensors) whether a household pet is moving towards the occupant's current location along with rule-based reasoning and artificial intelligence techniques. Similarly, a hazard-detecting service robot can be notified that temperature and humidity levels are increasing in the kitchen, and based on the inference that a slight increase in ambient smoke levels is likely due to cooking activities and not purely due to a dangerous condition, the hazard-detecting service robot can temporarily increase a hazard detection threshold, such as a smoke detection threshold. Any service robot configured for any type of monitoring, detection, and / or service can be implemented as a mesh node device on a home area network conforming to a wireless interconnection protocol for communicating on the home area network.

[0029] The wireless network device 140 may also include a networked alarm clock 174 for each individual occupant of the structure in the home environment. For example, the occupant may customize and set the alarm for a wake-up time, such as for the next day or week. Artificial intelligence may be used to consider the occupant's reaction to the alarm when the alarm goes off and infer preferred sleep patterns over time. And, individual occupants may be tracked within the home area network based on a person's unique signature, which is determined based on data obtained from sensors installed in the wireless network device, such as ultrasonic sensors and passive IR sensors. The occupant's unique signature may be based on a combination of movement patterns, voice, height, size, etc., as well as using facial recognition technology.

[0030] In one example of wireless interconnection, an individual's wake-up time can be associated with a thermostat 132 to control an HVAC system in an efficient manner to preheat or cool a structure to desired sleep and wake-up temperature settings. Preferred settings can be learned over time, such as by obtaining the temperature set on the thermostat before the person goes to sleep and when they wake up. The collected data may also include biological indicators of the person, such as breathing patterns, heart rate, and movement, and inferences are made based on a combination of this data and data indicating when the person will actually wake up. Other wireless network devices can use the data to provide other automation purposes, such as adjusting the thermostat 132 to preheat or cool the environment to a desired setting and turning on or off lighting units 138.

[0031] In an implementation, the wireless network devices may also be utilized to detect sound, vibration, and / or motion, such as detecting running water and determining inferences regarding water usage in the home environment based on algorithms and mapping of water usage and consumption. This may be used to determine a signature or fingerprint of each water source in the home, also referred to as "audio fingerprint water usage." Similarly, the wireless network devices may be utilized to detect subtle sounds, vibrations, and / or motions of unwanted pests, such as rats and other rodents, as well as termites, cockroaches, and other insects. The system may then notify occupants of suspected pests in the environment, such as with an alert message, to help facilitate early detection and prevention.

[0032] The environment 100 may include one or more wireless network devices that function as hubs 176. Hubs 176 (e.g., hubs 120) may be general-purpose home automation hubs or application-specific hubs, such as security hubs, energy management hubs, HVAC hubs, etc. Also, the functionality of hubs 176 may be integrated into any wireless network device, such as a networked thermostat device or border router 106. Hosting the functionality in hubs 176 within structures 142 may improve reliability when a user's Internet connection is unreliable, reduce latency for operations that would normally have to connect to cloud services 112, and satisfy system and regulatory constraints regarding local access between wireless network devices.

[0033] Additionally, the exemplary environment 100 includes a networked speaker 178. The networked speaker 178 provides voice assistant services, including providing voice control of networked devices. The functionality of the hub 176 may be hosted on the networked speaker 178. The networked speaker 178 may be configured to communicate over a HAN, which may include a wireless mesh network, a Wi-Fi network, or both.

[0034] FIG. 2A is a block diagram illustrating a representative network architecture 200 including a home area network 202 (HAN 202) according to some implementations. In some implementations, electronic devices 204 (e.g., wireless network devices 102) in the network environment 100 couple with a hub 176 to create a mesh network in the HAN 202. In some implementations, one or more of the smart devices 204 in the HAN 202 act as a smart home controller. Additionally and / or alternatively, the hub 176 may act as a smart home controller. In some implementations, the smart home controller has more computing power than other smart devices. The smart home controller can process inputs (e.g., from the smart devices 204, the end user devices 168, and / or the server system 206) and send commands (e.g., to the smart devices 204 in the HAN 202) to control the operation of the network environment 100. In aspects, some of the smart devices 204 in the HAN 202 (e.g., in the mesh network) are "spokesman" nodes (e.g., 204-1, 204-2) and others are "low power" nodes (e.g., 204-n). Some of the smart devices in the network environment 100 may be battery-powered, while others may have a regular, reliable power source, such as via line power (e.g., to 120V line voltage). Smart devices with a regular, reliable power source are called "spokesman" nodes. These nodes typically include the ability to use wireless protocols to facilitate bidirectional communication with various other devices in the network environment 100 and with the server system 206 (e.g., cloud service 112, partner cloud service 122). In some implementations, one or more "spokesman" nodes operate as smart home controllers. Meanwhile, battery-powered devices are "low power" nodes.These nodes tend to be smaller than spokesman nodes and typically communicate exclusively using wireless protocols such as Zigbee, ZWave, 6LoWPAN, Thread, and Bluetooth, which require very little power.

[0035] Some low power nodes are not capable of two-way communication. These low power nodes transmit messages but cannot "listen." Therefore, other devices in the network environment 100, such as spokesman nodes, cannot transmit information to these low power nodes.

[0036] Some low power nodes may only be capable of limited two-way communication, such that other devices may only communicate with these low power nodes during certain times of the day.

[0037] As described, in some implementations, smart devices function as low power nodes and spokesman nodes to build a mesh network in the network environment 100. In some implementations, each low power node in the network environment periodically transmits messages about what it senses, and other low power nodes in the network environment forward messages in addition to transmitting their own messages, so that messages travel from node to node (e.g., device to device) throughout the HAN 202. In some implementations, spokesman nodes in the HAN 202 that can communicate using a relatively high-power communication protocol (e.g., IEEE 802.11) can switch to a relatively low-power communication protocol (e.g., IEEE 802.15.4) to receive these messages, convert the messages to other communication protocols, and transmit the converted messages (e.g., using the relatively high-power communication protocol) to other spokesman nodes and / or the server system 206. Thus, low power nodes using a low-power communication protocol can transmit and / or receive messages throughout the HAN 202 and to the server system 206 via the Internet (e.g., network 108). In some implementations, the mesh network enables the server system 206 to periodically receive data from most or all of the smart devices in the home, make inferences based on the data, facilitate state synchronization between devices inside and outside the HAN 202, and send commands to one or more of the smart devices to perform tasks in the networked environment.

[0038] As described, the spokesman nodes and some of the low power nodes can "listen." Thus, a user, other devices, and / or the server system 206 may communicate control commands to the low power nodes. For example, a user may use an end user device 168 (e.g., a smartphone) to send a command over the Internet to the server system 206, which relays the command to one or more spokesman nodes in the HAN 202. The spokesman nodes may communicate the command using a low power protocol to the low power nodes throughout the HAN 202 and to other spokesman nodes that did not receive the command directly from the server system 206.

[0039] In some implementations, the lighting unit 138 (FIG. 1B), an example of a smart device 204, may be a low-power node. In addition to housing a light source, the lighting unit 138 may house an occupancy sensor (e.g., occupancy sensor 150), such as an ultrasonic sensor or a passive IR sensor, and an ambient light sensor (e.g., ambient light sensor 170), such as a photoresistor or a single pixel sensor that measures the light in the room. In some implementations, the lighting unit 138 is configured to activate the light source when its ambient light sensor detects that the room is dark and when its occupancy sensor detects that someone is in the room. In other implementations, the lighting unit 138 is configured to simply activate the light source when its ambient light sensor detects that the room is dark. Furthermore, in some implementations, the lighting unit 138 includes a low-power wireless communication chip (e.g., a ZigBee chip) that periodically transmits messages regarding the occupancy of the room and the amount of light in the room, including instant messages that occur simultaneously when the occupancy sensor detects that someone is in the room. As described above, these messages may be transmitted wirelessly (e.g., using a mesh network) between nodes (e.g., between smart devices) within the HAN 202, as well as transmitted to the server system 206 via the Internet 162.

[0040] Other examples of low power nodes include battery operated versions of hazard detectors 134. These hazard detectors 134 are often located in areas without access to constant and reliable power and may include any number and types of sensors, such as smoke / fire / heat sensors (e.g., thermal radiation sensors), carbon monoxide / carbon dioxide sensors, occupancy / motion sensors, ambient light sensors, ambient temperature sensors, humidity sensors, etc. Additionally, the hazard detectors 134 may transmit messages corresponding to each of their respective sensors to other devices and / or to the server system 206, such as by using a mesh network as described above.

[0041] Examples of spokesman nodes include hallway interface devices 146 (e.g., smart doorbells), thermostats 132, control panels 166, outlets 154, and other wireless network devices 140. Because these devices are often located near and connected to a reliable power source, they may contain more power-hungry components, such as one or more communications chips capable of bidirectional communication over a variety of protocols.

[0042] In some implementations, the network environment 100 includes a controlled system 156, such as a service robot, configured to autonomously perform any of a variety of household tasks.

[0043] As described with reference to FIG. 1B, in some implementations, the network environment 100 includes a hub device (e.g., hub 176) that is communicatively coupled to the network(s) 108 directly or via a network interface 208 (e.g., access point 110). The hub 176 is further communicatively coupled to one or more smart devices 204 using at least a wireless communication network available in the network environment 100. The communication protocols used by the wireless communication network include, but are not limited to, ZigBee, Z-Wave, Insteon, EuOcean, Thread, OSIAN, Bluetooth Low Energy, and the like. In some implementations, the hub 176 not only converts data received from each smart device to meet the data format requirements of the network interface 208 or network(s) 108, but also converts information received from the network interface 208 or network(s) 108 to meet the data format requirements of the respective communication protocols associated with the targeted smart device. In some implementations, in addition to converting data formats, the hub 176 also pre-processes data received from smart devices or information received from the network interface 208 or the network(s) 108. For example, the hub 176 can integrate inputs from multiple sensors / connected devices (including sensors / devices of the same and / or different types) and perform higher level processing on those inputs to, for example, evaluate the overall environment, coordinate operations among different sensors / devices, and / or provide instructions to different devices based on the collection and programmed processing of the inputs. Note that in some implementations, the network interface 208 and the hub 176 are integrated into one network device.The functionality described herein is representative of a particular implementation of smart devices, control application(s) running on representative electronic device(s) (such as a smart phone), hub(s) 176, and server system(s) 206 coupled to the hub(s) 176 via the Internet or other wide area network. All or part of the functionality and related operations may be performed by any element of the described systems, e.g., all or part of the functionality described herein as being performed by a hub implementation may be performed in whole or in part by a server, one or more connected smart devices and / or control applications, or different combinations thereof, in different system implementations.

[0044] FIG. 2B illustrates an exemplary operating environment 220 in which a server system 206 monitors events (e.g., motion, audio, security, etc.) in video streams captured by cameras 136 (e.g., video cameras, doorbell cameras) and provides data processing to facilitate review. As shown in FIG. 2B, the server system 206 receives video data from video sources 222 (including video cameras 224 or video recording doorbells 226) located at various physical locations (e.g., homes, restaurants, stores, streets, parking lots, and / or within or near the network environment 100 of FIG. 1). Each video source 222 can be linked to one or more reviewer accounts, and the server system 206 provides video surveillance data of the video sources 222 to client devices 228 associated with the reviewer accounts. For example, the portable end-user device 168 is an example of a client device 228. In some implementations, the server system 206 is a video processing server that provides video processing services to the video sources and the client devices 228.

[0045] In some implementations, the server system 206 receives non-video data (e.g., audio data, metadata, numerical data, etc.) from one or more smart devices 204. The non-video data may be analyzed to provide context to motion events detected by the video camera 224 and / or the video recording doorbell 226. In some implementations, the non-video data indicates that an audio event (e.g., detected by an audio device such as an audio sensor integrated into the network-connected speaker 178), a security event (e.g., detected by a perimeter monitoring device such as a camera 136 and / or a motion sensor), a danger event (e.g., detected by the danger detector 134), a medical event (e.g., detected by a health monitoring device), etc. has occurred within the network environment 100.

[0046] In some implementations, multiple reviewer accounts are linked to a single network environment 100. For example, multiple occupants of the network environment 100 may have favorited accounts in the network environment 100. In some implementations, each reviewer account is associated with a particular access level. In some implementations, each reviewer account has personalized notification settings. In some implementations, a single reviewer account is linked to multiple network environments 100 (e.g., multiple different HANs). For example, a person may own or occupy multiple network environments 100 and may be assigned to review and / or manage multiple network environments 100. In some implementations, a reviewer account has different levels of access and / or notification settings for each network environment.

[0047] In some implementations, each of the video sources 222 includes one or more video cameras 224 or video recording doorbells 226 that capture video and transmit the captured video to the server system 206 in substantially real-time. In some implementations, each of the video sources 222 includes one or more doorbells 226 that capture video and transmit the captured video to the server system 206 in real-time (e.g., within one second, within ten seconds, within thirty seconds, or within one minute). Each of the doorbells 226 may include a video camera that captures video and transmits the captured video to the server system 206 in real-time. In aspects, the video source 222 includes a controller device (not shown) that acts as an intermediary between the one or more doorbells 226 and the server system 206. The controller device receives video data from the one or more doorbells 226, optionally performs some preliminary processing on the video data, and transmits the video data and / or results of the preliminary processing to the server system 206 (e.g., in real-time) on behalf of the one or more doorbells 226. In some implementations, each camera has its own on-board processing capability to perform some preliminary processing on the captured video data before transmitting the video data (e.g., along with metadata obtained from the preliminary processing) to the controller device and / or server system 206. In some implementations, one or more of the cameras are configured to optionally store the video data locally (e.g., for later transmission if requested by a user). In some implementations, the cameras are configured to perform some processing of the captured video data and, based on the processing, either transmit the video data in substantially real time, store the video data locally, or ignore the video data.

[0048] According to some implementations, the client device 228 includes a client-side module 230. In some implementations, the client-side module communicates with a server-side module 232 executing on the server system 206 via one or more networks 108. The client-side module provides client-side functionality for event monitoring and review processing, as well as communication with the server-side module. The server-side module provides server-side functionality for event monitoring and review processing to any number of client-side modules each present on a respective client device 228 (e.g., any one of the client devices 228-1 through 228-m). In some implementations, the server-side module 232 also provides server-side functionality for video processing and camera control to any number of video sources 222, including any number of control devices, cameras 136, and doorbells 226.

[0049] In some implementations, the server system 206 includes one or more processors 234, a video storage database 236, an account database 238, an input / output (I / O) interface 240 to one or more client devices 228, and an I / O interface 242 to one or more video sources 222. The I / O interface 242 to the one or more client devices 228 facilitates input and output processing for the clients. The account database 238 stores multiple profiles of reviewer accounts registered with the video processing server, each user profile including account credentials for the respective reviewer account and one or more video sources linked to the respective reviewer account. The I / O interface 242 to the one or more video sources 218 facilitates communication with one or more video sources 222 (e.g., one or more doorbells 226, cameras 136, and a group of associated controller devices). The video storage database 236 stores raw video data received from the video sources 222 as well as various types of metadata, such as motion events, event categories, event classification models, event filters, and event masks, for use in processing the data for event monitoring and review per reviewer account.

[0050] Examples of representative client devices 228 include a handheld computer, a wearable computing device, a personal digital assistant (PDA), a tablet computer, a laptop computer, a desktop computer, a mobile phone, a smart phone, an enhanced general packet radio service (EGPRS) mobile phone, a media player, a navigation device, a gaming console, a television, a remote control, a point-of-sale (POS) terminal, an in-vehicle computer, an e-book reader, or a combination of any two or more of these or other data processing devices.

[0051] Examples of the one or more networks 108 include a local area network (LAN) and a wide area network (WAN), such as the Internet. The one or more networks 108 may be implemented using any known network protocol, including various wired or wireless protocols, such as Ethernet, Universal Serial Bus (USB), FIREWIRE, Long Term Evolution (LTE), Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Wi-Fi, voice over Internet Protocol (VoIP), Wi-MAX, or any other suitable communications protocol.

[0052] In some implementations, the server system 206 is implemented on one or more standalone data processing devices or a distributed network of computers. The server system 206 may employ various virtual devices and / or services of third-party service providers (e.g., third-party cloud service providers) to provide the computing and / or infrastructure resources underlying the server system 206. In some implementations, the server system 206 includes, but is not limited to, a server computer, a handheld computer, a tablet computer, a laptop computer, a desktop computer, or a combination of any two or more of these or other data processing devices.

[0053] The server-client environment shown in FIG. 2B includes both a client-side portion (e.g., a client-side module) and a server-side portion (e.g., a server-side module). The division of functionality between the client and server portions of the operating environment may vary in different implementations. Similarly, the division of functionality between the video source 222 and the server system 206 may vary in different implementations. For example, in some implementations, the client-side module is a thin client that provides only input / output processing functions for a user and defers all other data processing functions to a back-end server (e.g., the server system 206). Similarly, in some implementations, each one of the video sources 222 is a simple video capture device that continuously captures and streams video data to the server system 206 with limited or no local pre-processing of the video data. While many aspects of the present technology are described in terms of the server system 206, corresponding operations performed by the client device 228 and / or the video source 222 will be apparent to one of ordinary skill in the art. Similarly, some aspects of the present technology may be described in terms of the client device or the video source, and corresponding operations performed by the video server will be apparent to one of ordinary skill in the art. Additionally, certain aspects of the technology may be performed cooperatively by the server system 206, the client device 228, and the video source 222.

[0054] In some aspects, a video source 222 (e.g., a video camera 224 or a doorbell 226 with an image sensor) transmits one or more streams 244 of video data to the server system 206. In some implementations, the one or more streams include multiple streams having a respective resolution and / or frame rate of raw video captured by the image sensor. In some implementations, the multiple streams include a “primary” stream (e.g., 244-1) having a resolution and frame rate corresponding to the raw video captured by the image sensor, and one or more additional streams (e.g., 244-2 through 244-q). The additional streams are optionally the same video stream as the “primary” stream but at a different resolution and / or frame rate, or streams capturing a portion of the “primary” stream (e.g., cropped to include a portion of the field of view or pixels of the primary stream) at the same or a different resolution and / or frame rate as the “primary” stream. In some implementations, the primary stream and / or the additional streams are dynamically encoded (e.g., based on network conditions, server operating conditions, camera operating conditions, characterization of the data in the streams (e.g., presence or absence of motion), user preferences, etc.).

[0055] In some implementations, one or more of the streams 244 are sent directly from the video source 222 to the client device 228 (e.g., without being routed to or processed by the server system 206). In some implementations, one or more of the streams are stored in local memory of the doorbell 226 and / or on a local storage device (e.g., a dedicated recording device) such as a digital video recorder (DVR). For example, in some implementations, the doorbell 226 stores the last 24 hours of video recorded by a camera. In some implementations, portions of one or more of the streams are stored on the doorbell 226 and / or on the local storage device (e.g., portions corresponding to particular events or times of interest).

[0056] In some implementations, the server system 206 transmits one or more streams 246 of video data to the client device 228 to facilitate user monitoring of events. In some implementations, the one or more streams may include multiple streams of the same video feed at respective resolutions and / or frame rates. In some implementations, the multiple streams include a “primary” stream (e.g., 246-1) having a certain resolution and frame rate corresponding to the video feed, and one or more additional streams (e.g., 246-2 through 246-t). The additional streams may be the same video stream as the “primary” stream, but at a different resolution and / or frame rate, or may be streams showing a portion of the “primary” stream (e.g., cropped to include a portion of the field of view or pixels of the primary stream) at the same or a different resolution and / or frame rate as the “primary” stream.

[0057] figure 3 2 is a block diagram illustrating a server system 206 according to some implementations. The server system 206 typically includes one or more processors 302 and one or more networks. A network interface 304 (e.g., an I / O interface for one or more client devices) 20 and an I / O interface 240 to one or more electronic devices The chipset 242 includes a memory 306 and these components (called a chipset). and one or more communication buses 308 for interconnecting the memory 30 6. DRAM, SRAM, DDR SRAM, or other random access solid-state memory and optionally, a high speed random access memory such as a state memory device. One or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash A non-volatile storage device, such as a memory device or one or more other non-volatile solid-state storage devices. The memory 306 optionally includes a The memory 306 may include, or may alternatively include, one or more remotely located storage devices. The non-volatile memory in 6 includes a non-transitory computer readable storage medium. In an embodiment, the memory 306, or a non-transitory computer readable storage of the memory 306 The medium contains the following programs, modules, and data structures, or a subset thereof: Or store the superset: Handles various basic system services and performs hardware-dependent tasks an operating system 310 including instructions for The server system 206 is connected to one or more network interfaces 304 (wired or to other systems and devices (for example, one or more networks 1 62) to connect to the client devices, electronic devices, and systems a network communication module 312 for Device control, data processing, and data review, including but not limited to: A server-side module 314 that provides server-side functionality for the queue: Create a reviewer account and assign video software to each reviewer account. and performing a camera positioning process to establish an association between the client devices. 3. An account management module for providing account login services to the device 228 16; Data from an electronic device (e.g., video data from video source 222 in FIG. 2B) ), further process the received data, and store it in a data storage database (e.g. , a data receiving module for preparing the data for storage in a data storage database 332 Joule 316; Changing the operating mode of an electronic device (e.g., a device in the network environment 100). Generate and send server-initiated control commands to change the operating mode of the electronic device. A user-initiated control command (e.g., from the client device 228) that changes the mode ) a device control module 320 for receiving and forwarding; Process data provided by your electronic device and / or use the processed data Prepare the data and review devices (e.g., client devices for user review) a data processing module 322 for transmitting the processed data to a remote device 228; Identifying motion tracks, controlling false positives, and generating event masks Including caching, motion events in the video stream from each of the video sources 222 an event detection module 324 for detecting candidate events; To classify motion events detected in the received video stream an event classification module 326; and - identifying characteristics associated with the presence of a person in a received video stream; A person identification module 328; and Device control, data processing, and data review, including but not limited to: A server database 330 providing server-side storage data associated with the queue: associated with each electronic device (e.g., each video source 222) for each user account; Data to be processed (e.g. raw image data / processed image data), as well as data processing models the data, the processed data results, and any other relevant metadata associated with the data (e.g. , name of the data result, location of the electronic device, time of creation, duration, settings of the electronic device, etc.) a data storage database 332 for storing (optionally) Any data and / or processing related to the Hub 176 or Smart Device A data storage database 332, some of which is securely stored; User account information such as user profile, linked hub devices and and electronic device information and settings (for example, the hub device ID), hub device specific the identity of the user and the associated hardware characteristics (e.g., service tier, device device model, storage capacity, processing power, etc.), user interface settings, data To store account information for your user account, including review preferences The account database 334 includes information about the associated electronic device, such as one or more The device identifier (e.g., media access control (MAC) Address and universally unique identifier (UUID), device Account details, including but not limited to the device's unique secrets and the title displayed und database 334.

[0058] Each of the above-identified elements may be stored in one or more of the memory devices mentioned above and may correspond to a set of instructions for performing the functions described above. The above-identified modules or programs (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and various subsets of these modules may be combined in various implementations or rearranged in other aspects. In some implementations, memory 306 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 306 optionally stores additional modules and data structures not mentioned above.

[0059] 4 is a block diagram illustrating an example smart device 204 according to some implementations. In some implementations, the smart device 204 (e.g., any device of the network environment 100 of FIG. 1, including the end user device 168) includes one or more processors 402 (e.g., CPU, ASIC, FPGA, microprocessor, etc.), one or more communication interfaces 404 having a radio 406, image sensor(s) 408, user interface(s) 410, sensor(s) 412, memory 414, and one or more communication buses 416 for interconnecting these components (sometimes referred to as a chipset). In some implementations, the user interface 410 includes one or more output devices 418 that enable presentation of media content, including one or more speakers and / or one or more visual displays. In some implementations, the user interface 410 includes one or more input devices 420 that include user interface components that facilitate user input, such as a keyboard, a mouse, a voice command input unit or microphone, a touch screen display, a touch sensitive input pad, a gesture capture camera, or other input buttons or controls. In some implementations, the input device 420 for the doorbell 226 is a haptic or touch sensitive doorbell button. Additionally, the smart device 204 uses a microphone and voice recognition, or a camera and gesture recognition, to supplement or replace the keyboard.

[0060] The sensor(s) 422 may include, for example, one or more thermal radiation sensors, ambient temperature sensors, humidity sensors, infrared (IR) sensors such as passive infrared (PIR) sensors, proximity sensors, distance sensors, occupancy sensors (e.g., using RFID sensors), ambient light sensors (ALS), motion sensors 422, position sensors (e.g., GPS sensors), accelerometers, and / or gyroscopes.

[0061] In some implementations, the smart device 204 includes an energy storage component 424 (e.g., one or more batteries and / or capacitors). In some implementations, the energy storage component 424 includes a power management integrated circuit (IC). In some implementations, the energy storage component 424 includes circuitry to collect energy from signals received via an antenna (e.g., radio 406) of the smart device. In some implementations, the energy storage component 424 includes circuitry to collect thermal energy, vibration energy, electromagnetic energy, and / or solar energy received by the smart device. In some implementations, the energy storage component 424 includes circuitry to monitor stored energy levels and adjust operation and / or generate notifications based on changes in the stored energy levels.

[0062] The communication interface 404 includes hardware capable of data communication using, for example, any of a variety of custom or standard wireless protocols (e.g., IEEE802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.5A, WirelessHART, MiWi, etc.) and / or any of a variety of custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.) or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this application. The radio 406 enables one or more wireless communication networks in the network environment 100, allowing the smart device 204 to communicate with other devices. In some implementations, the radio 406 is capable of data communication using any of a variety of custom or standard wireless protocols (e.g., IEEE802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.5A, WirelessHART, MiWi, etc.).

[0063] Memory 414 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid-state storage devices. Memory 414, or alternatively the non-volatile memory within memory 414, includes a non-transitory computer-readable storage medium. In some implementations, memory 414, or the non-transitory computer-readable storage medium of memory 414, stores the following programs, modules, and data structures, or a subset or superset thereof: · an operating system 426 that handles various basic system services and contains procedures for performing hardware-dependent tasks; · a communications module 428 for coupling to and communicating with other network devices connected to one or more networks 108 (e.g., network interfaces 208 such as routers providing Internet connectivity, network-attached storage devices, network routing devices, server systems 206, other smart devices 204, client devices 228, etc.) via one or more communications interfaces 404 (wired or wireless); · an input processing module 430 for detecting one or more user inputs or interactions from one or more input devices 420 and interpreting the detected inputs or interactions; · a user interface module 432 for providing and presenting a user interface capable of configuring and / or reviewing settings, captured data, and / or other data of one or more devices (e.g., smart device 204 and / or other devices within network environment 100); · one or more applications 434 (e.g., games, social network applications, smart home applications, and / or other web or non-web based applications) for execution by the smart device to control the device (e.g., execute commands, send commands, and / or configure settings of the smart device 204 and / or other client / electronic devices) and to review data captured by the device (e.g., device status and settings, captured data, or other information about the smart device 204 and / or other client / electronic devices); A device-side module 436 that provides device-side functionality for device control, data processing, and data review, including but not limited to: a command module 438 for receiving, forwarding, and / or executing instruction and control commands for operating the smart device 204 (e.g., from the client device 228, from the server system 206, from user input detected on the user interface 410, etc.); and · a data processing module 440 for processing data captured or received by one or more inputs (e.g., input device(s) 420, image sensor(s) 408, sensors 412, interfaces (e.g., communications interface 404), radio 406) and / or other components of the smart device 204 and preparing and transmitting the processed data to a remote device (e.g., client device 228) for review by a user; · a camera module 442 for operating the image sensor(s) 408 and associated circuitry, e.g., for enabling and disabling the image sensor(s) 408 based on data from one or more low power sensors 412 (e.g., data from a PIR sensor or an ALS), and for adjusting the encoding of raw image data captured by the image sensor(s) 408 (e.g., adjusting the format, resolution, and / or frame rate); Device Data 444, which stores data related to a device (e.g., smart device 204), including but not limited to: Account data 446 that stores information related to a user account linked to the smart device 204, such as cached login credentials, smart device identifiers (e.g., MAC address and UUID), user interface settings, display preferences, authentication tokens and tags, password keys, etc.; and · Local data storage 448 for selectively storing raw or processed data related to the smart device 204, for example, event data and / or video data captured by the image sensor(s) 408.

[0064] Each of the above identified elements may be stored in one or more of the memory devices already described and may correspond to a set of instructions for performing the functions described above. The above identified modules or programs (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and therefore various subsets of these modules may be combined or otherwise rearranged in various implementations. In some implementations, the memory 414 optionally stores a subset of the above identified modules and data structures. Additionally, the memory 414 optionally stores additional modules and data structures not described above, such as a sensor management module for managing the operation of the sensor(s) 412.

[0065] FIG. 5 is a block diagram illustrating a representative client device 228 associated with a user account, according to some implementations. The client device 228 typically includes one or more processing units (CPUs) 502, one or more network interfaces 504, memory 506, and one or more communication buses 508 for interconnecting these components (sometimes referred to as a chipset). Optionally, the client device also includes a user interface 510 and one or more built-in sensors 512 (e.g., accelerometers and gyroscopes). The user interface 510 includes one or more output devices 514 that enable presentation of media content, including one or more speakers and / or one or more visual displays. The user interface 510 also includes one or more input devices 516, including user interface components that facilitate user input, such as a keyboard, a mouse, a voice command input unit or microphone, a touch screen display, a touch sensitive input pad, a gesture capture camera, or other input buttons or controls. Additionally, some client devices use a microphone and voice recognition, or a camera and gesture recognition, to supplement or replace the keyboard. In some implementations, the client device includes one or more camera, scanner, or photo sensor units (not shown) for capturing images. Optionally, the client device includes a location detection device 518, such as a global positioning satellite (GPS) sensor or other geolocation receiver for determining the location of the client device.

[0066] Memory 506 includes high speed random access memory such as DRAM, SRAM, DDR SRAM, or other random access solid state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid state storage devices. Memory 506 optionally includes one or more storage devices located remotely from the one or more processing units 502. Memory 506, or alternatively the non-volatile memory within memory 506, includes a non-transitory computer readable storage medium. In some implementations, memory 506, or the non-transitory computer readable storage medium of memory 506, stores the following programs, modules, and data structures, or a subset or superset thereof: · an operating system 520 that handles various basic system services and contains instructions for performing hardware-dependent tasks; · a network communications module 522 for connecting the client device 228 to other systems and devices (e.g., client devices, electronic devices, and systems connected to one or more networks 108) via one or more network interfaces 504 (wired or wireless); · an input processing module 524 for detecting one or more user inputs or interactions from one of the one or more input devices 516 and interpreting the detected inputs or interactions; · one or more applications 526 (e.g., games, social network applications, smart home applications, and / or other web or non-web based applications) for execution by the client devices to control the devices (e.g., sending commands to the hub device and / or other client or electronic devices, configuring settings, etc.) and review data captured by the devices (e.g., device state and settings, captured data, or other information about the hub device or other connected devices); · A user interface module 528 for providing and displaying a user interface that allows configuration and / or review of settings, captured data, and / or other data of one or more devices (e.g., smart devices 204 in the network environment 100); A client-side module 530 providing client-side functionality for device control, data processing and data review, including but not limited to: · A device control module 532 for generating control commands for changing the operating mode of the smart device (and optionally other electronic devices) according to user input; · a video analysis module 534 for analyzing the captured video data to detect and / or recognize people, objects, animals, and events, e.g., as described above with respect to the event analysis module 448; A data review module 536 for providing a user interface for reviewing data from the server system 206 or the video source 222, including but not limited to: an event review module 538 for reviewing events (e.g., motion events and / or audio events) and optionally allowing a user to edit and / or update the events; and · a people review module 540 for reviewing data and / or images regarding detected people and other entities, and optionally enabling a user to edit and / or update the people data; a presentation module 542 for presenting a user interface and response options for interacting with the smart device 204 and / or the server system 206; and a remote interaction module 544 for interacting with, for example, a remote person (e.g., a visitor to the network environment 100) via the smart device 204 and / or the server system 206; and Client Data 546, which stores data related to user accounts and electronic devices, including but not limited to: account data 548 that stores information related to both the user account loaded on the client device and the electronic device (e.g., of the video source 222) associated with the user account, including cached login credentials, hub device identifiers (e.g., MAC addresses and UUIDs), electronic device identifiers (e.g., MAC addresses and UUIDs), user interface settings, display preferences, authentication tokens and tags, password keys, etc.; and · A local data storage database 550 for selectively storing raw or processed data relating to the electronic devices (eg, of the video sources 222, such as the doorbell 226), optionally including the aforementioned entity data.

[0067] Each of the above identified elements may be stored in one or more of the memory devices already described and may correspond to a set of instructions for performing the functions described above. The above identified modules or programs (e.g., sets of instructions) need not be implemented as separate software programs, procedures, modules, or data structures, as various subsets of these modules may be combined or otherwise rearranged in various implementations. In some implementations, memory 506 optionally stores a subset of the above identified modules and data structures. Additionally, memory 506 optionally stores additional modules and data structures not described above.

[0068] The entities described with respect to Figures 1-5 may, for example, be further divided and combined. The environment 100 of Figure 1 and the detailed diagrams of Figures 2-12 illustrate some of the many possible environments, devices, and methods in which the described techniques may be employed, either individually or in combination with one another.

[0069] Example Implementation 6 is an isometric view 600 illustrating an example video recording doorbell (e.g., doorbell 226) with a camera module according to some implementations. Doorbell 226 is illustrated as having a vertical axis 602 (e.g., y-axis), a horizontal axis 604 (e.g., x-axis), and a central axis 606 (e.g., z-axis). Doorbell 226 has a height along longitudinal axis 602 that is significantly greater (at least two times greater) than its width along horizontal axis 604, and can be elongated along the longitudinal axis such that the width is greater than its depth along central axis 606. Doorbell 226 includes a camera end 608 and a button end 610. The camera end 608 of the doorbell 226 includes an IR cover 612 that includes a portion that is substantially transparent (e.g., 70%, 80%, 90%, 100% transparent) or translucent to IR light and another portion that is substantially opaque (e.g., 70%, 80%, 90%, 100% opaque) to IR light.

[0070] In embodiments, the IR cover extends outwardly from a first face 614 (e.g., front face) of the housing of the doorbell 226. The IR cover 612 forms an annular shape with a central opening through which the camera lens 616 of the camera module (e.g., camera module 442 of FIG. 4) extends. The annular shape is generally elliptical, and in some cases, when its major and minor axes are equal, the shape is circular. A retainer 618 (e.g., lens retainer) surrounds the camera lens 616 in the xy plane and extends to protrude from the outer surface of the IR cover 612 via the central opening of the IR cover 612. In this manner, the retainer 618 extends outwardly from the housing (and from the IR cover 612) and is exposed to the environment surrounding the doorbell 226. In one example, the retainer 618 has a substantially tubular shape (having an elliptical or circular cross-section) and the camera lens 616 is disposed within a central region of the retainer 618. The retainer 618 reduces and / or prevents IR light from leaking through the IR cover 612 and into the camera lens 616. The IR light may be provided by an IR illuminator (e.g., an IR LED) disposed behind the IR cover 612 and configured to direct the IR light through one or more openings 620 in the IR cover 612. IR light may also be received from the surrounding environment through the IR cover and captured by a sensor (e.g., an image sensor, a passive infrared (PIR) sensor). Thus, the retainer 618 prevents IR light from leaking out of the IR cover 612 to the sides or edges of the camera lens 616.

[0071] The button end 610 of the doorbell 226 includes a button 622 that can be pressed by a user to initiate a notification (e.g., a chime). In embodiments, the button 622 may be surrounded by a light ring 624, which may be substantially flush with the first face 614 of the doorbell 226. The button 622 and / or the light ring 624 may have a shape and / or size that substantially matches the outer shape and / or size of the IR cover 612. In one example, the button 622 may have a diameter substantially equal to the outer diameter of the IR cover 612. In another example, the light ring 624 has an outer diameter substantially the same as the outer diameter of the IR cover 612.

[0072] 7 is a front view 700 illustrating the example doorbell 226 of FIG. 6. As shown, the camera lens 616 of the camera module 442 (not shown in FIG. 7) is centered relative to the IR cover 612 and surrounded by the retainer 618. In the xy plane (e.g., a cross section of the retainer 618), the button 622 has an elliptical shape whose major and minor axes are different (e.g., form an ellipse) or equal to one another (e.g., form a circle). The IR cover 612 may have a similar elliptical shape as the button 622.

[0073] 8 is a right front view 800 illustrating the example doorbell 226 of FIG. 6 according to some implementations. As shown, the retainer 618 extends outward (in the z-direction) from the IR cover 612 to prevent IR light traveling through the IR cover 612 from leaking to the camera lens 616. The camera lens 616 may extend outward (in the z-direction) from the retainer 618 to maximize the field of view of an image sensor (e.g., image sensor 408 of FIG. 4) through the camera lens 616.

[0074] FIG. 9 illustrates an exploded view 900 of the example doorbell 226 of FIG. 6. The doorbell 226 includes a front housing component 902 and a rear housing component 904, which are connected together to form a housing that encloses the various components of the doorbell 226. An IR cover 612 is assembled to an exterior surface (e.g., the front surface, first surface 614 in FIG. 6) of the front housing component 902. At the button end 610, the doorbell 226 includes a button subassembly 906, which may include a button 622, a first reflector 908, a button form 910, a button flange 912, a light guide 914, a rubber button 916, a dome 918, a second reflector 920, and a button PCB (e.g., a button substrate 922). One or more fasteners (e.g., fastener 924) may be used to assemble the components of the button subassembly 906 together.

[0075] The doorbell 226 also includes a speaker subassembly 926 and one or more antennas 928, which are assembled proximate to each other and proximate to the button subassembly 906. The doorbell 226 includes a battery 930, which may be mounted within a battery frame 932. A battery heater 934 may be used to heat the battery 930 to maintain it within an operable temperature range when the doorbell 226 is exposed to a low temperature environment (e.g., below freezing).

[0076] At the camera end 608, the doorbell 226 may include a PCB 936, which may be a subassembly for an IR sensor (passive infrared sensor), an IR LED, and / or an audio sensor (e.g., a microphone). A pressure-sensitive adhesive (PSA) 938 may be disposed between the PCB 936 and the front housing component 902. Also, a mesh 940 for an audio sensor may be disposed adjacent to the audio sensor. Additionally, an IR flexible printed circuit (FPC) 942 may connect the PCB 936 to the camera module 442. The camera module 442 includes a camera subassembly 944 and a PCB (e.g., a camera board 946). The camera subassembly 944 is aligned with the IR cover 612. In embodiments, one or more thermal interface materials (TIMs) 948 may be disposed adjacent the camera board 946 to transfer heat generated by one or more integrated circuit components on the camera board 946, including the image sensor. Fasteners 950 may be used to secure the camera board 946 to the camera subassembly 944 and / or the front housing component.

[0077] A main FPC 952 may be used to connect the camera board 946 to a main logic board (MLB) subassembly 954 for the doorbell 226. A heat sink 956 may be disposed adjacent to the MLB subassembly 954 to dissipate heat from the MLB subassembly 954 and transfer the heat toward the housing including the rear housing component 904. A gasket 958 (e.g., an O-ring) may be disposed between the rear housing component 904 and the front housing component 902 to form a seal and prevent water ingress along the seam between the housing components 902 and 904. The doorbell 226 may also include a label plate 960 for adding and / or replacing one or more labels. An electrical connector 962 (e.g., wire, dongle) is used to connect the doorbell 226 to a line power source. A wall plate 964 and / or a wedge 966 may be used to mount the doorbell 226 to a surface (e.g., a wall). The wall plate 964 and wedge 966 may be secured to a surface. The doorbell 226 is attached to the rear housing component 904 and includes one or more studs 968 configured to hook onto the wall plate 964 to secure the doorbell 226 to a surface. After the doorbell 226 is assembled to the wall plate 964, a locking fastener 970 may be used to further secure the doorbell 226 to the wall plate 964. A hex wrench 972 (e.g., an Allen wrench) or other suitable tool may be used to insert and tighten the locking fastener 970 into place.

[0078] FIG. 10 illustrates an exemplary implementation of a camera module (e.g., camera module 442). In the illustrated example, a camera subassembly 944 is mounted on a camera board 946. The camera module 442 also includes a movable lens retainer (e.g., retainer 618) that is movable along the z-axis (e.g., toward the axis center 1000 of the camera lens) for camera focus adjustment. The retainer 618 surrounds the camera lens 616 to prevent IR light from leaking to the camera lens 616 in the xy plane. However, the retainer 618 is metal and therefore prone to attracting ESD sparks. A conductive material (e.g., ESD bridge component 1002, also referred to herein as a "lightning rod structure") included in the camera subassembly 944 is configured to direct ESD energy passing through the retainer 618 to system ground. In this manner, the ESD bridge component 1002 acts as a bridge to direct ESD current from the retainer to system ground. The ESD bridge component 1002 may have any suitable shape, including the illustrated planar shape having a body portion and an arm portion extending outward from the body portion in a plane. The ESD bridge component 1002 may be oriented with respect to the retainer 618 such that the arm is between the body and the retainer 618. The tip of the arm is sharp (e.g., triangular, pointed). In this manner, the electric field between the ESD bridge component 1002 and the retainer 618 is significantly higher than other areas, making the space (e.g., gap) between the tip of the arm and the retainer 618 more susceptible to electrical breakdown. In one implementation, the plane defined by the planar shape of the ESD bridge component 1002 is substantially orthogonal to the axial center 1000 of the camera lens 616. In another implementation, the plane defined by the planar shape of the ESD bridge component 1002 is non-orthogonal and non-parallel to the axial center 1000 of the camera lens 616. In other implementations, the ESD bridge component 1002 has a non-planar shape (eg, curved) but directs ESD currents away from the retainer 616 to system ground.

[0079] FIG. 11 is an exploded view 1100 showing the camera module 442 of FIG. 10. The camera module 442 includes a gasket 1102 (e.g., an O-ring), an ESD bridge component 1002, and a retainer 618 assembled to a lens holder 1104. A removable IR cut filter 1106 (ICR 1106) can be inserted into the lens holder 1104. The camera board 946 includes an image sensor 1108 (e.g., image sensor 408) that can be protected by a rubber seal 1110. When assembled together, the ICR 1106 is disposed between the camera lens 616 and the image sensor 1108 to block IR light during the day to enable capture of clear images. At night, the ICR 1106 is moved away from the lens to enable surveillance in low light. The camera module 442 can also include a shielding element 1112 having graphite. One or more thermal interface materials 1114 may be disposed between the camera board 946 and the shielding element 1112 to help dissipate heat generated by integrated components (e.g., image sensor 1108) on the camera board 946. The camera module 442 and its components are further described with respect to FIG.

[0080] Figure 12 shows a cross-sectional view 1200 of the doorbell 226 of Figure 7 taken along line AA of Figure 7. When an ESD spark 1202 strikes the metal retainer 618, an ESD current 1204 travels through the retainer 618. For example, if an ESD spark jumps from an electrostatically charged person or object touching or traveling in close proximity (e.g., 5.0 mm, 3.5 mm, 2.0 mm, 1.0 mm, 0.5 mm) to the retainer 618, the retainer 618 may receive the ESD current 1204. The ESD bridge component 1002 is positioned and oriented to provide a conductive path for the ESD current 1204 from the retainer 618 to a system ground (e.g., the heat sink 956, which may be externally grounded via one or more conductive paths within the doorbell 226). The ESD bridge component 1002 does not touch or contact the retainer 618, allowing the retainer 618 to move during camera focus adjustment without adversely affecting the connection to the ESD bridge component 1002. Rather, a gap (e.g., gap 1206) exists between the retainer 618 and the ESD bridge component 1002 to allow movement of the retainer 618 relative to the ESD bridge component 1002. The gap 1206 may comprise any suitable insulating material, flexible or compressible, including air, gas (e.g., nitrogen), plastic, or other material that undergoes electrical breakdown at voltage levels associated with electrostatic discharge to establish a conductive path for ESD current. However, the gap 1206 is small enough to provide a path of least resistance from the retainer 618 to the ESD bridge component 1002. As an example, if the gap were an air gap, electrical breakdown would result in an electrical arc of current flowing from the retainer 618 to the ESD bridge component 1002. Depending on space constraints within the doorbell 226, the ESD bridge component 1002 may include a lip, rib, wall, or extension disposed at the end of an arm of the ESD bridge component 1002 and extending in a direction non-parallel to the plane of the body of the ESD bridge component 1002 (e.g., ±30 degrees, ±45 degrees, ±60 degrees, ±90 degrees relative to the surface of the ESD bridge component 1002).

[0081] The ESD current 1204 jumps from the retainer 618 to the ESD bridge component 1002. The ESD current 1204 then flows through the ESD bridge component 1002 to a ground element, such as the heat sink 956. Optionally, there is another gap (e.g., gap 1208) between the ESD bridge component 1002 and the heat sink 956. The gap 1208 may include the same (or similar) material as the material of the gap 1206 (e.g., air, gas, plastic). In some implementations, the gap 1208 may include a different material than the material of the gap 1206, which undergoes electrical breakdown at voltage levels associated with an electrostatic discharge to establish a conductive path for the ESD current. Because there are no moving or dynamic parts in or adjacent to the gap 1208, a galvanic contact (e.g., springs, pogo pins, conductive foam) can be used to establish an ESD path through the gap 1208 between the ESD bridge component 1002 and the heat sink 956. Using the gap 1208, the ESD current 1204 jumps from the ESD bridge component 1002 to the heat sink 956. The heat sink 956 can be connected to another ground element (e.g., to an external ground) that grounds the ESD current 1204 for the doorbell 226.

[0082] The gaps 1206 and 1208 may have any suitable width that allows the ESD current 1204 to jump from one component to the next, specifically from the retainer 618 to the ESD bridge component 1002 and then from the ESD bridge component 1002 to a system ground (e.g., heat sink 956). In some embodiments, the gaps 1206 and 1208 may have the same width. In some embodiments, the gaps 1206 and 1208 may have different widths. The width of the gaps 1206 and 1208 may be, for example, in the range of 0.5 millimeters (mm) to 5 mm.

[0083] The ESD bridge component 1002 acts as a bridge between the retainer 618 and a ground element (e.g., heat sink 956) to control the ESD current 1204 of the ESD spark 1202. By providing a conductive path away from ESD-sensitive circuitry, the ESD spark does not affect the operation of the camera. Rather, the ESD current 1204 flows in a controlled manner by being routed to a safe location and prevented from jumping to undesired locations within the doorbell 226, such as ESD-sensitive PCBs (e.g., PCB 936, camera board 946). The ESD bridge component 1002 may be located in any suitable location between the retainer 618 and a system ground (e.g., heat sink 956, which is safely grounded). In the illustrated example, the ESD bridge component 1002 is located on one side of the retainer 618 between the PCB 936 and the camera board 946.

[0084] By implementing the ESD bridge component 1002, no ESD protection circuitry (e.g., TVS diodes, metal oxide varistors (MOVs)) is required in the surrounding components (e.g., camera board 946, PCB 936) to handle ESD currents, thereby reducing the component cost and associated manufacturing costs of the doorbell 226. Thus, in some implementations, there are no TVS diodes in the surrounding components (camera board 946, PCB 936). The absence of TVS diodes in the assembly not only reduces manufacturing and component costs, but also allows for a thinner overall thickness (e.g., depth measured along the z-axis (see FIG. 6 )) than many conventional devices with camera modules, including doorbell devices.

[0085] conclusion Although aspects of the ESD-protected camera module have been described in language specific to features and / or methods, the subject matter of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of the ESD-protected camera module technology, and other equivalent features and methods are intended to be within the scope of the appended claims. Moreover, it should be understood that a variety of different aspects have been described, and that each described aspect can be implemented independently or in conjunction with one or more of the other described aspects.

Claims

1. 1. A camera module for an electronic device, comprising: Camera lens and an image sensor aligned with the camera lens; a retainer surrounding the camera lens and movable during focusing of the camera module; an electrostatic discharge bridge component arranged to provide a controlled path for electrostatic discharge current to travel from the retainer to a system ground of the electronic device, separated from the retainer by a gap, and arranged to guide the electrostatic discharge current away from the image sensor.

2. The camera module of claim 1 , wherein the electrostatic discharge bridge component is configured to prevent the electrostatic discharge current from jumping to circuitry that is sensitive to the electrostatic discharge current.

3. The circuit comprises: a camera board having said image sensor; or The camera module of claim 2 including at least one printed circuit board having one or more infrared light sources thereon.

4. The camera module of claim 1 or 2, wherein the gap separates the electrostatic discharge bridge component from the retainer by a width in the range of 0.5 millimeters to 5 millimeters.

5. The camera module according to claim 1 , wherein the retainer is movable in an axial direction of the camera lens.

6. 3. The camera module of claim 1, wherein the retainer is configured to receive the electrostatic discharge current from an electrostatic discharge spark that jumps from an electrostatically charged person or object that touches or moves near the retainer.

7. The camera module of claim 3 , further comprising a lens holder attached to the camera board and configured to support the camera lens, the electrostatic discharge bridge component being disposed on the lens holder.

8. The camera module of claim 7 , wherein the electrostatic discharge bridge component includes a planar shape and is oriented such that a plane defined by the planar shape is non-parallel to an axial center of the camera lens.

9. A housing and a circuit susceptible to the electrostatic discharge current; a system ground for grounding the electrostatic discharge current; An electronic device comprising a camera module according to claim 1 or 2.

10. The electronic device of claim 9 , wherein the retainer is configured to extend outwardly from the housing and be exposed to an environment surrounding the electronic device.

11. The electronic device of claim 9 , wherein the retainer has a substantially tubular shape.

12. The electronic device of claim 9 , wherein the system ground comprises a heat sink.

13. the gap is a first gap, the electrostatic discharge bridge component is separated from the heat sink by a second gap; 13. The electronic device of claim 12, wherein the second gap separates the electrostatic discharge bridge component from the heat sink by a width in the range of 0.5 millimeters to 5 millimeters.

14. 10. The electronic device of claim 9, further comprising a printed circuit board disposed proximate to the retainer, the electrostatic discharge bridge component preventing the electrostatic discharge current from jumping to the printed circuit board.

15. The electronic device of claim 9, wherein the electronic device is a video recording doorbell.

Images