Smart device with privacy function enabling switch

By introducing hardware switches and controller management systems into the cameras, the privacy and security threats of home network cameras are addressed, enabling controllable enabling and disabling of audio and image components, thus enhancing the security and privacy protection of the devices.

CN116615907BActive Publication Date: 2025-11-07HUAWEI TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202080107896.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-16
Publication Date
2025-11-07
Estimated Expiration
2040-12-16

AI Technical Summary

Technical Problem

Computerized products such as home network security cameras face the risk of remote control by hackers, leading to privacy and security threats. Existing technologies are insufficient to effectively protect user privacy.

Method used

Hardware switches are introduced into the camera to enable or disable the audio component, and these switches are managed by a controller to control the camera's functional state, including image scrambling and audio scrambling, to ensure privacy protection.

Benefits of technology

By combining hardware switches and controllers, the camera components can be enabled and disabled in a controlled manner, enhancing the security and privacy protection of the device and preventing unauthorized information capture and transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116615907B_ABST
    Figure CN116615907B_ABST
Patent Text Reader

Abstract

The present technology discloses a security camera comprising a housing and a hardware switch coupled to the housing and an audio assembly of the security camera. The hardware switch has an on position and an off position. When the hardware switch is in the on position, the audio assembly of the camera is operational. When the hardware switch is in the off position, the audio assembly of the camera is not operational.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present invention relates generally to smart devices and privacy. BACKGROUND

[0002] The presence of cameras and microphones in computerized products such as home network security cameras presents challenges to information security and privacy today. As home network security cameras connected to public networks and the Internet become more common, the risk of hackers remotely controlling these devices also increases. Because these products have internal or external image-capturing sensors and microphones, they have always been at risk of becoming eavesdropping devices that violate the personal security and privacy of their own homes. SUMMARY

[0003] According to one aspect of the present invention, there is a security camera comprising: a housing; a hardware switch coupled to the housing and an audio component of the security camera, the hardware switch having an on position and an off position, wherein the audio component of the security camera is operational when the hardware switch is in the on position and the audio component of the security camera is not operational when the hardware switch is in the off position.

[0004] Optionally, in any of the above aspects, the hardware switch is located inside the housing; the security camera further comprises a removable cover attached to the housing, the hardware switch inside the housing is accessible when the removable cover is removed.

[0005] Optionally, in any of the above aspects, the hardware switch is accessible from outside the housing and is waterproof.

[0006] Optionally, in any of the above aspects, the hardware switch is mechanically switched to the on position or the off position.

[0007] Optionally, in any of the above aspects, the security camera further comprises a controller coupled to the hardware switch and configured to identify when the hardware switch is switched to the on position or the off position.

[0008] Optionally, in any of the above aspects, the audio component of the security camera is prevented from communicating with the controller when the hardware switch is in the off position.

[0009] Optionally, in any of the above aspects, the security camera further comprises an image sensor configured to capture an image or a sequence of images, the image or the sequence of images comprising a person's mouth, the person's mouth in the image or the sequence of images being detected by the controller and scrambled using data scrambling to obfuscate the person's mouth.

[0010] Optionally, in any of the above aspects, the data scrambling obfuscates the person's mouth when the hardware switch controlling the audio component is in the off position, or the hardware switch controlling the audio component is in the on position and the controller identifies that a mouth scrambling switch on a client device is in the on position.

[0011] Optionally, in any of the above aspects, the hardware switch is one of a single-pole single-throw switch or two single-pole single-throw switches, the hardware switch controlling an on / off state of a corresponding audio component of the security camera.

[0012] Optionally, in any of the above aspects, the audio component is one of a microphone and a speaker.

[0013] According to an aspect of the present invention, there is a computer-implemented method of protecting privacy in a security camera, comprising determining, by a controller of the security camera, that a hardware switch has moved to a position that enables or disables an audio component of the security camera, wherein the audio component of the security camera is not operational when the hardware switch is off, and the audio component of the security camera is operational when the hardware switch is in an on position; scrambling, by the controller of the security camera, a portion of an image or sequence of images received by the security camera when the hardware switch of the audio component is in the off position.

[0014] Optionally, in any of the above aspects, the method further comprises sending, by an interface of the security camera, a status signal to a client device, the status signal indicating that the audio component is enabled or disabled according to the position of the hardware switch.

[0015] Optionally, in any of the above aspects, the method further comprises capturing, by an image sensor of the security camera, an image or sequence of images of a person's mouth.

[0016] Optionally, in any of the above aspects, the person's mouth in the image or sequence of images is detected by the controller and scrambled using data scrambling to obfuscate the person's mouth.

[0017] Optionally, in any of the above aspects, the data scrambling obfuscates the person's mouth when the hardware switch controlling the audio component is in the off position, or the hardware switch controlling the audio component is in the on position and the controller identifies that a mouth scrambling switch on a client device is in the on position.

[0018] Optionally, in any of the above aspects, an off position of a first hardware switch disables a first audio component of the camera, and an off position of a second hardware switch disables a second audio component of the camera.

[0019] Optionally, in any of the above aspects, the first component is a microphone and the second component is a speaker.

[0020] Optionally, in any of the above aspects, the method further comprises updating the status signal when the hardware switch is toggled between the on position or the off position.

[0021] Optionally, in any of the above aspects, the method further comprises sending an updated status signal to the client device, the updated status signal indicating that the position of the hardware switch has toggled. This summary introduces a selection of concepts that are further described in the detailed description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it meant to limit the scope of the claimed subject matter. The patent application is not limited to implementations that solve any or all of the problems presented in the background. BRIEF DESCRIPTION OF DRAWINGS

[0022] Various aspects of the application are illustrated in the example and are not limited by the accompanying drawings, in which like numerals indicate similar elements.

[0023] Figure 1 An example of a smart device system is shown.

[0024] Figure 2 An example of a smart home monitoring system is shown.

[0025] Figure 3A An example embodiment of a smart device with a switch of the disclosed embodiments is shown.

[0026] Figure 3B An example of a switch in a smart device of Figure 3A is shown.

[0027] Figure 4 An example of a graphical user interface of a client device is shown.

[0028] Figure 5 An example flowchart of protecting privacy in a smart device is shown.

[0029] Figure 6 A schematic diagram of a general network component or computer system is shown. DETAILED DESCRIPTION

[0030] The application will now be described with reference to the drawings, which are generally directed to data transmission in a network.

[0031] The technology relates to a smart device having one or more hardware switches to activate and deactivate one or more components in the smart device. Incorporating a hardware or physical switch into a smart device allows a user to selectively activate and deactivate components in the smart device and provides a level of security and privacy that would otherwise not be available. For example, the switch can disconnect or disable a component that can be used to invade or compromise a user’s privacy (e.g., a camera, microphone, speaker, etc.). When in the off position, the switch can operate to disable the corresponding component, thereby providing a simple mechanism to determine whether the component is working or not. In one embodiment, when the switch is in the off position, the physical connection or signal between the component and a controller or processor of the smart device is disabled, such that the smart device cannot access the component.

[0032] It should be appreciated that the present embodiments of the application can be implemented in numerous ways, and that the appended claims should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the inventive embodiments concept to those skilled in the art. It should be appreciated that the application is intended to cover alternatives, modifications and equivalents of these embodiments, which are included within the spirit and scope of the application as defined by the appended claims. Furthermore, in the following detailed description of the present embodiments of the application, numerous specific details are set forth in order to provide a thorough understanding of the present application. However, it will be apparent to one skilled in the art that the present embodiments of the application can be practiced without these specific details.

[0033] Figure 1 An example of a smart device system is shown. The smart device system 100 includes a smart device 110, a server 112, a client device 114, and a storage device 116. In one embodiment, as shown, the smart device 110 is a camera, such as a video camera. It should be appreciated that the smart device system 100 is not limited to the illustrated components, and any number of components can be part of the smart device network 100. For example, the smart device system 100 can include more or fewer smart devices 110, servers 112, client devices 114, and storage devices 116.

[0034] In Figure 1In one embodiment, the smart device 110 is a camera that includes one or more image sensors 102, a microphone 104, a speaker 106, and one or more switches 108. In one embodiment, the switch 108 is a physical or hardware switch. The smart device 110 (e.g., camera) can include, for example, a high definition (HD) image sensor, such as a HD image sensor capable of capturing video images at a 720p or 1080p or higher image display resolution. Although not shown, the smart device 110 can also include other hardware and / or components, such as memory (e.g., volatile and / or non-volatile memory), a housing, one or more motion sensors (and / or other types of sensors), etc. It should also be understood that the smart device 110 is not limited to a camera and can be any type of smart device or internet of things (IoT) device, as discussed in more detail below.

[0035] In one embodiment, the smart device 110 is in communication with a local network 111. The local network 111 can be, for example, a wired and / or wireless (WiFi) network compatible with IEEE 802.11 standards and / or other wireless communication standards. Although not shown, the local network 111 can also be in communication with various other connected devices and is not limited to the illustrated embodiment. The local network 111 can also be connected to a public network 113, such as the Internet and / or the public switched telephone network (PSTN). As described below, the smart device 110 can be in communication with a client device 114 via the network 111 and / or the public network 113. The client device 114 can include, for example, a mobile device, such as a smartphone, a personal digital assistant (PDA), a computer, or another communication device. The client device 114 includes a display (not shown) and related components capable of displaying streamed and / or recorded video images acquired by the smart device 110. In one embodiment, the client device 114 can also include a speaker and related components capable of broadcasting streamed and / or recorded audio, and can also include a microphone.

[0036] In another embodiment, the smart device 110 can also be in communication with one or more storage devices 116 and one or more servers 112 via the public network 113 (e.g., Internet / PSTN) and the local network 111 (e.g., personal wired or wireless network). Although the illustrated embodiment shows the storage devices 116 and servers 112 as components separate from the local network 111, it should be understood that the storage devices 116 and servers 112 can be components of the local network 111. In another embodiment, the storage devices 116 and servers 112 can be part of the local network 111 or any combination thereof.

[0037] The public network 113 can be any wireless network or any wired network, or a combination thereof. For example, the public network 113 can include a wide area network (e.g., the Internet, an enterprise network), a telephone network, a data network associated with a telephone / voice provider (e.g., a mobile communication provider data and / or voice network), a direct connection between two computing devices, and any combination thereof.

[0038] Figure 2 An example of a smart home monitoring system is shown. The smart home monitoring system can be the same as or supplemental to the smart device system 100, monitoring an environment 200 using, for example, one or more smart devices 110 and client devices 114. The smart devices 110 and client devices 114 can be connected, for example, using a local network such as the local network 111 and / or a public network such as the network 113. In the illustrated example, the smart device 110 is a wall-mountable camera, such as a video camera, that can be installed in the environment 200 monitored by the smart home monitoring system. In one embodiment, the smart device 110 can be accessed by a user via the client device 114, which allows the user to operate the camera to monitor the environment 200. Although not shown, it should be understood that any number of smart devices 110 and client devices 114 can be employed in a home monitoring system, and the system is not limited to the disclosed embodiments.

[0039] The client device 114 includes, for example, a processor 216, an interface 218, and a memory 220 including an application 222. Examples of the client device 114 include, but are not limited to, any suitable type of computing device, such as a general purpose computer, a special purpose computer, a notebook computer, a desktop computer, a mobile device, a navigation system, a smartphone, a tablet computer, a wearable computing device (e.g., a head-mounted display or a smartwatch), a display with one or more processors, or other suitable computing device. Although located within the environment 200 in the described embodiment, the client device 114 can also be located remotely from the environment 200 and the smart device 110 and communicate via a network such as the public network 113.

[0040] In one embodiment, the smart device 110 (e.g., a camera) includes one or more image sensors 102, a microphone 104, a speaker 106, and one or more switches 108, similar to the smart device 110 described above with respect to the smart device system 100. Figure 1The image sensor 102 may, for example, capture light focused by a lens on the smart device 110 and convert the captured light into a signal that can be recorded as digital data. In some implementations, the image sensor 102 uses charge-coupled device (CCD), complementary metal oxide semiconductor (CMOS), or N-type metal oxide semiconductor (NMOS) technology. The microphone 104 can include an acoustoelectric transducer or sensor that converts sound from the environment 200 into an electrical signal, while the speaker 106 can include one or more electroacoustic transducers that convert electrical audio signals into corresponding sound for output in the environment 200. The switch 108, described in more detail below, can be a hardware or physical switch on the smart device 110 that can be used to turn on and off various components, such as the image sensor 102, microphone 104, and speaker 106.

[0041] The smart device 110 also contains a controller 214 that includes one or more network interfaces 208, one or more processors 210, and memory 212. The network interface 208 can connect to a network (local area network, wide area network, the Internet) through a wired or wireless connection and communicate with remote systems (e.g., video or other server systems). This communication can include, for example, the transmission of images and video to remote systems for storage and processing. The network interface 208 can also include, for example, hardware capable of data communication using any of a variety of custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6L0WPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.5a, WirelessHART, MiWi, etc.) and / or any of a variety of custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitable communication protocol.

[0042] The processor 210 (and the processor 216) can include one or more processors and / or processors with multiple cores. Further, the processor 210 can include one or more cores of different types. For example, the processor 210 can include application processor units, graphics processing units, etc. In one implementation, the processor 210 can include a microcontroller. In other embodiments, the processor 210 can include an encoding and compression chip. In yet other embodiments, the processor 210 can process video captured by the image sensor 102 and audio captured by the microphone 104 and can convert the data into a form suitable for wireless transmission to a network via the network interface 208. In yet another embodiment, the processor 210 executes programs and instructions stored in the memory 212.

[0043] The memory 212 (and the memory 220) can include volatile and nonvolatile memory, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Such memory includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, RAID storage systems, or any other medium that can be used to store the desired information and that can be accessed by the computing device. The memory 212 can be implemented as a computer-readable storage medium that can be accessed by the processor 210 to execute instructions stored on the memory 212. In one basic implementation, the computer-readable storage medium can include random access memory (RAM) and flash memory. In other implementations, the computer-readable storage medium can include, but is not limited to, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or any other tangible medium that can be used to store the desired information and that can be accessed by the processor 210.

[0044] It should be appreciated that the memory 212 can include at least one operating system (OS) module for managing hardware resource devices, such as the network interface 208 (and the interface 218), I / O devices of the respective apparatus, etc., and providing various services to applications or modules executing on the processor.

[0045] In some implementations, the smart home monitoring system includes more than one networked smart device 110 (e.g., networked cameras) for providing video monitoring and security in the environment 200. In one embodiment, a user can use a networked client device 114, such as a computer or mobile device, to control the smart devices 110 in the smart home monitoring system. In this case, the user can additionally operate a mechanical or hardware switch on the camera to turn on / off various camera components, as discussed further below.

[0046] Figure 3A An exemplary embodiment of a smart device with a switch of the disclosed embodiments is shown. The smart device 110 is a camera in the illustrated embodiment, which can be used, for example, in a smart device system 100 ( Figure 1 ) or a home monitoring system of an environment 200 ( Figure 2 ). As shown, the smart device 110 (e.g., camera) includes an image sensor 102, a microphone 104, a speaker 106, a switch 108, and a controller 214, as described above with reference to Figure 1 and 2 . The smart device 110 also includes a lens 302 that receives light and focuses the light onto the image sensor 102. In some implementations, the smart device 110 can communicate with one or more other smart devices 110, computers, devices, or systems through a network interface 208. For example, the smart device 110 can connect to a network (local area network, wide area network, Internet) through a wired or wireless connection and communicate with a remote system (e.g., a video or other server system). This communication can include, for example, transmitting images and video to the remote system for storage and processing.

[0047] The controller 214, which includes supplemental components to those discussed with reference to Figure 2 , includes a video front end, video and audio CODECs, a USB interface, a power supply, and other circuitry required to support the video sensor. The audio CODEC can be in the form of one or more CODEC chips and can include a microphone mute input (not shown) that controls the state of the CODEC functions. In one embodiment, the mute input is controlled by a switch, such as the switch 108 between the controller 214 and the microphone 104. The processor 210 in the controller 214 can perform functions such as image signal processing (ISP) and compression with various interfaces such as CPU type parallel, RS-232, 5-wire serial interface, USB full / high-speed device controller, and USB full-speed host controller, among others. The controller 214 can also include the network interface 208 described above, which can also include various communication interfaces such as, but not limited to, WiFi 208A components, Bluetooth TMcomponent 208B or Ethernet 208C. In another embodiment, the controller 214 can operate the switch 108 to control various components of the smart device 110, for example, by processing commands entered by a user via the client device 114.

[0048] The switch 108 allows a user in the environment or near the smart device 110 to enable and disable functions of the smart device 110 by simply toggling a mechanical switch to an on or off position. For example, the mechanical or hardware switch 108 can be a single pole single throw (SPST) switch, a double SPST switch, a double throw switch, or the like.

[0049] In one embodiment, the switch 108 enhances the security of the smart device 110 by allowing a user to mechanically enable and disable hardware components on the smart device 110. As used herein, the term "switch" refers to a collective of various types of switches or breakers designed to disable or change the state of a component (e.g., an electromechanical function, a transistor, an electrical signal, etc.) when activated. For example, the switch 108 can include a toggle switch 108A, such as an SPST switch. In another example, an actuator (not shown) can engage the switch 108. The actuator can include a physical connection to the device, such as a lanyard, that when broken or disconnected causes the actuator to send a signal to the switch 108.

[0050] In the illustrated embodiment, as described above, the smart device 110 is a camera having one or more image sensors 102, microphones 104, and speakers 106. The switch 108 can be located on or near the camera such that movement (e.g., toggling) of the movable portion from the on position to the off position causes one or more components to which the switch 108 is attached to be disabled. Similarly, movement of the movable portion from the off position to the on position causes one or more components to which the switch 108 is attached to be enabled. In one embodiment, the switch 108 is accessible from the housing of the camera and can be waterproof. In another embodiment, the switch 108 is located inside the camera, for example, behind a removable cover attached to the housing.

[0051] In another embodiment, when the switch 108 is moved to an on position, the controller 214 in the camera can recognize that the component corresponding to the switch 108 has been enabled. That is, the controller 214 can read the state of the switch 108 corresponding to the component to determine the state of the component (e.g., enabled / disabled). When enabled, the controller 214 can signal the component to activate. For example, switching the switch 108 to the on position for the microphone 104 will cause the component to be activated so that the user can speak to the camera via the microphone 104. In another example, switching the switch 108 to the on position for the image sensor 102 will cause the component to be activated so that images or video received by the camera will be captured. In yet another example, switching the switch 108 to the on position can activate the WiFi 208A or BT 208B. When in the activated state, the WiFi 208A and BT 208B allow the camera to communicate with the client device 114, for example, via a network, Bluetooth, or some other form of wireless communication. In yet another embodiment, when the WiFi 208A or BT 208A is activated, an application associated with the component can launch. For example, the camera application can launch on the client device 114 so that the user can access the camera.

[0052] When the switch 108 is switched to the off position, the corresponding component is deactivated or the signal between the component and the controller 214 is lost. For example, if the switch 108 corresponding to the speaker 106 is switched to the off position, the speaker 106 will be deactivated so that the user in the environment or close to the camera will no longer hear sounds from the speaker 106. In yet another example, switching the switch 108 corresponding to the microphone 104 will deactivate the use of the microphone 104 so that verbal or audio communication with the camera will cease.

[0053] In addition to disabling the components described above via the switch 108, it should be understood that disabling the components of the camera can include breaking the signal path between the components of the camera and the controller 214.

[0054] In another implementation, the processor 210 or controller 214 can also be used to disable communication with the camera in response to activation of the switch. For example, the network connection between the camera and a router connected to the camera to WiFi can be cut off so that data captured by the image sensor 102 cannot be transmitted to another device, such as the client device 114. For example, the switch 108 can be used to cut off the internet connection of the camera or cause the camera to limit data transmission when the switch 108 is activated.

[0055] One particular implementation, for example Figure 3BThe figure shown in FIG. 1 illustrates an analog switch or amplifier connected to switch 108 for on / off control. Analog switch or amplifier 108B can be separate from or integrated into camera controller 214. This type of analog switch or amplifier 108B has low resistance and capacitance characteristics suitable for low distortion audio, video, and data routing applications when enabled or turned on. The analog switch shown has an NC logic configuration such that when IN is low, the switch is on (NC connected to COM). As shown by the pin assignments of analog switch 108B, COM is the common signal line, NC is the normally closed signal line, GND is ground, IN is the control signal line, V CC is the power supply.

[0056] Figure 4 An example of a graphical user interface of a client device is shown. Client device 114, such as a smartphone, includes a display that displays audio and video settings. In the embodiment shown, client device 114 can access a camera in a home monitoring system of smart devices 110, such as Figure 2

[0057] The camera can be used to monitor captured image data. For example, the camera can be directed toward environment 200 Figure 2 to capture images of a person. The captured images can be transmitted to controller 214 for monitoring purposes related to the person in environment 200. It should be understood that while monitoring is discussed with reference to controller 214, other components such as processor 210 and devices such as client device 114 and server 112 can also be responsible for monitoring the captured images.

[0058] ​In one embodiment, the controller 214 can collect images of the environment 200 and identify portions of the collected images (or image sequences) that include privacy areas. The privacy areas can correspond to particular objects, particular users, particular human-object interactions, particular human-actions, particular geographic locations, and the like. For example, an image of a person in the environment 200 can include a mouth that is identified as a privacy area. In one embodiment, the controller 214 can be used to identify privacy areas by comparing captured image data to predefined privacy areas. For example, the controller 214 can be trained using an image database or a deep learning neural network model. Each image in the database can include predefined privacy areas that identify privacy entities, such as users or objects, that are included in the image.

[0059] In some implementations, the controller 214 can perform obfuscation of the identified privacy areas. For example, as shown, the person 402 can include a mouth that is identified as a privacy area 404, such that the privacy area of the image is obfuscated. The controller 214 can be used to obfuscate the privacy area 404 and provide only the non-privacy areas as output to the client device 114. In some aspects, the controller 214 is used to provide as output to the client device 114 the captured image that includes the obfuscated privacy area 404 in the image, as shown.

[0060] In one embodiment, the controller 214 determines the obfuscation technique for a particular object from an object type or a deep learning neural network model. The controller 214 can apply one or more different obfuscation techniques to a particular object according to the object type or the deep learning neural network model execution output. For example, a person can be speaking. Thus, the mouth can be determined to be a particular object associated with a first object type. In this case, the mouth can be obfuscated or blurred by scrambling the privacy area 404 in the image. The controller 214 can then obfuscate or blur the particular object using the determined obfuscation technique. In one embodiment, the controller 214 can be used to automatically perform a particular obfuscation technique on a particular object according to the object type. As discussed above, it should be understood that while obfuscation is discussed with reference to the controller 214, other components and devices can also perform obfuscation techniques.

[0061] Figure 5 An example flow diagram of protecting privacy in smart devices is shown. In the following discussion, the controller 214, including the processor 210, performs the processes. However, it should be understood that any other functional unit or processing unit can implement the processes described herein and the present application is not limited to implementation by controllers and processors.

[0062] At step 502, the controller 214 determines that the smart device 110 (e.g., a camera) is active and working.

[0063] Once active, the controller 214 determines the position of one or more switches 108, where each switch 108 corresponds to one or more components in the smart device 110, at step 504. Each switch 108 can enable or disable the corresponding one or more components of the smart device 110 (e.g., image sensor, microphone, speaker, etc.) depending on the on / off position of the switch 108.

[0064] The status of one or more switches 108 is determined at step 506. For the corresponding component of the smart device 110, the switch 108 is determined to be in the on position means that the component is active or enabled. In this case, the connection (e.g., signal path) between the corresponding component and the controller 214 is enabled at step 510, and the controller 214 will check if the client device has a switch setting for camera blur (e.g., mouth obscuring). For example, when the image or video captured by the camera is enabled (i.e., the image sensor is enabled), the controller 214 can check the camera blur switch setting to obscure or blur (or otherwise obfuscate) one or more portions of the captured image or video. At step 512, the controller 214 determines with the client device 114 that the camera blur switch is in the on position. If the camera blur switch is in the on position, the controller 214 will detect and obscure one or more portions of the image or video (e.g., obscuring the person’s mouth) at step 514. For example, when the microphone 104 has been disabled by switching the corresponding switch 108 to the off position, the camera can record a video of a person in the home environment (e.g., the image sensor 102 of the camera is turned on and enabled). In this case, although the audio has been disabled, audio can still be obtained via lip reading or some other form of communication captured in the video (e.g., sign language). To ensure the privacy of the person being recorded and prevent any other disabled audio from being captured, the user can choose to obscure or blur (obfuscate) a portion of the person’s video (e.g., the mouth), as described above.

[0065] For the corresponding component of the smart device 110, the switch 108 is determined to be in the off position means that the component is not active or disabled. In this case, the controller 214 will detect and obscure one or more portions of the image or video (e.g., obscuring the person’s mouth) at step 508. In an optional embodiment, the smart device 110 can send a status signal to the client device 114 via an interface 208, e.g., a WiFi interface. In one embodiment, the status signal indicates that the corresponding component is enabled or disabled depending on the position of one or more switches 108.

[0066] When the smart device 110 captures an image, it is continuously monitored to determine the position and status of the switches 108 and enable or disable the components depending on the status.

[0067] Figure 6 An exemplary embodiment of a computing system for implementing embodiments of the application is shown. The computer system 600 includes a processor 604 and a memory 608 that communicate with each other via a bus 612. The bus 612 can include any of several types of bus structures including, but not limited to, a memory bus, a memory controller, a peripheral bus, a local bus, and any combinations thereof, using any of a variety of bus architectures including, but not limited to, Industrial Standard Architecture (ISA), Micro Channel Architecture (MCA), Enhanced ISA (EISA), Video Electronics Standards Association (VESA), and Accelerated Graphics Port (AGP) buses.

[0068] The memory 608 can include various components (e.g., machine-readable media), including but not limited to a random access memory component, a read-only component, and any combinations thereof. In one example, a basic input / output system 616 (BIOS), including the basic routines that help to transfer information between elements within the computer system 600, such as during start-up, can be stored in the memory 608. The memory 608 can also include instructions (e.g., software) 620 (e.g., stored in one or more machine-readable media) to embody any one or more of the aspects and / or methodologies of the present application. In another example, the memory 608 can also include any number of program modules, including but not limited to an operating system, one or more application programs, other program modules, program data, and any combinations thereof.

[0069] The computer system 600 can also include a storage device 624. Examples of storage devices (e.g., the storage device 624) include, but are not limited to, a hard disk drive, a magnetic disk drive, an optical disk drive in combination with an optical medium, a solid-state memory device, and any combinations thereof. The storage device 624 can be connected to the bus 612 by a suitable interface (not shown). Exemplary interfaces include, but are not limited to, SCSI, advanced technology attachment (ATA), serial ATA, universal serial bus (USB), IEEE 1394 (FIREWIRE), and any combinations thereof. In one example, the storage device 624 (or one or more components thereof) can be detachably connected to the computer system 600 (e.g., via an external port connector (not shown)). Specifically, the storage device 624 and associated machine-readable medium 628 can provide non-volatile and / or volatile storage for machine-readable instructions, data structures, program modules, and / or other data for the computer system 600. In one example, the software 620 can reside entirely, or a portion thereof, within the machine-readable medium 628. In another example, the software 620 can reside entirely, or a portion thereof, within the processor 604.

[0070] Computer system 600 can also include input device 632. In one example, a user of computer system 600 can enter commands and / or other information into computer system 600 via input device 632. Examples of an input device 632 include, but are not limited to, an alpha-numeric input device (e.g., a keyboard), a pointing device, a joystick, a gamepad, an audio input device (e.g., a microphone, a voice response system, etc.), a cursor control device (e.g., a mouse), a touchpad, an optical scanner, a video capture device (e.g., a camera, a camcorder), a touchscreen, and any combinations thereof. Input device 632 can be connected to bus 612 via any of a variety of interfaces (not shown) including, but not limited to, a serial interface, a parallel interface, a game port, a USB interface, a FIREWIRE interface, a direct interface to bus 612, and any combinations thereof. Input device 632 can include a touchscreen interface that can be part of or separate from display 636, discussed further below. Input device 632 can be used as a user selection device for selecting one or more graphical representations in a graphical interface as described above.

[0071] A user can also input commands and / or other information to computer system 600 via storage device 624 (e.g., a removable disk drive, a flash memory device, etc.) and / or network interface device 640. Network interface device 640, among other network interface devices, can be used to connect computer system 600 to one or more of a variety of networks, such as network 644, and one or more remote devices 648 connected to the network. Examples of network interface devices include, but are not limited to, a network interface card (e.g., a mobile network interface card, a LAN card), a modem, and any combinations thereof. Examples of networks include, but are not limited to, a wide area network (e.g., the Internet, an enterprise network), a local area network (e.g., a network associated with an office, a building, a campus, or other relatively small geographic space), a telephone network, a data network associated with a telephone / voice provider (e.g., a mobile communication provider data and / or voice network), a direct connection between two computing devices, and any combinations thereof. Network 644, among other networks, can employ wired and / or wireless communication modes. In general, any network topology can be used. Information (e.g., data, software 620, etc.) can be communicated to and / or from computer system 600 via network interface device 640.

[0072] The computer system 600 can also include a video display adapter 652 to drive a display device, such as the display device 636, to present a visually perceptible image. Examples of display devices include, but are not limited to, liquid crystal displays (LCDs), cathode ray tubes (CRTs), plasma displays, light emitting diode (LED) displays, and any combination thereof. The display adapter 652 and the display device 636 can be used in combination with the processor 604 to provide a graphical representation of various aspects of the present application. In addition to a display device, the computer system 600 can include one or more other peripheral output devices including, but not limited to, audio speakers, printers, and any combination thereof. Such peripheral output devices can be connected to the bus 612 via a peripheral interface 656. Examples of peripheral interfaces include, but are not limited to, a serial port, a USB connection, a FIREWIRE interface connection, a parallel connection, and any combination thereof.

[0073] It is to be understood that the present subject matter can be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the subject matter to those skilled in the art. Indeed, the subject matter is intended to cover alternatives, modifications and equivalents of these embodiments, including those that are within the scope and spirit of the subject matter as defined by the appended claims. Furthermore, in the following detailed description of the present subject matter, numerous specific details are set forth in order to provide a thorough understanding of the present subject matter. However, it will be clear to those of ordinary skill in the art that the present subject matter can be practiced without these specific details.

[0074] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to produce a machine, such that the instructions that execute on the computer or other programmable data processing apparatus create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer program instructions can also be stored in a computer-usable or computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer- usable or computer-readable memory produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0075] Computer-readable non-transitory media includes various types of computer- readable media, including magnetic storage media, optical storage media, and solid state storage media, specifically excluding signals. It will be appreciated that software can be installed in a device and sold along with the device. Alternatively, software can be obtained, for example, by downloading the software from a server or a distribution system, including, for example, from a server owned by the software creator or from a server used by the software creator but not owned by the software creator. For example, software can be stored in a server for distribution over the Internet.

[0076] Computer-readable storage media does not include propagating signals, is accessible by a computer and / or processor, and includes both volatile and non-volatile, removable and / or non-removable media implemented in a method of storage component. For a computer, various types of storage media accommodate stored data in any suitable digital format. Those skilled in the art will appreciate that other types of computer-readable media can be used, such as compact discs, solid state drives, magnetic tapes, flash cards, flash drives, cartridges, and the like, for storing computer-executable instructions for performing the novel methods (acts) of the disclosed architecture.

[0077] The terminology used herein is for the purpose of describing particular aspects only and is not intended to be limiting of the present disclosure. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0078] The description of the present disclosure is presented solely for the purpose of illustration and description and is not intended to limit the present disclosure in scope or in any way to the precise description and disclosure given herein. Various modifications and changes can be made thereto by those of ordinary skill in the art without departing from the scope and spirit of the disclosure. The various aspects of the disclosure are chosen and described in order to best explain the principles of the disclosure and its practical application to thereby enable others skilled in the art to best utilize the disclosure and various modifications as suitable for the particular uses contemplated.

[0079] For the purposes of this document, each process associated with the disclosed technology can be performed continuously by one or more computing devices. Each step in the process can be performed by the same or different computing devices used in other steps, and each step need not be performed by a single computing device.

[0080] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example implementations of implementing the claims.

Claims

1. A security camera, characterized by, comprising: a housing; a hardware switch coupled to an audio component of the security camera and the housing, the hardware switch having an on position and an off position, wherein the audio component of the security camera is active when the hardware switch is in the on position, the audio component of the security camera is inactive when the hardware switch is in the off position; the security camera further comprises an image sensor for capturing an image or a sequence of images, the image or the sequence of images including a privacy area, the privacy area identified by a controller; the privacy area corresponding to at least a particular object, a particular user, a particular human-object interaction, a particular human-action, a particular geographic location; the controller further for obfuscating the privacy area and providing only a non-privacy area as output to a client device.

2. The security camera of claim 1, wherein, the hardware switch is located inside the housing; the security camera further comprises a removable cover attached to the housing, the hardware switch inside the housing being accessible when the removable cover is removed.

3. The security camera of claim 1, wherein, the hardware switch is accessible from outside the housing and is waterproof.

4. The security camera of any one of claims 1 to 3, wherein, the hardware switch is mechanically switched to the on position or the off position.

5. The security camera of any one of claims 1 to 3, wherein, further comprising a controller coupled to the hardware switch and for identifying when the hardware switch is switched to the on position or the off position.

6. The security camera of claim 1, wherein, the audio component of the security camera is prevented from communicating with the controller when the hardware switch is in the off position.

7. The security camera of claim 1, wherein, further comprising an image sensor for capturing an image or a sequence of images, the image or the sequence of images including a human mouth, the human mouth in the image or the sequence of images detected by the controller and scrambled using data scrambling for obfuscating the human mouth.

8. The security camera of claim 7, wherein, the data scrambling obfuscates the human mouth when the hardware switch controlling the audio component is in the off position, or the hardware switch controlling the audio component is in the on position and a mouth scrambling switch on a client device is in the on position.

9. The security camera of any one of claims 1 to 3, and 6 to 8, wherein, the hardware switch is one of a single-pole single-throw switch or two single-pole single-throw switches, the hardware switch controls the on / off state of the audio component of the security camera.

10. The security camera of any one of claims 1, 6 and 8, wherein, the audio component is one of a microphone and a speaker.

11. A computer-implemented method of protecting privacy in a security camera, the method comprising: comprising: determining, by a controller of the security camera, that a hardware switch is moved to a position that enables or disables an audio component of the security camera, wherein the audio component of the security camera is inactive when the hardware switch is in an off position and the audio component of the security camera is active when the hardware switch is in an on position; scrambling, by the controller of the security camera, a portion of an image or a sequence of images received by the security camera when the hardware switch of the audio component is in the off position; The controller is further configured to identify a privacy area in the image or image sequence and obfuscate the privacy area and provide only non-privacy areas as output to the client device; the privacy area corresponding to at least a particular object, a particular user, a particular human-object interaction, a particular human-action, a particular geographic location.

12. The computer-implemented method of claim 11, wherein, Further comprising sending a status signal to the client device through an interface of the security camera, the status signal indicating that the audio component is enabled or disabled according to the position of the hardware switch.

13. The computer-implemented method according to claim 11 or 12, wherein, Further comprising capturing an image or image sequence of a human mouth by an image sensor of the security camera.

14. The computer-implemented method of claim 13, wherein, The human mouth in the image or image sequence is detected by the controller and scrambled using data scrambling to obfuscate the human mouth.

15. The computer-implemented method of claim 14, wherein, The data scrambling obfuscates the human mouth when the hardware switch controlling the audio component is in the off position, or the hardware switch controlling the audio component is in the on position and the controller identifies that a mouth scrambling switch on the client device is in the on position.

16. The computer-implemented method of claim 14, wherein, The off position of a first hardware switch disables a first audio component of the security camera, the off position of a second hardware switch disables a second audio component of the security camera.

17. The computer-implemented method of claim 16, wherein, The first audio component is a microphone, the second audio component is a speaker.

18. The computer-implemented method of claim 14, wherein, Further comprising sending a status signal to the client device through an interface of the security camera, the status signal indicating that the audio component is enabled or disabled according to the position of the hardware switch; updating the status signal when the hardware switch is toggled between an on position or an off position.

19. The computer-implemented method of claim 18, wherein, Further comprising sending an updated status signal to the client device, the updated status signal indicating that the position of the hardware switch has been toggled.

Citation Information

Patent Citations

  • Secure video camera device

    US20130222609A1

  • System and Method for Redirection and Processing of Audio and Video Data based on Gesture Recognition

    US20150316990A1

  • Internal signal diversion with camera shuttering for mobile communication devices

    US8902318B1