TOUCH INTERACTIONS WITH IMAGE CAPTURE DEVICES

DE602018079464T2Active Publication Date: 2025-02-19HEWLETT PACKARD DEVELOPMENT COMPANY LP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE602018079464
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2018-06-21
Publication Date
2025-02-19
Estimated Expiration
2038-06-21

AI Technical Summary

Technical Problem

Users of computing devices with cameras face concerns about privacy, as cameras can be accessed and controlled without the user's knowledge, potentially allowing unauthorized image capture.

Method used

A privacy solution that allows users to intuitively control a shutter to cover the image sensor of a camera using natural gestures, such as taps and swipes, which are integrated directly into the camera, providing electrical isolation from the rest of the computing device.

Benefits of technology

This solution enables users to easily and securely control their camera's privacy settings, preventing unauthorized image capture by isolating the shutter control from the device's operating system.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND

[0001] Computing devices, such as laptop computers, desktop computers, and smartphones, may include a camera (e.g., webcam). The camera may capture electronic images such as photos and / or video images. The camera may capture the electronic images responsive to an input such as an input provided by a user and / or an application, among other possibilities. The cameras may be located on an external surface of the computing device, in order to promote capture of the electronic images. US20150077830 discloses a portable electronic device comprising an optical element and a switchable layer capable of being switched between a substantially opaque state and a substantially transparent state, wherein the substantially opaque state prevents viewing of the optical layer. US2007 / 153119 discloses an electric layer to obscure a webcam.SUMMARY OF INVENTION

[0002] The scope of the invention is defined by the appended claims.BRIEF DESCRIPTION OF THE DRAWINGS

[0003] FIGs. 1A-D illustrate the use of gestures to trigger a privacy solution, to cover an image sensor of an image capture device, according to an example; FIG. 2 illustrates the image capture device coupled to a controller for cycling between engaging and disengaging a shutter, according to an example; FIG. 3 illustrates an image capture device for registering user touch interactions with a touch-enabled layer to control the shutter, according to an example; and FIG. 4 is a flow diagram in accordance with an example of the present disclosure. DETAILED DESCRIPTION

[0004] Privacy is a concern for users of such computing devices including cameras. For instance, control may be gained of a camera in a computing device for a variety of undesired reasons. For instance, control may be acquired of the camera included in the computing device and / or access may be gained to electronic images captured by the camera, unbeknownst to a user of the computing device. In some approaches, this may be possible because the camera may be visible and accessible to the user at all times during operation of the computing device. For example, in some approaches the camera may be mounted on an exterior portion of the computing device (e.g., on a display of the computing device), where it may be visible and accessible to the user during operation of the computing device.

[0005] Examples disclosed herein provide the ability for a user to intuitively trigger a privacy solution, for example, to cover an image sensor of an image capture device, according to an example. As an example of being intuitive, natural user interactions may cycle between engaging and disengaging the privacy solution, such as a shutter. For example, referring to the webcam on a computing device, if a user desires to engage a privacy solution to cover the image sensor of the webcam, a first gesture, such as a tap on the webcam, may engage the privacy solution. Similarly, if the user desires to later disengage the privacy solution, in order to make use of the webcam, a second gesture, such as a swipe (or long press), may disengage the privacy solution. As a result, rather than searching for the trigger that cycles between engaging and disengaging the privacy solution (e.g., a function key), the user's intuitive reaction with the webcam itself may control the privacy solution, as will be further described.

[0006] In addition, rather than relying on a trigger separate from the webcam to engage and disengage the privacy solution, by integrating the trigger with the webcam itself, for example, via the gestures, control of the privacy solution may be electrically isolated from rest of the computing device, including the operating system of the device. As a result, the triggering of the privacy solution may be removed from malicious agents, such as hackers. For example, even if the webcam is hacked, where images can be captured without knowledge of the user, as the triggering of the privacy solution is electrically isolated from the rest of the computing device, particularly the operating system, when the privacy solution is covering the image sensor of the webcam, such capture may be prevented from occurring.

[0007] With reference to the figures, FIGs. 1A-D illustrate the use of gestures to trigger a privacy solution comprising a shutter 104, to cover the image sensor of an image capture device 102 of a computing device 100, such as the webcam, according to an example. Referring to FIG. 1A, the image sensor of the image capture device 102 is exposed, and available for use by the user of the computing device 100. However, when the user desires to engage the shutter 104 to cover the image sensor of the image capture device 102, natural user touch interactions, such as a tap on the image capture device 102, trigger the shutter 104 to cover the image sensor of the image capture device 102. As an example of the natural touch interaction by the user, when the user desires privacy, the user may naturally use their finger to block the image capture device 102. This action, or tap of the finger by the user, may correspond to a first gesture 106 performed by the user (e.g., depicted by hand). However, gestures besides a tap may be used to engage the shutter 104 to cover the image sensor of the image capture device 102. FIG. 1B illustrates engagement of the shutter 104 to cover the image sensor of the image capture device 102, upon detection of the first gesture 106 performed by the user. The shutter 104 may be actuated by various sources, such as by a solenoid, or it may be electrically-controlled.

[0008] Referring to FIG. 1C, when the user desires to disengage the shutter 104, in order to expose the image sensor of the image capture device 102 for use, a second gesture 108 different from the first gesture 106, is used to disengage the shutter 104. As an example of a natural user touch interaction when a user desires to utilize the image capture device 102, a second gesture 108, such as a finger swipe, or an attempt to "slide" open or "wipe" the image capture device 102 may be registered as a trigger to disengage the shutter 104 from covering the image sensor of the image capture device 102. However, gestures besides the finger swipe may be used to disengage the shutter 104. For example, a controller utilized to detect the gestures may determine the complexity of the gesture that may be used to engage and disengage the shutter 104, as will be further described. In addition, if a gesture besides the first or second gesture is detected, the gesture may be ignored. For example, if the gesture detected is neither a tap (e.g., first gesture) nor a swipe (e.g., second gesture), the image capture device 102 may determine that the gesture is an inadvertent action performed by the user, or a false trigger to actuate the shutter 104. FIG. 1D illustrates the image sensor of the image capture device 102 made available for use by the user.

[0009] FIG. 2 illustrates the image capture device 102 coupled to a controller 206 for cycling between engaging and disengaging the shutter (not shown), according to an example. As described above, the shutter (e.g., shutter 104) is used to cover or expose an image sensor 202 of the image capture device 102, based on the gesture detected from a user touch interaction on the image capture device 102. As an example of registering user touch interactions, the image capture device 102 includes a touch-enabled layer 204 disposed above the image sensor 202 for detecting touch events on the image capture device 102. As will be further described, the controller 206 may be connected to the touch-enabled layer 204, to register user touch interactions and detect gestures, in order to control the shutter (e.g., to switch between covering and exposing the image sensor 202).

[0010] As an example, the touch-enabled layer 204 includes a capacitive mesh for detecting user touch interactions. For example, a mesh, capacitive-interlaced plastic layer may be disposed above the image sensor 202. In order for the image sensor 202 to capture images, the touch-enabled layer 204 may be a translucent plastic cover, having a capacitive mesh inside. This capacitive mesh may be connected to the controller 206 that registers the user touch interactions. The density of the capacitive mesh, illustrated in a grid-like fashion on the touch-enabled layer 204 in FIG. 2, may vary. The density of the capacitive mesh may determine a sensitivity for the controller 206 to detect the user touch interactions with the touch-enabled layer 204, and a transparency of the touch-enabled layer 204 to expose the image sensor 202. For example, enough spacing should be allowed between the metallic wires of the capacitive mesh, in order to allow the touch-enabled layer 204 to still be transparent and see-through, for images to be captured by the image sensor 202. However, the spacing between the metallic wires should be narrow enough for the controller 206 to correctly register the user touch interactions with the touch-enabled layer 204. As a result, the sensitivity of the touch-enabled layer 204 and the transparency of the touch-enabled layer 204 may be inversely proportional to each other, so a balance approach may be desirable between the sensitivity and transparency.

[0011] As mentioned above, the controller 206 may determine the complexity of the gesture that may be used to engage and disengage the shutter of the image capture device 102. For example, a first gesture, such as a tap on the image capture device 102, may engage the shutter, as described above. Similarly, if the user desires to later disengage the shutter, in order to make use of the image capture device 102, a second gesture, such as a swipe, may disengage the shutter. However, if the controller 206 lacks the complexity to differentiate between a tap and a swipe, then the differentiation, whether to engage or disengage the shutter, may be made by simply measuring the length of time that the user maintains contact with the touch-enabled layer 204. For example, when a user presses and holds its touch on the touch-enabled layer 204, the controller 206 may interpret the gesture as an indication to engage the shutter to cover the image sensor 202. Similarly, when the user performs a quick press on the touch-enabled layer 204, the controller 206 may interpret the gesture as an indication to disengage the shutter to expose the image sensor 202. As mentioned above, if a gesture besides the first or second gesture is detected, the gesture may be ignored.

[0012] As an example, the controller 206 is electrically isolated, for example, from the operating system (OS) of the computing device housing the image capture device 102. Since the controls described above are built directly into the image capture device 102, there is electrical isolation between the image capture device 102 and other components of the computing device, such as the operating system. As a result, the triggering of the shutter may be removed from malicious agents, such as hackers, providing a safe and secure environment for users of the computing device.

[0013] FIG. 3 illustrates an image capture device 300 for registering user touch interactions with touch-enabled layer 204 to control shutter 104, according to an example. The image capture device 300 may correspond to the image capture device 102 illustrated in FIGs. 1A-D and 2. The image capture device 300 depicts the controller 206 and a memory device 302 and, as an example of the image capture device 300 performing its operations, the memory device 302 includes instructions 304-308 that are executable by the controller 206. Thus, memory device 302 can be said to store program instructions that, when executed by controller 206, implement the components of the image capture device 300. As mentioned above, since controls are built directly into the image capture device 300, there is electrical isolation between the image capture device 300 and other components of the computing device housing the image capture device 300, such as the operating system. The executable program instructions stored in the memory device 302 include, as an example, instructions to register user touch interaction (304), instructions to detect gesture (306), and instructions to engage / disengage shutter (308).

[0014] Instructions to register user touch interaction (304) represent program instructions that when executed by the controller 206 cause the image capture device 300 to detect touch events with the touch-enabled layer 204. As described above, the touch-enabled layer 204 includes a capacitive mesh for detecting user touch interactions.

[0015] Instructions to detect gesture (306) represent program instructions that when executed by the controller 206 cause the image capture device 300 to detect gestures from the user touch interaction on the touch-enabled layer 204. As an example, the controller 206 determines the complexity of the gesture that may be used to engage and disengage the shutter 104 of the image capture device 300.

[0016] Instructions to engage / disengage shutter (308) represent program instructions that when executed by the controller 206 cause the image capture device 300 to cycle between engaging the shutter 104 to cover the image sensor and disengaging the shutter 104 to expose the image sensor, based on whether the gesture is of a first type or second type. For example, a gesture of a first type, such as a tap on the touch-enabled layer 204, may engage the shutter 104. Similarly, if the user desires to later disengage the shutter, in order to make use of the image capture device 300, a gesture of a second type, such as a swipe, may disengage the shutter. However, the gestures for engaging and disengaging the shutter 104 may vary. In addition, the first and second gestures may be the same, where each time the gesture is performed, the shutter 104 alternates between engaging and disengaging, to switch between covering and exposing the image sensor of the image capture device 300. As mentioned above, if a gesture is of a type besides the first type or the second type, the gesture may be ignored.

[0017] Memory device 302 represents generally any number of memory components capable of storing instructions that can be executed by controller 206. Memory device 302 is non-transitory in the sense that it does not encompass a transitory signal but instead is made up of at least one memory component configured to store the relevant instructions. As a result, the memory device 302 may be a non-transitory computer-readable storage medium.

[0018] FIG. 4 is a flow diagram 400 of steps taken by an image capture device to implement a method for cycling between engaging and disengaging a shutter to cover and expose an image sensor of the image capture device, according to an example. Although the flow diagram of FIG. 4 shows a specific order of execution, the order of execution may differ from that which is depicted. For example, the order of execution of two or more blocks or arrows may be scrambled relative to the order shown. Also, two or more blocks shown in succession may be executed concurrently or with partial concurrence. All such variations are within the scope of the present invention.

[0019] At 410, the image capture device registers a user touch interaction with a touch-enabled layer disposed above the image sensor of the image capture device. At 420, the image capture device detects a gesture from the user touch interaction. As described above, gestures of varying degrees of complexity may be used.

[0020] At 430, the image capture device cycles between engaging the shutter to cover the image sensor and disengaging the shutter to expose the image sensor, based on whether the gesture is of a first type or a second type. As an example of being intuitive, natural user interactions may cycle between engaging and disengaging privacy solutions for the image capture device, such as the shutter. For example, referring to an image capture device on a computing device (e.g., webcam), if a user desires to engage the shutter to cover the image sensor of the image capture device, a gesture of the first type, such as a tap on the touch-enabled layer of the image capture device, may engage the shutter. Similarly, if the user desires to later disengage the shutter, in order to make use of the image capture device, a gesture of the second type, such as a swipe (or long press) on the touch-enabled layer of the image capture device, may disengage the shutter.

[0021] At 440, if the gesture if of a type besides the first type or the second type, the image capture device ignores the gesture. For example, if the gesture detected is neither a tap (e.g., gesture of a first type) nor a swipe (e.g., gesture of a second type), the image capture device may determine that the gesture is an inadvertent action performed by the user, or a false trigger to actuate the shutter.

Claims

1. An image capture device (102, 300) comprising: an image sensor (202); a privacy solution comprising a shutter (104); a touch-enabled layer (204) disposed above the image sensor (202); and a controller (206) to: register a user touch interaction with the touch-enabled layer (204); and based on a gesture detected from the user touch interaction, cycle between engaging the shutter (104) to cover the image sensor (202) and disengaging the shutter (104) to expose the image sensor (202), wherein when the controller (206) detects a first type of gesture from the user touch interaction, the controller (206) is to engage the shutter (104) to cover the image sensor (202) and when the controller (206) detects a second type of gesture different from the first gesture, the controller (206) is to disengage the shutter (104) to expose the image sensor (202).

2. The image capture device (102, 300) of claim 1, wherein the touch-enabled layer (204) comprises a capacitive mesh for detecting the user touch interaction.

3. The image capture device (102, 300) of claim 2, wherein a density of the capacitive mesh disposed within the touch-enabled layer (204) determines: a sensitivity for detecting the user touch interaction, and a transparency of the touch-enabled layer (204) to expose the image sensor (202), wherein the sensitivity of the touch-enabled layer (204) and the transparency of the touch-enabled layer (204) are inversely proportional to each other.

4. The image capture device (102, 300) of claim 1, wherein the controller (206) is electrically isolated from an operating system (OS) of a computing device comprising the image capture device (102, 300).

5. A non-transitory computer-readable storage medium comprising program instructions which, when executed by a controller (206) of an image capture device (102, 300) according to claim 1, cause the controller (206) to: register a user touch interaction with a touch-enabled layer (204) disposed above an image sensor (202) of the image capture device (102, 300); detect a gesture from the user touch interaction; and cycle between engaging a shutter (104) to cover the image sensor (202) and disengaging the shutter (104) to expose the image sensor (202), based on whether the gesture is of the first type or the second type.

6. The non-transitory computer-readable storage medium of claim 5, wherein the gesture of the first type comprises a tap on the touch-enabled layer (204).

7. The non-transitory computer-readable storage medium of claim 5, wherein the gesture of the second type comprises a swipe along the touch-enabled layer (204).

8. The non-transitory computer-readable storage medium of claim 5, wherein the controller (206) is electrically isolated from an operating system (OS) of a computing device comprising the image capture device (102, 300).

9. A method comprising, by a controller (206) of an image capture device (102) according to claim 1: registering, a user touch interaction with a touch-enabled layer (204) disposed above an image sensor (202) of the image capture device (102, 300); detecting a gesture from the user touch interaction; cycling between engaging a shutter (104) to cover the image sensor (202) and disengaging the shutter (104) to expose the image sensor (202), based on whether the gesture is of the first type or the second type; and ignoring the gesture if the gesture is of a type besides the first type or the second type.