Touch interaction with image capture device
By introducing a touch enable layer and a masker into the image capture device, combined with the electrical isolation of the operating system, users can intuitively control the privacy status of the camera, solving the problem of difficulty for users to control the camera and malicious capture, and achieving a safe and reliable Privacy protection.
Patent Information
- Application Number
- CN201880092744.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-06-21
- Publication Date
- 2024-12-20
- Estimated Expiration
- 2038-06-21
AI Technical Summary
It is difficult for users to intuitively control the camera in the computing device, especially in cases where undesirable cameras may be controlled or accessed, and there are malicious agents such as hackers that may capture electronic images, lacking an effective privacy protection mechanism.
An image capture device is designed, including an image sensor, a masker and a touch enable layer, which accesses and de-occludes the masker through user touch interactions (such as taps and swipes), controls the exposure and coverage of the image sensor, and combines the The operating system of the computing device is electrically isolated, ensuring that the user's triggering of the privacy solution is isolated from other parts of the computing device.
It realizes the user's intuitive control of privacy solutions, prevents unauthorized image capture, improves the security and reliability of user privacy protection, and avoids the intervention of malicious agents.
Smart Images

Figure CN111989683B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an image capturing device, a non-transitory computer-readable storage medium including program instructions, and a method of operating an image capturing device. Background Art
[0002] Computing devices such as laptops, desktop computers, and smartphones may include a camera (e.g., a webcam). The camera may capture electronic images, such as photographs and / or video images. The camera may capture the electronic image in response to input (such as input provided by a user and / or an application), among other possibilities. The camera may be located on an external surface of the computing device to facilitate the capture of the electronic image. Summary of the invention
[0003] An image capture device is provided, comprising: an image sensor; a mask; a touch-enabled layer disposed above the image sensor; and a controller for: registering user touch interactions with the touch-enabled layer; and cycling between engaging the mask to cover the image sensor and releasing the mask to expose the image sensor based on a gesture detected from the user touch interaction, wherein when the controller detects a first type of gesture from the user touch interaction, the controller engages the mask to cover the image sensor, and when the controller detects a second type of gesture different from the first type of gesture, the controller releases the mask to expose the image sensor, and wherein if the gesture is a type other than the first type or the second type, the controller ignores the gesture.
[0004] In some embodiments, the touch-enabling layer includes a capacitive grid for detecting user touch interactions.
[0005] In some embodiments, the density of the capacitive grid disposed within the touch enabling layer determines: the sensitivity for detecting the user touch interaction, and the transparency of the touch enabling layer exposing the image sensor, wherein the sensitivity of the touch enabling layer and the transparency of the touch enabling layer are inversely proportional to each other.
[0006] In some embodiments, the controller is electrically isolated from an operating system (OS) of a computing device including the image capture device.
[0007] A non-transitory computer-readable storage medium comprising program instructions is provided, which, when executed by a controller of an image capture device according to the present disclosure, causes the controller to: register the user touch interaction with the touch-enabled layer; detect a gesture from the user touch interaction; cycle between engaging the mask to cover the image sensor and releasing the mask to expose the image sensor based on whether the gesture is the first type or the second type; and ignore the gesture if the gesture is a type other than the first type or the second type.
[0008] In some embodiments, the first type of gesture comprises a tap on the touch-enabled layer.
[0009] In some embodiments, the second type of gesture comprises a swipe along the touch-enabled layer.
[0010] In some embodiments, the controller is electrically isolated from an operating system (OS) of the computing device including the image capture device.
[0011] A method for operating an image capture device is provided, the method comprising: registering the user touch interaction with the touch-enabled layer; detecting a gesture from the user touch interaction; cycling between engaging the masker to cover the image sensor and releasing the masker to expose the image sensor based on whether the gesture is the first type or the second type; and ignoring the gesture if the gesture is a type other than the first type or the second type. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figures 1A-1D illustrates using a gesture to trigger a privacy solution to cover an image sensor of an image capture device according to an example;
[0013] Figure 2 illustrates an image capture device coupled to a controller for cycling between engaging and disengaging a masker according to an example; Figure 3 illustrates an image capture device for registering user touch interactions with a touch-enabled layer to control a masker according to an example; and
[0014] Figure 4 is a flow chart according to an example of the present disclosure. DETAILED DESCRIPTION
[0015] Privacy is a concern for users of such computing devices that include cameras. For example, control of a camera in a computing device may be obtained for a variety of undesirable reasons. For example, control of a camera included in a computing device may be obtained and / or access to electronic images captured by the camera may be obtained without the user of the computing device being aware. In some approaches, this may be possible because the camera may always be visible and accessible to the user during operation of the computing device. For example, in some approaches, the camera may be mounted on an external portion of the computing device (e.g., on a display of the computing device) where the camera is visible and accessible to the user during operation of the computing device.
[0016] According to an example, the examples disclosed herein provide a user with the ability to intuitively trigger a privacy solution, such as to cover an image sensor of an image capture device. As an intuitive example, a natural user interaction may cycle between engaging and disengaging a privacy solution, such as a masker. For example, with reference to a webcam on a computing device, if a user desires to engage a privacy solution to cover the image sensor of the webcam, a first gesture, such as a tap on the webcam, may engage the privacy solution. Similarly, if the user desires to later disengage the privacy solution in order to utilize the webcam, a second gesture, such as a swipe (or long press), may disengage the privacy solution. As a result, the user's intuitive reaction to the webcam itself may control the privacy solution, rather than searching for a trigger that cycles between engaging and disengaging the privacy solution (e.g., a function key), as will be further described.
[0017] Additionally, by integrating the trigger with the webcam itself, such as via a gesture, control of the privacy solution may be electrically isolated from the rest of the computing device, including the device's operating system, rather than relying on a trigger separate from the webcam to engage and disengage the privacy solution. Thus, the triggering of the privacy solution may be removed from malicious agents, such as hackers. For example, even if the webcam is hacked (in which case images may be captured without the user's knowledge), because the triggering of the privacy solution is electrically isolated from the rest of the computing device, particularly the operating system, such capture may be prevented from occurring when the privacy solution covers the webcam's image sensor.
[0018] With reference to the accompanying drawings, according to the examples, Figures 1A-1D The use of a gesture to trigger a privacy solution, such as a masker 104, to cover an image sensor of an image capture device 102 of a computing device 100, such as a webcam, is illustrated. Figure 1A, the image sensor of the image capture device 102 is exposed and available to the user of the computing device 100. However, when the user desires to engage the obstructor 104 to cover the image sensor of the image capture device 102, a natural user touch interaction (such as a tap on the image capture device 102) may trigger the obstructor 104 to cover the image sensor of the image capture device 102. As an example of a user's natural touch interaction, when the user desires privacy, the user may naturally use their finger to block the image capture device 102. This action or tap of the user's finger may correspond to a first gesture 106 performed by the user (e.g., depicted by hand). However, gestures other than tapping may be used to engage the obstructor 104 to cover the image sensor of the image capture device 102. Figure 1B The engagement of the shutter 104 to cover the image sensor of the image capture device 102 is illustrated when a first gesture 106 performed by a user is detected. The shutter 104 may be actuated by various sources, such as by a solenoid, or it may be electrically controlled.
[0019] refer to Figure 1C , when the user desires to remove the shutter 104, in order to expose the image sensor of the image capture device 102 for use, for example, a second gesture 108 different from the first gesture 106 can be used to remove the shutter 104. As an example of a natural user touch interaction when the user desires to utilize the image capture device 102, the second gesture 108 (such as a finger swipe) or an attempt to "slide" open or "wipe" the image capture device 102 can be registered as a trigger to cause the shutter 104 to remove the image sensor of the image capture device 102. However, gestures other than a finger swipe can be used to remove the shutter 104. For example, a controller used to detect gestures can determine the complexity of gestures that can be used to access and remove the shutter 104, as will be further described. In addition, if a gesture other than the first or second gesture is detected, the gesture can be ignored. For example, if the detected gesture is neither a tap (e.g., the first gesture) nor a swipe (e.g., the second gesture), the image capture device 102 can determine that the gesture is an unintentional action performed by the user, or an erroneous trigger to actuate the shutter 104. Although the first and second gestures are described as engaging and disengaging the obstructer 104, respectively, the first and second gestures may be identical, wherein the obstructer 104 alternates between engaging and disengaging to switch between covering and exposing the image sensor of the image capture device 102 each time the gesture is performed. Figure 1D An image sensor of image capture device 102 is illustrated as being available to a user.
[0020] Figure 2An image capture device 102 is illustrated coupled to a controller 206 for cycling between engaging and disengaging a masker (not shown) according to an example. As described above, a masker (e.g., masker 104) may be used to cover or expose an image sensor 202 of the image capture device 102 based on a gesture detected from a user touch interaction on the image capture device 102. As an example of registering a user touch interaction, the image capture device 102 includes a touch-enabled layer 204 disposed over the image sensor 202 for detecting touch events on the image capture device 102. As will be further described, the controller 206 may be connected to the touch-enabled layer 204 to register a user touch interaction and detect gestures in order to control the masker (e.g., to switch between covering and exposing the image sensor 202).
[0021] As an example, the touch-enabling layer 204 includes a capacitive grid for detecting user touch interactions. For example, a grid capacitive interlaced plastic layer may be disposed over the image sensor 202. To enable the image sensor 202 to capture an image, the touch-enabling layer 204 may be a translucent plastic cover with a capacitive grid inside. The capacitive grid may be connected to the controller 206 that registers the user touch interactions. Figure 2 The density of the capacitive grid illustrated in a grid fashion on the touch-enabling layer 204 in FIG. 2 may vary. The density of the capacitive grid may determine the sensitivity of the controller 206 to detect user touch interactions with the touch-enabling layer 204, as well as the transparency of the touch-enabling layer 204 to expose the image sensor 202. For example, sufficient spacing should be allowed between the metal lines of the capacitive grid to allow the touch-enabling layer 204 to remain transparent and see-through for the image sensor 202 to capture an image. However, the spacing between the metal lines should be narrow enough to allow the controller 206 to properly register user touch interactions with the touch-enabling layer 204. As a result, the sensitivity of the touch-enabling layer 204 and the transparency of the touch-enabling layer 204 may be inversely proportional to each other, so a balancing approach may be desired between sensitivity and transparency.
[0022] As described above, the controller 206 may determine the complexity of gestures that may be used to access and remove the shutter of the image capture device 102. For example, as described above, a first gesture (such as a tap on the image capture device 102) may access the shutter. Similarly, if the user desires to remove the shutter later in order to utilize the image capture device 102, a second gesture (such as a swipe) may remove the shutter. However, if the controller 206 lacks the complexity to distinguish between a tap and a swipe, the distinction may be made by simply measuring the length of time the user maintains contact with the touch-enabled layer 204 (whether accessing or removing the shutter). For example, when the user presses and maintains their touch on the touch-enabled layer 204, the controller 206 may interpret the gesture as an indication of accessing the shutter to cover the image sensor 202. Similarly, when the user performs a quick press on the touch-enabled layer 204, the controller 206 may interpret the gesture as an indication of removing the shutter to expose the image sensor 202. As described above, if a gesture other than the first or second gesture is detected, the gesture may be ignored.
[0023] As an example, the controller 206 is electrically isolated from an operating system (OS) of a computing device that houses the image capture device 102. Since the above-mentioned controls are built directly into the image capture device 102, there is electrical isolation between the image capture device 102 and other components of the computing device (such as the operating system). As a result, the triggering of the masker can be removed from malicious agents (such as hackers), thereby providing a safe and secure environment for users of the computing device.
[0024] Figure 3 An image capture device 300 is illustrated for registering user touch interactions with the touch-enabled layer 204 to control the masker 104 according to an example. The image capture device 300 may correspond to Figures 1A-1D and Figure 2 . The image capture device 300 depicts the controller 206 and the memory device 302, and as an example of the image capture device 300 performing its operations, the memory device 302 may include instructions 304-308 executable by the controller 206. Thus, it can be said that the memory device 302 stores program instructions that implement components of the image capture device 300 when executed by the controller 206. As described above, because the controls are built directly into the image capture device 300, there is electrical isolation between the image capture device 300 and other components of the computing device that houses the image capture device 300, such as an operating system. As an example, the executable program instructions stored in the memory device 302 include instructions for registering user touch interactions (304), instructions for detecting gestures (306), and instructions for engaging / disengaging a masker (308).
[0025] The instructions to register user touch interactions (304) represent program instructions that, when executed by the controller 206, cause the image capture device 300 to detect touch events with the touch-enabled layer 204. As described above, the touch-enabled layer 204 includes a capacitive grid for detecting user touch interactions.
[0026] The instructions to detect gestures (306) represent program instructions that, when executed by the controller 206, cause the image capture device 300 to detect gestures from user touch interactions on the touch-enabled layer 204. As an example, the controller 206 determines the complexity of gestures that can be used to engage and disengage the obstructer 104 of the image capture device 300.
[0027] The instructions to access / remove the obstructor (308) represent program instructions that, when executed by the controller 206, cause the image capture device 300 to cycle between accessing the obstructor 104 to cover the image sensor and removing the obstructor 104 to expose the image sensor, based on whether the gesture is of the first type or the second type. For example, a gesture of the first type (such as a tap on the touch-enabled layer 204) may access the obstructor 104. Similarly, if the user desires to remove the obstructor later, a gesture of the second type (such as a swipe) may remove the obstructor in order to utilize the image capture device 300. However, the gestures for accessing and removing the obstructor 104 may vary. In addition, the first and second gestures may be the same, wherein the obstructor 104 alternates between accessing and removing each time the gesture is performed to switch between covering and exposing the image sensor of the image capture device 300. As described above, if the gesture is of a type other than the first type or the second type, the gesture may be ignored.
[0028] Memory device 302 generally represents any number of memory components capable of storing instructions that can be executed by controller 206. Memory device 302 is non-transitory in the sense that it does not encompass transient signals, but instead consists of at least one memory component configured to store relevant instructions. As a result, memory device 302 can be a non-transitory computer-readable storage medium.
[0029] Figure 4 4 is a flow chart 400 of steps taken by an image capture device to implement a method for cycling between engaging and disengaging a masker to cover and expose an image sensor of the image capture device, according to an example. Figure 4 The flowchart of the embodiment of the present invention shows a specific execution order, but the execution order may be different from the depicted order. For example, the execution order of two or more boxes or arrows may be scrambled relative to the order shown. In addition, two or more boxes shown in succession may be executed simultaneously or partially simultaneously. All such variations are within the scope of the present invention.
[0030] At 410, the image capture device registers a user touch interaction with a touch-enabled layer disposed over an image sensor of the image capture device. At 420, the image capture device detects a gesture from the user touch interaction. As described above, gestures of varying complexity may be used.
[0031] At 430, based on whether the gesture is of the first type or the second type, the image capture device cycles between engaging a masker to cover the image sensor and removing the masker to expose the image sensor. As an intuitive example, a natural user interaction may cycle between engaging and removing a privacy solution (such as a masker) of the image capture device. For example, with reference to an image capture device (e.g., a webcam) on a computing device, if a user desires to engage a masker to cover the image sensor of the image capture device, a first type of gesture (such as a tap on a touch-enabled layer of the image capture device) may engage the masker. Similarly, if the user desires to later remove the masker in order to utilize the image capture device, a second type of gesture (such as a swipe (or long press) on a touch-enabled layer of the image capture device) may remove the masker.
[0032] At 440, if the gesture is a type other than the first type or the second type, the image capture device ignores the gesture. For example, if the detected gesture is neither a tap (e.g., a first type of gesture) nor a swipe (e.g., a second type of gesture), the image capture device may determine that the gesture is an unintentional action performed by the user, or an erroneous triggering of the actuation shutter.
[0033] It should be understood that the examples described may include various components and features. It should also be understood that many specific details are set forth to provide a thorough understanding of the examples. However, it should be understood that these examples may be practiced without limiting these specific details. In other cases, well-known methods and structures may not be described in detail to avoid unnecessarily obscuring the description of the examples. Likewise, these examples may be used in combination with each other.
[0034] References to "example" or similar language in the specification mean that a particular feature, structure, or characteristic described in conjunction with the example is included in at least one example, but not necessarily in other examples. Various instances of the phrase "in one example" or similar phrases in various places in the specification do not necessarily refer to the same example.
[0035] It should be understood that the previous description of the disclosed examples is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these examples will be apparent to those skilled in the art, and the general principles defined herein may be applied to other examples without removing the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the examples shown herein, but to be consistent with the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. An image capturing device, comprising: Image sensor; Masker; a touch enabling layer disposed above the image sensor; and Controller for: registering user touch interactions with the touch-enabled layer; and cycling between engaging the masker to cover the image sensor and disengaging the masker to expose the image sensor based on a gesture detected from the user touch interaction, wherein, when the controller detects a first type of gesture from the user touch interaction, the controller engages the mask to cover the image sensor, and when the controller detects a second type of gesture different from the first type of gesture, the controller removes the mask to expose the image sensor, and wherein, if the gesture is a type other than the first type or the second type, the controller ignores the gesture.
2. The image capture device according to claim 1, wherein: The touch-enabling layer includes a capacitive grid for detecting user touch interactions.
3. The image capture device according to claim 2, wherein: The density of the capacitive grid disposed within the touch enabling layer determines: a sensitivity for detecting the user touch interaction, and The touch enabling layer exposes transparency of the image sensor, wherein sensitivity of the touch enabling layer and transparency of the touch enabling layer are inversely proportional to each other.
4. The image capture device according to claim 1, wherein: The controller is electrically isolated from an operating system (OS) of a computing device including the image capture device.
5. A non-transitory computer-readable storage medium comprising program instructions, which, when executed by a controller of the image capture device according to claim 1, cause the controller to: registering the user touch interactions with the touch-enabled layer; detecting a gesture from said user touch interaction; cycling between engaging the obstructer to cover the image sensor and disengaging the obstructer to expose the image sensor based on whether the gesture is the first type or the second type; as well as If the gesture is of a type other than the first type or the second type, the gesture is ignored.
6. The non-transitory computer-readable storage medium of claim 5, wherein: The first type of gesture comprises tapping on the touch-enabled layer.
7. The non-transitory computer-readable storage medium of claim 5, wherein: The second type of gesture comprises a swipe along the touch-enabled layer.
8. The non-transitory computer-readable storage medium of claim 5, wherein: The controller is electrically isolated from an operating system (OS) of a computing device including the image capture device.
9. A method of operating the image capture device according to claim 1, comprising: registering the user touch interactions with the touch-enabled layer; detecting a gesture from said user touch interaction; cycling between engaging the obstructer to cover the image sensor and disengaging the obstructer to expose the image sensor based on whether the gesture is the first type or the second type; as well as If the gesture is of a type other than the first type or the second type, the gesture is ignored.
