Camera control method, device and electronic equipment
By receiving user input and obtaining feature information, the legality of the camera activation operation is judged, which solves the privacy leakage problem caused by the camera being activated by mistake, and realizes the timely shutdown of the camera to protect user privacy.
Patent Information
- Application Number
- CN202310183237.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-27
- Publication Date
- 2025-09-26
- Estimated Expiration
- 2043-02-27
AI Technical Summary
The existing technology has a problem of user privacy leakage due to the camera being accidentally turned on.
By receiving user input, turning on the camera and obtaining user feature information, determining whether the feature information matches, and outputting a prompt message or turning off the camera if there is no match.
Effectively detect and promptly handle the phenomenon of accidentally turning on the camera, reducing the risk of user privacy leakage.
Smart Images

Figure CN116170679B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of electronic technology, and specifically relates to a camera control method, device and electronic equipment. Background Art
[0002] Currently, camera functions are being used in more and more scenarios. For example, in a video conference, participants can turn on the camera function so that their real-time behavior can be displayed in the video conference and seen by other participants.
[0003] In some application scenarios, the phenomenon of accidentally turning on the camera often occurs. For example, in a video conference, there are many participants, most of whom may only need to listen in and do not need to turn on the camera. Or, the participants may be in some special environment where it is inconvenient to turn on the camera, so there is no need to turn on the camera. During the video conference, users may make mistakes, causing the camera to be accidentally turned on, and the user may not be able to detect it in time, which may lead to the leakage of user privacy. In addition, this personal behavior may also affect the order of the meeting.
[0004] It can be seen that in the existing technology, the phenomenon of the camera being accidentally turned on may lead to the leakage of user privacy. Summary of the Invention
[0005] The purpose of the embodiments of the present application is to provide a camera control method that can solve the problem of user privacy leakage caused by the phenomenon of accidental activation of the camera in the prior art.
[0006] In a first aspect, an embodiment of the present application provides a camera control method, which is applied to an electronic device including a camera, the method comprising:
[0007] receiving a first input from a user;
[0008] In response to the first input, turning on the camera and acquiring first characteristic information of the user;
[0009] When the first characteristic information does not match the second characteristic information, a prompt message is output or the camera is turned off, wherein the prompt message is used to prompt the user to turn off the camera.
[0010] In a second aspect, an embodiment of the present application provides a camera control device, the device comprising:
[0011] A receiving module, configured to receive a first input from a user;
[0012] A first acquisition module, configured to activate a camera in response to a first input and acquire first characteristic information of a user;
[0013] The control module is used to output a prompt message or turn off the camera when the first characteristic information does not match the second characteristic information, wherein the prompt message is used to prompt to turn off the camera.
[0014] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor, a memory, and a camera, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.
[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0016] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method described in the first aspect.
[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0018] In an embodiment of the present application, in the case where the camera is not turned on by mistake, the electronic device pre-records the second characteristic information, based on which, it receives the user's first input, responds to the first input, turns on the camera, and simultaneously obtains the user's first characteristic information. Thus, if the first characteristic information does not match the second characteristic information, the electronic device determines that the first input is an erroneous input, and correspondingly determines that the camera turning on operation is an erroneous operation, and then the electronic device outputs a prompt message to prompt the user to turn off the camera in time, or the electronic device directly turns off the camera. It can be seen that based on the embodiment of the present application, the phenomenon of the camera being turned on by mistake can be detected, and timely measures can be taken to turn off the camera as soon as possible, thereby reducing the risk of user privacy leakage. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is a flow chart of a camera control method according to an embodiment of the present application;
[0020] Figure 2 This is one of the schematic diagrams illustrating the camera control method according to an embodiment of the present application;
[0021] Figure 3 This is the second schematic diagram illustrating the camera control method according to an embodiment of the present application;
[0022] Figure 4 is a block diagram of a camera control device according to an embodiment of the present application;
[0023] Figure 5 This is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application;
[0024] Figure 6 This is the second hardware structure diagram of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION
[0025] The following will be combined with the accompanying drawings of the embodiments of the present application to clearly describe the technical solutions of the embodiments of the present application. Obviously, the embodiments described are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.
[0026] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.
[0027] The camera control method provided in the embodiment of the present application may be executed by the camera control device provided in the embodiment of the present application, or an electronic device integrating the camera control device, wherein the camera control device may be implemented in hardware or software.
[0028] The camera control method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0029] Figure 1 A flowchart of a camera control method according to an embodiment of the present application is shown. The method is applied to an electronic device, and the electronic device includes a camera. The method includes:
[0030] Step 110: Receive a first input from the user.
[0031] The first input includes touch input performed by the user on the screen, and is not limited to inputs such as clicks, slides, and drags. The first input can also be input from the user through the air, such as gestures or facial movements. The first input also includes input from the user on physical buttons on the device, and is not limited to inputs such as presses. Furthermore, the first input includes one or more inputs, wherein the multiple inputs can be continuous or spaced apart.
[0032] In this step, the first input is used to turn on the camera.
[0033] Optionally, this embodiment may be applied to a video conferencing scenario, for example, receiving a first input from a user in a video conferencing.
[0034] For example, during a video conference, multiple function options are displayed in the interface, including an option to "turn on camera", and the user clicks the option to "turn on camera".
[0035] For another example, before entering a video conference, the interface displays an option to "turn on camera," and the user clicks on the option to "turn on camera."
[0036] It should be noted that the user who makes the first input is only used to limit a user account information, and is not used to limit it to the specific person who makes the input.
[0037] Step 120: In response to the first input, turn on the camera and obtain first characteristic information of the user.
[0038] In one application scenario, before a user joins a video conference, the user performs a first input, thereby turning on the camera when the user joins the video conference.
[0039] Another application scenario is that when a user has joined a video conference, the user performs a first input to turn on the camera.
[0040] In addition, after the camera is turned on, the camera collects images and obtains the first feature information of the user based on the collected images.
[0041] It should be noted that, for the sake of distinction, the image collected here is defined as the first image.
[0042] Optionally, based on user's pre-setting, the first image is a picture or a video.
[0043] Optionally, the first image captured by the camera includes a facial portion of the user, and the first feature information primarily includes facial feature information. For example, the first feature information includes: information related to the area where the facial portion is located (e.g., location information, area information), the distance between the eyes in the facial portion and the camera, the angle between the eyes in the facial portion and the camera, etc.
[0044] Step 130: When the first characteristic information does not match the second characteristic information, output a prompt message or turn off the camera, wherein the prompt message is used to prompt to turn off the camera.
[0045] In this step, before matching the first feature information with the second feature information, the second feature information needs to be acquired.
[0046] Optionally, the second image is an image actively input by the user for matching, wherein the second image includes a facial portion of the user.
[0047] Optionally, the second image is obtained by the system analyzing historical data of the user-activated camera.
[0048] Optionally, the first feature information and the second feature information include the same information items, and the second feature information includes: relevant information of the area where the facial part is located (such as position information, area information), the distance between the eyes in the facial part and the camera, the angle between the eyes in the facial part and the camera, etc.
[0049] Optionally, the second image is a picture, and the second feature information is obtained based on the picture.
[0050] Optionally, the second image is a video, and thus averaged feature information, ie, second feature information, is obtained based on feature information of multiple frames.
[0051] In this embodiment, the second characteristic information is set to match the first characteristic information to detect whether the first input made by the user is an error, and correspondingly, whether the camera activation in response to the first input is an error. Therefore, the second image can be an image recorded when the user activates the camera without an error.
[0052] In the embodiment of the present application, prompt information can be output in a variety of ways.
[0053] Optionally, a pop-up window may be displayed on the screen of the electronic device, and prompt information may be displayed in the pop-up window.
[0054] Optionally, the prompt information content can be played by voice.
[0055] The content of the prompt information may include: abnormal camera activation has been identified; further, it may also include: asking the user whether to turn off the camera, a "yes" option, a "no" option, etc.
[0056] In an embodiment of the present application, in the case where the camera is not turned on by mistake, the electronic device pre-records the second characteristic information, based on which, it receives the user's first input, responds to the first input, turns on the camera, and simultaneously obtains the user's first characteristic information. Thus, if the first characteristic information does not match the second characteristic information, the electronic device determines that the first input is an erroneous input, and correspondingly determines that the camera turning on operation is an erroneous operation, and then the electronic device outputs a prompt message to prompt the user to turn off the camera in time, or the electronic device directly turns off the camera. It can be seen that based on the embodiment of the present application, the phenomenon of the camera being turned on by mistake can be detected, and timely measures can be taken to turn off the camera as soon as possible, thereby reducing the risk of user privacy leakage.
[0057] In a camera control method provided in another embodiment of the present application, the first feature information includes a first facial region of a user, and the second feature information includes a preset second facial region of the user. Step 130 includes:
[0058] Sub-step A1: Determine first area information based on a non-overlapping area between the first face area and the second face area.
[0059] Usually, when the user turns on the camera normally, the face needs to look at the screen. Therefore, the position information of the face area in the captured image is located in a fixed area of the image (such as the middle area), and the area information of the face area in the captured image is located in a certain numerical range.
[0060] For example, see Figure 2 The second face area 201 is used to represent the contour area of a face, see the corresponding ellipse shape in the figure.
[0061] When the user mistakenly turns on the camera, the face may not be looking at the screen. Therefore, the position information and area information of the face area in the collected image will deviate significantly compared to the case when the camera is turned on normally.
[0062] For example, see Figure 2 The first face region 202 is used to represent the outline of a face, as shown in the corresponding elliptical shape in the figure. It can be seen that the first face region 202 deviates from the second face region 201.
[0063] Based on this, in this embodiment, the first face region and the second face region are compared.
[0064] In this step, a non-overlapping area between the first face area and the second face area is identified.
[0065] For example, see Figure 2 The non-overlapping area 203 is the area filled with dotted lines shown in the figure.
[0066] Furthermore, first area information of the non-overlapping area is obtained.
[0067] Sub-step A2: Determine a first value based on a ratio of the first area information to the second area information; wherein the second area information is area information of the second facial region.
[0068] Optionally, the first value=first area information / second area information.
[0069] Optionally, the first area information and the second area information are specific numerical values.
[0070] In this step, the first value is used to describe the ratio of the area of the first facial region that deviates from the area of the second facial region to the area of the second facial region.
[0071] Sub-step A3: When the first value is greater than the first threshold, output a prompt message or turn off the camera.
[0072] In this step, when the first value is greater than the first threshold, the first input is determined to be an erroneous input, and a prompt message is output or the camera is turned off.
[0073] Optionally, the first threshold may be preset.
[0074] In this embodiment of the present application, the area of the non-overlapping area of the first face region with the second face region is calculated as a ratio of the area of the second face region to the area of the first face region, using the second face region as a reference, to assess the degree of deviation of the first face region. The larger the ratio, the greater the degree of deviation. When the ratio exceeds a first threshold, the first input is determined to be an erroneous input. This embodiment, when detecting the phenomenon of mistaken camera activation, fully utilizes the characteristics of the face region (including the region's location and area) to achieve the matching process of the first feature information and the second feature information, thereby accurately detecting the phenomenon of mistaken camera activation.
[0075] In a camera control method provided in another embodiment of the present application, the first characteristic information includes a first distance between the camera and the user, and a first angle between the camera and the user; the second characteristic information includes a preset second distance between the camera and the user, and a preset second angle between the camera and the user. Step 130 includes:
[0076] Sub-step B1: obtaining a first absolute value of a difference between the first distance and the second distance; and obtaining a second absolute value of a difference between the first angle and the second angle.
[0077] Typically, when a user turns on the camera without accidental input, the relative position of the face and the screen is not much different based on the user's operating habits. Therefore, the distance between the user's eyes and the camera in the captured image, as well as the angle between the user's eyes and the camera, are within a certain range.
[0078] In this embodiment, the first feature information and the second feature information both include: the distance between the user (with the user's eyes as a reference point) and the camera, and the angle between the user (with the user's eyes as a reference point) and the camera.
[0079] For example, see Figure 3 When the user normally inputs to turn on the camera, Rr is used to represent the second distance between the user's eyes and the camera, and Ar is used to represent the second angle between the user's eyes and the camera.
[0080] Sub-step B2: Determine the second value according to the distance weight value, the angle weight value, the first absolute value, and the second absolute value.
[0081] For reference, the calculation formula of the second value is:
[0082] Formula 1: H = W1|Ar-At|+W2|Rr-Rt|.
[0083] In Formula 1, H is used to represent the second value, W1 is used to represent the angle weight value, W2 is used to represent the distance weight value, Ar is used to represent the second angle, At is used to represent the first angle, Rr is used to represent the second distance, and Rt is used to represent the first distance.
[0084] Optionally, the distance weight value and the angle weight value are set in advance.
[0085] Sub-step B3: When the second value is greater than the second threshold, output a prompt message or turn off the camera.
[0086] In this step, when the second value is greater than the second threshold, the first input for turning on the camera is considered to be an erroneous input, and a prompt message is output or the camera is turned off.
[0087] Optionally, the second threshold is preset.
[0088] In this embodiment, the relative position between the face and the camera during a non-incorrect input is used as a standard. The relative position between the face and the camera during the first input is calculated. The degree of deviation of the face during the first input is assessed by the shooting distance and angle compared to the standard relative position. This deviation is represented by a second value. When the second value exceeds a second threshold, the first input is determined to be an incorrect input. This embodiment fully utilizes the relative position between the face and the camera to match the first feature information with the second feature information when detecting incorrect camera activation, thereby accurately detecting incorrect camera activation.
[0089] In a camera control method provided in another embodiment of the present application, the first feature information includes multiple groups of sub-information arranged in sequence, and step 130 includes:
[0090] Sub-step C1: When at least N consecutive groups of sub-information do not match the second feature information, output a prompt message or turn off the camera, where N is a positive integer and N is greater than a third threshold.
[0091] In this embodiment, the first image is a video, and thus the first image includes multiple frames. Correspondingly, a set of sub-information can be extracted from each frame, so that the first feature information includes multiple sets of sub-information, and the multiple sets of sub-information are arranged in sequence according to the arrangement order of the multiple frames.
[0092] Therefore, in the matching of this embodiment, it is necessary to match the sub-information of each frame with the second feature information respectively.
[0093] Optionally, the third threshold value may be set to “2.” Correspondingly, when at least two consecutive sets of sub-information do not match the second feature information, a prompt message is output or the camera is turned off.
[0094] For example, in combination with other embodiments provided in the present application, if the first values of two consecutive frames are both greater than the first threshold, or if the second values of two consecutive frames are both greater than the second threshold, the first input is determined to be an erroneous input.
[0095] In more embodiments, the first feature information may be obtained by averaging the sub-information of all frame images included in the first image, and then matched with the second feature information.
[0096] In this embodiment, when the first image includes multiple frames, a final matching result is obtained based on the matching results of N consecutive frames to improve the detection accuracy of the camera being mistakenly activated.
[0097] In another embodiment of the camera control method of the present application, before step 130, the method further includes:
[0098] Step D1: Receive a second input from the user.
[0099] The second input includes touch input performed by the user on the screen, and is not limited to inputs such as clicks, slides, and drags. The second input can also be input from the user through the air, such as gestures or facial movements. The second input also includes input from the user on physical buttons on the device, and is not limited to inputs such as presses. Furthermore, the second input includes one or more inputs, where the multiple inputs can be continuous or spaced apart.
[0100] In this step, the second input is used to capture the second image.
[0101] For example, when it is recognized that the user is logging into the video conferencing software for the first time, a pop-up window will be displayed to ask the user whether he agrees to record the second image; further, after the user selects the "Agree" option, the camera is turned on and the image preview interface is displayed. The user's face is displayed in the image preview interface, and the user is prompted to adjust the head posture to suit the operating habits of turning on the camera. Among them, the prompt content includes the area of the face part in the image preview interface (specifically, the adjustment can be achieved through the position of the face part in the image preview interface and the area occupied), and the position of the eyes in the face part (specifically, the adjustment can be achieved through the distance and angle between the eyes and the camera). Further, after the user adjusts the head posture, the user clicks the "OK" option under the relevant prompt.
[0102] Step D2: In response to the second input, record a second image.
[0103] Optionally, the second image is a preview image determined in the image preview interface.
[0104] Optionally, the second image is a picture.
[0105] Step D3: Based on the second image, obtain second feature information.
[0106] Optionally, the second feature information includes: a second distance Rr between the eyes and the camera, a second angle Ar between the eyes and the camera, relevant information of the second facial area Pr (such as position information, area information), and the like.
[0107] Optionally, the second image is recorded by capturing images using a camera.
[0108] Optionally, at the prompt of the video conferencing software, upload a second image to complete the entry.
[0109] In this embodiment, the user can pre-record the second image for use in the subsequent matching process. As can be seen, in this embodiment, the second image is customized by the user, thereby ensuring accurate detection of the phenomenon of mistaken camera activation.
[0110] In a camera control method provided in another embodiment of the present application, before step 110, the method further includes:
[0111] Step E1: Acquire multiple sets of feature information based on historical data of users turning on their cameras.
[0112] Step E2: Determine the second feature information based on the average value of multiple sets of feature information
[0113] Optionally, a third input from the user is received, and an image is captured after the third input.
[0114] It should be noted that, for the sake of distinction, the image here is defined as the third image.
[0115] The third input includes touch input performed by the user on the screen, and is not limited to inputs such as clicks, slides, and drags. The third input can also be input from the user through the air, such as gestures and facial movements. The third input also includes input from the user on physical buttons on the device, and is not limited to inputs such as presses. Furthermore, the third input includes one or more inputs, where multiple inputs can be continuous or spaced apart.
[0116] In this step, the third input is used by the user to turn on the camera.
[0117] Further, when the duration of the camera being turned on based on the third input is greater than a fourth threshold, third feature information is obtained based on the third image.
[0118] Among them, the duration of the camera being turned on based on the third input is greater than the fourth threshold, which indicates that the user did not turn off the camera within a short period of time, and therefore the third input is determined not to be an erroneous input.
[0119] Optionally, in order to avoid collecting feature information corresponding to erroneous input, the fourth threshold is set to be relatively large.
[0120] In addition, after capturing the third image, the third feature information can be directly obtained without first determining whether the duration of the camera being turned on based on the third input is greater than the fourth threshold; further, if the third input is determined to be an erroneous input, the obtained third feature information can be directly discarded.
[0121] Furthermore, when a plurality of third inputs that are not erroneous inputs are received, an average value is calculated based on the plurality of third feature information and used as the second feature information.
[0122] Optionally, the second feature information includes: the second distance Rr between the eyes and the camera obtained by averaging multiple sets of feature information, the second angle Ar between the eyes and the camera obtained by averaging multiple sets of feature information, relevant information (such as position information, area information) of the second facial area Pr obtained by averaging multiple sets of feature information, and so on.
[0123] Optionally, historical data is collected in real time to update the second feature information in real time.
[0124] In this embodiment, the system automatically collects historical data for use in completing the subsequent matching process. As can be seen, in this embodiment, the second feature information is automatically obtained by the system, thereby ensuring accurate detection of the phenomenon of mistaken camera activation.
[0125] Optionally, the second feature information entered by the user is preferentially used for matching. If the user does not enter it, the second feature information obtained by the system based on historical data is used for matching.
[0126] In a camera control method provided in another embodiment of the present application, after step 130, the method further includes:
[0127] Step F1: Receive a fourth input of prompt information.
[0128] The fourth input includes touch input by the user on the screen, not limited to click, slide, drag, and other inputs. The fourth input can also be air input by the user, such as gestures, facial movements, etc. The fourth input also includes input by the user on physical buttons on the device, not limited to presses. Moreover, the fourth input includes one or more inputs, where the multiple inputs can be continuous or spaced apart.
[0129] In this step, the fourth input is used to turn off the camera based on the prompt information.
[0130] Step F2: In response to the fourth input, turning off the camera.
[0131] In an application scenario, the prompt information includes the options of "Close" and "Do not close". Based on the fourth input, the user clicks the "Close" option.
[0132] In this embodiment, convenience is provided for the user so that the user can quickly take timely measures to deal with the phenomenon of accidentally turning on the camera, thereby preventing losses caused by the erroneous operation as soon as possible.
[0133] In summary, in this application, first, the relevant information about the user's facial angle, distance, and / or facial area when the camera is normally turned on is recorded and used as the second feature information. In addition, the relevant information about the user's facial angle, distance, and / or facial area when the camera is turned on in the past is collected and used as the second feature information. When the user turns on the camera, the relevant information about the user's facial angle, distance, and / or facial area is obtained as the first feature information, which is matched with the second feature information. After matching, if the matching two sides are significantly different, a prompt is given or the camera is turned off. It can be seen that this application can promptly detect the phenomenon of accidentally turning on the camera, thereby achieving the purpose of protecting user privacy.
[0134] The camera control method provided in the embodiment of the present application can be executed by a camera control device. In the embodiment of the present application, the camera control device provided in the embodiment of the present application is described by taking the camera control method executed by the camera control device as an example.
[0135] Figure 4 A block diagram of a camera control device provided by an embodiment of the present application is shown, the device comprising:
[0136] The receiving module 10 is configured to receive a first input from a user;
[0137] A first acquisition module 20 is configured to activate the camera and acquire first characteristic information of the user in response to a first input;
[0138] The control module 30 is configured to output a prompt message or turn off the camera when the first characteristic information does not match the second characteristic information, wherein the prompt message is used to prompt the camera to be turned off.
[0139] In an embodiment of the present application, in the case where the camera is not turned on by mistake, the electronic device pre-records the second characteristic information, based on which, it receives the user's first input, responds to the first input, turns on the camera, and simultaneously obtains the user's first characteristic information. Thus, if the first characteristic information does not match the second characteristic information, the electronic device determines that the first input is an erroneous input, and correspondingly determines that the camera turning on operation is an erroneous operation, and then the electronic device outputs a prompt message to prompt the user to turn off the camera in time, or the electronic device directly turns off the camera. It can be seen that based on the embodiment of the present application, the phenomenon of the camera being turned on by mistake can be detected, and timely measures can be taken to turn off the camera as soon as possible, thereby reducing the risk of user privacy leakage.
[0140] Optionally, the first feature information includes a first facial region of the user, and the second feature information includes a preset second facial region of the user;
[0141] The control module 30 includes:
[0142] a first determining unit, configured to determine first area information based on an area of a non-overlapping region between the first facial region and the second facial region;
[0143] a second determining unit, configured to determine a first value based on a ratio of the first area information to the second area information, wherein the second area information is area information of the second facial region;
[0144] The first control unit is configured to output a prompt message or turn off the camera when the first value is greater than a first threshold.
[0145] Optionally, the first characteristic information includes a first distance between the camera and the user, and a first angle between the camera and the user; the second characteristic information includes a preset second distance between the camera and the user, and a preset second angle between the camera and the user;
[0146] The control module 30 includes:
[0147] an acquiring unit, configured to acquire a first absolute value of a difference between the first distance and the second distance; and acquire a second absolute value of a difference between the first angle and the second angle;
[0148] a third determining unit, configured to determine a second value according to the distance weight value, the angle weight value, the first absolute value, and the second absolute value;
[0149] The second control unit is used to output a prompt message or turn off the camera when the second value is greater than a second threshold.
[0150] Optionally, the first characteristic information includes multiple groups of sub-information arranged in sequence;
[0151] The control module 30 includes:
[0152] The third control unit is used to output a prompt message or turn off the camera when at least N consecutive groups of sub-information do not match the second feature information, where N is a positive integer and N is greater than a third threshold.
[0153] Optionally, the device further comprises:
[0154] The second acquisition module is used to obtain multiple sets of feature information based on the historical data of users turning on the camera;
[0155] The determination module is used to determine the second feature information according to the average value of multiple sets of feature information.
[0156] The camera control device in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not specifically limit it.
[0157] The camera control device of the embodiment of the present application may be a device having a motion system. The motion system may be an Android motion system, an iOS motion system, or other possible motion systems, which are not specifically limited in the embodiment of the present application.
[0158] The camera control device provided in the embodiment of the present application can implement each process implemented in the above method embodiment. To avoid repetition, it will not be described here.
[0159] Alternatively, as Figure 5 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101, a memory 102, a camera 103, and a program or instruction stored in the memory 102 and executable on the processor 101. When the program or instruction is executed by the processor 101, each step of any of the above-mentioned camera control method embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0160] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0161] Figure 6 A schematic diagram of the hardware structure of an electronic device provided for implementing an embodiment of the present application.
[0162] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, a camera 1011 and other components.
[0163] Those skilled in the art will understand that the electronic device 1000 may also include a power source (such as a battery) to power each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. Figure 6 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be repeated here.
[0164] Among them, the user input unit 1007 is used to receive the user's first input; the processor 1010 is used to turn on the camera 1011 and obtain the first characteristic information of the user in response to the first input; when the first characteristic information does not match the second characteristic information, output a prompt message or turn off the camera 1011, wherein the prompt message is used to prompt to turn off the camera 1011.
[0165] In the embodiment of the present application, when the camera 1011 is not turned on by mistake, the electronic device pre-records the second characteristic information, based on which, it receives the first input of the user, responds to the first input, turns on the camera 1011, and simultaneously obtains the first characteristic information of the user. Thus, when the first characteristic information does not match the second characteristic information, the electronic device determines that the first input is an erroneous input, and correspondingly determines that the operation of turning on the camera 1011 is an erroneous operation, and then the electronic device outputs a prompt message to prompt the user to turn off the camera 1011 in time, or the electronic device directly turns off the camera 1011. It can be seen that based on the embodiment of the present application, the phenomenon of the camera 1011 being turned on by mistake can be detected, and timely measures can be taken to turn off the camera 1011 as soon as possible, thereby reducing the risk of user privacy leakage.
[0166] Optionally, the first feature information includes the first facial area of the user, and the second feature information includes a preset second facial area of the user; the processor 1010 is further used to determine the first area information based on the area of the non-overlapping region between the first facial area and the second facial area; determine the first value based on the ratio of the first area information to the second area information; wherein the second area information is the area information of the second facial area; when the first value is greater than the first threshold, output a prompt message or turn off the camera 1011.
[0167] Optionally, the first characteristic information includes a first distance between the camera 1011 and the user, and a first angle between the camera 1011 and the user; the second characteristic information includes a preset second distance between the camera 1011 and the user, and a preset second angle between the camera 1011 and the user; the processor 1010 is also used to obtain a first absolute value of the difference between the first distance and the second distance; and to obtain a second absolute value of the difference between the first angle and the second angle; determine a second value based on the distance weight value, the angle weight value, and the first absolute value and the second absolute value; and when the second value is greater than a second threshold, output a prompt message or turn off the camera 1011.
[0168] Optionally, the first feature information includes multiple groups of sub-information arranged in sequence; the processor 1010 is further used to output a prompt message or turn off the camera 1011 when at least N consecutive groups of sub-information do not match the second feature information, where N is a positive integer and N is greater than a third threshold.
[0169] Optionally, the processor 1010 is further configured to obtain multiple sets of feature information based on historical data of the user turning on the camera 1011; and determine the second feature information based on an average value of the multiple sets of feature information.
[0170] In summary, in this application, first, the relevant information of the user's facial angle, distance, and / or facial area when the camera is normally turned on is recorded and used as the second feature information. In addition, the relevant information of the user's facial angle, distance, and / or facial area when the camera is turned on in the past is collected and used as the second feature information. When the user turns on the camera, the relevant information of the user's facial angle, distance, and / or facial area is obtained as the first feature information, and matched with the second feature information. After matching, if the difference between the two matched parties is large, a prompt is given or the camera is turned off. It can be seen that this application can detect the phenomenon of mistaken camera activation in a timely manner, thereby achieving the purpose of protecting user privacy and maintaining meeting order.
[0171] It should be understood that in an embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of a static picture or video image obtained by an image capture device (such as a camera) in a video image capture mode or an image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of the other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an action stick, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and action systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes the action system, user pages and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.
[0172] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0173] Processor 1010 may include one or more processing units. Optionally, processor 1010 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1010.
[0174] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned camera control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0175] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0176] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned camera control method embodiment and achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0177] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0178] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned camera control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0179] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0180] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
[0181] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.
Claims
1. A camera control method, characterized in that: Applied to an electronic device including a camera, the method includes: receiving a first input from a user; In response to the first input, turning on the camera and acquiring first feature information of the user, where the first feature information includes a first facial region of the user; determining first area information based on a non-overlapping area between the first facial region and a preset second facial region of the user; determining a first value based on a ratio of the first area information to the second area information of the second facial region, the first value being used to describe a ratio of an area of the first facial region that deviates from the second facial region to an area of the second facial region; When the first value is greater than a first threshold, a prompt message is output or the camera is turned off.
2. The method according to claim 1, characterized in that When the first characteristic information further includes a first distance between the camera and the user, and a first angle between the camera and the user, and the second characteristic information includes a preset second distance between the camera and the user, and a preset second angle between the camera and the user, the method further includes: Obtaining a first absolute value of a difference between the first distance and the second distance; and obtaining a second absolute value of a difference between the first angle and the second angle; Determine a second value according to the distance weight value, the angle weight value, the first absolute value, and the second absolute value; When the second value is greater than a second threshold, a prompt message is output or the camera is turned off.
3. The method according to claim 1, characterized in that In a case where the first feature information includes multiple groups of sub-information arranged in sequence, the method further includes: When at least N consecutive groups of sub-information do not match the second feature information, a prompt message is output or the camera is turned off, where N is a positive integer and N is greater than a third threshold.
4. The method according to claim 1, wherein Before receiving the first input from the user, the method further includes: Acquire multiple sets of feature information based on historical data of users turning on the camera; The second feature information is determined according to an average value of the multiple sets of feature information.
5. A camera control device, characterized in that: The device comprises: A receiving module, configured to receive a first input from a user; a first acquisition module, configured to, in response to the first input, activate a camera and acquire first characteristic information of the user; the first characteristic information including a first facial region of the user; a control module, configured to output a prompt message or turn off the camera when the first characteristic information does not match the second characteristic information, wherein the prompt message is used to prompt the user to turn off the camera; The control module includes: a first determining unit, configured to determine first area information based on a non-overlapping area between the first facial region and a preset second facial region of the user; a second determining unit, configured to determine a first value based on a ratio of the first area information to the second area information of the second facial region, the first value being used to describe a ratio of an area of the first facial region deviating from the second facial region to an area of the second facial region; The first control unit is configured to output a prompt message or turn off the camera when the first value is greater than a first threshold.
6. The device according to claim 5, characterized in that In a case where the first characteristic information further includes a first distance between the camera and the user, and a first angle between the camera and the user, and the second characteristic information includes a preset second distance between the camera and the user, and a preset second angle between the camera and the user, the control module further includes: an acquiring unit, configured to acquire a first absolute value of a difference between the first distance and the second distance; and acquire a second absolute value of a difference between the first angle and the second angle; a third determining unit, configured to determine a second value according to the distance weight value, the angle weight value, the first absolute value, and the second absolute value; The second control unit is configured to output a prompt message or turn off the camera when the second value is greater than a second threshold.
7. The device according to claim 5, characterized in that In the case where the first feature information includes multiple groups of sub-information arranged in sequence, the control module further includes: The third control unit is used to output a prompt message or turn off the camera when at least N consecutive groups of sub-information do not match the second feature information, where N is a positive integer and N is greater than a third threshold.
8. The device according to claim 5, characterized in that The device further comprises: A second acquisition module is used to obtain multiple sets of feature information based on historical data of users turning on the camera; A determination module is used to determine the second feature information according to an average value of the multiple sets of feature information.
9. An electronic device, characterized in that: The method comprises a processor, a memory and a camera, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the camera control method according to any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Terminal user identity login method and system
CN106028140A
Information security system for video conference based on artificial intelligence
CN115334048A