Image acquisition device, method and electronic equipment

Abstract

An image acquisition device, method and electronic device, wherein the image acquisition device includes: a normally-on camera, which, in response to an image acquisition operation, acquires a first scene image of the current scene; and an application processor, which transmits the first scene image to a designated external device. When the image acquisition device provided by the present application is applied to an electronic device, since the first scene image reflects the scene content of the real scene, the designated external device can assist the user in determining the real location of the electronic device through the first scene image, thereby better guiding the user to find the electronic device and increasing the probability of the electronic device being found.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to an image acquisition device, method and electronic equipment. Background Art

[0002] With the continuous development of electronic technology, people are becoming more and more dependent on electronic devices such as mobile phones and tablets. However, in real life, when a user needs to use an electronic device, the probability of finding the electronic device is low because the user forgets where the electronic device is placed or loses the electronic device. Summary of the invention

[0003] The present application provides an image acquisition device, method and electronic device, which can increase the probability of the electronic device being found.

[0004] In a first aspect, the present application provides an image acquisition device, comprising:

[0005] The camera is always on, and in response to an image acquisition operation, acquires a first scene image of a current scene;

[0006] The application processor transmits the first scene image to a designated external device.

[0007] In a second aspect, the present application provides an image acquisition method, which is applied to an image acquisition device, wherein the image acquisition device includes a normally-on camera and an application processor, and the image acquisition method includes:

[0008] The normally-on camera acquires a first scene image of the current scene in response to the image acquisition operation;

[0009] The application processor transmits the first scene image to a designated external device.

[0010] In a third aspect, the present application also provides an electronic device, which includes the image acquisition device provided by the present application.

[0011] When the image acquisition device provided by the present application is applied to an electronic device, the electronic device can respond to the image acquisition operation through the normally-open camera of the image acquisition device, acquire a first scene image of the current scene, and transmit the first scene image to a designated external device through the application processor of the image acquisition device. Since the first scene image reflects the scene content of the real scene, the designated external device can assist the user in determining the real location of the electronic device through the first scene image, thereby better guiding the user to find the electronic device and increasing the probability of the electronic device being found. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0013] Figure 1 This is a first structural block diagram of the image acquisition device provided in an embodiment of the present application.

[0014] Figure 2 This is an example diagram of the screen projection topology generated in the embodiment of the present application.

[0015] Figure 3 This is a second structural block diagram of the image acquisition device provided in an embodiment of the present application.

[0016] Figure 4 This is the third structural block diagram of the image acquisition device provided in an embodiment of the present application.

[0017] Figure 5 This is a first process example diagram of the image acquisition method provided in an embodiment of the present application.

[0018] Figure 6 This is a second process example diagram of the image acquisition method provided in an embodiment of the present application.

[0019] Figure 7 It is a structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] It should be noted that the terms "first", "second" and "third" in this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not limited to the listed steps or modules, but some embodiments also include steps or modules that are not listed, or some embodiments also include other steps or modules inherent to these processes, methods, products or devices.

[0021] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0022] At present, electronic devices such as mobile phones and tablet computers have brought great convenience to people's lives. People are becoming more and more dependent on electronic devices, but they often lose their electronic devices or forget where they are placed. When users need to find electronic devices, they generally use the following two methods to find electronic devices:

[0023] (1) Manual search, that is, the user tries to find the electronic device at the location where the electronic device may be placed based on memory. This method of finding the electronic device is the most direct but the least efficient, and is generally used for preliminary attempts.

[0024] (2) Use other electronic devices to call the electronic device to be found, and determine the location of the electronic device by the sound source of the ringing or vibration of the electronic device. This method can only be implemented if the electronic device has turned on the ringing or vibration and is within the sound propagation range of the electronic device.

[0025] It can be seen that the above two methods of searching for electronic devices are heavily dependent on manpower, so that the efficiency and probability of finding the electronic device are not high. To this end, the present application provides an image acquisition device, an image acquisition method and an electronic device.

[0026] Please refer to Figure 1 , Figure 1 The structure block diagram of the image acquisition device 100 provided in the embodiment of the present application is as follows: Figure 1 As shown, the image acquisition device 100 may include a normally-on camera 110 and an application processor 120 .

[0027] The always-on (AON) camera 110 is configured to capture images, and includes at least a lens and an image sensor. The lens is used to project external light signals to the image sensor, and the image sensor is used to perform photoelectric conversion on the light signals projected by the lens, and convert the light signals into usable electrical signals to obtain a digitized image. It should be noted that, unlike ordinary cameras, the always-on camera 110 can enter a waiting state between data frames, so that image capture can be achieved with lower power consumption, achieving the purpose of always-on.

[0028] In this embodiment, the normally-on camera 110 can respond to the image acquisition operation and perform image acquisition on the current scene, thereby acquiring an image of the current scene, which is recorded as the first scene image. The current scene can be understood as the real scene that the normally-on camera 110 is aimed at, that is, the normally-on camera 110 can currently convert the light signal into a corresponding image. There is no specific restriction on the source of the image acquisition operation here, and the image acquisition operation can come from the inside of the image acquisition device 100 (such as the application processor 120), or from the outside of the image acquisition device 100 (such as a designated external device).

[0029] The application processor 120 may be a general-purpose processor, such as an ARM architecture processor, an X86 architecture processor, etc. In this embodiment, the application processor 120 may transmit the first scene image acquired by the normally-on camera 110 to a designated external device. The type of the designated external device is not specifically limited here, and may be configured by those skilled in the art according to actual needs. For example, the designated external device may be a server set up in the cloud.

[0030] When the image acquisition device 100 provided by the present application is applied to electronic equipment, for example, please refer to Figure 2 , the image acquisition device 100 can be applied to electronic devices such as mobile phones, so that the electronic device can respond to the image acquisition operation through the normally-on camera 110 of the image acquisition device 100, acquire the first scene image of the current scene, and transmit the first scene image to the server-specified external device through the application processor 120 of the image acquisition device 100. In this way, since the first scene image reflects the scene content of the real scene, the designated external device can assist the user in determining the real location of the electronic device through the first scene image, thereby better guiding the user to find the electronic device and increasing the probability of the electronic device being found.

[0031] Optionally, in one embodiment, the image acquisition operation is received by the application processor 120 from a designated external device;

[0032] Alternatively, the image acquisition operation is triggered by the application processor 120 when a preset acquisition period is reached;

[0033] Alternatively, the image acquisition operation is triggered by the application processor 120 when it is in motion;

[0034] Alternatively, the image acquisition operation is triggered by the application processor 120 when receiving a preset operation input.

[0035] In this embodiment, the image acquisition operation may originate from inside the image acquisition device 100 or from outside the image acquisition device 100 .

[0036] As an optional implementation, the application processor 120 receives an image acquisition operation from a designated external device.

[0037] For example, the designated external device provides an image acquisition interface, and the image acquisition interface provides an image acquisition control for inputting image acquisition operations. When the user needs to find an electronic device, the user can log in to the image acquisition interface through another electronic device, and input the image acquisition operation to the designated external device through the image acquisition control provided by the image acquisition interface. Accordingly, after receiving the input image acquisition operation, the designated external device transmits the image acquisition operation to the application processor 120 of the image acquisition device 110.

[0038] As an optional implementation, the application processor 120 triggers the image acquisition operation when a preset acquisition period is reached. The preset acquisition period may be preset by a person skilled in the art by default, or may be preset by a user according to actual needs.

[0039] For example, the preset acquisition period may be configured as 15:00 of each natural day, and accordingly, the application processor 120 will automatically trigger the image acquisition operation at 15:00 of each natural day.

[0040] As an optional implementation, the application processor 120 triggers an image acquisition operation when in motion.

[0041] For example, when the image acquisition device 100 is equipped with a motion sensor, the application processor 120 can obtain sensor data collected by the motion sensor, and identify whether it is currently in a motion state based on the sensor data, and trigger an image acquisition operation if it is.

[0042] For another example, the always-on camera 110 has a motion detection function. The always-on camera 110 can identify whether it is in motion by comparing the difference of the collected images. If it is, it indicates that the application processor 120 is currently in motion, and accordingly, the application processor 120 triggers an image acquisition operation. It should be noted that the always-on camera 110 does not transmit the collected images to the application processor 120 during the period of collecting images for motion state detection, and it will only transmit the collected images to the application processor 120 after responding to the image acquisition operation.

[0043] As an optional implementation, the application processor 120 triggers an image acquisition operation when receiving an input preset operation.

[0044] For example, when the image acquisition device 100 is applied to an electronic device, the preset operation can be configured by a person skilled in the art according to actual needs. For example, the preset operation can be configured as an operation for viewing private information in the electronic device, an operation for shutting down the electronic device, and / or an operation for unlocking the electronic device. Accordingly, if the application processor 120 receives the input of the preset operation, the image acquisition operation is triggered.

[0045] Optionally, in one embodiment, please refer to Figure 3 , the image acquisition device 100 further includes:

[0046] The image processing chip 130 performs face detection on the first scene image if the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a face image;

[0047] When a human face exists in the first scene image, the application processor 120 transmits the first scene image to a designated external device.

[0048] It should be noted that when the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a facial image, the image acquisition operation may also carry instruction information for instructing the image acquisition apparatus 100 to acquire an image including an object of a designated type and return it to the designated external device.

[0049] In this embodiment, when the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a face image, that is, to instruct the acquisition of an image including a face, the normally-on camera 110 transmits the acquired first scene image to the image processing chip 130, and the image processing chip 130 further performs face detection on the first scene image, that is, detects whether there is a face in the first scene image. The manner in which the image processing chip 130 performs face detection is not specifically limited here, for example, the image processing chip 130 can perform face detection by using a template matching method.

[0050] After completing the face detection on the first scene image, if the image processing chip 130 detects that there is a face in the first scene image, the first scene image is transmitted to the application processor 120, and the application processor 120 transmits the first scene image to a designated external device.

[0051] Exemplarily, the image processing chip 130 may include an image processing unit and a neural network processing unit. After the image processing chip 130 receives the first scene image from the normally-on camera 110, the image processing unit performs basic optimization processing on the first scene image, including but not limited to black level compensation, lens correction, bad pixel correction, white balance, color correction, and gamma correction; after the image processing unit completes the optimization processing of the first scene image, the neural network processing unit performs face detection on the first scene image through a trained face detection model to obtain a face detection result. If a face is detected in the first scene image, the image processing chip 130 transmits the first scene image to the application processor 120, and the application processor 120 transmits the first scene image to the designated external device; if no face is detected in the first scene image, the image processing chip 130 instructs the normally-on camera 110 to re-capture the first scene image to capture the first scene image including the face, and if the first scene image with the face is still not captured after receiving the first preset time of the image capture operation, the image processing chip 130 sends acquisition failure indication information indicating the failure of capturing the face image to the application processor 120. When receiving the acquisition failure indication information from the image processing chip 130, the application processor 120 instructs the normally-on camera 110 to stop capturing the first scene image, and returns indication information indicating the absence of the face to the designated external device.

[0052] In other embodiments, the image acquisition operation from the designated external device can also be used to indicate the acquisition of scene images. The difference from the above image acquisition operation indicating the acquisition of facial images is that the image processing chip 130 does not perform face detection on the first scene image from the normally-on camera 110, but directly transmits the first scene image to the application processor 120 after optimizing the first scene image through the image processing chip, and the application processor 120 transmits the first scene image to the designated external device.

[0053] Optionally, in one embodiment, the normally-on camera 110 performs human shape detection on the first scene image to determine a human shape region of the first scene image;

[0054] The image processing chip 130 performs face detection on the first scene image according to the human-shaped area using a face detection model.

[0055] In this embodiment, the normally-on camera 110 has the ability to detect human figures. There is no specific limitation on how the normally-on camera 110 performs human figure detection. For example, the normally-on camera 110 can perform human figure detection by template matching.

[0056] Among them, after the normally-on camera 110 captures the first scene image of the current scene, it does not directly transmit the first scene image to the image processing chip 130, but first performs human figure detection on the first scene image to determine the human figure area in the first scene image, and then transmits the first scene image and the area indication information for indicating the human figure area in the first scene image to the image processing chip 130.

[0057] Correspondingly, after receiving the first scene image and area indication information from the normally-on camera 110, the image processing chip 130 further performs face detection on the first scene image through a trained face detection model according to the human-shaped area indicated by the area indication information, and obtains a face detection result.

[0058] Among them, the neural network processing unit can crop the image content of the human area from the first scene image according to the indication of the area indication information, and input the image content of the cropped portrait area into the trained face detection model for face detection, and obtain the face detection result of the first scene image accordingly.

[0059] In this way, by performing targeted face detection according to the human shape area, the efficiency of face detection can be improved.

[0060] In other embodiments, if the human figure detection of the first scene image fails, that is, no human figure area is detected from the first scene image, the normally-on camera 110 re-captures the first scene image to capture the first scene image including the human figure area. If the first scene image with the human figure area is still not captured after receiving the second preset time length of the image capture operation, the normally-on camera 110 directly transmits the first scene image obtained by the last capture to the image processing chip 130 for face detection.

[0061] Among them, the second preset time length is constrained to be shorter than the first preset time length, and the value can be determined by technical personnel in this field according to actual needs.

[0062] Optionally, in one embodiment, if the image acquisition operation is triggered by the application processor 120 when it is in motion, the image processing chip 130 performs face recognition on the first scene image;

[0063] When a non-preset human face exists in the first scene image, the application processor 120 transmits the first scene image to a designated external device.

[0064] In this embodiment, when the image acquisition device 110 is applied to an electronic device, the preset face can be understood as the face of a user who has the authority to operate the electronic device, such as the face of the owner of the device, or the face of another user authorized by the owner to use the electronic device. The preset face will be loaded into the neural network processing unit of the image processing chip 130 for face recognition.

[0065] Correspondingly, if the image acquisition operation is triggered by the application processor 120 when it is in motion, it means that the electronic device may be held and used at this time, and the image processing chip 130 performs face recognition on the first scene image, that is, the neural network processing unit identifies whether there is a face that does not match the preset face in the first scene image. When it is recognized that there is a face that does not match the preset face in the first scene image, that is, there is a non-preset face in the first scene image, the image processing chip 130 transmits the first scene image with the non-preset face to the application processor 120, and the application processor 120 transmits the first scene image to the designated external device.

[0066] Optionally, in one embodiment, the application processor 120 compresses the first scene image to obtain a third compressed image, and transmits the compressed third compressed image to a designated external device.

[0067] In order to reduce the occupancy of data transmission bandwidth, the application processor 120 compresses the first scene image before transmitting it.

[0068] Exemplarily, in this embodiment, the first scene image captured by the normally-on camera 110 is an image in RAW format. After the first scene image in RAW format is input into the image processing chip 130 for optimization processing, it is output in YUV format. When the first scene image in YUV format meets the transmission requirements (for details, please refer to the relevant description in the above embodiments, which will not be repeated here), the application processor 120 compresses the first scene image in YUV format and compresses it into a format that occupies smaller storage space before transmitting it. For example, the application processor 120 can compress the first scene image from YUV format to JPEG format or Webp format before transmitting it to the designated external device.

[0069] Optionally, see Figure 4 In one embodiment, the image acquisition device 100 further includes a first wide-angle camera 140, the viewing angle range of the first wide-angle camera 140 is greater than the viewing angle range of the normally-on camera 110, and when a non-preset human face exists in the first scene image, the first wide-angle camera 140 acquires a second scene image of the current scene;

[0070] The image processing chip 130 determines a significant region in the second scene image, and performs object recognition on the significant region to obtain object information;

[0071] The application processor 120 obtains the current first position information, and compresses the first scene image according to the first position information and the object information to obtain a first compressed image; and transmits the first compressed image to a designated external device.

[0072] In this embodiment, the image acquisition device 100 further includes a first wide-angle camera 140 for acquiring images with richer content, thereby providing richer information. For example, when the image acquisition device 100 is applied to a mobile phone, the normally-on camera 110 can be configured as the front camera of the mobile phone, and the first wide-angle camera 140 can be configured as the rear camera of the mobile phone.

[0073] Among them, when the application processor 120 receives the first scene image with non-preset faces transmitted by the image processing chip 130, it instructs the first wide-angle camera 140 to shoot. Correspondingly, the first wide-angle camera 140 will capture images of the current scene according to the instructions of the application processor 120, and record the captured image as the second scene image.

[0074] As described above, after acquiring the second scene image, the first wide-angle camera 140 transmits the second scene image to the image processing chip 130 .

[0075] After the image processing chip 130 receives the second scene image from the first wide-angle camera 110, the image processing unit performs basic optimization processing on the second scene image, including but not limited to black level compensation, lens correction, bad pixel correction, white balance, color correction, and gamma correction; after the image processing unit completes the optimization processing of the second scene image, the neural network processing unit performs saliency recognition on the second scene image through the trained saliency region recognition model to determine the saliency region in the second scene image. In layman's terms, the saliency region is the region that is more likely to be noticed by the user. The architecture and training method of the saliency region recognition model are not specifically limited here, and can be configured by those skilled in the art according to actual needs.

[0076] After determining the salient area in the second scene image, the image processing chip 130 further performs object recognition on the salient area of ​​the second scene image. The object information obtained by recognition will reflect the objects in the second scene image that are easily noticed by the user. In other words, it is the objects that can easily help determine the scene in which the electronic device is currently located.

[0077] Among them, the image processing chip 130 can use a preset object recognition technology to perform object recognition on the salient area in the aforementioned second scene image to obtain object information, and the object information may include the type and color of the object, or other information that can describe the characteristics of the object. There is no specific restriction on which object recognition technology is used as the preset object recognition technology for object recognition in the second scene image, and it can be selected by those skilled in the art according to actual needs. For example, the image processing chip 130 can use a neural network processing unit to identify the salient area of ​​the second scene image through a pre-trained image semantic segmentation model, thereby obtaining object information of objects existing in the salient area of ​​the second scene image.

[0078] In this embodiment, when the image acquisition device 100 is applied to an electronic device, the application processor 120 can also obtain the current position information from the positioning unit (including but not limited to the satellite positioning unit and the base station positioning unit, etc.) configured by the electronic device, which is recorded as the first position information. Afterwards, the application processor 120 compresses the first scene image according to the first position information and the aforementioned object information, and transmits the compressed first compressed image to the designated external device, and the first compressed image includes both the original image content of the first scene image and the aforementioned first position information and the aforementioned object information.

[0079] It can be understood that when a user needs to find an electronic device, the original image content included in the first compressed image, the first location information describing its location, and the object information in the prominent area can help the user more accurately determine the location of the electronic device, thereby finding the electronic device faster.

[0080] For example, taking a mobile phone as an example of an electronic device used in the image acquisition device, when the mobile phone is lost and a passerby picks it up and uses it, the image captured by the normally-on camera 110 as a front camera is mostly occupied by the portrait, while the first wide-angle camera as a rear camera can capture the scene on the back of the mobile phone, such as large road signs, store names and other prominent objects. In this case, synchronously recording the current location information of the mobile phone can help the user find the mobile phone faster.

[0081] Optionally, in one embodiment, when the image acquisition operation is triggered by the application processor 120 when a preset acquisition cycle is reached, or when the application processor 120 is in motion, or when the application processor 120 receives an input preset operation, the application processor 120 obtains the current second position information; compresses the first scene image according to the second position information to obtain a second compressed image; and transmits the second compressed image to a designated external device.

[0082] In this embodiment, when the image acquisition device 100 is applied to an electronic device, an activity recording function can be provided for the electronic device. For example, taking the electronic device as a mobile phone, sometimes the user does not realize in time that the mobile phone has been lost, and misses the opportunity to find the mobile phone. At this time, the activity recording function provided by this embodiment can provide help to the user.

[0083] When the image acquisition operation is triggered by the application processor 120 when the preset acquisition cycle is reached, or when the application processor 120 is in motion, or when the application processor 120 receives an input preset operation, that is, when the image acquisition operation comes from the inside of the image acquisition device 100, the application processor 120 obtains the current position information from the positioning unit (including but not limited to the satellite positioning unit and the base station positioning unit, etc.) configured by the electronic device, which is recorded as the second position information. Afterwards, the application processor 120 compresses the first scene image according to the second position information, and transmits the compressed second compressed image to the designated external device, and the second compressed image includes both the original image content of the first scene image and the aforementioned second position information.

[0084] It is understandable that when a user needs to find an electronic device, the original image content included in the second compressed image and the second location information describing its location can help the user more accurately determine the location of the electronic device, thereby finding the electronic device faster.

[0085] The above activity record function can help users obtain the current status information of electronic devices and handle them appropriately. Taking mobile phones as an example, by viewing the photos of the mobile phone users, users can confirm whether the mobile phone is safe. If the mobile phone is being used by an untrusted person, the user can remotely lock the mobile phone or delete the mobile phone data to prevent important information on the mobile phone from being leaked; if the current user of the mobile phone is a trusted friend or relative of the owner, it is unnecessary to clear the data on the mobile phone, which is an overprotective operation, to avoid losses.

[0086] Optionally, in one embodiment, the image acquisition device 100 further includes a second wide-angle camera, the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera 110, and the application processor 120 evaluates the scene complexity of the first scene image to obtain the complexity of the first scene image;

[0087] When the complexity of the first scene image is less than the complexity threshold, the second wide-angle camera acquires a third scene image of the current scene;

[0088] The application processor 120 replaces the first scene image with the second scene image.

[0089] In order to ensure that an image with sufficient clues is finally provided to the user, in this embodiment, when the original image content of the first scene image is relatively simple, it is replaced.

[0090] Among them, after the normally-on camera 110 captures the first scene image, it does not directly transmit the first scene image to the image processing chip 130 for subsequent processing. Instead, the application processor 120 first evaluates the scene complexity of the first scene image according to the configured complexity evaluation strategy to obtain the complexity of the first scene image. There is no specific restriction on the configuration of the complexity evaluation strategy here, and it can be configured by technical personnel in this field according to actual needs.

[0091] If the complexity of the first scene image is less than the complexity threshold (which can be determined by a person skilled in the art according to actual needs), the application processor 120 instructs the second wide-angle camera to capture an image. Accordingly, the second wide-angle camera, according to the instruction of the application processor 120, captures an image of the current scene when the complexity of the first scene image is less than the complexity threshold, records the captured image as the third scene image, and replaces the first scene image with the third scene image, that is, the third scene image is transmitted as the first scene image to the image processing chip 130 for subsequent processing. For details, please refer to the relevant description in the above embodiments, which will not be repeated here.

[0092] For example, when the image acquisition device 100 is applied to a mobile phone, the always-on camera 110 is configured as the front camera of the mobile phone, and the second wide-angle camera is configured as the rear camera of the mobile phone. If the mobile phone is placed facing the desktop, the first scene image taken by the always-on camera 110 will be a dark image. At this time, the second wide-angle camera on the back of the mobile phone will take pictures and obtain a third scene image with normal image content.

[0093] It should be noted that in the above embodiments, after the application processor 120 obtains the image to be transmitted to the designated external device (such as the first compressed image, the second compressed image, etc.), it does not directly transmit the image to be transmitted to the designated external device, but first saves the image to be transmitted locally in the electronic device. For example, when the electronic device is a mobile phone, the image to be transmitted can be saved in a local dedicated album of the mobile phone. When the mobile phone network is in good condition and the battery is sufficient, the image to be transmitted is transmitted to the designated external device, and after the transmission is successful, the local image to be transmitted is deleted.

[0094] When the above image acquisition device 100 provided by the present application is applied to a mobile phone and the designated external device is configured as a cloud server, it has the following advantages:

[0095] (1) It can help users to confirm the specific location of their mobile phone more quickly. By using the first scene image collected, it can help users to make detailed location judgments. This is very helpful when the mobile phone is lost in an environment that the user is familiar with, such as home or office.

[0096] (2) It can help users obtain information about the current status of the phone and take appropriate actions. By viewing the first scene image including the face, the user can confirm whether the phone is safe. If the phone is being used by an untrusted person, the user can remotely lock the phone or delete the phone data to prevent important information on the phone from being leaked; if the current user of the phone is a trusted friend or relative of the owner, there is no need to perform overprotective operations such as clearing the phone data to avoid losses.

[0097] (3) By using the activity record function, even if the user does not realize that the phone is lost in time and cannot connect to the phone remotely, the user can view the second compressed image uploaded by the phone in history to understand the movement trajectory and situation of the phone. This information can provide users with more clues and increase the possibility of finding the phone.

[0098] The present application also provides an image acquisition method, which is applied to the image acquisition device provided in the present application. The image acquisition device includes a normally-on camera and an application processor. Please refer to Figure 5 , the process of the image acquisition method can be as follows:

[0099] In S210, the normally-on camera acquires a first scene image of the current scene in response to the image acquisition operation;

[0100] In S220 , the application processor transmits the first scene image to a designated external device.

[0101] Optionally, in one embodiment, the image acquisition operation is received by the application processor from a designated external device;

[0102] Alternatively, the image acquisition operation is triggered by the application processor when a preset acquisition period is reached;

[0103] Alternatively, the image acquisition operation is triggered by the application processor while in motion;

[0104] Alternatively, the image acquisition operation is triggered by the application processor when receiving a preset operation input.

[0105] Optionally, in one embodiment, the image acquisition device further includes an image processing chip, and before the application processor transmits the first scene image to the designated external device, it further includes:

[0106] If the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a face image, the image processing chip performs face detection on the first scene image;

[0107] The application processor transmits the first scene image to a designated external device, including:

[0108] When a human face exists in the first scene image, the application processor transmits the first scene image to a designated external device.

[0109] Optionally, in one embodiment, before the image processing chip performs face detection on the first scene image, the process further includes:

[0110] The normally-on camera performs human shape detection on the first scene image to determine a human shape area of ​​the first scene image;

[0111] The image processing chip performs face detection on the first scene image, including:

[0112] The image processing chip performs face detection on the first scene image according to the human-shaped area through a face detection model.

[0113] Optionally, in one embodiment, before the application processor transmits the first scene image to the designated external device, the process further includes:

[0114] If the image acquisition operation is triggered by the application processor when it is in motion, the image processing chip performs face recognition on the first scene image;

[0115] The application processor transmits the first scene image to a designated external device, including:

[0116] When a non-preset human face exists in the first scene image, the application processor transmits the first scene image to a designated external device.

[0117] Optionally, in one embodiment, the image acquisition device further includes a first wide-angle camera, the viewing angle range of the first wide-angle camera is greater than the viewing angle range of the normally-on camera, and before the application processor transmits the first scene image to the designated external device, it further includes:

[0118] When a non-preset human face exists in the first scene image, the first wide-angle camera acquires a second scene image;

[0119] The image processing chip determines a salient area in the second scene image, and performs object recognition on the salient area to obtain object information;

[0120] The application processor transmits the first scene image to a designated external device, including:

[0121] The application processor obtains the current first position information, and compresses the first scene image according to the first position information and the object information to obtain a first compressed image; and transmits the first compressed image to a designated external device.

[0122] Optionally, in one embodiment, the application processor transmits the first scene image to a designated external device, including:

[0123] When the image acquisition operation is triggered by the application processor when a preset acquisition cycle is reached, or when the application processor is in motion, or when the application processor receives an input preset operation, the application processor obtains the current second position information; compresses the first scene image according to the second position information to obtain a second compressed image; and transmits the second compressed image to a designated external device.

[0124] Optionally, in one embodiment, the image acquisition device further includes a second wide-angle camera, the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera, and before the application processor transmits the first scene image to the designated external device, it also includes:

[0125] The application processor evaluates the scene complexity of the first scene image to obtain the complexity of the first scene image;

[0126] When the complexity of the first scene image is less than the complexity threshold, the second wide-angle camera captures a third scene image of the current scene and replaces the first scene image with the third scene image.

[0127] It should be noted that, for the specific implementation of the above image acquisition method, please refer to the relevant description in the above image acquisition device embodiment, which will not be repeated here.

[0128] The present application also provides an electronic device, which includes the image acquisition device provided by any embodiment of the present application.

[0129] The present application also provides an image acquisition method, which is applied to an electronic device, wherein the electronic device includes a normally-on camera. Figure 6 , the process of the image acquisition method can be as follows:

[0130] In S310, in response to the image acquisition operation, a first scene image of the current scene is acquired by acquiring through a normally-on camera;

[0131] In S320 , the first scene image is transmitted to a designated external device.

[0132] Optionally, in one embodiment, the image acquisition operation is received from a designated external device;

[0133] Alternatively, the image acquisition operation is triggered when the preset acquisition cycle is reached;

[0134] Alternatively, the image acquisition operation is triggered when the current state is in motion;

[0135] Alternatively, the image acquisition operation is triggered by a preset operation when an input is currently received.

[0136] Optionally, in one embodiment, the electronic device further includes an image processing chip, and before transmitting the first scene image to the designated external device, further includes:

[0137] If the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a face image, performing face detection on the first scene image through the image processing chip;

[0138] Transmitting the first scene image to a designated external device, including:

[0139] When a human face exists in the first scene image, the first scene image is transmitted to a designated external device.

[0140] Optionally, in one embodiment, before performing face detection on the first scene image by the image processing chip, the method further includes:

[0141] Performing human figure detection on the first scene image by using a normally-on camera to determine a human figure area of ​​the first scene image;

[0142] Performing face detection on the first scene image through the image processing chip includes:

[0143] According to the human-shaped area, the face detection model is called by the image processing chip to perform face detection on the first scene image.

[0144] Optionally, in one embodiment, before transmitting the first scene image to the designated external device, the method further includes:

[0145] If the image acquisition operation is triggered when the current state is in motion, the first scene image is subjected to face recognition through the image processing chip;

[0146] Transmitting the first scene image to a designated external device, including:

[0147] When a non-preset human face exists in the first scene image, the first scene image is transmitted to a designated external device.

[0148] Optionally, in one embodiment, the electronic device further includes a first wide-angle camera, the viewing angle range of the first wide-angle camera is greater than the viewing angle range of the normally-on camera, and before transmitting the first scene image to the designated external device, the electronic device further includes:

[0149] When a non-preset human face exists in the first scene image, a second scene image of the current scene is acquired by collecting the first wide-angle camera;

[0150] Determine a salient area in the second scene image by using an image processing chip, and perform object recognition on the salient area to obtain object information;

[0151] Transmitting the first scene image to a designated external device, including:

[0152] The current first position information is acquired, and the first scene image is compressed according to the first position information and the object information to obtain a first compressed image; and the first compressed image is transmitted to a designated external device.

[0153] Optionally, in one embodiment, transmitting the first scene image to a designated external device includes:

[0154] When the image acquisition operation is triggered when the preset acquisition cycle is reached, or when the image acquisition operation is in motion, or when the preset operation input is received, the current second position information is obtained; and the first scene image is compressed according to the second position information to obtain a second compressed image; and the second compressed image is transmitted to a designated external device.

[0155] Optionally, in one embodiment, the electronic device further includes a second wide-angle camera, the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera, and before transmitting the first scene image to the designated external device, the electronic device further includes:

[0156] Evaluating the scene complexity of the first scene image to obtain the complexity of the first scene image;

[0157] When the complexity of the first scene image is less than the complexity threshold, a third scene image of the current scene is acquired through the second wide-angle camera, and the first scene image is replaced by the third scene image.

[0158] It should be noted that, for the specific implementation of the above image acquisition method, please refer to the relevant description in the above image acquisition device embodiment, which will not be repeated here.

[0159] This application also provides an electronic device, please refer to Figure 7 The electronic device 400 includes an application processor 410, a normally-on camera 420 and a memory 430.

[0160] The application processor 410 may be a general-purpose processor, such as an ARM architecture processor, an X86 architecture processor, etc.

[0161] The normally-on camera 420 includes at least a lens and an image sensor. The lens is used to project external light signals to the image sensor. The image sensor is used to perform photoelectric conversion on the light signals projected by the lens, converting the light signals into usable electrical signals to obtain a digital image. It should be noted that, unlike ordinary cameras, the normally-on camera 420 can enter a waiting state between data frames, so that image acquisition can be achieved with lower power consumption, achieving the purpose of being normally-on.

[0162] The memory 430 stores a computer program, which may be a high-speed random access memory or a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 430 may also include a memory controller to provide the application processor 410 with access to the memory 430. The application processor 410 executes the computer program in the memory 430 to execute the image acquisition method, such as:

[0163] In response to the image acquisition operation, a first scene image of the current scene is acquired by the normally-on camera 420;

[0164] The first scene image is transmitted to a designated external device.

[0165] Optionally, in one embodiment, the image acquisition operation is received from a designated external device;

[0166] Alternatively, the image acquisition operation is triggered when the preset acquisition cycle is reached;

[0167] Alternatively, the image acquisition operation is triggered when the current state is in motion;

[0168] Alternatively, the image acquisition operation is triggered by a preset operation when an input is currently received.

[0169] Optionally, in one embodiment, the electronic device further includes an image processing chip, and before transmitting the first scene image to the designated external device, the application processor 410 is further configured to execute:

[0170] If the image acquisition operation comes from a designated external device and is used to instruct the acquisition of a face image, performing face detection on the first scene image through the image processing chip;

[0171] When transmitting the first scene image to the designated external device, the application processor 410 is used to execute:

[0172] When a human face exists in the first scene image, the first scene image is transmitted to a designated external device.

[0173] Optionally, in one embodiment, before performing face detection on the first scene image through the image processing chip, the application processor 410 is further configured to execute:

[0174] Performing human shape detection on the first scene image by using the normally-on camera 420 to determine a human shape region of the first scene image;

[0175] When performing face detection on the first scene image through the image processing chip, the application processor 410 is used to execute:

[0176] According to the human-shaped area, the face detection model is called by the image processing chip to perform face detection on the first scene image.

[0177] Optionally, in one embodiment, before transmitting the first scene image to the designated external device, the application processor 410 is further configured to execute:

[0178] If the image acquisition operation is triggered when the current state is in motion, face recognition is performed on the first scene image through the image processing chip;

[0179] When transmitting the first scene image to the designated external device, the application processor 410 is used to execute:

[0180] When a non-preset human face exists in the first scene image, the first scene image is transmitted to a designated external device.

[0181] Optionally, in one embodiment, the electronic device further includes a first wide-angle camera, the viewing angle range of the first wide-angle camera is greater than the viewing angle range of the normally-on camera 420, and before transmitting the first scene image to the designated external device, the application processor 410 is further configured to execute:

[0182] When a non-preset human face exists in the first scene image, a second scene image of the current scene is acquired by collecting the first wide-angle camera;

[0183] Determine a salient area in the second scene image by using an image processing chip, and perform object recognition on the salient area to obtain object information;

[0184] When transmitting the first scene image to the designated external device, the application processor 410 is used to execute:

[0185] The current first position information is acquired, and the first scene image is compressed according to the first position information and the object information to obtain a first compressed image; and the first compressed image is transmitted to a designated external device.

[0186] Optionally, in one embodiment, when transmitting the first scene image to the designated external device, the application processor 410 is configured to execute:

[0187] When the image acquisition operation is triggered when the preset acquisition cycle is reached, or when the image acquisition operation is in motion, or when the preset operation input is received, the current second position information is obtained; and the first scene image is compressed according to the second position information to obtain a second compressed image; and the second compressed image is transmitted to a designated external device.

[0188] Optionally, in one embodiment, the electronic device further includes a second wide-angle camera, the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera 420, and before transmitting the first scene image to the designated external device, the application processor 410 is further configured to execute:

[0189] Evaluating the scene complexity of the first scene image to obtain the complexity of the first scene image;

[0190] When the complexity of the first scene image is less than the complexity threshold, a third scene image of the current scene is acquired through the second wide-angle camera, and the first scene image is replaced by the third scene image.

[0191] It should be noted that the above computer program runs in the form of a background process on the application processor 410, including two threads, thread 1 and thread 2. Thread 1 interacts with the specified external device, receives an image acquisition operation from the specified external device, and transmits the image acquired in response to the image acquisition operation back to the specified external device. Thread 2 is used to record the activity information of the electronic device, automatically trigger image acquisition, and upload the acquired image to the specified external device with the location information of the electronic device attached.

[0192] In addition, for the specific implementation of the above electronic device, please refer to the relevant description in the above image acquisition device embodiment, which will not be repeated here.

[0193] The present application also provides a storage medium on which a computer program is stored. When the computer program stored therein is executed on a processor of an electronic device provided in an embodiment of the present application, the processor of the electronic device executes the steps in any of the above image acquisition methods. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0194] The image acquisition device, method and electronic device provided by the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An image acquisition device, It is characterized in that include: The camera is always on, and in response to an image acquisition operation, acquires a first scene image of a current scene; A second wide-angle camera, wherein the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera; An application processor is used to evaluate the scene complexity of the first scene image to obtain the complexity of the first scene image; When the complexity of the first scene image is less than a complexity threshold, the second wide-angle camera acquires a third scene image of the current scene, and replaces the first scene image with the third scene image; The application processor transmits the replaced first scene image to a designated external device.

2. The image acquisition device according to claim 1, It is characterized in that The image acquisition operation is received by the application processor from the designated external device; Alternatively, the image acquisition operation is triggered by the application processor when a preset acquisition cycle is reached; Alternatively, the image acquisition operation is triggered by the application processor when the application processor is in motion; Alternatively, the image acquisition operation is triggered by the application processor when receiving a preset operation input.

3. The image acquisition device according to claim 2, It is characterized in that Also includes: an image processing chip, performing face detection on the replaced first scene image if the image acquisition operation comes from the designated external device and is used to instruct the acquisition of a face image; When a human face exists in the replaced first scene image, the application processor transmits the replaced first scene image to the designated external device.

4. The image acquisition device according to claim 3, It is characterized in that If the image acquisition operation is triggered by the application processor when it is in motion, the image processing chip performs face recognition on the replaced first scene image; When a non-preset human face exists in the replaced first scene image, the application processor transmits the replaced first scene image to a designated external device.

5. The image acquisition device according to claim 4, It is characterized in that It also includes a first wide-angle camera, the viewing angle range of the first wide-angle camera is greater than the viewing angle range of the normally-on camera, and the first wide-angle camera collects a second scene image when a non-preset human face exists in the replaced first scene image; The image processing chip determines a salient area in the second scene image, and performs object recognition on the salient area to obtain object information; The application processor acquires the current first position information, and compresses the replaced first scene image according to the first position information and the object information to obtain a first compressed image; and transmitting the first compressed image to the designated external device.

6. The image acquisition device according to claim 2, It is characterized in that The application processor acquires the current second position information when the image acquisition operation is triggered by the application processor when a preset acquisition cycle is reached, or when the application processor is in motion, or when the application processor receives an input preset operation; and compressing the replaced first scene image according to the second position information to obtain a second compressed image; and transmitting the second compressed image to the designated external device.

7. An image acquisition method, It is characterized in that Applied to an image acquisition device, the image acquisition device includes a normally-on camera, an application processor, and a second wide-angle camera, the viewing angle range of the second wide-angle camera is greater than the viewing angle range of the normally-on camera, and the image acquisition method includes: The normally-on camera acquires a first scene image of the current scene in response to the image acquisition operation; The application processor evaluates the scene complexity of the first scene image to obtain the complexity of the first scene image; When the complexity of the first scene image is less than a complexity threshold, the second wide-angle camera acquires a third scene image of the current scene, and replaces the first scene image with the third scene image; The application processor transmits the replaced first scene image to a designated external device.

8. An electronic device, It is characterized in that It comprises the image acquisition device as described in any one of claims 1-6.

Images