A camera detection method and related apparatus

Abstract

Embodiments of the present application provide a camera detection method and related device, the method comprising: emitting infrared light to a to-be-detected area through an infrared emission unit; collecting a first image of the to-be-detected area through an infrared imaging sensor; detecting a target position where retroreflected light spots exist in the first image; and outputting a second image, wherein the second image is an image in which prompt information is marked in an image where the target position is located, and the prompt information is used to prompt that the target position exists a camera. By using the embodiments of the present application, a pick-up camera in most application scenarios can be simply and accurately detected.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a camera detection method and related apparatus. Background Technology

[0002] To detect potential hidden cameras, there are currently three main types of tools on the market: The first type involves analyzing suspicious Wi-Fi signals and checking for suspicious devices within the Wi-Fi router's coverage area. These tools can automatically analyze abnormally strong signals or search for hidden cameras using Wi-Fi communication, and are easy to use. However, their limitation is that they rely on wireless network communication. If the hidden camera is not communicating via Wi-Fi in real time or is not running, it cannot be detected. The second type involves using a mobile phone's camera lens to observe whether there is an infrared light source in the room in a dark environment. However, this method can only detect hidden cameras with infrared fill lights enabled, and requires that the user's mobile phone camera lens coating does not completely filter the infrared band. The third type of tool actively emits red / infrared light, and the user manually observes whether there is reflection from the hidden camera lens. This method is limited by the subjective ability of human observation, is slow and inefficient, and requires a high level of experience. Figure 1 It showcases some common deployment scenarios for pinhole cameras and examples of existing solutions for categories one and three.

[0003] It can be seen that the existing solutions mentioned above have significant limitations. Therefore, how to design a pinhole camera detection solution that is simple to operate and adaptable to a wide range of scenarios is a technical problem that those skilled in the art are currently studying. Summary of the Invention

[0004] This application provides a camera detection method and related apparatus that can easily and accurately detect hidden cameras in most application scenarios.

[0005] In a first aspect, embodiments of this application provide a camera detection method applied to an electronic device, the method comprising:

[0006] Infrared light is emitted into the area to be tested through an infrared emitting unit;

[0007] A first image of the area to be tested is acquired using an infrared imaging sensor;

[0008] Detect the target location in the first image where retroreflected light spots exist;

[0009] Output a second image, wherein the second image is an image in which a prompt message is marked in the image where the target location is located, and the prompt message is used to indicate that a camera is present at the target location.

[0010] This method, by introducing an infrared emitting unit to actively emit infrared light and constructing a retroreflection effect, can actively detect hidden cameras in the test area that have not activated infrared supplementary lighting. Furthermore, because the light actively emitted into the environment in this solution is infrared, interference from natural light is significantly reduced, improving the accuracy of the detection results. In addition, the entire detection process requires minimal user intervention, exhibiting a high degree of automation and simple operation.

[0011] In conjunction with the first aspect, in one possible implementation, the method further includes:

[0012] A third image of the area to be tested is acquired by an infrared imaging sensor. The third image is acquired when the infrared emitting unit does not emit infrared light, while the first image is acquired when the infrared emitting unit emits infrared light. The target position where an infrared light source exists is detected in the third image.

[0013] This method also introduces a passive detection method (the method of not actively emitting infrared light). This passive detection method can quickly and accurately detect pinhole cameras with supplementary lighting. Although the passive detection method cannot perform well in scenarios where the infrared supplementary lighting of the hidden camera is not turned on, the aforementioned active detection method (i.e., actively emitting infrared light) makes up for this deficiency. The combination of active detection and passive detection not only ensures detection speed and accuracy, but also makes it applicable to all scenarios.

[0014] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, if there is no target location with an infrared light source in the third image, then the operation of detecting the target location with retroreflective light spots in the first image is performed. It is understood that if one detection method (active detection or passive inspection) can detect a result, the other detection method is not activated, effectively saving power consumption.

[0015] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, if there is no target location with retroreflective light spots in the first image, then the operation of detecting the target location with an infrared light source in the third image is performed. It is understood that if one detection method (active detection or passive inspection) can detect a result, the other detection method is not activated, effectively saving power consumption.

[0016] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, the step of acquiring a first image of the area to be tested via an infrared imaging sensor includes: continuously acquiring multiple first images of the area to be tested via the infrared imaging sensor while changing the acquisition angle, wherein the timestamps of the multiple first images are different; the step of acquiring a third image of the area to be tested via an infrared imaging sensor includes: continuously acquiring multiple third images of the area to be tested via the infrared imaging sensor while changing the acquisition angle, wherein the timestamps of the multiple third images are different; wherein the first image and the third image are acquired alternately in time.

[0017] This approach allows users to perform a single continuous scene scan on a suspected area to be tested, eliminating the need for separate scans for active and passive detection. This can potentially reduce the user's workload and improve the convenience and efficiency of scanning (image acquisition).

[0018] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, the method further includes: generating a first parameter based on depth information in the acquired images during the process of alternately acquiring the first image and the third image, wherein the first parameter represents the desired distance between the electronic device and the surface of the object in the area to be measured; and outputting the first parameter.

[0019] This method can promptly remind users to adjust the scanning distance, improve scene scanning quality, and reduce missed detections.

[0020] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, the method further includes: during the alternating acquisition of the first image and the third image, generating a second parameter based on parameters of the accelerometer and / or gyroscope of the electronic device, wherein the second parameter characterizes the desired acquisition angle and / or speed; and outputting the second parameter.

[0021] This method can promptly remind users to adjust the scanning speed or angle, improving scene scanning quality and reducing missed detections.

[0022] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, the output of the second image includes: outputting the second image during the alternating acquisition of the first image and the third image. Using this method, the feedback of the detection results is more timely, and the interaction between the user and the electronic device is more intuitive.

[0023] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, outputting the second image includes: outputting the second image after completing the acquisition of the first image and the third image. This method allows for the output of all results at once, facilitating unified processing by the user.

[0024] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, in the third image, if the pixel value in a pixel region is higher than the pixel value of the adjacent pixel points of the pixel region and the difference is greater than a first threshold, then the pixel region is the target location.

[0025] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, the first image is an image of infrared light emitted by the infrared emitting unit reflected by the area to be tested and projected onto an infrared imaging sensor. In the first image, if the reflected light signal in a pixel area is higher than the reflected light signal of the adjacent pixels in the pixel area and the difference is greater than a second threshold, then the pixel area is the target location.

[0026] In conjunction with the first aspect, or any of the above possible implementations of the first aspect, in yet another possible implementation, detecting the target location in the first image where a retroreflective light spot exists includes:

[0027] Multiple first positions of retroreflected cursors are determined in multiple first images, wherein the multiple first images are captured from different angles, and the number of first positions in each first image is greater than or equal to 0;

[0028] The target location is determined from the plurality of first locations based on the background information of the plurality of first images. The background information of the first images is used to determine the relative position of the first location in the first image in the area to be tested. If the relative position of the first location in one first image in the area to be tested is the same as the relative position of the first location in other first images in the area to be tested, then the first location in the first image is the target location.

[0029] This method can filter out interference caused by the smoothness of the object's surface, reduce false detections, and improve detection capabilities.

[0030] In conjunction with the first aspect, or any of the possible implementations of the first aspect described above, in yet another possible implementation, if the target location is detected from the third image, the method further includes:

[0031] The target location in the third image is mapped to a first image that is adjacent in timestamp, wherein the relative position of the target location in the area to be tested before mapping is the same as the relative position of the target location in the area to be tested after mapping; the second image is specifically an image in which the target location is mapped to be marked with prompt information.

[0032] It is understandable that, since the environment image is completely black, it is not easy for users to accurately find the location of the abnormal target in the test area. Specifically, users can see which position the target is in the third image, but it is not easy to determine which position in the test area the target position corresponds to (because the surrounding images of the target position are completely black, and a good reference cannot be formed). Therefore, the corresponding position can be circled in the adjacent active detection image (i.e. the first image with the infrared emitting unit turned on) to facilitate positioning.

[0033] Secondly, embodiments of this application provide an electronic device, the electronic device comprising: one or more processors; a memory; wherein the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to implement the method described in the first aspect or any possible implementation of the first aspect.

[0034] Thirdly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to implement the method described in the first aspect or any possible implementation of the first aspect.

[0035] Fourthly, embodiments of this application provide a computer program product containing instructions that, when the computer program product is run on an electronic device, cause the electronic device to implement the method described in the first aspect or any possible implementation of the first aspect.

[0036] Fifthly, embodiments of this application provide a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to implement the method described in the first aspect or any possible implementation of the first aspect.

[0037] It should be understood that the descriptions of technical features, technical solutions, beneficial effects, or similar language in this application do not imply that all features and advantages can be achieved in any single embodiment. Rather, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution, or beneficial effect is included in at least one embodiment. Therefore, the descriptions of technical features, technical solutions, or beneficial effects in this specification do not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions, and beneficial effects described in this embodiment can be combined in any suitable manner. Those skilled in the art will understand that embodiments can be implemented without one or more specific technical features, technical solutions, or beneficial effects of a particular embodiment. In other embodiments, additional technical features and beneficial effects may be identified in specific embodiments that do not embody all embodiments. Attached Figure Description

[0038] The accompanying drawings used in the embodiments of this application are described below.

[0039] Figure 1 This is a schematic diagram of a conventional arrangement scenario for a pinhole camera provided in an embodiment of this application;

[0040] Figure 2 This is a schematic diagram of an infrared supplementary light provided in an embodiment of this application;

[0041] Figure 3 This is a magnified schematic diagram of an infrared imaging sensor and an infrared emitting unit provided in an embodiment of this application;

[0042] Figure 4 This is a schematic diagram illustrating the effect of retroreflection provided in an embodiment of this application;

[0043] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0044] Figure 6 This is a schematic diagram of a software architecture provided in an embodiment of this application;

[0045] Figure 7 This is a schematic flowchart of a camera detection method provided in an embodiment of this application;

[0046] Figure 8 This is a schematic diagram illustrating the effect of a retroreflective light spot provided in an embodiment of this application;

[0047] Figure 9 This is a schematic diagram illustrating the effect of another retroreflective light spot provided in the embodiments of this application;

[0048] Figure 10 This is a schematic diagram of a process for filtering interference provided in an embodiment of this application;

[0049] Figure 11 This is a schematic diagram of the imaging effect of an infrared light source provided in an embodiment of this application;

[0050] Figure 12 This is a schematic diagram illustrating the display effect of a second image provided in an embodiment of this application;

[0051] Figure 13 This is a flowchart illustrating another camera detection method provided in an embodiment of this application;

[0052] Figure 14 This is a flowchart illustrating another camera detection method provided in an embodiment of this application;

[0053] Figure 15 This is a schematic diagram illustrating the alternating acquisition of a first image and a third image provided in an embodiment of this application;

[0054] Figure 16 This is a schematic diagram illustrating the indication effect of a first parameter provided in an embodiment of this application;

[0055] Figure 17 This is a schematic diagram of the structure of a camera detection device provided in an embodiment of this application. Detailed Implementation

[0056] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.

[0057] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0058] The relevant technologies involved in this application will be introduced below.

[0059] (1) Cameras with infrared fill lights (such as pinhole cameras), such as Figure 2As shown, to achieve night vision, some cameras are equipped with infrared fill lights 201. These fill lights emit relatively strong infrared light that is invisible to the human eye. After being reflected off the surface of an object, the light is received by the camera lens and sensor 202, which are capable of receiving infrared light, to achieve imaging. When the infrared fill lights of such cameras are working, although they are invisible to the naked eye, other image sensors with infrared light receiving capabilities (such as infrared cameras) can easily capture the illumination light, including some smartphone rear cameras that do not filter out all infrared wavelengths.

[0060] (2) Infrared camera. An infrared camera may or may not have ranging capability (e.g., a TOF camera). An infrared camera can be a highly integrated module that integrates an infrared imaging sensor and an infrared emitting unit. Figure 3 This is an enlarged display of the infrared imaging sensor and infrared emitting unit integrated into the infrared camera of a mobile phone. When the infrared emitting unit is not working, the infrared imaging sensor can work independently to capture existing infrared information in the environment (such as detecting infrared illumination from a pinhole camera); the infrared emitting unit can also work simultaneously with the infrared imaging sensor to actively emit infrared light to "illuminate" the surrounding environment, and the image is formed by the infrared imaging sensor after being reflected by the environment.

[0061] (3) Camera retroreflection effect, also known as cat's eye effect, occurs when commercially available cameras (such as pinhole cameras) contain an imaging prism and the lens needs to be exposed outside the hidden object to achieve imaging. For example... Figure 4 As shown, for optical structures like cameras, when illuminated by an additional light source, the lens will exhibit significant strong reflections within a certain angle range. This phenomenon is known as retroreflection or cat's-eye effect. When strongly reflected light forms an image on the image sensor, it creates a retroreflection spot, which can reveal optical lenses hidden on the surface of ordinary objects.

[0062] For example, the electronic device in this application embodiment may be a smart screen device, a smart TV (TV), a mobile phone, a tablet computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), a wearable device (such as a smartwatch, a smart bracelet), and other devices with shooting functions. This application embodiment does not impose any special restrictions on the specific form of the electronic device.

[0063] For example, taking a mobile phone as an electronic device, Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. That is, exemplary, Figure 5 The electronic device shown could be a mobile phone.

[0064] like Figure 5 As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 129, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a subscriber identification module (SIM) card interface 195, and an infrared transmitting unit 196, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, etc.

[0065] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0066] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0067] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0068] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0069] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0070] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device.

[0071] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0072] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0073] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0074] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device to display images.

[0075] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0076] USB port 130 is a USB standard compliant interface, which can be a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic devices, and can also be used for data transfer between electronic devices and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other devices, such as AR devices.

[0077] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a limitation on the structure of the electronic device. In other embodiments of this application, the electronic device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0078] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via a USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0079] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 129, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0080] The wireless communication function of electronic devices can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0081] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0082] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0083] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0084] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, frequency modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0085] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0086] Electronic devices implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0087] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than 1.

[0088] Electronic devices can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0089] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0090] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard formats such as RGB and YUV. In some embodiments, the electronic device may include one or N cameras 193, where N is a positive integer greater than 1. Optionally, the electronic device may include multiple cameras 193, among which there are infrared cameras (i.e., infrared imaging sensors) and non-infrared cameras (i.e., non-infrared imaging sensors), wherein the infrared cameras are capable of capturing infrared light and forming an image.

[0091] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device is selecting a frequency, a DSP can perform a Fourier transform on the frequency energy.

[0092] Video codecs are used to compress or decompress digital video. Electronic devices can support one or more video codecs. This allows the electronic device to play or record video in various encoded formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0093] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0094] Internal memory 129 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0095] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and double data rate synchronous dynamic random access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM). Non-volatile memory can include disk storage devices and flash memory.

[0096] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.

[0097] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0098] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0099] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0100] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.

[0101] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0102] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic devices can listen to music or make hands-free calls through the speaker 170A.

[0103] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When an electronic device answers a phone call or voice message, the receiver 170B can be brought close to the ear to hear the voice.

[0104] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C.

[0105] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0106] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

[0107] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B.

[0108] The magnetic sensor 180D includes a Hall sensor.

[0109] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices.

[0110] A distance sensor 180F is used to measure distance. Electronic devices can measure distance using infrared or laser. In some embodiments, during a shooting scene, the electronic device can utilize the distance sensor 180F to measure distance for rapid focusing.

[0111] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode.

[0112] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.

[0113] The fingerprint sensor 180H is used to collect fingerprints. Electronic devices can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, app access locks, fingerprint photography, fingerprint answering of calls, etc.

[0114] Temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy.

[0115] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of the electronic device, in a different position than display screen 194.

[0116] Button 190 includes the power button, volume buttons, etc. Button 190 can be a mechanical button or a touch button.

[0117] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback.

[0118] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0119] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.

[0120] The infrared emitting unit 196 is used to emit infrared light (also known as infrared signals). In one optional case, the infrared emitting unit 196 can alternate between being on and off according to a certain pattern, thereby enabling the infrared camera and the ordinary camera (i.e., non-infrared camera) to alternately acquire images. For example, the infrared camera acquires one frame, the ordinary camera acquires one frame, the infrared camera acquires one frame, the ordinary camera acquires one frame, and so on, to complete image acquisition. In this embodiment, the processor 110 can control the infrared emitting unit to alternate between being on and off. Alternatively, the infrared emitting unit 196 itself may be configured in hardware or software to alternate between being on and off. Of course, other mechanisms can also be used to control the infrared emitting unit 196 to alternate between being on and off; the specific method is not limited here.

[0121] The software system of electronic devices (such as mobile phones) can adopt a layered architecture, transaction-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application uses the layered architecture of the Android system as an example to illustrate the software architecture of a mobile phone. Please refer to... Figure 6 , Figure 6 This is a schematic diagram of the software architecture of the electronic device provided in the embodiments of this application.

[0122] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom: the application layer, the application framework layer (frame), the hardware abstraction layer (HAL), the driver layer, and the hardware layer.

[0123] The application layer can include a series of application packages. For example... Figure 6 As shown, the application may include applications such as a camera, gallery, and anomaly detection. The camera application can be used to capture images, for example, controlling the shooting mode, method, and timing; the gallery application can display images, such as images captured by the camera application or images acquired through other means; optionally, users can view and edit images using the gallery application; the anomaly detection application can perform anomaly analysis based on images captured (or acquired) by the camera application, for example, analyzing whether pinhole cameras exist in the shooting environment; optionally, users can control the timing and method of detection through the anomaly detection application and view the detection results; optionally, the anomaly detection application can be a standalone application or configured within the camera application as a function of the camera application.

[0124] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0125] like Figure 6 As shown, the application framework layer includes a camera access interface, providing an entry point for camera invocation and management. Additionally, the application framework layer may also include a window manager, content provider, view system, resource manager, etc.

[0126] The window manager manages window programs, including obtaining screen size, determining the presence of a status bar, locking the screen, and capturing screenshots. The content provider stores and retrieves data, making it accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, and phone books. The view system is used to construct the application's display interface. Each interface can consist of one or more controls. Generally, controls can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other interface elements. The resource management service provides applications with various resources, such as localized strings, icons, images, layout files, video files, etc.

[0127] The Hardware Abstraction Layer (HAL) is an interface layer located between the operating system kernel and the hardware circuitry, providing HALs corresponding to different application modules of electronic devices. For example... Figure 6 As shown, HAL includes, but is not limited to, the camera hardware abstraction layer (camera HAL) and algorithms that support specific functions around the camera. Of course, the algorithms mentioned here can also be deployed in other layers; deployment in the hardware abstraction layer is just one possible implementation.

[0128] The driver layer is the layer between hardware and software, and it includes drivers for various hardware components. The driver layer can include camera device drivers, digital signal processor (DSP) drivers, and image processor (IPC) drivers, among others. Specifically, camera device drivers are used to drive the image sensors of one or more cameras in a camera system to acquire images and to drive the image signal processor to preprocess the images. DSP drivers are used to drive the digital signal processor to process images. IPC drivers are used to drive the graphics processor to process images.

[0129] The hardware layer may include a camera, an image signal processor, a digital signal processor, and an image processor. The camera may include one or more image sensors (e.g., image sensor 1, image sensor 2, etc.). Optionally, the camera may also include a camera motor, a lens, a TOF sensor, etc. Optionally, embodiments of this application may include multiple cameras, including both infrared cameras (i.e., infrared cameras) and ordinary cameras (i.e., non-infrared sensors).

[0130] The following example illustrates the workflow of an electronic device's software system. Assume the "anomaly detection" function is deployed in a camera application. The system desktop can receive a user's action of opening the camera application, such as clicking the "Camera" desktop icon. In response to this user action, the system can launch the CameraUI module and display a preview interface.

[0131] The CameraUI module is responsible for the human-computer interaction of the camera application, such as controlling the preview interface and the display of its elements, and listening to and responding to user actions in the preview interface. After launching the camera application, it sends a command to launch the application by invoking the camera in the camera hardware abstraction layer, such as an infrared camera or a regular camera. The camera hardware abstraction layer sends this command to the camera device driver in the driver layer. This driver can then activate the corresponding sensors of the infrared and regular cameras, respectively, and acquire image light signals. These signals are then transmitted to an image signal processor for preprocessing, resulting in multiple preview stream image frames, including the first object. These preview stream image frames can be referred to as the raw image stream. Finally, the raw image stream is transmitted back to the hardware abstraction layer through the camera device driver.

[0132] The camera hardware abstraction layer (HAL) can send the raw image stream to the algorithm module. Based on the support of a digital signal processor (DSP) and an image processor (Image Processor), in one example, the algorithm module can invoke one or more of the following algorithms to perform anomaly detection processing on the raw image stream: strong reflection point detection algorithm, background auxiliary information extraction algorithm, conventional smooth object filtering algorithm, and high-pixel point detection algorithm. This determines the location of the target in the image, i.e., the location where a hidden camera might be present. The algorithm module sends the anomaly detection results to the HAL, and the HAL returns an image frame containing the anomaly detection results to the camera frame layer. After receiving the image frame from the HAL, the camera frame can pass the image frame to the CameraUI and display it to the user through the user interface.

[0133] The term "user interface (UI)" used in the specification, claims, and drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It facilitates the conversion between the internal form of information and a form acceptable to the user. The user interface of an application is source code written in specific computer languages ​​such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on an electronic device, ultimately presenting user-recognizable content such as images, text, and buttons. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a web page is also defined through tags or nodes in the web page source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>To define the elements and attributes of a webpage.

[0134] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an interface element such as an icon, window, or control displayed on the screen of an electronic device. The control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0135] Please see Figure 7 , Figure 7 This is a flowchart illustrating a camera detection method provided in an embodiment of this application. This method is applied to check for the presence of suspicious cameras in the environment; therefore, this camera detection algorithm can also be called an anomaly detection algorithm, and the specific name is not limited here. This method can be based on... Figure 5 , Figure 6 The electronic device shown can be implemented using the hardware and software architectures, or it can be implemented based on other architectures. The method includes, but is not limited to, the following steps:

[0136] Step S701: Emit infrared light into the area to be tested through the infrared emitting unit.

[0137] The area to be tested here is the area where the user is concerned about the presence of hidden cameras (such as pinhole cameras), such as all or part of a hotel room, bathroom, or office. The user is worried that their personal privacy information will be secretly photographed, so the area to be tested can be detected by electronic devices (such as mobile phones). The infrared emitter is one of the important components to complete the detection. The infrared emitting unit is a device that can emit infrared light. For example, after receiving the instruction to emit infrared light, the infrared emitting unit can continuously emit infrared light or intermittently emit infrared light according to a certain pattern.

[0138] Step S702: Acquire a first image of the area to be tested using an infrared imaging sensor.

[0139] In this embodiment, the infrared emitting unit emits infrared light to the area to be tested, so that the area to be tested reflects the infrared light, so that the infrared imaging sensor on the electronic device can collect the reflected light signal of the area to be tested. The reflected light signal is imaged on the infrared imaging sensor to obtain an image of the area to be tested, which can be referred to as the first image for ease of description later.

[0140] This infrared imaging sensor can continuously acquire data or intermittently acquire data according to a certain pattern. The final acquired image may be one or multiple images.

[0141] Step S703: Detect the target location in the first image where there is a retroreflection spot.

[0142] Typically, in a dark environment visible to the human eye, when an electronic device activates its infrared emitting unit, if a hidden camera (such as a pinhole camera) is present in the area being tested, it usually exhibits strong reflective properties, much stronger than the reflectivity of most walls, ceilings, furniture, etc. in the environment. The effect presented in the first image is that the location of the hidden camera appears as a retroreflective spot, while the surfaces of most objects in the environment exhibit normal diffuse reflection, causing these objects to appear as grayscale images in the first image, without any retroreflective spot. Figure 8 As shown, the white bright spot enclosed in the circle is retroreflective spot 801. Retroreflective spot 801 shows a significant contrast with the surrounding grayscale image. Therefore, the first image can be analyzed to determine if a retroreflective spot exists. If a retroreflective spot exists, there is a high probability that a hidden camera is present at the location corresponding to it; if no retroreflective spot exists, then there is essentially no hidden camera in the tested area.

[0143] For ease of description, the location in the image where retroreflected light spots appear can be called the target location. It can be understood that if multiple hidden cameras exist in the area under test, then the result shown in the first image should be the presence of multiple target locations.

[0144] There are many ways to determine the existence of retroreflected light spots. For example, if the reflected signal in a pixel region is higher than the reflected signal of the adjacent pixels in the same pixel region and the difference is greater than a second threshold, then the pixel region is the target location. Here, the second threshold is a pre-set reference value that reflects a large difference in the reflected signals (for example, a large reflected signal can be specifically manifested as a large pixel value). This second threshold can be set based on experience and scene requirements, or it can be trained through model training.

[0145] In one alternative approach, the area to be tested may contain objects with smooth surfaces (e.g., door handles, mirrors, screens, faucets, and other metal or glass products). These surfaces have strong reflective properties, and the infrared light they emit will appear as retroreflective spots on the infrared imaging sensor. This can lead to the object being mistaken for a hidden camera, interfering with its detection. However, there are still differences in characteristics between hidden cameras and smooth interfering objects, specifically: objects in two temporally close (e.g., adjacent) first images are not entirely identical, but some objects are the same, such as objects A and B. Although the positions of the same objects differ in two adjacent first images, their positions in the objective scene of the area to be tested are the same. For any first image, the position of a specific object in the area to be tested can be determined by combining its background information. Furthermore, for the same object, the position in the area to be tested is the same when determined by the background information of different first images. Based on this characteristic, it can be determined that for the same hidden camera, its position in the area to be tested is the same when identified by the background information in different first images. Figure 9 As shown, Figure 9 911 and in part (a) Figure 9 In part (b), 921 refers to the camera position, and both positions are the same in the area to be tested. However, objects with smooth surfaces in the area to be tested are different, such as a mirror. In different first images, due to the different shooting angles of the first images, the reflection position on the mirror surface is different. Therefore, the position of the mirror in the area to be tested, determined by the background information of different first images, is also different. Figure 9 As shown, Figure 9 912 and in part (a) Figure 9 In part (b), 922 represents the position of a smooth object, and the effect of the two positions is different in the area to be tested.

[0146] To this end, this application also provides a method for determining the target location in a first image, which can filter out interference caused by the smoothness of the object surface and reduce false detections. For example, high-intensity reflection points (i.e., retroreflection spots) in each of multiple first images are detected, and then a temporal model is constructed by combining the background information of each first image to achieve the filtering of conventional smooth objects, and output the coordinates of the remaining suspicious lenses (such as the location of a hidden camera). Figure 10 As shown, an active detection algorithm can be introduced to detect cameras. This active detection algorithm includes a strong reflection point detection model, a background auxiliary information extraction model, and a conventional smooth object filtering model. Multiple first images (i.e., an infrared image sequence) are input into this active detection algorithm. The strong reflection point detection model detects strong reflection points, and the background auxiliary information extraction model extracts the background information of each first image. Then, the conventional smooth object filtering model filters out the lens coordinates based on the information of the strong reflection points and the background information. The strong reflection point detection model can employ several detection neural network models (such as the YOLO series), and the background auxiliary information extraction model can include, but is not limited to, algorithms such as contour extraction, corner detection, and optical flow. This solution does not impose specific limitations.

[0147] To make it easier to understand, the following example illustrates the process of filtering a typical smooth object:

[0148] First, identify multiple first positions of retroreflective cursors in multiple first images. These multiple first images are taken from different angles, and the number of first positions in each first image is greater than or equal to 0. It can be understood that the user takes multiple first images of the area to be tested by adjusting the shooting angle of the electronic device and using an infrared sensor. This shooting angle can change gradually, and the shooting timestamp also changes gradually. Therefore, some objects are the same in any two first images that are adjacent in time.

[0149] Then, the target location is determined from the plurality of first locations based on the background information of the plurality of first images. The background information of the first images is used to determine the relative position of the first location in the first image within the area to be tested. This background information reflects the relative positional relationships between objects in the first image, thus enabling the determination of the position of any object in the first image within the area to be tested. For example, if the relative position of a first location in a first image within the area to be tested is the same as the relative position of a first location in other first images within the area to be tested, then the first location in the first image can be identified as having a hidden camera. If the relative position of a first location in a first image within the area to be tested is different from the relative position of a first location in other first images within the area to be tested, then the first location in the first image contains an object with a smooth surface. Based on this principle, the principle for determining the target location is: if the relative position of a first location in a first image within the area to be tested is the same as the relative position of a first location in other first images within the area to be tested, then the first location in the first image is the target location.

[0150] Optionally, the other first image and the first image may or may not be adjacent; generally, they need to have some common objects between them.

[0151] In this embodiment of the application, the method of detecting hidden cameras by analyzing retroreflected light spots can be referred to as "active detection". The active detection mode can theoretically be applied to all hidden cameras. It does not require the hidden camera to be emitting infrared light, but it requires the electronic device to enable the infrared emitting unit to provide additional infrared illumination.

[0152] Step S704: Acquire a third image of the area to be tested using an infrared imaging sensor.

[0153] Often, if a hidden camera is present in the area to be tested, it is highly likely to emit infrared light into the environment. This infrared light, after being emitted and reflected back into the environment, will form an image on the hidden camera, allowing it to capture content within the environment. This application utilizes the characteristic that a hidden camera may emit infrared light into the environment to detect the presence of a hidden camera in the area to be tested. Specifically, an image of the area to be tested is first acquired using an infrared imaging sensor, and then analyzed to determine the presence of a hidden camera. For ease of description, this image can be referred to as the third image.

[0154] This infrared imaging sensor can continuously acquire data or intermittently acquire data according to a certain pattern. The final acquired third image may be one or multiple images.

[0155] Step S705: Detect the target location in the third image where an infrared light source exists.

[0156] In environments where the human eye can see complete darkness (such as a normal living room), no active infrared device typically operates continuously, meaning there should be no near-infrared light in the environment. Therefore, when observing and photographing this environment using an infrared imaging sensor (or infrared camera) with its infrared emitting unit disabled, the image should also be nearly completely black. If an infrared emitting unit is emitting infrared light at this time (for example, the infrared fill light from a pinhole camera is working), then that infrared emitting unit will appear as a very conspicuous high-pixel image in the third image, such as... Figure 11 As shown, when an infrared fill light 1101 of a device (right side) is photographed by an infrared imaging sensor, the imaging effect of the infrared fill light 1101 on the infrared imaging sensor is a bright, high-resolution image 1102. Therefore, based on this characteristic, it is easy to find the infrared light source by analyzing the third image. For ease of description, the location in the image where the infrared light source exists can be called the target location. It can be understood that if there are multiple hidden cameras in the area to be measured, then the result shown in the third image should be the presence of multiple target locations.

[0157] In practical implementation, methods such as threshold segmentation and edge detection can be used to detect and locate the target position of the infrared light source from the third image. This application does not specifically limit the algorithm for detecting the target position of the infrared light source. For ease of understanding, a method for determining the target position is provided below: In the third image, if the pixel value in a pixel region is higher than the pixel values ​​of its adjacent pixels and the difference is greater than a first threshold, then the pixel region is the target position. Here, the first threshold is a pre-set reference value that reflects a large difference in pixel values. This first threshold can be set based on experience and scene requirements, or it can be obtained through model training.

[0158] In this embodiment, the hidden camera is detected by detecting the position of the infrared light source, which can be referred to as "passive detection". Passive detection has a low false detection rate and is less affected by interference. Compared with the common method of using the rear camera of a smartphone for observation, the infrared imaging sensor in this embodiment is designed to capture infrared light, so there is no need to add a filter to filter out the light of the required wavelength. Therefore, it can respond more clearly to the infrared fill light of the hidden camera and is less likely to miss it.

[0159] Step S706: Output the second image.

[0160] The second image is an image in which a prompt message is marked on the image of the target location. The prompt message is used to indicate the presence of a camera at the target location. The prompt message can be in the form of text, image, language, or special markings (such as colors, boxes, arrows, etc.), and the specific prompting method is not limited here.

[0161] For example, such as Figure 12 As shown, the second image contains a target location 1501, and the user is informed of the presence of a camera at the target location 1501 through a gesture 1502 (i.e., indication information).

[0162] In this application embodiment, there are many ways to output (e.g., display) the second image, and examples are given below.

[0163] Method 1: During the acquisition of the first image and / or the third image, the second image is output. That is to say, while the user is scanning the area to be tested, the electronic device generates and feeds back the detection results based on the acquired images in real time or near real time. Optionally, this approach is more suitable for infrared imaging sensor lenses (such as infrared cameras or TOF cameras) compared to electronic devices with a display screen behind them. Its advantage is that the interaction between the user and the electronic device is more intuitive.

[0164] Method 2: After completing the acquisition of the first image and / or the third image, output the second image. That is, the detection results are fed back to the user after the entire area to be scanned has been scanned. The advantage of this method is that it can be well applied to electronic devices in front of infrared imaging sensors (such as TOF cameras). Since it is inconvenient for users to view the screen of electronic devices during scanning, the overall analysis and feedback of detection results are only provided after the entire scan is completed.

[0165] In one case, if the target location is detected by the "active detection" method described in steps S701-S703, then the second image can be an image in which the first image containing the target location is marked with a prompt.

[0166] In another case, if the target location is detected by the "passive detection" method described in steps S704-S705, then the second image can be an image in which the prompt information is marked in the third image where the target location is located.

[0167] In another case, if the target location is detected using the "passive detection" method described in steps S704-S705, the target location in the third image can be mapped to the adjacent first image in terms of timestamp. The relative position of the target location in the test area before mapping is the same as the relative position of the target location in the test area after mapping. In this case, the second image is specifically the image to which the target location is mapped, marked with a prompt message. The rationale for this approach is that, since the surrounding image is completely black, it is not easy for the user to accurately locate the abnormal target location in the test area. Specifically, the user can see the target location in the third image, but it is difficult to determine which location in the test area corresponds to the target location (because the surrounding images of the target location are completely black, making it difficult to form a good reference). Therefore, the corresponding location can be circled based on the adjacent actively detected image (i.e., the first image with the infrared emitting unit activated), facilitating localization.

[0168] Regarding the active detection methods described in steps S701-S703 and the passive detection methods described in steps S704-S705, they can be executed in combination, or only one of them can be executed. If these two detection methods are executed in combination, there can be many possible execution times. For ease of understanding, examples are given below:

[0169] Scenario 1: First, perform the active detection steps S701-S703. If the obtained first image does not contain a target location with a retroreflective spot, then perform the passive detection steps S704-S705. If the obtained first image contains a target location with a retroreflective spot, then the passive detection steps S704-S705 are not performed. The corresponding process is as follows: Figure 13 As shown.

[0170] Scenario 2: First, perform passive detection in steps S704-S705. If the obtained third image does not contain a target location with an infrared light source, then perform active detection in steps S701-S703. If the obtained third image contains a target location with an infrared light source, then perform active detection in steps S701-S703 without executing them. The corresponding process is as follows: Figure 14 As shown.

[0171] Scenario 3: Both the passive detection in steps S704-S705 and the active detection in steps S701-S703 are executed, with no specific order required. The detection results from both methods are then summarized. There are many ways to summarize the results; examples are provided below:

[0172] Case 1: The union of the two results is taken, that is, the target location obtained by active detection and the target location obtained by passive detection are both counted as the final target location, and the camera is identified at the target location.

[0173] Case 2: The intersection of the two results is taken. That is, if a location is identified as a target location by both active and passive detection, then the location is identified as the real target location, and a camera is identified at the target location.

[0174] In another alternative approach, the acquisition methods for the first and third images described above can also be varied, for example:

[0175] The method involves acquiring a first image of the area to be measured using an infrared imaging sensor, including continuously acquiring multiple first images of the area to be measured by the infrared imaging sensor while changing the acquisition angle, with the acquisition timestamps of the multiple first images being different.

[0176] The method involves acquiring a third image of the area under test using an infrared imaging sensor, including continuously acquiring multiple third images of the area under test by changing the acquisition angle of the infrared imaging sensor, with different timestamps for the acquisition of the multiple third images.

[0177] Optionally, the first and third images are acquired alternately in time. After the detection function of the electronic device is activated, the infrared emitting unit alternates between on and off. The user holds the electronic device and scans the entire suspected test area, while the corresponding infrared imaging sensor (e.g., a TOF camera) on the electronic device continuously acquires (collects) images (e.g., 20 frames per second). Figure 15 As shown, frame t is acquired with the infrared emitting unit enabled, frame t+1 is acquired without the infrared emitting unit enabled, frame t+2 is acquired with the infrared emitting unit enabled, frame t+3 is acquired without the infrared emitting unit enabled, and so on. The image captured with the infrared emitting unit enabled is the first image, used for active detection, while the image captured with the infrared emitting unit disabled is the third image, used for passive detection. This method allows users to perform only one continuous scene scan on a suspected test area, eliminating the need for separate scans for active and passive detection. This reduces manual workload and improves the convenience and efficiency of scanning (image acquisition).

[0178] In another alternative implementation, during the acquisition of the first image and / or the third image, a first parameter can be generated based on depth information in the acquired images (e.g., depth information acquired by a TOF camera), wherein the first parameter represents the desired distance between the electronic device and the surface of the object in the area to be measured; then the first parameter is output (e.g., displayed), and the output of the first parameter can be in the form of text, images, voice, etc., to remind the user to adjust the shooting distance or position, for example, as... Figure 16 As shown, the first parameter is 1601. Alternatively, the first parameter can be omitted, and the user can be directly prompted to adjust the distance or position based on it. This approach can improve scene scanning quality and reduce missed detections.

[0179] In another alternative implementation, during the acquisition of the first and / or third images, a second parameter can be generated based on the parameters of the electronic device's accelerometer and / or gyroscope, wherein the second parameter represents the desired acquisition angle and / or speed; then, the second parameter is output (e.g., displayed). The second parameter can be output in the form of text, images, voice, etc., to remind the user to adjust the shooting angle and / or speed; alternatively, the second parameter can be omitted, and the user can be directly reminded to adjust the angle or speed based on the second parameter. This approach can improve scene scanning quality and reduce missed detections.

[0180] exist Figure 7 The method described above utilizes an infrared emitting unit to actively emit infrared light, creating a retroreflection effect. This allows for the proactive detection of hidden cameras in the test area that are not using infrared illumination. Furthermore, since the light actively emitted into the environment is infrared, interference from natural light is significantly reduced, improving the accuracy of the detection results. Additionally, the entire detection process requires minimal user intervention, exhibiting a high degree of automation and ease of operation.

[0181] The methods of the embodiments of this application have been described in detail above, and the apparatus of the embodiments of this application is provided below.

[0182] Please see Figure 17 , Figure 17 This is a schematic diagram of a camera detection device provided in an embodiment of this application. The device may be the electronic device mentioned above or a component in the electronic device. The device may include a transmitting unit 1701, a acquiring unit 1702, a first detection unit 1703 and a first output unit 1704, wherein each unit is described in detail below.

[0183] The transmitting unit 1701 is used to emit infrared light into the area to be measured through the infrared transmitting unit;

[0184] Acquisition unit 1702 is used to acquire a first image of the area to be measured through an infrared imaging sensor;

[0185] The first detection unit 1703 is used to detect the target location in the first image where there is a retroreflection spot.

[0186] The first output unit 1704 is used to output a second image, wherein the second image is an image in which a prompt message is marked in the image where the target location is located, and the prompt message is used to indicate that a camera exists at the target location.

[0187] This method, by introducing an infrared emitting unit to actively emit infrared light and constructing a retroreflection effect, can actively detect hidden cameras in the test area that have not activated infrared supplementary lighting. Furthermore, because the light actively emitted into the environment in this solution is infrared, interference from natural light is significantly reduced, improving the accuracy of the detection results. In addition, the entire detection process requires minimal user intervention, exhibiting a high degree of automation and simple operation.

[0188] In one possible implementation, the device further includes:

[0189] The acquisition unit 1702 is also used to acquire a third image of the area to be measured by an infrared imaging sensor. The third image is acquired when the infrared emitting unit does not emit infrared light, while the first image is acquired when the infrared emitting unit emits infrared light.

[0190] The second detection unit is used to detect the target location in the third image where an infrared light source exists.

[0191] This method also introduces a passive detection method (the method of not actively emitting infrared light). This passive detection method can quickly and accurately detect pinhole cameras with supplementary lighting. Although the passive detection method cannot perform well in scenarios where the infrared supplementary lighting of the hidden camera is not turned on, the aforementioned active detection method (i.e., actively emitting infrared light) makes up for this deficiency. The combination of active detection and passive detection not only ensures detection speed and accuracy, but also makes it applicable to all scenarios.

[0192] In another possible implementation, if there is no target location with an infrared light source in the third image, then the operation of detecting the target location with retroreflective light spots in the first image is performed. It is understood that if one detection method (active detection or passive inspection) can detect a result, the other detection method is not activated, which effectively saves power consumption.

[0193] In another possible implementation, if no target location with retroreflected light spots exists in the first image, then the operation of detecting the target location with an infrared light source in the third image is performed. It is understood that if one detection method (active detection or passive inspection) can detect a result, the other detection method is not activated, effectively saving power consumption.

[0194] In another possible implementation, regarding the acquisition of a first image of the area to be tested using an infrared imaging sensor, the acquisition unit is specifically configured to: continuously acquire multiple first images of the area to be tested using an infrared imaging sensor while changing the acquisition angle, wherein the timestamps of the multiple first images are different; the acquisition of a third image of the area to be tested using an infrared imaging sensor includes: continuously acquiring multiple third images of the area to be tested using an infrared imaging sensor while changing the acquisition angle, wherein the timestamps of the multiple third images are different; wherein the first image and the third image are acquired alternately in time.

[0195] This approach allows users to perform a single continuous scene scan on a suspected area to be tested, eliminating the need for separate scans for active and passive detection. This can potentially reduce the user's workload and improve the convenience and efficiency of scanning (image acquisition).

[0196] In yet another possible implementation, the device further includes:

[0197] The second output unit is used to generate a first parameter based on the depth information in the acquired images during the process of alternately acquiring the first image and the third image, wherein the first parameter represents the expected distance between the electronic device and the surface of the object in the area to be measured; and output the first parameter.

[0198] This method can promptly remind users to adjust the scanning distance, improve scene scanning quality, and reduce missed detections.

[0199] In yet another possible implementation, the device further includes:

[0200] The third output unit is used to generate a second parameter based on the parameters of the accelerometer and / or gyroscope of the electronic device during the alternating acquisition of the first image and the third image, wherein the second parameter represents the desired acquisition angle and / or speed; and output the second parameter.

[0201] This method can promptly remind users to adjust the scanning speed or angle, improving scene scanning quality and reducing missed detections.

[0202] In another possible implementation, regarding the output of the second image, the first output unit is specifically used to output the second image during the alternating acquisition of the first image and the third image. Using this method, the feedback of the detection results is more timely, and the interaction between the user and the electronic device is more intuitive.

[0203] In another possible implementation, regarding the output of the second image, the first output unit is specifically used to output the second image after the acquisition of the first and third images is completed. This method allows for the output of all results at once, facilitating unified processing by the user.

[0204] In another possible implementation, in the third image, if the pixel value in a pixel region is higher than the pixel value of the adjacent pixel in the pixel region and the difference is greater than a first threshold, then the pixel region is the target location.

[0205] In another possible implementation, the first image is an image formed on an infrared imaging sensor after the infrared light emitted by the infrared emitting unit is reflected by the area to be tested. In the first image, if the reflected signal in a pixel area is higher than the reflected signal of the adjacent pixels in the pixel area and the difference is greater than a second threshold, then the pixel area is the target location.

[0206] In another possible implementation, regarding the detection of the target location where a retroreflected light spot exists in the first image, the first detection unit is specifically used for:

[0207] Multiple first positions of retroreflected cursors are determined in multiple first images, wherein the multiple first images are captured from different angles, and the number of first positions in each first image is greater than or equal to 0;

[0208] The target location is determined from the plurality of first locations based on the background information of the plurality of first images. The background information of the first images is used to determine the relative position of the first location in the first image in the area to be tested. If the relative position of the first location in one first image in the area to be tested is the same as the relative position of the first location in other first images in the area to be tested, then the first location in the first image is the target location.

[0209] This method can filter out interference caused by the smoothness of the object's surface, reduce false detections, and improve detection capabilities.

[0210] In another possible implementation, if the target location is detected from the third image, the method further includes:

[0211] The target location in the third image is mapped to a first image that is adjacent in timestamp, wherein the relative position of the target location in the area to be tested before mapping is the same as the relative position of the target location in the area to be tested after mapping; the second image is specifically an image in which the target location is mapped to be marked with prompt information.

[0212] It is understandable that, since the environment image is completely black, it is not easy for users to accurately find the location of the abnormal target in the test area. Specifically, users can see which position the target is in the third image, but it is not easy to determine which position in the test area the target position corresponds to (because the surrounding images of the target position are completely black, and a good reference cannot be formed). Therefore, the corresponding position can be circled in the adjacent active detection image (i.e. the first image with the infrared emitting unit turned on) to facilitate positioning.

[0213] It should be noted that the implementation of each unit can also be referenced accordingly. Figure 7 The corresponding description of the method embodiments shown.

[0214] It should be understood that the steps in the above-described method embodiments provided in this application can be implemented by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.

[0215] This application also provides an electronic device that may include a memory and a processor. The memory may be used to store a computer program; the processor may be used to invoke the computer program in the memory to cause the electronic device to perform all or part of the steps in any of the above method embodiments (e.g., when multiple devices or modules interact, executing the steps corresponding to one of the devices or the predicted module). Optionally, one possible implementation of the memory and processor is as described above in the electronic device.

[0216] This application also provides a chip system including at least one processor for implementing the functions involved in the methods performed by the electronic device in any of the above embodiments.

[0217] In one possible design, the chip system also includes a memory for storing program instructions and data, which may be located within or outside the processor.

[0218] The chip system can consist of chips or include chips and other discrete components.

[0219] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0220] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0221] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0222] This application also provides a computer program product comprising: a computer program (also referred to as code or instructions) that, when run, causes a computer to perform the method executed by the electronic device in any of the above embodiments.

[0223] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it causes the computer to perform the method executed by the electronic device in any of the above embodiments.

[0224] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0225] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive).

[0226] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0227] In summary, the above description is merely an embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made based on the disclosure of this application should be included within the scope of protection of this application.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A camera detection method, characterized in that, The method is applied to an electronic device, and the method comprises: emitting infrared light into a to-be-measured region by an infrared emission unit; continuously collecting a plurality of first images of the to-be-measured region in a process of changing a collection angle by an infrared imaging sensor, the plurality of first images being collected at different time stamps; detecting a target position at which a retroreflected light spot exists in the first images; continuously collecting a plurality of third images of the to-be-measured region in a process of changing a collection angle by the infrared imaging sensor, the plurality of third images being collected at different time stamps, the third images being collected in a case where the infrared emission unit does not emit infrared light, the first images being collected in a case where the infrared emission unit emits infrared light, the first images and the third images being collected alternately in time; detecting a target position at which an infrared light source exists in the third images; outputting a second image, wherein the second image is an image in which prompt information is marked in an image in which the target position is located, and the prompt information is used to prompt that the target position exists a camera; the detecting the target position at which the retroreflected light spot exists in the first images comprises: determining a plurality of first positions at which retroreflected light spots exist in the plurality of first images, wherein the plurality of first images are collected at different angles, and the number of the first positions in each first image is greater than or equal to 0; determining a target position from the plurality of first positions according to background information of the plurality of first images, wherein the background information of the first images is used to determine the relative positions of the first positions in the to-be-measured region in the first images, and if the relative position of a first position in one first image in the to-be-measured region is the same as the relative positions of the first positions in other first images in the to-be-measured region, the first position in the one first image is the target position.

2. The method of claim 1, wherein, If there is no target position at which the infrared light source exists in the third images, the operation of detecting the target position at which the retroreflected light spot exists in the first images is performed.

3. The method of claim 1, wherein, If there is no target position at which the retroreflected light spot exists in the first images, the operation of detecting the target position at which the infrared light source exists in the third images is performed.

4. The method according to any one of claims 1 to 3, characterized in that, Further comprising: generating a first parameter according to depth information in the collected images in a process of alternately collecting the first images and the third images, wherein the first parameter represents a distance expected between the electronic device and an object surface of the to-be-measured region; outputting the first parameter.

5. The method according to any one of claims 1 to 3, characterized in that, Further comprising: generating a second parameter according to parameters of an accelerometer and / or a gyroscope of the electronic device in a process of alternately collecting the first images and the third images, wherein the second parameter represents a collection angle and / or a speed expected to be collected; outputting the second parameter.

6. The method according to any one of claims 1 to 3, characterized in that, The outputting the second image comprises: outputting a second image in a process of alternately collecting the first images and the third images.

7. The method according to any one of claims 1 to 3, characterized in that, The outputting the second image comprises: outputting a second image after ending the collection of the first images and the third images.

8. The method according to any one of claims 1 to 3, characterized in that, In the third image, if a pixel region has a pixel value higher than that of a pixel point adjacent to the pixel region and the difference is greater than a first threshold, the pixel region is a target position.

9. The method according to any one of claims 1 to 3, characterized in that, The first image is an image of infrared light emitted by the infrared emitting unit and reflected by the to-be-measured region on an infrared imaging sensor. In the first image, if a pixel region has a reflected light signal higher than that of a pixel point adjacent to the pixel region and the difference is greater than a second threshold, the pixel region is a target position.

10. The method according to any one of claims 1 to 3, characterized in that, If a target position is detected from the third image, the method further includes: mapping the target position in the third image to a first image adjacent in time stamp, wherein the relative position of the target position in the to-be-measured region before mapping is the same as the relative position of the target position in the to-be-measured region after mapping; and the second image is specifically an image in which prompt information is marked in the image to which the target position is mapped.

11. An electronic device, comprising: The electronic device includes one or more processors, a memory, wherein the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors invoke the computer instructions to enable the electronic device to perform the method of any one of claims 1-10.

12. A chip system, characterized by The chip system is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to invoke computer instructions to enable the electronic device to perform the method of any one of claims 1-10.

13. A computer program product comprising instructions, characterized in that, When the computer program product runs on the electronic device, the electronic device performs the method of any one of claims 1-10.

14. A computer-readable storage medium comprising instructions, wherein: When the instructions run on the electronic device, the electronic device performs the method of any one of claims 1-10.

Images