Stroboscopic detection method, apparatus and medium
By utilizing an under-screen light sensor for frequency domain transformation and filtering on electronic devices, the stability and cost issues of flicker detection are resolved, achieving efficient and reliable flicker detection and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BEIJING XIAOMI MOBILE SOFTWARE CO LTD
- Filing Date
- 2021-09-24
- Publication Date
- 2026-07-10
AI Technical Summary
In existing technologies, flicker effect detection is prone to failure due to terminal movement or the need for a dedicated brightness sensor, leading to unstable detection and increased production costs.
By using an under-screen light sensor on an electronic device to acquire sampling signals, and through frequency domain transformation and filtering, the ambient light AC component information is determined to determine whether a flicker effect exists.
This technology enables flicker detection when the screen of an electronic device is lit, improving the reliability of the detection results and the user experience, simplifying the production process, and avoiding additional hardware costs.
Smart Images

Figure CN115855446B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of terminal technology, and in particular to flicker detection methods, devices and media. Background Technology
[0002] Civilian power supply systems typically use 50Hz or 60Hz alternating current (AC). If an artificial light source does not convert this AC to DC, then the artificial light source is an alternating flickering light source with a frequency of 100Hz or 120Hz. In a terminal imaging system, if imaging is based on this alternating flickering light source, the user will see alternating bright and dark stripes when previewing or taking pictures; this phenomenon is called stroboscopic effect.
[0003] In related technologies, flicker effects are mainly detected in two ways: one method requires flicker detection to begin after the camera outputs content, and this method is prone to failure due to terminal movement. The other method requires installing a dedicated brightness sensor near the camera for flicker detection. Summary of the Invention
[0004] To overcome the problems existing in related technologies, this disclosure provides a flicker detection method, apparatus and medium.
[0005] According to a first aspect of the present disclosure, a flicker detection method is provided, the method comprising:
[0006] Acquire the sampling signal from the under-screen light sensor installed on the electronic device;
[0007] The sampled signal is transformed in the frequency domain to obtain multiple frequency domain components corresponding to the sampled signal;
[0008] Based on the frequency domain components, it is determined that the sampled signal includes ambient light AC component information;
[0009] If it is determined that the sampled signal includes the ambient light AC component information, then it is determined that the electronic device has a flicker effect.
[0010] Optionally, based on the frequency domain components, determining that the sampled signal includes ambient light AC component information includes:
[0011] Determine the frequency value corresponding to each frequency domain component;
[0012] The frequency values are filtered to remove ambient light DC component information and screen backlight component information from the sampled signal;
[0013] If there are frequency values that have not been filtered out, then the sampled signal is determined to include the ambient light AC component information.
[0014] Optionally, filtering the frequency value includes:
[0015] Based on the frequency domain component threshold and the screen refresh rate, filter out the frequency values corresponding to frequency domain components that are less than the frequency domain component threshold, as well as the frequency values that are multiples of the screen refresh rate.
[0016] Optionally, the frequency domain component threshold is determined based on the average value of the frequency domain components.
[0017] Optionally, determining the frequency value corresponding to each of the frequency domain components includes:
[0018] The frequency value corresponding to each frequency domain component is determined based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampling signals included in the sampling signal.
[0019] Optionally, determining the frequency value corresponding to each frequency domain component based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampled signals included in the sampled signal includes:
[0020] The frequency value corresponding to each frequency domain component is determined by the following formula:
[0021]
[0022] Where f(k) is the frequency value corresponding to the k-th frequency domain component X(k), f s The sampling frequency is N, the total number of sampled signals is N, and the value of k ranges from 0 to N-1.
[0023] Optionally, the step of performing a frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal includes:
[0024] Perform a Discrete Fourier Transform on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal.
[0025] According to a second aspect of the present disclosure, a flicker detection device is provided, the device comprising:
[0026] The acquisition module is configured to acquire the sampling signal of the under-screen light sensor installed on the electronic device;
[0027] The first determining module is configured to perform frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal;
[0028] The second determining module is configured to determine, based on the frequency domain components, that the sampled signal includes ambient light AC component information;
[0029] The third determining module is configured to determine that the electronic device has a flicker effect if it is determined that the sampled signal includes the ambient light AC component information.
[0030] Optionally, the second determining module includes:
[0031] The first determining submodule is configured to determine the frequency value corresponding to each of the frequency domain components;
[0032] The filtering submodule is configured to filter the frequency values to remove ambient light DC component information and screen backlight component information from the sampled signal.
[0033] The second determining submodule is configured to determine that the sampled signal includes the ambient light AC component information if there are frequency values that have not been filtered out.
[0034] Optionally, the filtering submodule is configured to filter the frequency values in the following manner:
[0035] Based on the frequency domain component threshold and the screen refresh rate, filter out the frequency values corresponding to frequency domain components that are less than the frequency domain component threshold, as well as the frequency values that are multiples of the screen refresh rate.
[0036] Optionally, the frequency domain component threshold in the filtering submodule is determined based on the average value of the frequency domain components.
[0037] Optionally, the first determining submodule is configured to determine the frequency value corresponding to each frequency domain component in the following manner:
[0038] The frequency value corresponding to each frequency domain component is determined based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampling signals included in the sampling signal.
[0039] Optionally, the first determining submodule is configured to determine the frequency value corresponding to each frequency domain component using the following formula:
[0040]
[0041] Where f(k) is the frequency value corresponding to the k-th frequency domain component X(k), f s The sampling frequency is N, the total number of sampled signals is N, and the value of k ranges from 0 to N-1.
[0042] Optionally, the first determining module is configured to perform a frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal in the following manner:
[0043] Perform a Discrete Fourier Transform on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal.
[0044] According to a third aspect of the present disclosure, a flicker detection device is provided, comprising:
[0045] processor;
[0046] Memory used to store processor-executable instructions;
[0047] The processor is configured as follows:
[0048] Acquire the sampling signal from the under-display light sensor installed on the electronic device;
[0049] The sampled signal is transformed in the frequency domain to obtain multiple frequency domain components corresponding to the sampled signal;
[0050] Based on the frequency domain components, it is determined that the sampled signal includes ambient light AC component information;
[0051] If it is determined that the sampled signal includes the ambient light AC component information, then it is determined that the electronic device has a flicker effect.
[0052] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, having stored thereon computer program instructions that, when executed by a processor, implement the steps of the flicker detection method provided in the first aspect of the present disclosure.
[0053] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0054] The above technical solution acquires the sampling signal from the under-display light sensor on the electronic device; performs frequency domain transformation on the sampling signal to obtain multiple frequency domain components corresponding to the sampling signal; based on the frequency domain components, it is determined that the sampling signal includes ambient light AC component information; if it is determined that the sampling signal includes ambient light AC component information, then it is determined that the electronic device has a flicker effect. Thus, by acquiring the sampling signal through the under-display light sensor on the electronic device, flicker detection can be performed when the screen of the electronic device is lit. By detecting the presence of a flicker effect, appropriate measures can be taken in a timely manner to eliminate it when it is determined to exist, preventing users from seeing alternating bright and dark stripes in the preview image. It also avoids the influence of shaking of the electronic device on the detection results, improving the user experience and the reliability of the flicker detection results. Furthermore, using the existing under-display light sensor of the electronic device eliminates the need for a dedicated brightness sensor near the camera of the electronic device, simplifying the production process.
[0055] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0056] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0057] Figure 1 This is a flowchart illustrating a flicker detection method according to an exemplary embodiment;
[0058] Figure 2 This is a schematic diagram illustrating the positional relationship between a glass, a screen, a screen backlight, and an under-screen light sensor according to an exemplary embodiment;
[0059] Figure 3 It is a spectral coordinate diagram established based on frequency domain components and frequency values, according to an exemplary embodiment;
[0060] Figure 4 This is a block diagram illustrating a flicker detection device according to an exemplary embodiment;
[0061] Figure 5 This is a block diagram illustrating a flicker detection device according to an exemplary embodiment. Detailed Implementation
[0062] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0063] Figure 1 This is a flowchart illustrating a flicker detection method according to an exemplary embodiment. The method can be applied to a terminal, which may be an electronic device with a screen and imaging system, such as a mobile phone or tablet computer. Figure 2 This is a schematic diagram illustrating the positional relationship between a glass, a screen, a screen backlight, and an under-screen light sensor according to an exemplary embodiment, in conjunction with... Figure 2 ,right Figure 1 The method shown will be explained. For example... Figure 1 As shown, the method may include steps S101 to S104.
[0064] In step S101, the sampling signal of the under-screen light sensor installed on the electronic device is acquired.
[0065] For example, in related technologies, electronic devices typically incorporate under-display light sensors to detect ambient brightness and adjust screen brightness accordingly. These sensors usually have a high sampling frequency, generally above 500Hz, which meets the requirements for flicker detection. Therefore, in this embodiment, the existing under-display light sensor in the electronic device can be used, eliminating the need for additional hardware and simplifying the production process.
[0066] The sampled signal may include ambient light DC component information, ambient light AC component information, and screen backlight component information. For example... Figure 2 As shown, the under-display light sensor is located inside the electronic device and below the screen backlight. The screen backlight is the light source below the screen of the electronic device. When the user uses the electronic device, some of the light emitted by the screen backlight will be reflected by the glass above the screen, producing reflected light. Ambient light and reflected light will pass through the screen. At this time, the under-display light sensor collects the sampling signal.
[0067] In step S102, the sampled signal is transformed in the frequency domain to obtain multiple frequency domain components corresponding to the sampled signal.
[0068] In step S103, based on the frequency domain components, it is determined that the sampled signal includes ambient light AC component information.
[0069] For example, the ambient light DC component information and ambient light AC component information included in the sampling signal come from ambient light sources, while the screen backlight component information comes from the screen backlight. The flicker effect occurs because the environment in which the electronic device is located contains AC light sources; that is, the ambient light AC component information causes the flicker effect, while the ambient light DC component information and screen backlight component information do not. Based on the frequency domain components, it can be determined that the sampling signal includes ambient light AC component information, thereby determining whether the electronic device exhibits a flicker effect in the current environment. For example, a filtering operation can be performed based on the frequency domain components to determine whether the sampling signal includes ambient light AC component information. For example, the ambient light DC component information and screen backlight component information in the sampling signal can be filtered based on the frequency domain components to determine whether the sampling signal includes ambient light AC component information.
[0070] In step S104, if it is determined that the sampled signal includes ambient light AC component information, then it is determined that the electronic device has a flicker effect.
[0071] For example, if it is determined that the sampled signal includes ambient light AC component information, it can be determined that the electronic device has a flicker effect. In this case, measures can be taken to eliminate the impact of the flicker effect to improve the user experience. Conversely, if it is determined that the sampled signal does not include ambient light AC component information, it can be determined that the electronic device does not have a flicker effect. In this case, it is not necessary to take measures to eliminate the flicker effect to reduce the energy consumption of the electronic device.
[0072] The above technical solution acquires the sampling signal from the under-display light sensor on the electronic device; performs frequency domain transformation on the sampling signal to obtain multiple frequency domain components corresponding to the sampling signal; based on the frequency domain components, it is determined that the sampling signal includes ambient light AC component information; if it is determined that the sampling signal includes ambient light AC component information, then it is determined that the electronic device has a flicker effect. Thus, by acquiring the sampling signal through the under-display light sensor on the electronic device, flicker detection can be performed when the screen of the electronic device is lit. By detecting the presence of a flicker effect, appropriate measures can be taken in a timely manner to eliminate it when it is determined to exist, preventing users from seeing alternating bright and dark stripes in the preview image. It also avoids the influence of shaking of the electronic device on the detection results, improving the user experience and the reliability of the flicker detection results. Furthermore, using the existing under-display light sensor of the electronic device eliminates the need for a dedicated brightness sensor near the camera of the electronic device, simplifying the production process.
[0073] Optionally, step S102, which involves performing a frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal, may include:
[0074] Perform a Discrete Fourier Transform on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal.
[0075] For example, the sampled signal can be transformed from the time domain to the frequency domain by performing a discrete Fourier transform using the following formula, thereby obtaining multiple frequency domain components corresponding to the sampled signal:
[0076]
[0077] Where X(k) is the k-th frequency domain component, N is the total number of sampled signals, and λ total (n) represents the time-domain information of the nth sampled signal, j is an imaginary number, k ranges from 0 to N-1, and n ranges from 1 to N.
[0078] Optionally, determining that the sampled signal includes ambient light AC component information based on the frequency domain components in step S103 may include:
[0079] Determine the frequency value corresponding to each frequency domain component;
[0080] The frequency values are filtered to remove ambient light DC component information and screen backlight component information from the sampled signal;
[0081] If there are unfiltered frequency values, it is determined that the sampled signal includes ambient light AC component information.
[0082] Optionally, determining the frequency value corresponding to each frequency domain component may include:
[0083] The frequency value corresponding to each frequency component is determined by the ratio of the sampling frequency of the under-display light sensor to the total number of sampled signals included in the sampled signal.
[0084] For example, the sampling frequency of the under-display light sensor can be preset at the factory, for example, set to 900Hz. In this embodiment, the total number of sampled signals can also be preset, for example, set to 1000. The frequency value corresponding to each frequency domain component can be determined based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampled signals.
[0085] Optionally, determining the frequency value corresponding to each frequency component based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampled signals included in the sampled signal may include:
[0086] The frequency value corresponding to each frequency domain component is determined by the following formula:
[0087]
[0088] Where f(k) is the frequency value corresponding to the k-th frequency domain component X(k), f s Where is the sampling frequency, N is the total number of sampled signals, and k ranges from 0 to N-1.
[0089] For example, the frequency value corresponding to the ambient light DC component information in the sampling signal is 0, which will not cause flickering. The screen backlight component information in the sampling signal includes screen backlight DC component information and screen backlight AC component information. The frequency value corresponding to the screen backlight DC component information is 0, which will not cause flickering; the waveform of the screen backlight AC component information in the sampling signal is a rectangular wave, while flickering occurs because the environment in which the electronic device is located contains an AC light source. AC power has a sine wave waveform; rectangular waves and sine waves have different waveform characteristics and will not cause flickering. To avoid interference from the ambient light DC component information and screen backlight component information in the sampling signal on the flicker detection results, filtering can be performed based on the frequency value corresponding to each frequency domain component. This can improve the reliability of the flicker detection results.
[0090] Optionally, filtering the frequency values may include:
[0091] Based on the frequency domain component threshold and the screen refresh rate, filter out the frequency values corresponding to frequency domain components that are less than the frequency domain component threshold, as well as the frequency values that are multiples of the screen refresh rate.
[0092] For example, during the process of the under-display light sensor acquiring the sampling signal, it may be interfered with by other unrelated signals, such as noise signals. These unrelated signals have small frequency domain components. When the frequency domain components of the signal are small, the signal will not cause the flicker effect. Therefore, the frequency values corresponding to the frequency domain components that are less than the frequency domain component threshold can be filtered out to ensure the reliability of the flicker detection results.
[0093] For example, the frequency of the screen backlight AC component information in the sampled signal is determined based on the screen refresh rate. Its waveform is a rectangular wave, which can be decomposed into many harmonic components through discrete Fourier transform. Alternating current is a sine wave, which will not produce harmonic components after discrete Fourier transform. Since the waveform characteristics of rectangular waves and sine waves are different, the screen backlight AC component information will not cause flickering. Therefore, the frequency values that are harmonics of the screen refresh rate can be filtered out to further ensure the reliability of the flicker detection results.
[0094] Optionally, the frequency domain component threshold in this method can be determined based on the average value of the frequency domain components.
[0095] For example, after determining all frequency domain components through discrete Fourier transform, the average value of all frequency domain components can be determined. If the average value of all frequency domain components is 500, a preset multiple of 500 can be set as the frequency domain component threshold. The preset multiple can be pre-set (the preset multiple must be greater than 1). For example, if it is set to 4, then 2000 can be set as the frequency domain component threshold. In this way, the flicker effect detection result can be avoided from being interfered with by unrelated signals, and the reliability of the flicker detection result can be ensured.
[0096] For example, the screen refresh rate can be determined based on the parameters of the electronic device; for instance, the screen refresh rate can be 60Hz. Figure 3 This is a spectral coordinate graph established based on frequency domain components and frequency values, as illustrated in an exemplary embodiment. The graph uses k=0 as the origin, frequency values as the x-axis, and frequency domain components as the y-axis. For example... Figure 3 As shown in the spectrum graph, after filtering out the frequency values corresponding to frequency components that are less than the frequency component threshold, the remaining frequency values are 60Hz, 100Hz, 120Hz, and 360Hz. Here, 60Hz, 120Hz, and 360Hz are the 1st, 2nd, and 4th multipliers of the screen refresh rate, respectively. After filtering out the frequency values that are multipliers of the screen refresh rate, the remaining frequency is 100Hz, thus confirming the existence of a flicker effect.
[0097] Optionally, the method may further include:
[0098] If a flicker effect is confirmed, in response to receiving a camera activation command, a flicker effect elimination operation is performed on the camera's acquired data to obtain target data for image preview.
[0099] A preview screen is displayed based on the target data.
[0100] For example, if a flicker effect is confirmed, and the electronic device's camera receives a camera-on command, indicating the user's intention to use the device's imaging system, a preview screen will be displayed. At this point, flicker elimination can be performed on the camera's captured data to obtain target data for the preview, and the preview can be displayed based on this target data. This avoids the flicker effect affecting the preview displayed by the electronic device, preventing users from seeing alternating bright and dark stripes in the preview, and effectively improving the user experience.
[0101] It should be noted that the numerical examples given in any of the above embodiments of this disclosure are for illustrative purposes only and do not constitute a limitation on the implementation of this disclosure.
[0102] Based on the same inventive concept, this disclosure also provides a flicker detection device. Figure 4 This is a block diagram illustrating a flicker detection device 400 according to an exemplary embodiment. (Refer to...) Figure 4 The flicker detection device 400 includes an acquisition module 401, a first determination module 402, a second determination module 403, and a third determination module 404.
[0103] The acquisition module 401 is configured to acquire the sampling signal of the under-screen light sensor installed on the electronic device;
[0104] The first determining module 402 is configured to perform frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal;
[0105] The second determining module 403 is configured to determine, based on the frequency domain components, that the sampled signal includes ambient light AC component information;
[0106] The third determining module 404 is configured to determine that the electronic device has a flicker effect if it is determined that the sampled signal includes the ambient light AC component information.
[0107] The above technical solution acquires the sampling signal from the under-display light sensor on the electronic device; performs frequency domain transformation on the sampling signal to obtain multiple frequency domain components corresponding to the sampling signal; based on the frequency domain components, it is determined that the sampling signal includes ambient light AC component information; if it is determined that the sampling signal includes ambient light AC component information, then it is determined that the electronic device has a flicker effect. Thus, by acquiring the sampling signal through the under-display light sensor on the electronic device, flicker detection can be performed when the screen of the electronic device is lit. By detecting the presence of a flicker effect, appropriate measures can be taken in a timely manner to eliminate it when it is determined to exist, preventing users from seeing alternating bright and dark stripes in the preview image. It also avoids the influence of shaking of the electronic device on the detection results, improving the user experience and the reliability of the flicker detection results. Furthermore, using the existing under-display light sensor of the electronic device eliminates the need for a dedicated brightness sensor near the camera of the electronic device, simplifying the production process.
[0108] Optionally, the second determining module 403 includes:
[0109] The first determining submodule is configured to determine the frequency value corresponding to each of the frequency domain components;
[0110] The filtering submodule is configured to filter the frequency values to remove ambient light DC component information and screen backlight component information from the sampled signal.
[0111] The second determining submodule is configured to determine that the sampled signal includes the ambient light AC component information if there are frequency values that have not been filtered out.
[0112] Optionally, the filtering submodule is configured to filter the frequency values in the following manner:
[0113] Based on the frequency domain component threshold and the screen refresh rate, filter out the frequency values corresponding to frequency domain components that are less than the frequency domain component threshold, as well as the frequency values that are multiples of the screen refresh rate.
[0114] Optionally, the frequency domain component threshold in the filtering submodule is determined based on the average value of the frequency domain components.
[0115] Optionally, the first determining submodule is configured to determine the frequency value corresponding to each frequency domain component in the following manner:
[0116] The frequency value corresponding to each frequency domain component is determined based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampling signals included in the sampling signal.
[0117] Optionally, the first determining submodule is configured to determine the frequency value corresponding to each frequency domain component using the following formula:
[0118]
[0119] Where f(k) is the frequency value corresponding to the k-th frequency domain component X(k), f s The sampling frequency is N, the total number of sampled signals is N, and the value of k ranges from 0 to N-1.
[0120] Optionally, the first determining module 402 is configured to perform a frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal in the following manner:
[0121] Perform a Discrete Fourier Transform on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal.
[0122] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0123] This disclosure also provides a non-transitory computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the flicker detection method provided in this disclosure.
[0124] Figure 5 This is a block diagram illustrating a flicker detection device 800 according to an exemplary embodiment. For example, device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0125] Reference Figure 5 The device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.
[0126] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the aforementioned flicker detection method. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
[0127] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0128] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device 800.
[0129] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0130] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
[0131] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0132] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0133] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0134] In an exemplary embodiment, the device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described flicker detection method.
[0135] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by the processor 820 of the device 800 to complete the above-described flicker detection method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0136] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the above-described flicker detection method when executed by the programmable device.
[0137] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of this disclosure. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0138] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A flicker detection method, characterized in that, The method includes: Acquire the sampling signal from the under-display light sensor installed on the electronic device; The sampled signal is transformed in the frequency domain to obtain multiple frequency domain components corresponding to the sampled signal; Based on the frequency domain components, it is determined that the sampled signal includes ambient light AC component information; If it is determined that the sampled signal includes the ambient light AC component information, then it is determined that the electronic device has a flicker effect.
2. The method according to claim 1, characterized in that, The step of determining that the sampled signal includes ambient light AC component information based on the frequency domain components includes: Determine the frequency value corresponding to each frequency domain component; The frequency values are filtered to remove ambient light DC component information and screen backlight component information from the sampled signal; If there are frequency values that have not been filtered out, then the sampled signal is determined to include the ambient light AC component information.
3. The method according to claim 2, characterized in that, The filtering of the frequency values includes: Based on the frequency domain component threshold and the screen refresh rate, filter out the frequency values corresponding to frequency domain components that are less than the frequency domain component threshold, as well as the frequency values that are multiples of the screen refresh rate.
4. The method according to claim 3, characterized in that, The frequency domain component threshold is determined based on the average value of the frequency domain components.
5. The method according to claim 2, characterized in that, Determining the frequency value corresponding to each frequency domain component includes: The frequency value corresponding to each frequency domain component is determined based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampling signals included in the sampling signal.
6. The method according to claim 5, characterized in that, The step of determining the frequency value corresponding to each frequency domain component based on the ratio of the sampling frequency of the under-display light sensor to the total number of sampling signals included in the sampling signal includes: The frequency value corresponding to each frequency domain component is determined by the following formula: in, Let X(k) be the frequency value corresponding to the k-th frequency domain component. The sampling frequency is... The total number of sampled signals, The value range is from 0 to N-1.
7. The method according to claim 1, characterized in that, The step of performing a frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal includes: Perform a Discrete Fourier Transform on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal.
8. A flicker detection device, characterized in that, The device includes: The acquisition module is configured to acquire the sampling signal from the under-display light sensor installed on the electronic device; The first determining module is configured to perform frequency domain transformation on the sampled signal to obtain multiple frequency domain components corresponding to the sampled signal; The second determining module is configured to determine, based on the frequency domain components, that the sampled signal includes ambient light AC component information; The third determining module is configured to determine that the electronic device has a flicker effect if it is determined that the sampled signal includes the ambient light AC component information.
9. A flicker detection device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured as follows: Acquire the sampling signal from the under-display light sensor installed on the electronic device; The sampled signal is transformed in the frequency domain to obtain multiple frequency domain components corresponding to the sampled signal; Based on the frequency domain components, it is determined that the sampled signal includes ambient light AC component information; If it is determined that the sampled signal includes the ambient light AC component information, then it is determined that the electronic device has a flicker effect.
10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the program implements the steps of the method described in any one of claims 1-7.