Display under sensor, system and method

Abstract

The technology, apparatuses, and systems disclosed herein include detecting a vertical synchronization (VSYNC) signal cycle; determining a high frequency trigger pulse based on detecting a pulse width modulation (PWM) signal of an illumination component, the high frequency trigger pulse corresponding to a deactivation time of the illumination component; receiving a delay time period; and activating a first sensor at a first time within the VSYNC signal cycle, the first time determined based on the high frequency trigger pulse and the delay time period. The first sensor can sense a first sensor reading, and can be deactivated after being activated. A display setting can be adjusted based at least on the first sensor reading, and the illumination component can be activated after the first sensor is deactivated.

Description

Technical Field

[0001] This disclosure relates generally to sensing devices, and more specifically to methods, systems, and apparatus for sensing proximity and ambient light under a display. Background Technology

[0002] Sensing environmental conditions can be an important part of optimizing the operation of electronic devices (e.g., devices including displays). Sensing such conditions can provide information for the operation of such electronic devices, enabling them to operate or be operated more efficiently and cost-effectively.

[0003] Electronic devices, including displays, can also include many additional components that help optimize their operation by sensing environmental conditions. The placement and configuration of these additional components can improve the overall performance of the device and reduce manufacturing costs. Summary of the Invention

[0004] The techniques, processes, methods, apparatus, and systems disclosed herein include: detecting a vertical synchronization (VSYNC) signal cycle; determining a high-frequency trigger pulse based on a pulse width modulation (PWM) signal of a detected lighting component, the high-frequency trigger pulse corresponding to a deactivation time of the lighting component; receiving a delay time period; and activating a first sensor at a first time within the VSYNC signal cycle, the first time being determined based on the high-frequency trigger pulse and the delay time period. The first sensor can sense a first sensor reading and can be deactivated after being activated. Display settings can be adjusted at least based on the first sensor reading, and the lighting component can be activated after the first sensor is deactivated. According to an embodiment, an updated VSYNC signal cycle can be determined. Furthermore, the updated VSYNC signal cycle can be determined to be at least one of two cases: greater than a high-frequency threshold (HFTH) and less than a low-frequency threshold (LFTH), and an updated high-frequency trigger pulse and an updated delay time period can be determined accordingly. The first sensor can be activated at a second time within the updated VSYNC signal cycle, the second time being determined based on the updated high frequency and the updated delay time period.

[0005] According to one aspect, an apparatus disclosed herein includes: a surface layer having an upper surface and a lower surface and formed to receive ambient wavelengths; an illumination component disposed below the lower surface of the surface layer and configured to be activated and deactivated; and a first sensor disposed below the lower surface of the surface layer, thereby placing the illumination component between the surface layer and the illumination component. The first sensor may be configured to activate when the illumination component is deactivated, and to sense ambient wavelengths emitted through the surface layer while the first sensor is activated. A processor is provided, and the processor may be configured to modify the operation of the illumination component based on the ambient wavelengths sensed by the first sensor.

[0006] According to another aspect, a process, method, and technique are provided, comprising: emitting a proximity signal from a proximity sensor in the reflection-affected area when an illumination component in the reflection-affected area of ​​a display device is deactivated as an illumination component; receiving a reflected proximity signal based on the emitted proximity signal; determining, based on the reflected proximity signal, that the display device is in either a stable state or a transitional state; and determining a proximity sensor sensing rate based on whether the display device is determined to be in either a stable state or a transitional state.

[0007] According to another aspect, the device disclosed herein includes an illumination component located in a reflection-affected area and a proximity sensor located in the reflection-affected area. The proximity sensor can be configured to emit a proximity signal when the illumination component is deactivated, and to receive a reflected proximity signal based on the emitted proximity signal. The processor can be configured to: determine, based on the reflected proximity signal, that the display device is in either a stable state or a transitional state; and to determine a proximity sensor sensing rate based on determining that the display device is in either a stable state or a transitional state.

[0008] According to another approach, the display device can be manufactured by placing the lighting component below the surface layer of the display device and placing a first sensor close to the lighting component. The first sensor can be configured to: detect a VSYNC signal cycle; determine a high-frequency trigger pulse by detecting the PWM signal of the lighting component, the high-frequency trigger pulse corresponding to the deactivation time of the lighting component; determine a delay time period; and be activated at a first time within the VSYNC signal cycle, the first time being determined based on the high-frequency trigger pulse and the delay time period.

[0009] According to another approach, a display device can be manufactured by placing an illumination component below the surface layer of the display device and a processor below the surface layer of the display device. The processor can be configured to: detect a VSYNC signal cycle; determine a high-frequency trigger pulse by detecting a PWM signal of the illumination component, the high-frequency trigger pulse corresponding to the deactivation time of the illumination component; and determine a delay time period. A first sensor can be placed close to the illumination component and can be configured to be activated at a first time within the VSYNC signal cycle, the first time being determined based on the high-frequency trigger pulse and the delay time period.

[0010] According to another approach, a display device can be manufactured by placing an illumination component in a reflective area and a proximity sensor in that reflective area. The proximity sensor can be configured to emit a proximity signal when the illumination component is deactivated, and to receive a reflected signal based on the emitted proximity signal. A processor can be placed in the display device and can be configured to: determine whether the display device is in a stable state or a transitional state based on the reflected signal; and determine the proximity sensor sensing rate based on determining whether the display device is in a stable state or a transitional state. Attached Figure Description

[0011] The accompanying drawings described below are for illustrative purposes only. The drawings are not intended to limit the scope of this disclosure. Similar reference numerals shown in the drawings designate the same portions in various embodiments.

[0012] Figure 1 This is a system diagram illustrating an exemplary device with a display;

[0013] Figure 2A This is a cross-sectional view showing an exemplary display and sensor in the device.

[0014] Figure 2B It is a cross-sectional view including the reflection-affected area of ​​the device;

[0015] Figure 2C It is a top view including the area affected by the reflection of the device;

[0016] Figure 2D This is a top view of the lighting components in the display device;

[0017] Figure 3 This is a flowchart of the sensor activation process based on high-frequency trigger pulses and delay time;

[0018] Figure 4A This is a diagram illustrating the activation time of an exemplary sensor;

[0019] Figure 4B This is a diagram illustrating an exemplary VSYNC signal;

[0020] Figure 4C This is a diagram illustrating an exemplary high-frequency trigger pulse signal;

[0021] Figure 4D This is a diagram illustrating an exemplary delayed signal;

[0022] Figure 4E It shows a graph of activation time based on the delay time;

[0023] Figure 4F This is a flowchart for implementing Dynamic Variable Refresh Rate (DVRR) technology;

[0024] Figure 4G This is a flowchart for implementing the Automatic Synchronous Switching Timing (ASST) scheme;

[0025] Figure 4H This is a diagram illustrating an exemplary implementation of the ASST scheme;

[0026] Figure 5A This is an illustration showing a portion of the display device;

[0027] Figure 5B This is an illustration showing the active portion of the display device;

[0028] Figure 6A It is an image showing the state of the lighting components and the corresponding pulse width modulation signal;

[0029] Figure 6B It is another image of the state of the lighting components and the corresponding pulse width modulation signal;

[0030] Figure 6C It is another image of the state of the lighting components and the corresponding pulse width modulation signal;

[0031] Figure 7 This is an image showing an example black dot on a monitor;

[0032] Figure 8 This is a flowchart used to determine the operation of the display device and the activation frequency of the proximity sensor;

[0033] Figure 9A This is a diagram illustrating the activation time of the proximity sensor;

[0034] Figure 9B It is a diagram based on proximity.

[0035] Figure 9C This is another illustration of the proximity sensor activation time;

[0036] Figure 9D This is another illustration of the proximity sensor activation time;

[0037] Figure 10 This is a diagram illustrating the sensor's operating mode;

[0038] Figure 11 This is a diagram of the cumulative function;

[0039] Figure 12A This is a system diagram of sensor activation time;

[0040] Figure 12B This is a flowchart of the DVRR technology implementation;

[0041] Figure 12C This is a system diagram of the SYNC generator in Figure 12, implemented according to the ASST scheme;

[0042] Figure 13 This is a diagram of an active-matrix OLED display;

[0043] Figure 14 This is a diagram of a sensor package containing a transmitter and a sensor; and

[0044] Figure 15 This is a diagram of the sensor pads. Detailed Implementation

[0045] Embodiments of this teaching provide techniques, apparatus, and systems for implementing under-device sensing using sensors placed beneath the surface layer of a display device (e.g., a mobile phone). The sensor can be placed beneath the light-emitting elements of the display device and can be configured to sense ambient light wavelengths and / or proximity detection signals in a manner consistent with the operation of the light-emitting elements of the display device.

[0046] Sensors can be configured to activate simultaneously with the corresponding light-emitting element of a display device being off, ensuring that light emitted by the light-emitting element and reflected back into the display device does not interfere with the operation of the sensors. The off state of such light-emitting elements can be determined by first detecting the vertical synchronization (VSYNC) cycle of the light-emitting element, which indicates the cycle refresh rate of the light-emitting element. A high-frequency trigger pulse rate can be determined based on the VSYNC cycle and pulse width modulation rate of the light-emitting element. The high-frequency trigger pulse rate can provide trigger pulses to one or more sensors based on the number of times the light-emitting element is turned on and off within a given VSYNC cycle. A delay time can also be determined based on the physical location of the light-emitting element, which can be applied to the VSYNC cycle to align the high-frequency trigger pulse rate for each sensor or group of sensors. The delayed high-frequency trigger pulse rate can provide trigger pulses to a sensor or group of sensors such that the sensor or group of sensors is activated at the time when the corresponding light-emitting element is deactivated.

[0047] According to embodiments of this teaching, a proximity sensor can be activated during the off-time of the corresponding light-emitting component to prevent or mitigate visible black spots on the display device. Furthermore, the activation frequency of the proximity sensor can be determined based on whether a given display device is in a stable or transitional state. The stable and transitional states can be determined based on the proximity of the display device to an external object outside the display device.

[0048] It should be understood that although the terms “first,” “second,” etc., may be used herein to describe various elements, these elements should not be limited by these terms. These terms are merely used to distinguish one element from another. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element, without departing from the scope of this teaching. As used herein, the term “and / or” includes any and all combinations of one or more of the associated enumerations.

[0049] It should also be understood that when an element, such as a layer, region, or substrate, is referred to as being "on" or "extending" to another element, it may be directly on or extended to that other element, or an intermediary element may be present. Conversely, when an element is referred to as being "directly on" or "extending" to another element, no intermediary element is present. It should also be understood that when an element is referred to as being "connected to" or "coupled to" another element, it may be directly connected to or coupled to that other element, or an intermediary element may be present. Conversely, when an element is referred to as being "directly connected" or "directly coupled" to another element, no intermediary element is present. It should be understood that these terms are intended to cover different orientations of the element other than those shown in the accompanying drawings.

[0050] This document may use relative terms such as “below” or “above” or “upper” or “lower” or “horizontal” or “vertical” to describe the relationship of one element, layer, or region relative to another element, layer, or region as shown in the accompanying drawings. It should be understood that these terms are intended to cover different orientations of the device other than those shown in the accompanying drawings.

[0051] Figure 1 This is a system diagram illustrating an exemplary device 102, which may be, for example, a smartphone including a display that also functions as a touchscreen. Figure 1As shown, device 102 may include a processor 118, a transceiver 120, a transmitting / receiving element 122, a speaker / microphone 124, a keypad 126, a display / touchpad 128, a non-removable memory 130, a removable memory 132, a power supply 134, a Global Positioning System (GPS) chipset 136, and / or other peripheral devices 138, as well as other components. It should be understood that device 102 may include any sub-combination of the foregoing elements while remaining consistent with the embodiments.

[0052] Processor 118 may be a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) circuit, any other type of integrated circuit (IC), a state machine, etc. Processor 118 may perform signal encoding, data processing, power control, input / output processing, and / or any other function that enables device 102 to operate in a wireless environment. Processor 118 may be coupled to transceiver 120, and transceiver 120 may be coupled to transmitting / receiving element 122. Although... Figure 1 While the processor 118 and transceiver 120 are depicted as separate components, it should be understood that the processor 118 and transceiver 120 can be integrated together into an electronic package or chip. Furthermore, although... Figure 1 A single processor 118 is shown, but multiple processors may be provided to implement the subject matter of this teaching.

[0053] The transmitting / receiving element 122 can be configured to transmit signals to or receive signals from the base station via the air interface 116. Although in Figure 1 The transmitting / receiving element 122 is depicted as a single element, but the device 102 may include any number of transmitting / receiving elements 122.

[0054] The processor 118 of device 102 can be coupled to the speaker / microphone 124, keypad 126, and / or display / touchpad 128 (e.g., a liquid crystal display (LVD) unit or an organic light-emitting diode (OLED) display unit) and receive user input data from the speaker / microphone 124, keypad 126, and / or display / touchpad 128 (e.g., a liquid crystal display (LVD) unit or an organic light-emitting diode (OLED) display unit). The processor 118 can also output user data to the speaker / microphone 124, keypad 126, and / or display / touchpad 128. Furthermore, the processor 118 can access information from any type of suitable memory (such as non-removable memory 130 and / or removable memory 132) and store data therein. Non-removable memory 130 may include random access memory (RAM), read-only memory (ROM), hard disk, or any other type of memory storage device. Removable memory 132 may include a Subscriber Identity Module (SIM) card, memory stick, Secure Digital (SD) memory card, etc. In other embodiments, processor 118 may access information from and store data in a memory that is not physically located on device 102 (e.g., not on a server, PC, or home computer).

[0055] The processor 118 can receive power from the power source 134 and can be configured to distribute and / or control power to other components in the device 102. The power source 134 can be any suitable device for powering the device 102. For example, the power source 134 may include one or more dry cell batteries (e.g., nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel metal hydride (NIMH), lithium-ion (Li-ion), etc.), solar cells, fuel cells, etc., or any known power source for such purposes.

[0056] The processor 118 may also be coupled to a GPS chipset 136, which may be configured to provide location information (e.g., longitude and latitude) about the current location of the device 102. In addition to or as a substitute for information from the GPS chipset 136, the device 102 may receive location information from base stations via an air interface 116 and / or determine the location of the device 102 based on the timing of signals received from two or more nearby base stations.

[0057] The processor 118 may be further coupled to other peripheral devices 138, which may include one or more software and / or hardware modules that provide additional features, functions, and / or wired or wireless connectivity. For example, peripheral devices 138 may include an accelerometer, electronic compass, satellite transceiver, digital camera (for photos and / or video), Universal Serial Bus (USB) port, vibration device, television transceiver, hands-free headset, Bluetooth. Modules, FM radio units, digital music players, media players, video game console modules, internet browsers, virtual reality and / or augmented reality (VR / AR) devices, activity trackers, etc. Peripheral devices 138 may include one or more sensors, which may be one or more of the following: gyroscopes, accelerometers, Hall effect sensors, magnetometers, orientation sensors, proximity sensors, temperature sensors, time sensors, geolocation sensors, altimeters, light sensors, touch sensors, magnetometers, barometers, posture sensors, biometric sensors, and / or humidity sensors.

[0058] Having described this teaching in detail, those skilled in the art will recognize that modifications can be made to this teaching without departing from the spirit of the principles described herein, given this disclosure. Therefore, it is not intended that the scope of this teaching be limited to the specific embodiments illustrated and described.

[0059] According to embodiments of this teaching, techniques and apparatus are provided for determining sensing timing schemes and intelligent proximity sensing under a display. Figure 2A An illustration of a display device 200 is shown, which includes a surface layer 205 formed to allow ambient light wavelengths 210 to enter the display device 200. The display device can be used with... Figure 1 The device 102 is the same as or similar to the display device 200. The display device 200 can be any device configured to display and / or otherwise provide visible light via the surface layer 205, and can be, for example, a mobile device, a laptop display, a monitor, a gaming device screen, or a medical device screen. The surface layer 205 can be a completely or partially transparent layer, allowing light wavelengths to enter and exit the surface layer 205 from both main surfaces of the surface layer 205.

[0060] The display device 200 may include a light-emitting layer 215, which may include a plurality of illumination components 216 configured to emit light. The illumination components 216 may be light-emitting diodes (LEDs), active-matrix organic light-emitting diodes (AMOLEDs), or organic light-emitting diodes (OLEDs), etc. As an example, the illumination components 216 may include components that emit different wavelengths or different wavelength ranges (e.g., those corresponding to red, green, and blue visible light). The light-emitting layer 215, including the illumination components 216, is positioned below the surface layer 205 within the display device 200. A transistor layer 212 may be provided and positioned below the light-emitting layer 215 such that the surface layer 205 faces a first surface 215a of the light-emitting layer 215, and the transistor layer 212 faces a second surface 215b of the light-emitting layer 215, such that the first surface 215a is substantially opposite to the second surface 215b.

[0061] like Figure 2A As shown, the illumination component 216 can generate both emitted light 216a and internal light 216b. Emitted light 216a can be light generated by the illumination component 216 that exits the display device 200 via the surface layer 205. Emitted light 216a can be light generated by the illumination component 216 to facilitate the intended operation of the display device 200. Internal light 216b can be light generated by the illumination component 216 and reflected or otherwise directed back to the display device 200. For example, internal light 216b can be light emitted by the illumination component 216 and reflected or reflected back to the display device 200 by the surface layer 205. Internal light 216b may not be light provided to facilitate the intended operation of the device and may be a byproduct of the light and component characteristics of the display device 200. It should be noted that the display device 200 may be arranged such that all or part of the internal light 216b may be incident on one or more sensors (such as light sensor 230 and / or proximity sensor 240) in the sensor layer 220, as further disclosed herein. As applied herein, the light sensor may be an ambient light sensor (ALS) or a sensor with similar functionality known to those skilled in the art.

[0062] Transistor layer 212 may include electrical contacts configured to independently control illumination component 216. As an example, transistor layer 212 may include multiple thin-film transistors (TFTs) of the MOSFET type. TFTs may be fabricated by depositing a thin film of an active semiconductor layer, along with a dielectric layer and metal contacts, on a supporting substrate. The TFT layer may be semi-transparent, allowing light to pass through and undergo attenuation as it is emitted through the TFT layer. According to an example, the light transmittance may be in the range of 5% to 40% due to light attenuation through the TFT layer.

[0063] The display device 200 may further include a sensor layer 220, which may include one or more sensors, such as a light sensor 230 and / or a proximity sensor 240, or a combination of these sensors. According to embodiments, such as... Figure 2A As shown, sensor layer 220 can be positioned below transistor layer 212 such that the one or more sensors (e.g., light sensor 230 and / or proximity sensor 240) face transistor layer 212 and are located on the side of transistor layer 212 opposite to light-emitting layer 215. Accordingly, transistor layer 212 can be positioned between sensor layer 220 and light-emitting layer 215. According to another embodiment, sensor layer 220 can be oriented or otherwise positioned to detect or sense light emitted by light-emitting layer 215 without positioning transistor layer 212 between light-emitting layer 215 and sensor layer 220. The transistors in transistor layer 212 can be positioned above one or more sensors in sensor layer 220 or can be offset relative to the sensors in sensor layer 220, such that the transistors in transistor layer 212 are wholly or partially offset relative to the position of one or more sensors in sensor layer 220.

[0064] Sensor layer 220 may include one or more different types of sensors, such as light sensor 230 and proximity sensor 240, such that the different types of sensors are positioned on different planes relative to each other. Sensor layer 220 may be located close to printed circuit board 213 or may be located on top of printed circuit board 213.

[0065] The ambient light wavelength 210 can be any light wavelength generated outside the display device 200 or otherwise provided and enters the display device 200 via the surface layer 205. The ambient light wavelength 210 can correspond to natural light, light generated by an external lighting device, external reflected light, etc., and can be a combination of light from two or more sources. It should be noted that the display device 200 can be arranged such that the ambient light wavelength 210 incident on the display device 200 can enter the display device 200 via the surface layer 205 and can be incident on one or more sensors (such as the light sensor 230 and the proximity sensor 240) in the sensor layer 220.

[0066] A light sensor 230, in or in any way constituting part of sensor layer 220, may be configured to receive ambient light wavelength 210 to determine one or more ambient lighting conditions corresponding to display device 200. The light sensor 230 may receive light wavelengths incident on it and may determine one or more characteristics of the ambient lighting conditions. Such characteristics may include luminance (LUX), hue, saturation, correlated color temperature (CCT), or tristimulus values ​​(XYZ or xy), etc. The light sensor 230 may sense one or more such characteristics and generate an electrical signal that enables a processor or (multiple) other components to modify the operation of display device 200, for example, by modifying the operation of illumination component 216. The processor and / or (multiple) other components may be configured to operate independently or in conjunction with software or an operating system. It should be noted that the teachings disclosed herein include those related to... Figure 2A and Figure 2B The relevant instruction can be performed by a single component, a combination of components, and / or a combination of hardware, software, and / or firmware.

[0067] For example, the electrical signal generated by the light sensor 230 can enable the processor to determine that the ambient light incident on the light sensor 230 has a brightness value below a predetermined threshold, and accordingly the processor can provide an electrical signal to promote a decrease in the total brightness level of the light emitted through the lighting component 216.

[0068] The proximity sensor 240 in sensor layer 220 can be configured to detect the proximity of an external object (e.g., the user's ear) located outside the display device 200. The proximity sensor 240 operates by emitting a signal of a first wavelength and sensing a response to the signal when it is reflected back or directed back to the proximity sensor 240. For example, the signal can be an infrared (IR) signal emitted by one or more proximity sensors 240, thereby sensing the timing, amplitude, and / or phase of a response signal received as a result of the emission by one or more of the proximity sensors 240. The proximity sensor 240 can sense the response signal and generate an electrical signal that enables a processor to modify the operation of the display device 200, for example, by modifying the operation of the illumination component 216. For example, the proximity sensor 240 can generate an electrical signal that causes the processor to determine, based on the returned signal received by the proximity sensor 240, that the user's ear is within a threshold distance of the display device 200. Accordingly, the processor can provide electrical signals to facilitate the operation of the lighting component 216, for example, by reducing the output of the lighting component 216 while the display device is located at the user's ear.

[0069] like Figure 2AAs shown, ambient light wavelength 210 and internal light 216b can be incident on one or more sensors in sensor layer 220. Ambient light wavelength 210 can pass through surface layer 205 and through display device 200 to reach one or more sensors in sensor layer 220, including, for example, light sensor 230 and proximity sensor 240. Internal light 216b can be or can include a portion of light emitted from illumination component 216 that is reflected back into display device 200 by surface 205 or otherwise directed back into display device 200. Internal light 216b can reach one or more sensors in sensor layer 220 (e.g., including light sensor 230 and proximity sensor 240).

[0070] It can be understood that the light sensor 230 and / or the proximity sensor 240 can be configured to detect environmental conditions outside the display device 200. For example, the light sensor 230 can detect ambient light incident on the display device 200, and the proximity sensor 240 can detect the proximity of external objects to the display device 200. However, the operation of the light sensor 230 and the proximity sensor 240 may produce inaccurate results due to internal light 216b incident on the light sensor 230 and / or the proximity sensor 240. It should be noted that although the light sensor 230 is activated to sense the ambient light wavelength 210, when the light sensor 230 also senses the internal light 216b in addition to the ambient light wavelength 210, such sensing may produce inaccurate, unexpected, or undesirable results. To be clear, such sensing produces inaccurate results when detecting environmental conditions because the light sensor 230 senses both the ambient light wavelength 210 and the internal light 216b.

[0071] Similarly, proximity sensor 240 can emit a signal at a given wavelength (e.g., an IR signal) and can sense the response signal reflected by an object outside the display device 200. Proximity sensor 240 can sense one or more characteristics of the response signal (e.g., timing, amplitude, phase, etc.) to determine the proximity of the external object. However, proximity sensor 240 may produce inaccurate results because internal light 216b is incident on proximity sensor 240 in addition to the response signal incident on proximity sensor 240.

[0072] Figure 2B It shows Figure 2A Different viewing angles of the display device 200 shown. For example... Figure 2B As shown, the reflection-affected region 250 corresponds to the portion of the surface layer that can reflect light emitted from the light-emitting layer 215 toward the sensor layer 220. More specifically, the portion of the surface layer 205 indicated by the reflection-affected region 250 can be a portion of the surface layer 205 capable of reflecting light onto one or more sensors in the sensor layer 220. Figure 2B As shown, ambient light wavelength 210 can be incident on surface layer 205, and attenuated ambient light wavelength 210a, an attenuated version of ambient light wavelength 210, can be incident on one or more sensors in sensor layer 220. Figure 2C A top view of the display device 200 is shown, which includes also Figure 2B The top view of the reflection-affected area 250 is shown in the figure. Figure 2D A top view of the lighting component is shown, for example, Figure 2A Lighting component 216 in the middle. Figure 2D The lighting component shown may be a portion of a light-emitting layer (e.g., light-emitting layer 215). Figure 2D As shown, the light-emitting layer may include different lighting components, such as green lighting component 261, blue lighting component 262, and red lighting component 263. Each different lighting component may be configured to emit light at a different wavelength and may, for example, have a wavelength conversion material (e.g., phosphor) as part of each lighting component.

[0073] Figure 2A and Figure 2B The components shown are arranged according to an exemplary arrangement. It should be understood that modified arrangements of such components may be provided in accordance with the subject matter of this disclosure. For example, surface layer 205 may be the top layer of the display device, and light-emitting layer 215, transistor layer 212 and sensor layer 220 may be located below surface layer 205, adjacent to surface layer 205, facing surface layer 205, or otherwise close to surface layer 205.

[0074] Figure 13 Multiple layers of an exemplary display device according to embodiments of the disclosed subject matter are shown. Figure 13 The example provided can correspond to an active matrix OLED along with the TFT layer located beneath that matrix. As shown in the figure, Figure 13 The system includes a cathode layer 271, an organic active layer 272, a TFT layer 273, and a substrate layer 274. The TFT layer 273 may include a plurality of TFTs configured to independently address lighting elements provided in the organic active layer 272. The TFTs in the TFT layer 273 can receive signals from one or more processors and can activate corresponding lighting elements based on the signals received from the one or more processors.

[0075] Figure 14 and Figure 15An exemplary sensor package 280 is shown, which includes an emitter window 281, a sensor window 282, and a sensor pad 283. The emitter window 281 may include an IR emitter (e.g., a 940nm IR emitter) or may be located above an IR emitter configured to transmit sensor signals through the emitter window 281. The sensor window 282 may be configured to receive a signal received as a result of a signal transmitted via the sensor window 282.

[0076] Figure 15 A detailed view of sensor pad 283 is shown, which includes, for example, an RGB light sensor 285, a proximity sensor 286, and a bonding pad 284. The RGB light sensor 285 and the proximity sensor 286 can be activated according to the techniques disclosed herein and can be activated independently of each other, such that the RGB light sensor 285 is activated at the same or different time as the proximity sensor 286.

[0077] According to embodiments of this teaching, an under-display sensing scheme includes one or more sensors in an illumination component (e.g., Figure 2A The sensor is activated when the lighting component 216 is in the off state. (Reference) Figure 2A This under-display sensing scheme allows one or more sensors in sensor layer 220 to be placed below surface layer 205 of display device 200, thereby mitigating or eliminating the effects of undesirable internal light 216b. One or more sensors in sensor layer 220 can be placed below surface layer 205 such that the one or more sensors lie on a plane below the plane established by surface layer 205. It should be noted that the technology disclosed herein enables operation of one or more sensors in sensor layer 220 when illumination component 216 is actually turned off, such that when one or more sensors are in operation, there is no or only minimal internal light 216b.

[0078] Figure 3 A process 300 for activating a sensor under a display is illustrated based on an embodiment disclosed herein. Although it is a contact... Figure 2A , Figure 2B , Figure 4A , Figure 4B , Figure 4C , Figure 4D and Figure 4E The system described herein, however, will be recognized by those skilled in the art that any system configured to perform the steps of process 300 in any technically feasible order falls within the scope of this disclosure. Figure 3At step 310 of process 300, a vertical synchronization (VSYNC) frequency is detected, which indicates the display refresh timing of display device 200. The VSYNC frequency can be detected based on signals received from one or more timing controllers (TCONs) of the light-emitting layer 215 shown in FIG. 2. The VSYNC frequency can include rising and falling edges, and the duration between the first VSYNC cycle edge (e.g., rising or falling edge) and the second VSYNC cycle edge can correspond to the cycle length of the refresh timing of display device 200. The VSYNC frequency can be any suitable frequency capable of enabling operation of the display device, and can be, for example, 60Hz, 90Hz, 120Hz, or 240Hz. The VSYNC signal provided by the TCON can be input to the synchronization pins of one or more sensors of sensor layer 220.

[0079] Figure 4A A diagram illustrating process 300 is shown. (As shown) Figure 4A As shown, a VSYNC signal 410 can be detected, and the VSYNC signal 410 can have a cycle length 411 corresponding to the frequency of the VSYNC signal 410. According to this example, the VSYNC signal 410 can have a frequency of 60 Hz, such that the cycle length of each VSYNC signal is ~16.66 ms. The VSYNC signal frequency and / or cycle length can be provided by a TCON for a light-emitting layer including lighting components (e.g., AMOLED, LED, OLED, etc.). The cycle length 411 of the VSYNC signal 410 can be measured from the first leading edge to the second leading edge of the VSYNC signal 410, or alternatively from the first falling edge to the second falling edge of the VSYNC signal 410. One or more sensors in sensor layer 220 can be operated using a driver configured to read the value of a synchronous loop detector counter and can determine the VSYNC signal 410.

[0080] Figure 4B It shows Figure 4A The simplified portion includes a VSYNC signal 410 with a cycle length of 411. The VSYNC signal 410 can be detected when the corresponding VSYNC detection mode register is set to enable bit 01. The VSYNC signal 410 can be detected using a base clock set to, for example, 1MHz (1μs). A rising edge 413 can be detected and stored in the SYNC_EDGE register as rising edge 0 bit corresponding to the sync signal edge setting. A falling edge 414 can be detected and stored in the SYNC_EDGE register as falling edge 1 bit. The frequency detection data register can include 16 bits and can store VSYNC signal data, as further disclosed herein. Figure 4BAs shown, the lighting component can be activated once or multiple times within the cycle length 411 of the VSYNC signal 410 (e.g., Figure 4B In specific examples, there are four instances, corresponding to times 422, 423, 424, and 425 (as further disclosed herein).

[0081] exist Figure 3 At step 320 of process 300, a high-frequency trigger pulse can be determined. This high-frequency trigger pulse can be based on the determination of a VSYNC cycle and can be a high-frequency pulse or digital signal provided to one or more sensors in sensor layer 220 of FIG2. The high-frequency trigger pulse can be determined by identifying the frequency of a pulse width modulation (PWM) drive signal (e.g., 240 Hz), which is generated based on the number of cycles the lighting component undergoes between on and off states within a given VSYNC cycle. This high-frequency trigger pulse can be automatically determined or predetermined and can be used to determine the sampling rate of one or more sensors in sensor layer 220.

[0082] Figure 4A An exemplary high-frequency trigger pulse 420 described in step 320 of process 300 is shown. The high-frequency trigger pulse 420 has a cycle length 421. It should be noted that the cycle length of the high-frequency trigger pulse 420 can be at most the same as the cycle length 411 of the VSYNC signal 410, because the lighting component (e.g., lighting component 216) can be configured to activate at least once within each VSYNC signal 410 cycle length 421. Figure 4A As shown in the example, the cycle length 421 of the high-frequency trigger pulse 420 is ~4.15ms, and the frequency of the high-frequency trigger pulse 420 is 240Hz and corresponds to the PWM frequency of (multiple) lighting components (such as...). Figure 6A and Figure 6B As further described herein, the VSYNC signal 410 is determined based on this PWM frequency. It should be noted that in this example, the cycle length 421 of the high-frequency trigger pulse 420 is one-quarter of the cycle length 411 of the VSYNC signal 410, because the PWM drive signal frequency corresponding to the lighting component will indicate that such a component is activated four times within a given VSYNC signal 410 cycle. Figure 4AAs shown, the illumination component can be activated at times 422, 423, 424, and 425, which correspond to frequencies equal to the frequency of the high-frequency trigger pulse 420. The determination result of the high-frequency trigger pulse 420 can be stored in a high-frequency trigger setting register and provided to one or more sensors to determine the sensor activation time. As an example, if the high-frequency trigger pulse 420 corresponds to a frequency of 240 Hz, then the high-frequency trigger setting register can store "4116" corresponding to a cycle length of 4.166 ms. According to this example, a sensor or sensor group can be triggered based on the 4.166 ms high-frequency trigger pulse 420, thereby generating 4 sampling cycles per 60 Hz VSYNC refresh cycle time 411. As another example, if the high-frequency trigger pulse 420 corresponds to a frequency of 120 Hz, then the high-frequency trigger setting register can store "8332" corresponding to a cycle length of 8.332 ms. According to this example, a sensor or sensor group can be triggered based on the 8.332 ms high-frequency trigger pulse 420, thereby generating 2 sampling cycles per 60 Hz VSYNC refresh cycle time 411.

[0083] Figure 4C It shows Figure 4A The simplified portion includes a VSYNC signal 410 with a cycle length of 411 and a high-frequency trigger pulse 420 with a cycle length of 421. As disclosed herein, the high-frequency trigger pulse 420 with a cycle length of 421 can be used to detect a component corresponding to an illumination element (e.g., Figure 2A The activation and deactivation times of the lighting component 216) are determined based on the PWM, such as Figure 6A and Figure 6B As further described in the figure, the cycle length 421 of the high-frequency trigger pulse 420 can have a duration that is a subset of the cycle length 411 of the VSYNC signal 410, because the lighting component can have at least one activation and deactivation cycle within each VSYNC signal 410 cycle length 411, as indicated by the corresponding lighting component PWM signal.

[0084] exist Figure 3At step 330 of process 300, a delay time is applied to the high-frequency trigger pulse of step 320. This delay time may correspond to the position of one or more sensors in the sensor layer (e.g., sensor layer 220 of FIG. 2). It should be noted that sensor layer 220 may include multiple sensors, and these sensors may be placed at different locations below the light-emitting layer 215. The delay time for a given sensor or group of sensors may be determined based on the position, orientation, and / or orientation of the sensor or group of sensors. The value of the delay time may be based on the VSYNC signal, and more specifically, on the amount of propagation time taken for the VSYNC signal to reach the position of one or more sensors. Figure 5A and Figure 5B An example of a delay time is shown. For example... Figure 5A As shown, the display on the display device 500 can be divided into multiple rows 501a, 501b to 501n, such that the delay time can be based on the row time Time of each given row. 行-1 Time 行-2 Time 行-n For example, the display pixel driver corresponding to the display of display device 500 can be subdivided into four or five blocks composed of gate-on-array (GOA) driver circuitry. Each GOA driver can drive a specific segment of a pixel line. For example, display device 500 may include GOA blocks for an HD OLED display with 2435 pixel lines. Figure 5B As shown, each GOA driver circuit 520a and 520b can drive 487 pixel lines. Each pixel line can have a delay time of 8.55 μs. According to some GOA implementations, sensor position 511 can be positioned such that the corresponding pixel line is turned off during the end portion of the VSYNC cycle, as shown by RGB sensor turn-on times and PS sensor turn-on times 513a and 513b, their turn-on facing the end of the corresponding VSYNC cycle, while OLED turn-on times 512a and 512b face the beginning of the corresponding VSYNC cycle. Alternatively, for example, pixel lines are turned off during the beginning portion of the VSYNC cycle, as shown by RGB sensor turn-on times and PS sensor turn-on times 523a and 523b, their turn-on facing the beginning of the corresponding VSYNC cycle, while OLED turn-on times 522a and 522b face the beginning of the corresponding VSYNC cycle. The delay time can be determined during the initial setup phase and can be provided based on the position of each sensor or sensor group. It should be noted that this delay time can be different for each sensor or sensor group. This delay time can be less than the cycle length 421 of the high-frequency trigger pulse 420.

[0085] Figure 4AAn exemplary delay time 431 is shown, determined based on the position of sensors activated at times 432, 433, and 434. It should be noted that applying the delay time 431 allows the sensor activation times 432, 433, and 434 to correspond to the time between illumination component activity times 422, 423, 424, and 425, such that the sensors activated at 432, 433, and 434 are inactive during illumination component activity. When the illumination component is activated at times 422, 423, 424, and 425, the light wavelength generated by the illumination component causes internal light, for example, Figure 2A The internal light 216b. Accordingly, activating the sensor or sensor group at sensor activation times 432, 433, and 434 prevents the sensor or sensor group from sensing light wavelengths including those generated during times 422, 423, 424, and 425. The delay time 431 can be stored in a sensor delay time register, and the sensor or sensor group can access the sensor delay time register to determine the sensor activation time.

[0086] Figure 4D It shows Figure 4A The simplified portion includes a VSYNC signal 410 with a cycle length of 411, a high-frequency trigger pulse 420 with a cycle length of 421, an illumination component activation time 422, a delay time 431, and a sensor activation time 432. As shown, the delay time 431 can be determined based on the position of the sensor activated by the high-frequency trigger pulse 420 with a cycle length of 421 at time 432, where the cycle length 421 is determined based on the VSYNC signal 410 with a cycle length of 411. The sensor activation time 432 can be a time during which, for example, the illumination component is not activated during the illumination device activation time 422.

[0087] Figure 4E An exemplary sensor time and register group setting is shown, which includes a setting for a light sensor (e.g., Figure 2A The IT SYNC value 451 for the optical sensor 230, the IT_BANK SYNC value 452 for the optical sensor (e.g., optical sensor 230), and the IT_BANK SYNC value 452 for the proximity sensor (e.g., Figure 2AThe proximity sensor (e.g., proximity sensor 240) has an IT SYNC value 451 and an IT_BANK SYNC value 452. The RGB SYNC IT value 451 determines the activation or integration time of the light sensor (e.g., light sensor 230), where the activation or integration step increment is 50 μs. As shown in the IT SYNC value 451, the activation or integration time range covers from 500 μs to 1.25 ms. The IT_BANK corresponds to the multiplication factor of the IT SYNC value. For example, if IT_SYNC 451 is programmed to 500 μs, then the IT_BANK value 452 with "01" configures the light sensor activation or integration time to 1000 μs. For proximity sensing, an exemplary proximity sensing integration time is 100 μs. The PS IT SYNC value 453 covers proximity integration times from 50 μs to 200 μs. For example, if the SYNC IT value of 453 is programmed to be 50 μs, then the corresponding IT_Bank value of "01" 454 will configure the proximity sensor integration time to be 100 μs.

[0088] It should be noted that, based on the driving timing of the VSYNC signal 410 and the PWM drive signal frequency, the high-frequency timing value 421 and the sensor delay time 431, as further disclosed herein, are programmed into the corresponding registers. For example, if the detected VSYNC signal 410 is 60Hz and the PWM drive timing is 240Hz, then the value "4166" is programmed into the high-frequency trigger register. Accordingly, the high-frequency trigger pulse signal 420 is set to a period of 4.166ms or 240Hz. If a sensor delay time 431 of 3ms is required, then the value "3000" can be programmed into the RGB delay time register.

[0089] According to embodiments of the disclosed subject matter, the display device (e.g., Figure 2A The display device 200 may support Dynamic Variable Refresh Rate (DVRR), allowing the display device to be configured to dynamically adjust its refresh rate. For example, the display device may include an AMOLD or micro-LED display that supports both 60Hz and 90Hz refresh rates. As another example, the display device could be a digital watch with a micro-LED display that supports both 30Hz and 60Hz refresh rates. This variation in refresh rate can allow for power savings during the use of such devices. Alternatively or additionally, such devices with DVRR capability can allow for enhanced performance when needed (e.g., higher refresh rates can be implemented during video game operation).

[0090] According to the DVRR-based implementation of the disclosed subject matter, as further disclosed herein, changes in the cycle duration can be detected during a given cycle. The change in cycle duration corresponds to a modified refresh rate, which may be modified based on one or more of user setting changes, temperature changes, or automatic setting changes. Automatic setting changes may be implemented based on hardware input, software input, or firmware input, and may be caused by, for example, a program or class of programs activated on the device, a sensor detecting settings, or excess (e.g., available device resource bandwidth) or insufficient (e.g., limited device resource bandwidth).

[0091] Figure 4F A process 470 for implementing a DVRR according to the subject matter disclosed herein is shown. Figure 4F As shown in step 472 of process 470, the VSYNC loop detector (e.g., Figure 12A and Figure 12B The VSYNC loop detector 1210 (as further disclosed herein) can detect the display refresh rate (e.g., 30Hz, 60Hz, 90Hz, 120Hz, 240Hz, etc.). The VSYNC loop detector can detect the display refresh rate according to the techniques disclosed herein; for example, the techniques could be... Figure 3 Steps 310 and 320 of process 300 and Figures 4A-4D The technologies that were made public in China.

[0092] At step 474 of process 400, the detected display refresh rate may be determined to be different from the display refresh rate detected by the VSYNC loop detector during the previous loop. The difference in the detected refresh rate may be greater than a high-frequency threshold (HFTH) or a low-frequency threshold (LFTH). HFTH may be a threshold amount such that if the detected refresh rate is at least HFTH greater than the previously detected refresh rate, process 470 continues to step 476 after step 474. Similarly, LFTH may be a threshold amount such that if the detected refresh rate is at least LFTH lower than the previous refresh rate, process 470 continues to step 476 after step 474. According to an embodiment, HFTH and LFTH may be the same value (e.g., 5Hz). Alternatively, HFTH may be different from LFTH (e.g., HFTH may be 5Hz and LFTH may be 7Hz). According to an embodiment, HFTH and / or LFTH may be percentage values ​​(e.g., 3%).

[0093] Furthermore, at step 474, based on the determination that the detected display refresh rate differs from the previous display refresh rate by at least HFTH or LFTH, the Variable Refresh Rate (VRR) interrupt flag register can be triggered. The VRR interrupt flag register can be triggered by any applicable technique, such as changing a binary value from 0 to 1, changing a bit value, or applying a voltage, etc.

[0094] According to an implementation of the disclosed subject matter, when the VRR interrupt flag is triggered at step 474, the driver can be configured to... Figure 4F Step 470 of the process was initiated at point 476. Figure 3 The process is as follows: 300. It should be noted that when the VRR interrupt flag is triggered at step 474, the VSYNC frequency can be determined (e.g., Figure 3 In step 310 of process 300, the high-frequency trigger pulse can be determined (e.g., Figure 3 In step 320 of process 300, a delay time can be applied to the determined high-frequency trigger pulse (e.g., Figure 3 The process 300, step 330), and can activate one or more sensors (e.g., based on a high-frequency trigger pulse and a delay time) Figure 3 The process is 300 steps 340).

[0095] exist Figure 4F At step 478, the VRR interrupt flag can be reset, allowing the system to return to step 472. Subsequent refresh rate changes greater than HFTH or LFTH can be detected, and process 470 can continue accordingly.

[0096] According to one embodiment of the disclosed subject matter, an Automatic Synchronous Switching Timing (ASST) scheme can be implemented. When the VSYNC signal is not actively available, the ASST scheme can be implemented by applying and / or storing an internal synchronization signal with an internal synchronization signal cycle. It should be noted that the internal synchronization signal can be an initialization signal available before the first instance of a VSYNC signal is generated in a given device, and / or can be determined based on the last available VSYNC signal before the display device enters a power-off or sleep state. The internal synchronization signal allows operation according to the disclosed embodiments without using a software solution while the display device enters an idle or sleep state. Specifically, the idle or sleep state of the display device can correspond to when the display device is in an idle or power-saving mode, but is still otherwise powered on. More specifically, the idle or sleep state is the state when the display device does not generate a VSYNC signal.

[0097] According to the ASST-based implementation, the ALS and PS techniques disclosed herein, which are generally implemented using the VSYNC signal, can alternatively be implemented using the internal synchronization signal when the VSYNC signal is absent.

[0098] Figure 4G A process 480 for an ASST implementation according to the subject matter disclosed herein is illustrated. As shown at step 482 of process 480, an internal synchronization signal can be used to synchronize the display device (e.g., Figure 2A-2C The display device 200 is initialized. The internal synchronization signal can be pre-programmed via physical components or registers. At step 282, the ALS / PS parameters can be set by applying the internal synchronization signal implemented during initialization. For example, the internal synchronization signal can be used to determine a high-frequency trigger pulse, and a delay can be applied to the determined high-frequency trigger pulse, thereby activating the ALS and PS sensors based on the high-frequency trigger pulse and delay time determined by the internal synchronization signal.

[0099] At step 484, the display device (e.g., Figure 2A-2C The display device 200 can generate a VSYNC signal (e.g., if switched to an active or on state). When generating the VSYNC signal, VSYNC period detection can be activated, and the VSYNC signal can be applied as disclosed herein. For example, the VSYNC signal can be used to determine a high-frequency trigger pulse, and a delay can be applied to the determined high-frequency trigger pulse, thereby activating the ALS and / or PS sensors based on the high-frequency trigger pulse and delay time determined by the VSYNC signal.

[0100] Furthermore, at step 486 of process 480, the internal synchronization signal can be rewritten to substantially match the VSYNC signal received at step 484. The rewritten internal synchronization signal can be stored so that it can be applied at a later time. At a later time, the VSYNC signal may no longer be available. For example, the display device may enter a sleep or idle mode because a threshold time period has elapsed since the start of use of the display device and / or display screen. At step 488, in the absence of VSYNC, the rewritten internal synchronization signal (rewritten at step 486) can be applied to determine the ALS and / or PS parameters, as disclosed herein. This internal synchronization signal (as disclosed at step 488) can be applied until the VSYNC signal becomes available again. Steps 484 to 488 can be repeated during operation of the display device.

[0101] Figure 4HA diagram of an ASST implementation 490 according to the subject matter disclosed herein is shown. As shown, a SYNC decision 493 can be made using an internal synchronization signal 491 and / or a VSYNC signal 492. The display device is in internal synchronization mode before the AMOLED panel is turned on at time 494. During this internal synchronization mode, the SYNC decision 493 is based on the internal synchronization signal 491. At time 494, a VSYNC signal 495a is detected, and the duration of the VSYNC signal cycle is determined at time 495b. Upon detecting the duration of the VSYNC signal time, the display device switches the SYNC decision 493 from the internal synchronization mode to the VSYNC mode at time 495b. Specifically, when the VSYNC signal 492 is available and at least one cycle of the VSYNC signal 492 has elapsed, the SYNC decision 493 defaults to the VSYNC signal 492.

[0102] Furthermore, after time 495b, at time 495c, the internal synchronization signal 491 is rewritten based on VSYNC cycle data (e.g., collected between time 495a and time 495b). The display device continues to operate based on the VSYNC data until it becomes unavailable. At time 495d, the AMOLED panel is turned off and the VSYNC signal terminates. The process continues for a threshold number of cycles of undetected VSYNC signals (e.g., 3 cycles, as...). Figure 4H (As shown in the diagram) After this, the display device reverts to internal synchronization mode at time 496 because the VSYNC signal is not detected. It should be noted that, up to time 496, this threshold number of undetected VSYNC cycles can cause the display device to revert to internal synchronization mode. The display device can switch to an on or active state at time 497a, thereby providing the VSYNC signal 492. The first cycle length of the VSYNC signal can be detected at time 497b. The display device can remain in internal synchronization mode until time 497b, and can switch to VSYNC mode based on the VSYNC signal cycle length detected at time 497b. At 498, the internal synchronization counter can be rewritten using the VSYNC cycle length detected at time 497b.

[0103] Figure 6A This shows a display device (e.g., Figure 2AThe image shows the on and off times of the illumination component while the display device 200 is set to a 90% brightness setting. As shown, time 610 corresponds to the time when the illumination component is activated, and time 611 corresponds to the time when the illumination component is deactivated. The PWM signal indicated by signal curve 630 corresponds to a signal of approximately 238.8 Hz, such that the cycle length of the activation and deactivation of the illumination component is approximately 4.1 ms, and the deactivation time is 575 μs as shown by duration 620. It should be noted that in this exemplary 90% display device brightness setting, the illumination component is activated for most of the illumination activation and deactivation cycle, such that the sensor or sensor group can only be activated within a maximum of 575 μs.

[0104] Figure 6B This shows a display device (e.g., Figure 2A The display device 200 is set to a 50% brightness setting, and another image shows the on and off times of the lighting component. As shown, time 615 corresponds to the time when the lighting component is activated, and time 616 corresponds to the time when the lighting component is deactivated. The PWM signal indicated by signal curve 635 corresponds to... Figure 6A A similar 238.8Hz signal results in an activation and deactivation cycle length of approximately 4.1ms for the lighting component. However, as shown in duration 625, the deactivation time of the lighting component is 1.59ms, which is approximately... Figure 6A The deactivation time of the illumination component is three times that shown when the display device is set to 90% brightness. It should be noted that in this exemplary 50% display device brightness setting, compared to... Figure 6A Compared to the activation and deactivation cycles of the display device, the illumination components are activated within shorter illumination activation and deactivation cycles, allowing sensors or sensor groups to be activated within a maximum of 1.59 ms. Accordingly, Figure 6B The lower brightness setting shown allows for a longer sensing time, which can result in higher sensing accuracy.

[0105] According to embodiments of this teaching, when a given display device is set to maximum brightness, the longest sensing time (e.g., the time it causes) is... Figure 4A The sensor activation times 432, 433, 434 can be preset to (e.g.) the duration of the deactivation time (e.g., Figure 6A 620 and Figure 6B (625). According to this embodiment, the sensor activation time will always be at the minimum duration for which the lighting component is deactivated.

[0106] According to another embodiment of this teaching, the sensing time can be dynamic and can be determined based on a given brightness setting. According to this embodiment, the sensing time (e.g., which causes...) Figure 4A The sensor activation times (432, 433, 434) are when the brightness is set to 90%. Figure 6A In the example shown, it can be set to 575 μs, and the brightness is set to 50%. Figure 6B In the example shown, it can be set to 1.59ms.

[0107] Figure 6C This shows a display device (e.g., Figure 2A The display device 200 is set to 50% brightness while the lighting components are turned on and off simultaneously, displaying another image. Figure 6C The PWM 640 shown here cycles once in each corresponding VSYNC loop, thus exhibiting a 50% on and 50% off drive scheme.

[0108] As a response Figure 3 A summary of process A (300 points), such as... Figure 4A As shown in the provided illustration, a VSYNC signal 410 can be provided by a TCON for a display device. The cycle length 411 of the VSYNC signal 410 can be determined based on detecting one or more rising and / or falling edges of the VSYNC signal 410. A high-frequency trigger pulse 420 can be determined based on the VSYNC signal 410 and can be determined based on detecting PWM signals corresponding to the activation and deactivation times of one or more lighting elements. The high-frequency trigger pulse 420 can have a cycle length 421 that is less than the cycle length 411 of the VSYNC signal 410. The high-frequency trigger pulse 420 can segment the VSYNC signal 410, and the cycle length of the high-frequency trigger pulse 420 can include a delay 431 and a sensor activation time 432. The delay 431 can be determined based on the position of the sensor or sensor group activated at sensor activation times 432, 433, and 434. Delay 431 allows the sensor or sensor group to activate at a time different from the activation times 422, 423, 424, and 425 of the illumination component, so that the sensor or sensor group is activated when the illumination component is deactivated. It should be noted that the sensor or sensor group can be activated at sensor activation times 432, 433, and 434 when there is no internal light reflected based on the activation of the illumination component, thus making the corresponding sensor readings unaffected by such reflected light.

[0109] like Figure 2AAs shown, one or more light sensors 230 and proximity sensors 240 may be provided in sensor layer 220. The light sensor 230 is configured to sense ambient light wavelength 210 and can provide the resulting sensing data to a processor. If one or more lighting components 216 are activated to sense ambient light wavelength 210 at the time when the light sensor 230 is activated, then the ambient light wavelength 210 sensed by the light sensor 230 may be doped. Accordingly, Figure 3 Process 300 (e.g.) Figures 4A-4D The example provided illustrates a technique that configures a sensor or group of sensors to activate when a corresponding lighting element is deactivated. Accordingly, Figure 3 The process 300 enables the optical sensor to sense ambient light wavelength 210 without the influence of doping of internal light 216B.

[0110] Traditionally, proximity sensors in display devices are not located below the surface layer of the display device because the signals emitted by such proximity sensors interfere with the visible operation of the display device. Figure 7 An exemplary result of operating an IR proximity sensor located beneath the surface layer 705 of the display device 700 is shown. Operation of the IR proximity sensor may result in visible black spots, such as black spot 720 visible on the surface layer 705 of the display device 700. Black spot 720 may be a result of activating the IR proximity sensor simultaneously with activating the illumination component of the display device 700, causing the signal emitted by the IR proximity sensor to interfere with the light illuminated by the illumination component, thus producing black spot 720.

[0111] Figure 3 Process 300 (e.g.) Figures 4A-4D (As illustrated in the illustration) provides a technique that prevents or mitigates black spots by activating a proximity sensor while the corresponding lighting component is deactivated. Figure 7 The black spots (720) are removed, resulting in a visible effect without black spots.

[0112] In addition, it can be done according to Figure 8 The further configuration of the proximity sensor as specified in process 800 (e.g., Figure 2A Operation of proximity sensor 240.

[0113] At step 810, a proximity sensor may be activated. The proximity sensor may be an IR sensor, which, when activated, emits an IR signal toward the surface layer of the display device, such that the IR signal, or a component of the IR signal, leaves the display device via the surface layer. The IR signal may be emitted by the proximity sensor and may be reflected by an external surface (e.g., if the display device is placed close to the user's ear while the user is making a phone call, the display device is close to the user's skin). Alternatively, the IR signal may be emitted by the proximity sensor and may not be incident on external objects (e.g., if no external object is near the display device), and therefore may not be reflected.

[0114] Accordingly, in Figure 8 At step 820 of process 800, a proximity sensor may be configured to sense a reflected IR signal (e.g., an IR reflection value). The reflected IR signal may be received by the proximity sensor, and the proximity sensor may be configured to sense the distance between the display device and an external object. The proximity sensor may be configured to sense this distance based on one or more of the timing, amplitude, and / or phase of the reflected IR signal. The proximity sensor may provide proximity sensing data to a processor, and the processor may maintain or modify the operation of the display device based on the proximity sensing data, as further described herein. At step 820, the proximity sensor configured to sense the reflected IR signal may not sense the reflected IR signal, or may sense a reflected IR signal below a given threshold (e.g., signal amplitude). The result of step 820 may be a proximity determination result, which may be, for example, a proximity value (e.g., if a reflected IR signal is received) or no proximity determination result.

[0115] exist Figure 8At step 830 of process 800, a display device operation determination can be made based on the result of step 820. The display device operation determination can be made by any component (e.g., a processor or sensor hub device that receives the result of step 820). For example, if the proximity value is greater than the HTH value, the sensor hub or processor can send a signal to turn off the display device, thereby reducing power consumption. According to this example, a proximity value greater than the HTH value could correspond to a smartphone device being very close to the user's head. Continuing with this example, if the proximity value is less than the LTH value, the sensor hub or processor can turn on the display driver, thereby restoring the normal display screen. According to this example, a proximity value less than the LTH value could correspond to a smartphone device not being very close to the user's head. The display device operation determination can include, but is not limited to, activating the display device, deactivating the display device, modifying the characteristics of the display device (e.g., brightness (LUX), hue, saturation, correlated color temperature (CCT), tristimulus values ​​(XYZ or xy), etc.) or combinations thereof. As an example, when the proximity sensor is configured to sense a reflected IR signal, the result of step 820 could be that the proximity sensor senses an external object within a proximity threshold of the display device (e.g., within 6 inches). Based on this determination, in step 830, a display device operation determination can be made that the display device should cease displaying for at least a given amount of time.

[0116] exist Figure 8 In step 840 of process 800, the proximity sensor activation frequency can be determined based on the result of step 820. The proximity sensor activation frequency can be maintained at its current frequency, increased, or decreased. It should be noted that decreasing the proximity sensor activation frequency can further mitigate or prevent the influence of black spots, such as... Figure 7 As shown in the diagram. The proximity sensor activation frequency can be determined based on the result of step 820, thereby allowing a higher activation frequency to be generated for a given proximity or proximity range, and a lower activation frequency to be generated for different proximity or proximity ranges, as further described herein. The determined proximity sensor activation frequency can be provided as input to step 810, so that the proximity sensor can be activated based on the determined frequency in subsequent iterations of step 810, and process 800 can continue to loop for subsequent iterations and subsequent additional iterations.

[0117] Figure 9A It shows Figure 8An exemplary implementation of step 840 of process 800. As shown, a SYNC signal 910 (e.g., the VSYNC signal described herein) may be provided, and the proximity sensor may be configured to activate once during each alternating cycle of the SYNC signal 910, as shown in signal activation 920. The proximity sensor may be an IR 940nm emitter and may be provided below the light-emitting layer of the display device, for example, proximity sensor 240 of FIG2. As shown in signal activation 920, the proximity sensor is activated once every two cycles of SYNC signals 910. Signal activation 930 shows the proximity sensor at a time after all signal activations 920. Figure 9A In the example shown, the result of a proximity sensor activated at time 930a by transmitting a signal and sensing a reflected signal (e.g., the result of step 820 of process 800) can be that the proximity sensor determines that it is within 2 inches of an external object. According to this example, the proximity threshold can be 6 inches, thus distances below 6 inches can be considered low proximity distances. As an example, a user using a corresponding display device might be making a phone call with the display device close to the user's ear. Accordingly, at step 830 of process 800, and based on the sensing result of the reflected signal indicating a proximity distance of 2 inches (e.g., the result of step 820 of process 800), the display device can temporarily turn off its display, thereby saving battery life and reducing the heat generated by the display device. Furthermore, at step 840 of process 800, a decision can be made to reduce the activation frequency of the proximity sensor based on the result of sensing the reflected signal and determining that the distance is below the proximity threshold. Accordingly, as... Figure 9A As shown, after the proximity sensor is activated at time 930a, the frequency of signal activation 930 can be delayed, so that the proximity sensor is subsequently activated at time 930b, which is four cycles after the previous sensor activation at time 930a. It should be noted that the frequency of proximity sensor signal activation 920 is twice the frequency of signal activation 930, which is a result of the proximity between the sensor and the external object being below a proximity threshold.

[0118] According to embodiments of this teaching, a high threshold (HTH) and a low threshold (LTH) can be applied to determine the proximity sensor sensing rate. HTH and / or LTH can be predetermined or dynamically determined. Predetermined settings can be pre-programmed or determined based on user settings or user input. HTH and / or LTH can be dynamically determined based on historical usage or machine learning, etc. Figure 9B Determine the proximity sensor's sensing rate. For example... Figure 9BAs shown, HTH can be set to, for example, 2.5 cm, and LTH can be set to, for example, 5 cm. Band 940 can correspond to a proximity closer than 2.5 cm, and band 941 can correspond to a proximity between HTH and LTH, thus in Figure 9B In the example, the proximity is between 2.5cm and 5cm. Zone 942 can correspond to a proximity greater than 5cm.

[0119] Bands 940 and 942 can be considered stable bands, where their proximity sensor sensing rates are slower compared to band 941, while band 941 is considered a transition band where the proximity sensor sensing rate is high when crossing regions from 941 to 940 or from 941 to 942. As an example, stable band 940, corresponding to proximity less than 2.5 cm, could correspond to a user holding the mobile phone close to their ear (e.g., while making a call), or when the mobile phone is in the user's pocket. Stable band 942, corresponding to proximity greater than 5 cm, could correspond to a mobile phone placed on a surface and not in use. Transition band 941, corresponding to proximity between 2.5 cm and 5 cm, could correspond to a user holding the mobile phone and possibly using it. Accordingly, the proximity sensor sensing rate may be low when the mobile phone is in stable zone 940 (e.g., when the mobile phone is at the user's ear or in the user's pocket) and in stable zone 942 (e.g., when the mobile phone is on a surface). The proximity sensing rate may be high when the mobile phone moves from transition zone 941 to stable zone 940 or when the mobile phone moves from transition zone 941 to stable zone 942 (e.g., when the mobile phone is on a surface). Although actual proximity distances (e.g., 2.5 cm and 5 cm) are provided herein, it should be understood that proximity can be determined based on the signal strength of the proximity signal (e.g., IR reflection value). Accordingly, HTH can be a value less than LTH, such that the signal strength can be lower as the object moves further away and higher as the object moves closer.

[0120] Figure 9C This shows the display device in a stable band (e.g., Figure 9B The exemplary proximity sensor sensing rate in band 940 or band 942. As shown, signal activation 944 may occur once every four SYNC cycles 943, such that the time interval 945 between each signal activation 944 is four SYNC cycles, as indicated by the lengths 945A, 945B, and 945c of the four SYNC cycles corresponding to the SYNC signal 943.

[0121] Figure 9D This illustrates the situation when the display device is transitioning from transition zone 941 to stable zone (e.g., Figure 9B An exemplary proximity sensor sensing rate during the band 940 is indicated by duration 965. As an example, the proximity sensor activation time 951 may include a first proximity sensor activation time 951a. The response obtained by sensing the reflected signal based on the IR signal emitted during the first proximity sensor activation time 951a can produce a determination of the proximity value being across the HTH (e.g., when the mobile phone is at the user's ear or in the user's pocket) or across the LTH level (e.g., when the mobile phone is on a surface). Accordingly, the proximity sensing rate can be set to a high frequency such that subsequent proximity sensor activation occurs during the next cycle of the SYNC signal 950, as indicated by a second proximity sensor activation time 951b. The proximity sensing rate can continue to be set to a high frequency for four cycles of the SYNC signal 950, as indicated by durations 965 of 956, 957, 958, and 959, each divided into four SYNC cycles occupying one SYNC cycle of the SYNC signal 950. After these four cycles have expired, it can be determined that the proximity of the display device is in a stable band (e.g., Figure 9B Within the band 940 or 942. Accordingly, the proximity sensing rate can be set to a slow frequency such that during durations 966 and 967, proximity sensor activation occurs four cycles after the SYNC signal 950, starting from proximity sensor activation time 952, corresponding to signal proximity sensor activation times 952 and 953.

[0122] like Figure 2A As shown, multiple sensors can be provided, and these sensors may include a light sensor 230 and a proximity sensor 240. Multiple sensors can be placed in... Figure 2B and Figure 2C The reflection-affected area 250 occupies the same area. For example... Figure 10 As shown, the light sensor 230 and the proximity sensor 240 can be activated relative to each other based on the SYNC signal 1001. For example, the light sensor 230 and the proximity sensor 240 can be activated simultaneously, as shown in operation mode 1010; the light sensor 230 can be activated more frequently than the proximity sensor 240, as shown in operation mode 1020; or the light sensor 230 can be activated at a lower frequency than the proximity sensor 240, as shown in operation mode 1030. A given operation mode can be determined based on a predetermined criterion or a dynamically determined criterion (e.g., based on attributes sensed by one or more corresponding sensors, such as the amount of ambient light or proximity).

[0123] According to embodiments of this teaching, an accumulation function can be applied, which defines the frequency of output sensing data. The accumulation function can be applied such that sensing data is output after a set number of sensing cycles, as based on... Figure 11 The accumulation function 1101 is shown, where the sensed data is output at output time 1101a after three sense cycles. Alternatively, an accumulation function can be applied to output the sensed data after each sense cycle, as shown in accumulation function 1102, where the sensed data is output at output time 1102a after each sense cycle. The accumulation function can be predetermined or dynamically predetermined. For example, when the proximity sensor is in a stable zone (e.g., as shown in accumulation function 1102), the accumulation function can be applied at output time 1102a. Figure 9B When the accumulation function is set to a low frequency (as described in the document), the sensing data can be output after accumulating multiple sensing cycles (e.g., accumulation function 1101).

[0124] Figure 12A A system 1200 illustrating an implementation of this teaching is shown. Block 1210 illustrates, as shown... Figure 3 The VSYNC loop detector is described in step 310 of process 300. The VSYNC input signal 1201 can be provided by a TCON and can have a frequency such as 60Hz, 90Hz, 120Hz, or 240Hz. The VSYNC input signal can be combined with a clock generator 1202 (e.g., a 1MHz clock generator) and can be provided to a counter 1204 (e.g., a 16-bit counter). Counter 1204 can provide a clock-aligned VSYNC signal to a SYNC duty cycle counter 1203, and the clock duty cycle counter 1203 signal can be provided to counter 1230. Edge data can be provided to a loop counter 1223 and an AND gate 1225. Loop counter 1223 can be a SYNC counter or a component of a SYNC counter. Loop counter 1223 can provide a count to a SYNC_Gen counter 1224, which can be configured to determine the duration of the loop length of the VSYNC input signal 1201. The SYNC_GEN counter can be the SYNC wait signal or can receive the SYNC wait signal. The output of the loop counter 1223 can be provided to the AND gate 1225, and the implementation of the logical AND can be provided to the counter 1230.

[0125] At block 1220, a high-frequency trigger pulse can be generated and provided to counter 1230. The VSYNC input signal 1201 can be provided to the SYNC edge detector, which can detect the rising edge of the VSYNC input signal 1201 (e.g., Figure 4B The rising edge 413) and / or falling edge (e.g., Figure 4B (falling edge 414).

[0126] Delayed signal 1261 (e.g.) Figure 4D The duty cycle signal 1262 (described herein) can also be provided to counter 1230. The output of counter 1230 can be provided to sensing mode determination block 1264, which can determine the sensing mode based on, for example, logic table 1263, as shown in... Figure 10 As depicted in the diagram. The output of counter 1230 can be combined with sensing mode determination block 1264 and can be provided to proximity sensing block 1240 and light sensing block 1250.

[0127] The proximity sensing block 1240 may include a PS_Engine 1242, which receives inputs from the output of the sensing mode determination block 1264, namely PS_Window 1241 and PS_GAN(IT) 1243. PS_Engine 1242 can generate an output and provide it to PS_Counter 1245, which also receives inputs from PS_Count 1244 to provide a proximity counter signal that activates the proximity sensor via PS_OUT 1247. According to one embodiment, PS_Engine 1242, PS_Counter 1245, and PS_OUT 1247 provide inputs to PS_D_Buffer 1246, which can adjust the timing of PS_OUT 1247.

[0128] Ambient light sensing block 1250 may include ALS_Engine 1251, which receives input from the outputs of sensing mode determination block 1264 and ALS_IT 1252. ALS_Engine 1251 can generate an output and provide it to ALS_Counter 1254, which also receives input from ALS_Count 1255 to provide an ALS counter signal that activates the light sensor via ALS_OUT 1256. According to an embodiment, ALS_Engine 1251, ALS_Counter 1254, and ALS_OUT 1256 provide input to ALS_D_Buffer 1253, which can adjust the timing of ALS_OUT 1256. The outputs of PS_Counter 1245 and ALS_Counter 1254 can also be provided to INT_GEN 1257, which also receives the INT_MODE 1258 signal.

[0129] Figure 12BImplementations of the disclosed subject matter are shown, including DVRR detection techniques as disclosed herein. Figure 12A The VSYNC loop detector 1210 can... Figure 12B In step 1270, a VSYNC input signal 1201 is received from the TCON. The VSYNC input signal 1201 may have a refresh rate frequency such as, for example, 60Hz, 90Hz, 120Hz, or 240Hz. The detected refresh rate frequency can be provided to block 1271. At block 1271, the current refresh rate frequency can be compared with the refresh rate frequency of the previous cycle. This comparison may include determining that the difference between the previous refresh rate frequency and the current refresh rate frequency is greater than an HFTH or LFTH value, as disclosed herein.

[0130] If it is determined at block 1271 that the difference between the previous refresh rate frequency and the current refresh rate frequency is greater than HFTH or less than LFTH, then the VRR interrupt flag can be triggered at block 1272. When the VRR interrupt flag is triggered, the driver can be configured to... Figure 3 , Figures 4A-4E Determine the parameters to update. For example... Figure 12A As shown, the update parameters can include Figure 12A The synchronization generator 1220 includes a synchronization counter 1223, a delay signal 1261 of counter 1230, a PS integration time (PS_window) 1241 of proximity sensing block 1240, and an ALS integration time (ALS_IT) 1252 of ambient light sensing block 1250. These can correspond to updated PWM signals, which in turn correspond to updated refresh rate frequencies, such as... Figures 6A-6C As illustrated in the example, system registers can be updated based on update parameters, such as... Figure 4E exemplified in .

[0131] Figure 12C An implementation of the disclosed subject matter according to the ASST scheme disclosed herein is shown. It should be noted that... Figure 12C The modified version based on the ASST scheme is shown. Figure 12A A SYNC generator. For example... Figure 12C As shown, in addition to the loop counter 1223, an internal synchronization counter 1226 is also provided. The internal synchronization counter 1226 can generate an initialization signal to be used before the display device is fully activated. Furthermore, the internal synchronization counter 1226 can be updated based on the SYNC counter, so that when the SYNC_GEN counter does not provide a signal (e.g., when the device is in a sleep or idle state), the internal synchronization counter 1226 can provide a synchronization signal based on the previous SYNC_GEN counter signal.

[0132] like Figure 12C As shown, the SYNC signal 1201 is provided to the AND gate 1225, and the internal synchronization counter 1226 signal is provided to the AND gate 1227. When the SYNC signal 1201 is active, the SYNC generator outputs the SYNC signal 1201, and when the SYNC signal 1201 is inactive, the SYNC generator outputs the signal generated by the internal synchronization counter 1226.

[0133] As a specific example, a 16-bit timing data register (e.g., 1666 μs or 60.024 Hz) can be used to implement a SYNC signal 1201 cycle detection counter. When a new SYNC signal 1201 is provided, the SYNC signal 1201 cycle data can be written to the internal synchronization counter 1226. According to the implementation, SYNC signal 1201 pulses shorter than 10 μs can be ignored as noise.

[0134] It should be understood that although an IR proximity sensor has been described above, the proximity sensor can be any suitable type of sensor capable of detecting the proximity of an external object to the display device. For example, the proximity sensor can be a long infrared (LIR) sensor, an ultrasonic sensor, a radar sensor, an inductive sensor, a capacitive sensor, a photoelectric sensor, a transmission beam sensor, a diffuser sensor, an ultrasonic sensor, or any other proximity detection sensor. Accordingly, it should be understood that although an IR proximity sensor has been described, the embodiments of this teaching can be applied to any such suitable proximity detection sensor.

[0135] Those skilled in the art will readily recognize that the apparatus, systems, and techniques for under-display sensing as defined herein can be implemented using any or more of a wide variety of available forms, techniques, and components, including but not limited to implementation via a non-writable storage medium such as a ROM device, via a writable storage medium such as a floppy disk, magnetic tape, CD, RAM device, and other magnetic and optical media, via wired or wireless communication, via circuits, registers, etc. The apparatus, systems, and techniques disclosed herein can be implemented by processor-executable software or can be implemented as a set of instructions embedded in a carrier wave. Alternatively, the apparatus, systems, and techniques disclosed herein can be embodied entirely or partially using hardware components, such as application-specific integrated circuits (ASICs), state machines, controllers, or other hardware components or devices, or a combination of hardware, software, and firmware components.

[0136] Although the teachings have been specifically shown and described with reference to embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made herein without departing from the scope of the teachings as covered by the appended claims.

Claims

1. A method for operating a display device, the method comprising: Detect the vertical synchronization (VSYNC) signal loop; A high-frequency trigger pulse is determined by detecting the pulse width modulation (PWM) signal of the lighting component, the high-frequency trigger pulse corresponding to the deactivation time of the lighting component; Determine the delay time period of the first sensor; The first sensor is activated at the first moment within the VSYNC signal cycle, while the lighting component is deactivated. The first moment is determined based on the high-frequency trigger pulse and the delay time period. The operation of the display device is modified based on the activation of the first sensor; Detect and update the VSYNC signal loop; The updated VSYNC signal cycle is determined to be at least one of two cases: greater than the high frequency threshold (HFTH) and less than the low frequency threshold (LFTH). Based on determining that the updated VSYNC signal cycle is at least one of two cases, greater than HFTH and less than LFTH, the updated high-frequency trigger pulse and the updated delay time period are determined; and The first sensor is activated at a second time within the updated VSYNC signal cycle, the second time being determined based on the updated high-frequency trigger pulse and the updated delay time period.

2. The method according to claim 1, further comprising: The first sensor senses the reading of the first sensor; The first sensor is deactivated in response to sensing a reading from the first sensor. The display settings are modified by adjusting the display settings based at least on the first sensor readings; as well as The lighting component is activated after the first sensor is deactivated.

3. The method according to claim 2, further comprising: The second sensor is activated after the first sensor is activated. The second sensor senses the reading of the second sensor; as well as The display settings are adjusted based on the readings from the second sensor.

4. The method according to claim 1, wherein, The delay time period is based on the position of the first sensor.

5. The method according to claim 1, wherein, Detecting the VSYNC loop includes detecting either the rising edge or the falling edge of the VSYNC loop.

6. The method according to claim 1, wherein, The first sensor is one of a proximity sensor and an ambient light sensor.

7. The method of claim 1, further comprising activating the first sensor at a second time within an internal synchronization signal loop.

8. An apparatus comprising: It has an upper surface and a lower surface and is formed as a surface layer to receive ambient wavelengths; A lighting component positioned below the lower surface of the surface layer and configured to be activated and deactivated; A first sensor is positioned below the lower surface of the surface layer, such that the illumination component is positioned between the surface layer and the first sensor, the first sensor being configured to: Activation occurs at a first time within the vertical synchronization (VSYNC) signal cycle, wherein the lighting component is deactivated. This first time is determined based on the high-frequency trigger pulse corresponding to the deactivation of the lighting component and the delay time period of the first sensor. The second activation occurs within the updated VSYNC signal cycle, where the updated VSYNC signal is at least one of two conditions: greater than a high-frequency threshold (HFTH) and less than a low-frequency threshold (LFTH). This second activation time is determined based on the updated high-frequency trigger pulse corresponding to the deactivation of the illumination component and the update delay period of the first sensor. The ambient wavelength emitted through the surface layer is sensed while the first sensor is activated. as well as A processor configured to modify the operation of the lighting component based on the ambient wavelength sensed by the first sensor.

9. The apparatus according to claim 8, wherein, The first sensor is also configured to: Sensing the first sensor reading; and Deactivate in response to sensing the first sensor reading.

10. The apparatus according to claim 9, wherein, The processor is also configured to: Adjust the display settings based at least on the readings of the first sensor; and The lighting component is activated after the first sensor is deactivated.

11. The apparatus according to claim 8, wherein, The delay period is applied based on the edge of the VSYNC loop.

12. The apparatus according to claim 8, wherein, The delay time period is determined based on the position of the lighting component.

13. The apparatus of claim 8, further comprising a second sensor facing the surface layer and configured to: Activated when the lighting component is deactivated; and Sensing reflected proximity signals.

14. The apparatus according to claim 13, wherein, The processor is also configured to modify the operation of the lighting component based on the reflected proximity signal sensed by the second sensor.

Images