Electronic device, optical compensation system, and method for driving the electronic device

Abstract

The present invention provides an optical compensation system, an electronic device including a compensation system, and a method for driving an electronic drive device. [Solution] The electronic device includes a display panel including a plurality of pixels and a plurality of sensors, a sensor drive circuit for driving the plurality of sensors, a decoder for receiving coordinate information relating to an arbitrary region from the sensor drive circuit, and a memory for receiving memory coordinate information and a read command signal corresponding to the arbitrary region from the decoder and outputting corresponding compressed compensation data to the decoder. The decoder may include a first memory for storing information necessary for restoring the compressed compensation data, a restoration unit for outputting restored compensation data using the compressed compensation data and the information necessary for restoration, and a second memory for receiving and storing the restored compensation data from the restoration unit and outputting the restored compensation data to the sensor drive circuit.

Description

[Technical Field]

[0001] The present invention relates to an optical compensation system, an electronic device including a compensation system, and a method for driving an electronic device. [Background technology]

[0002] Electronic devices capable of displaying images, such as televisions, mobile phones, tablet PCs, navigation systems, and game consoles, may employ touch-based input methods in addition to conventional input methods such as buttons, keyboards, and mice, allowing users to easily and intuitively input information or commands.

[0003] Recently, methods utilizing fingerprints, a type of biometric information, as a means of user authentication for online banking, product purchases, and security have been proposed, and the demand for electronic devices with fingerprint recognition capabilities is increasing.

[0004] Optical sensors used for fingerprint recognition, document scanning, and other applications may be provided separately from the display panel of an electronic device. Recently, technologies have emerged that integrate pixels for displaying images and light-sensing elements (or optical sensors) for detecting light into a single display panel. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Korean Published Patent No. 10-2017-0026975 [Patent Document 2] Korean Published Patent No. 10-2021-0033882 [Patent Document 3] Korean Published Patent No. 10-2019-0088150 [Patent Document 3] Chinese Patent No. 114120915 Specification [Overview of the project] [Problems that the invention aims to solve]

[0006] One objective of the present invention is to provide an optical compensation system, an electronic device including a compensation system, and a method for driving an electronic drive device. [Means for solving the problem]

[0007] According to one embodiment of the present invention, the electronic device includes a display panel including a plurality of pixels and a plurality of sensors, a sensor drive circuit for driving the plurality of sensors, a decoder for receiving coordinate information relating to an arbitrary region from the sensor drive circuit, and a memory for receiving memory coordinate information and a read command signal corresponding to the arbitrary region from the decoder and outputting corresponding compressed compensation data to the decoder. The decoder may include a first memory for storing information necessary for restoring the compressed compensation data, a restoration unit for outputting restored compensation data using the compressed compensation data and the information necessary for restoration, and a second memory for receiving and storing the restored compensation data from the restoration unit and outputting the restored compensation data to the sensor drive circuit.

[0008] In one embodiment of the present invention, the sensor drive circuit receives sensor signals from the plurality of sensors, converts the sensor signals to generate sensor data, and the sensor drive circuit can perform optical compensation calculations on the sensor data via the restoration compensation data to generate optically compensated sensor data.

[0009] In one embodiment of the present invention, the first memory may include a 1-1 memory, a 1-2 memory, a 1-3 memory, a 1-4 memory, a 1-5 memory, and a 1-6 memory, each storing different information necessary for the restoration.

[0010] In one embodiment of the present invention, the restoration compensation data may include offset data and gain data.

[0011] In one embodiment of the present invention, the second memory may include a second-first memory for storing the offset data and a second-second memory for storing the gain data.

[0012] In one embodiment of the present invention, each of the plurality of sensors may be an optical sensor.

[0013] In one embodiment of the present invention, the arbitrary region may be a region necessary for fingerprint authentication.

[0014] In one embodiment of the present invention, the period during which the information necessary for the restoration is output from the first memory to the restoration unit may overlap with the overhead period.

[0015] In one embodiment of the present invention, the information necessary for the restoration may be encoded table data.

[0016] In one embodiment of the present invention, the information necessary for the restoration may be quantization error correction data.

[0017] In one embodiment of the present invention, the information necessary for the restoration may be outlier data.

[0018] In one embodiment of the present invention, the memory is a non-volatile memory, and the first memory and the second memory may be volatile memories.

[0019] In one embodiment of the present invention, the compression compensation data is data obtained by compressing AC component data, and the AC component data may be data obtained by removing DC component data from optical compensation data.

[0020] According to one embodiment of the present invention, the optical compensation system includes a decoder that receives coordinate information relating to an arbitrary region, and a memory that receives memory coordinate information and a read command signal corresponding to the arbitrary region from the decoder and outputs corresponding compressed compensation data to the decoder. The decoder includes a first memory that stores information necessary for restoring the compressed compensation data, a restoration unit that outputs restored compensation data using the compressed compensation data and the information necessary for restoration, and a second memory that receives and stores the restored compensation data from the restoration unit and outputs the restored compensation data. The memory is a non-volatile memory, and the first and second memories may be volatile memories.

[0021] In one embodiment of the present invention, the aforementioned arbitrary region may be a region necessary for fingerprint authentication.

[0022] In one embodiment of the present invention, the period during which the information necessary for restoration is output from the first memory to the restoration unit may overlap with the overhead period.

[0023] In one embodiment of the present invention, the information necessary for restoration may be encoded table data, quantization error correction data, or outlier data.

[0024] According to one embodiment of the present invention, a method for driving an electronic device may include the steps of: identifying an arbitrary region in contact with an object; identifying a corresponding ROM address based on the coordinate information of the arbitrary region; reading continuous data from the beginning address of the ROM address; generating data by restoring the compressed and compensated data, which is the read data, through information necessary for restoration; and generating optically compensated sensor data by performing optical compensation calculations on the sensor data through the restored data.

[0025] In one embodiment of the present invention, the step of reading consecutive data from the beginning address of the ROM address may include the step of calculating the number of bits of unnecessary first data, the step of calculating the number of bits of unnecessary last data, and the step of calculating the number of clock cycles required for reading.

[0026] In one embodiment of the present invention, the restoration step may include: comparing representative value data corresponding to the (X0+i, Y0+j) coordinate with representative value data corresponding to the Y0+j row; if there is outlier data, restoring the compressed compensation data for the coordinates having the outlier data in the Y0+j row via the outlier data; if there is no outlier data, restoring the compressed compensation data via the corresponding representative value data; and, once the restoration of the data in the Y0+j row is complete, repeating the restoration of any rows that have not been restored. [Effects of the Invention]

[0027] As described above, the electronic device may include a display panel, a decoder, and a memory. The sensor area of ​​the display panel can detect whether an object is in contact with it, and an arbitrary area can be identified for acquiring the necessary image (or data). The decoder can receive coordinate information of the arbitrary area from the panel and receive corresponding compressed and compensated data from the memory.

[0028] The decoder's restoration unit can generate and output restoration compensation data using the compression compensation data corresponding to the arbitrary region and the information necessary for restoration corresponding to the arbitrary region stored in the decoder's first memory.

[0029] Because electronic devices can compensate for only a specific region of the image, power consumption can be reduced and the recovery speed can be increased. [Brief explanation of the drawing]

[0030] [Figure 1] This is a perspective view of an electronic device according to one embodiment of the present invention. [Figure 2]This is a block diagram of an electronic device according to one embodiment of the present invention. [Figure 3] This is a block diagram of an optical compensation system according to one embodiment of the present invention. [Figure 4] This is a plan view showing a sensor area according to one embodiment of the present invention. [Figure 5] This is a flowchart for an optical compensation system according to one embodiment of the present invention. [Figure 6A] This graph illustrates an optical compensation data compression algorithm according to one embodiment of the present invention. [Figure 6B] This graph illustrates an optical compensation data compression algorithm according to one embodiment of the present invention. [Figure 7] This is a flowchart illustrating a restoration algorithm according to one embodiment of the present invention. [Figure 8A] This figure illustrates a method for calculating a ROM address according to one embodiment of the present invention. [Figure 8B] This figure illustrates a method for calculating a ROM address according to one embodiment of the present invention. [Figure 9] This is a block diagram of a decoder design according to one embodiment of the present invention. [Modes for carrying out the invention]

[0031] In this specification, when a component (or region, layer, part, etc.) is referred to as "on top of," "combined with," or "combined with" another component, it means that it can be directly placed on top of, connected to, or combined with the other component, or that a third component can be placed between them.

[0032] The same drawing symbol refers to the same component. Furthermore, in drawings, the thickness, proportions, and dimensions of components are exaggerated for the sake of effective explanation of the technical content. "and / or" includes all combinations of one or more components defined by the relevant component.

[0033] Terms such as "first," "second," etc., are used to describe a variety of components, but the components are not limited to those defined by these terms. These terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may also be named the first component. A singular form may include plural expressions unless the context clearly indicates otherwise.

[0034] Furthermore, terms such as "down," "on the lower side," "up," and "on the upper side" are used to describe the relationships between the components shown in the drawing. These terms are relative concepts and are described in relation to the direction shown in the drawing.

[0035] Terms such as "includes" or "has" indicate the presence of features, figures, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood not to pre-exist to exclude the presence or possibility of adding one or more other features, figures, steps, actions, components, parts, or combinations thereof.

[0036] The terms "part" and "unit" refer to software components or hardware components that perform a specific function. Hardware components include, for example, FPGAs (field-programmable gate arrays) or ASICs (application-specific integrated circuits). Software components refer to executable code and / or data used by executable code in an addressable storage medium. Thus, software components include, for example, object-oriented software components, class components, and work components, and include processes, functions, attributes, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, or variables.

[0037] Unless otherwise defined, all terms used herein (including technical and scientific terms) have the same meaning as those generally understood by those skilled in the art in the field to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries should be interpreted as having the same meaning as they do in the context of the relevant art, and should not be interpreted in an overly idealistic or formal sense unless expressly defined herein.

[0038] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0039] Figure 1 is a perspective view of an electronic device ED according to one embodiment of the present invention.

[0040] Referring to Figure 1, the electronic device ED may be a device activated by an electrical signal. For example, the electronic device ED may be, but is not limited to, a mobile phone, a flip phone, a laptop computer, a television, a tablet, a car navigation system, a game console, or a wearable device. Figure 1 illustrates the electronic device ED as a mobile phone.

[0041] An electronic device ED may be defined as having an active region 1000A and a peripheral region 1000NA. The electronic device ED can display an image via the active region 1000A. The active region 1000A may include a plane defined by a first direction DR1 and a second direction DR2. The peripheral region 1000NA may surround the periphery of the active region 1000A. In one embodiment of the present invention, the peripheral region 1000NA may be omitted. The active region 1000A is, for example, a region on which an image can be displayed, and the peripheral region 1000NA is, for example, a region on which no image is displayed.

[0042] The thickness direction of the electronic device ED is generally parallel to the third direction DR3, which intersects the first direction DR1 and the second direction DR2. Therefore, the front (or top) and back (or bottom) surfaces of the components constituting the electronic device ED can be defined with respect to the third direction DR3.

[0043] Figure 2 is a block diagram of an electronic device ED according to one embodiment of the present invention.

[0044] Referring to Figure 2, the electronic device ED may include a display panel DP, a drive controller DC, a data drive circuit DDC, a scan drive circuit GDC, a sensor drive circuit SDC, a decoder DEC, and a memory ROM.

[0045] In one embodiment of the present invention, the drive controller DC, data drive circuit DDC, scan drive circuit GDC, sensor drive circuit SDC, decoder DEC, and memory ROM can each be implemented as an integrated circuit (IC) and electrically connected to the display panel DP. Alternatively, at least a portion of the data drive circuit DDC, scan drive circuit GDC, and sensor drive circuit SDC may be embedded within a predetermined area of ​​the display panel DP.

[0046] Furthermore, in one embodiment of the present invention, the sensor drive circuit SDC and the decoder DEC may be implemented on a single integrated chip, or they may be implemented on separate chips that are separated from each other. Also, the sensor drive circuit SDC, the decoder DEC, and the memory ROM may be implemented on a single integrated chip, or they may be implemented on separate chips that are separated from each other.

[0047] The drive controller DC can receive input video signals RGB and control signal CTRL. The drive controller DC can generate output video signal DATA by converting the data format of the input video signal RGB to match the data drive circuit DDC and display panel DP. The drive controller DC can output scan control signal GSC, data control signal DCS, and sensor control signal SCS.

[0048] The data drive circuit (DDC) can receive a data control signal (DCS) and an output video signal (DATA) from the drive controller (DC). The data drive circuit (DDC) can convert the output video signal (DATA) into a data signal and output the data signal to a plurality of data lines DL1, DL2, ..., DLm, which will be described later. The data signal may be an analog voltage corresponding to the grayscale level of the output video signal (DATA).

[0049] The display panel DP may include multiple scan lines GL1-GLn, multiple data lines DL1-DLm, multiple sensor lines SL1-SLs, multiple pixels PX, and multiple sensor OPDs. m may be an integer greater than or equal to 3, n may be an integer greater than or equal to 2, and s may be an integer greater than or equal to 2.

[0050] The display panel DP may include a display area DA corresponding to the active area 1000A (see Figure 1) and a non-display area NDA corresponding to the peripheral area 1000NA (see Figure 1). Pixels PX and sensor OPD may be located in the display area DA.

[0051] The scan drive circuit GDC and the sensor drive circuit SDC may be located in the non-display area NDA of the display panel DP. However, the invention is not limited to this, and parts of the scan drive circuit GDC and the sensor drive circuit SDC may be located in the display area DA, or outside the display panel DP. In one embodiment of the present invention, the scan drive circuit GDC may be located adjacent to one side of the display area DA within the display panel DP, and the sensor drive circuit SDC may be located adjacent to the other side of the display area DA within the display panel DP.

[0052] The scan drive circuit GDC can receive a scan control signal GCS from the drive controller DC. In response to the scan control signal GCS, the scan drive circuit GDC can output scan signals to scan lines GL1-GLn. Each of the scan lines GL1-GLn may be extended from the scan drive circuit GDC in a second direction DR2 and arranged spaced apart from each other in the first direction DR1. The data lines DL1-DLm may be extended from the data drive circuit DDC in a first direction DR1 and arranged spaced apart from each other in the second direction DR2.

[0053] A pixel PX can be electrically connected to scan lines GL1-GLn and data lines DL1-DLm, respectively. Figure 2 shows that one pixel PX is connected to one of the scan lines GL1-GLn, but the present invention is not limited to this. For example, one pixel PX can be connected to multiple scan lines among the scan lines GL1-GLn.

[0054] Each sensor OPD can be electrically connected to a sensor line SL1-SLs. A single sensor OPD can be electrically connected to a single scan line, for example, one of the scan lines GL1-GLn. However, the present invention is not limited to this, and the number of scan lines connected to each sensor OPD may be variable. Each sensor OPD can be formed by the same process as a pixel PX. The number of sensor OPDs may be the same as or different from the number of pixel PXs.

[0055] In one embodiment of the present invention, the sensor OPD may have an optical sensor and may sense fingerprints via the optical sensor. The sensor signal may be optical information (luminance information) acquired from the optical sensor, but it may also be a biosensing signal containing biometric information such as a user's fingerprint or a document scanning signal. The sensor OPD senses an object such as a fingerprint by, for example, emitting light and receiving the light that is reflected back from an object such as a finger. The sensing result by the sensor OPD is, for example, an image of the object such as a fingerprint. Furthermore, the sensing result by the sensor OPD may be any data that senses the object, and may be data represented by numerical values ​​or the like.

[0056] The sensor drive circuit SDC can receive a sensor control signal SCS from the drive controller DC. In response to the sensor control signal SCS, the sensor drive circuit SDC can receive a sensor signal from the sensor OPD via the sensor lines SL1-SLs. The sensor drive circuit SDC can generate sensor data (sensor data before optical compensation) by converting the sensor signal received from the sensor lines SL1-SLs from analog to digital. Based on the sensor signal from the sensor OPD (sensor signal before optical compensation), or the sensor data obtained by converting the sensor signal (sensor data before optical compensation), the sensor drive circuit SDC determines whether an object such as a finger has come into contact with the display panel DP, and identifies an arbitrary region RA as the area of ​​contact.

[0057] In one embodiment of the present invention, the memory ROM can store compressed optical compensation data (compressed compensation data CCD). Generally, optical compensation data may be data necessary to compensate for data received from a sensor OPD. For example, each sensor OPD may have a predetermined deviation, and optical compensation data may be data to compensate for the said deviation. For example, multiple sensor OPDs do not each have exactly the same sensor sensitivity, and there may be deviations in sensor sensitivity, etc., between each sensor OPD. Optical compensation data is used to compensate for such deviations in sensor sensitivity, etc., between multiple sensor OPDs, and to suppress deviations in display quality in the display area DA, etc. Alternatively, optical compensation data may be data to increase the sensitivity of fingerprint sensing using each sensor OPD. The memory ROM may pre-measure the sensitivity information of each sensor OPD, and compress, i.e., encode, each optical compensation data generated based on the measured information and store it in advance. Hereinafter, the compressed optical compensation data may be referred to as compressed compensation data CCD (see Figure 3).

[0058] The decoder DEC can send and receive signals to and from the memory ROM. The decoder DEC can also receive necessary data (compressed and compensated data CCD corresponding to any region RA) from the memory ROM. The decoder DEC can convert the received data (compressed and compensated data CCD corresponding to any region RA) and output optical compensation data ELCD to the sensor drive circuit SDC. The transmission and reception of signals between the decoder DEC and the memory ROM, and the conversion of the received data, are explained below in Figure 3.

[0059] In one embodiment of the present invention, the sensor drive circuit SDC can output coordinate information CI necessary for optical compensation to the decoder DEC, and the sensor drive circuit SDC can receive optical compensation data ELCD from the decoder DEC. The sensor drive circuit SDC can perform optical compensation calculations on the sensor data (sensor data before optical compensation) via the received optical compensation data ELCD to generate optically compensated sensor data LCSD. The optically compensated sensor data LCSD can be output from the sensor drive circuit SDC.

[0060] Figure 2 shows an example where optically compensated sensor data LCDD is output to the drive controller DC, but this is not the only example. Optically compensated sensor data LCDD can be used to generate captured images and optically compensated captured images.

[0061] Figure 3 is a block diagram of an optical compensation system LCS according to one embodiment of the present invention. Figure 4 is a plan view showing the sensor region SA according to one embodiment of the present invention.

[0062] Referring to Figures 2, 3, and 4, the sensor OPD may be arranged in the sensor region SA along the first direction DR1 and the second direction DR2. The sensor region SA may, but is not limited to, the display region DA. For example, the sensor region SA may have a smaller area than the display region DA.

[0063] The optical compensation system (LCS) may include a memory (ROM) and a decoder (DEC).

[0064] The memory ROM can store compressed compensation data CCD. In one embodiment of the present invention, the memory ROM may be a non-volatile memory and may be a ROM (read-only memory) or an EEPROM (Electrically Erasable Programmable read-only memory). By using ROM, which is relatively inexpensive, when storing compressed compensation data CCD, memory costs can be reduced.

[0065] In one embodiment of the present invention, compressed compensation data CCD can be stored in the memory ROM in order based on the coordinates of the sensor OPD located in the sensor area SA. In this case, the method for storing the compressed compensation data CCD may include a column order method, a row order method, and a tile order method. Referring to the sensor area SA shown in Figure 4, the memory ROM may store data from (0,0) to (X s -1,Y s A compressed compensated data CCD can be stored with optical compensation data for coordinates up to (-1). For example, the sequence order method is (0,0) as the base coordinate, (0,1), (0,2), ..., (0,Y s -1) A possible method is to save compressed compensation data CCDs with optical compensation data compressed in that order. Alternatively, the row order method is based on the (0,0) coordinate as (1,0), (2,0), ..., (X s One possible method is to store compressed compensation data CCDs in the order of -1,0) by compressing the optical compensation data.

[0066] Alternatively, the tile ordering method could involve dividing the sensor area SA into tiles (or blocks) and storing them in order. For example, one tile may contain one row, multiple rows, or multiple rows × multiple columns. The memory ROM may store optical compensation data (compressed compensation data CCD) arranged in row and column order, with the optical compensation data (compressed compensation data CCD) of the coordinates of the upper left corner of each tile as the first data. The compression ratio can increase as the number of data points in a single tile increases. Therefore, increasing the tile size increases the compression ratio, and the amount of compressed compensation data CCD stored in the memory ROM decreases accordingly, which can be advantageous in terms of storage space and cost. In other words, the sensor area SA is divided into multiple tiles, for example, each tile containing multiple rows, multiple rows × multiple columns, etc. Then, for each tile, multiple compressed compensation data CCDs corresponding to multiple rows, multiple rows × multiple columns, etc., are compressed into, for example, one. Furthermore, by increasing the number of compressed compensation data CCDs contained in that single tile, the total number of compressed compensation data CCDs for the entire sensor area SA can be reduced, and the overall data compression ratio of the sensor area SA can be increased. The number of tiles into which the sensor area SA is divided can be set as appropriate.

[0067] In one embodiment of the present invention, the decoder DEC may include a transmit / receive unit SAR, a decompression unit (which can also be called a decoding unit) DECC, a first memory SRAM1, and a second memory SRAM2.

[0068] The transceiver (SAR) can transmit and receive signals between the decoder (DEC) and the memory (ROM). The transceiver (SAR) can also be referred to as an interface circuit.

[0069] In one embodiment of the present invention, the memory ROM stores compressed compensation data CCD for the coordinates of the entire sensor area SA, and the decoder DEC can selectively receive a necessary portion of the entire compressed compensation data CCD.

[0070] Referring to the sensor region SA shown in Figure 4, an arbitrary region RA can be defined within the sensor region SA. This arbitrary region RA may be called the target region, object region, or predetermined region. The arbitrary region RA is from (X0, Y0) to (X0+A x -1, Y0+A y It can be an area up to (-1). Any area RA may be, for example, an area that includes only the area necessary for fingerprint authentication, and any area RA may include the area that the finger touches during fingerprint authentication and its surrounding area. Any area RA is a part of the sensor area SA.

[0071] An arbitrary region RA can be identified in various ways. For example, an arbitrary region RA can be determined from an image captured by a sensor OPD. The region of an image of an object, such as a fingerprint, acquired by the sensor OPD, or a region containing such an image, can be designated as an arbitrary region RA. Alternatively, the display panel DP may further include a sensor layer that senses external inputs, and the sensor layer may be a self-capacitive sensor or a mutual-capacitive sensor. In this case, the sensor layer can be used to identify the area where a touch occurred based on a change in capacitance. Furthermore, any area RA may be determined to be an area that overlaps with the area where the touch occurred. Furthermore, the identification method is not limited as long as any region RA can be identified.

[0072] The transmitter / receiver SAR of the decoder DEC can receive compressed compensation data CCD necessary for compensating the sensor OPD located in the sensor region SA. In one embodiment of the present invention, the transmitter / receiver SAR can receive only the compressed compensation data CCD necessary for compensating the sensor OPD located in any region RA. The compressed compensation data CCD necessary for compensating the sensor OPD located in any region RA can be referred to as the compressed compensation data CCD corresponding to any region RA.

[0073] The recovery unit DECC can receive compressed compensation data CCD, that is, compressed compensation data CCD corresponding to any region RA, received from the memory ROM via the transmit / receive unit SAR. The recovery unit DECC can recover, that is, decode (decode) the received compressed compensation data CCD corresponding to any region RA. In this process, the recovery unit DECC can receive information RNI necessary for recovery (which can also be called decoding) from the first memory SRAM1.

[0074] In one embodiment of the present invention, the restoration unit DECC can restore only the compressed compensation data CCD corresponding to any region RA received from the memory ROM. In this case, the information RNI necessary for restoration received from the first memory SRAM1 may be the information RNI necessary for restoring the compressed compensation data CCD corresponding to any region RA.

[0075] The restoration unit DECC can restore compressed and compensated data CCD corresponding to any region RA using the information RNI necessary for restoration. The data restored from the restoration unit DECC can be output to the second memory SRAM2. Hereinafter, the restored data may be referred to as restored and compensated data RCD. Restored and compensated data RCD is also a restored compressed and compensated data CCD corresponding to any region RA.

[0076] The first memory SRAM1 can store information RNI necessary for restoration when the restoration unit DECC restores the compressed and compensated data CCD. For example, the information RNI necessary for restoration may include coded table data, quantization error correction data, outlier data, and average value data.

[0077] The encoded table data may be the data for the conversion table used to decode the compressed-compensated data CCD when encoding is used to compress optical-compensated data into compressed-compensated data CCD. Encoding refers to the compression mentioned above, or encoding, and decoding refers to the restoration (decompression, decoding) mentioned above, or decoding.

[0078] Quantization error correction data may be data used to correct quantization errors when nonlinear quantization processing is used to compress optical compensation data into compressed compensation data CCD. Quantization can be a process of dividing the amplitude interval (quantization interval, quantization width) of an analog signal and representing it as a representative value. In one embodiment of the present invention, nonlinear quantization differs from linear quantization in that the amplitude intervals are made different so that the occurrence frequency of the analog signals included in each section is the same. Therefore, since nonlinear quantization results in large quantization errors for analog signals with low occurrence frequency, quantization error correction data is used to precisely correct quantization errors in such data.

[0079] Outlier data are data with extremely low occurrence rates in optically compensated data and may be data that deviates significantly from the range. When the above-described encoding process is used to compress optically compensated data, encoding the outlier data as well may worsen the compression ratio. Therefore, it is preferable to exclude outlier data from the encoding process. In addition, outlier data can be stored separately via the coordinates of the outlier data. Since the occurrence rate of outlier data stored separately is low, the amount of data stored is also small, which may be advantageous in terms of the storage interval.

[0080] The average value data can be the average value for each column, row, or tile of the optically compensated data. The average value data may include, for example, data for approximating a linear function or data for approximating a piecewise linear function. In one embodiment of the present invention, taking the average value data for each row as an example, the data for approximating a linear function may be, for example, the intercept value or slope value when the optically compensated data for each row is represented on a graph. The piecewise linear data may be, for example, the data values ​​at each end of each section (the start and end points of the section) when the optically compensated data for each row is represented on a graph and divided into multiple sections. In this case, the compression ratio can be easily increased by compressing the data for the difference between the optically compensated data and the average value data.

[0081] The information RNI necessary for restoration can be pre-stored in the first memory SRAM1. The first memory SRAM1 can output the information RNI necessary for restoration to the restoration unit DECC. In other words, the first memory SRAM1 pre-stores the information RNI necessary for restoration for the range of the sensor region SA in Figure 4. The first memory SRAM1 receives information such as coordinate information CI for an arbitrary region RA from the restoration unit DECC, etc., via the transmitting / receiving unit SAR. Therefore, based on the coordinate information CI, etc. for an arbitrary region RA, the first memory SRAM1 can output the information RNI necessary for restoring the compressed compensation data CCD corresponding to an arbitrary region RA from the information RNI necessary for restoration of the entire sensor region SA to the restoration unit DECC.

[0082] The second memory SRAM2 can receive and store the restored restoration compensation data RCD from the restoration unit DECC. The second memory SRAM2 can output the stored restoration compensation data RCD as optical compensation data ELCD to the sensor drive circuit SDC. Note that both the restoration compensation data RCD and the optical compensation data ELCD also correspond to any region RA.

[0083] In one embodiment of the present invention, the first memory SRAM1 and the second memory SRAM2 may be volatile memories. Furthermore, the first memory SRAM1 and the second memory SRAM may be SRAMs (Static Random Access Memory).

[0084] In one embodiment of the present invention, the sensor drive circuit SDC can receive optical compensation data ELCD from the second memory SRAM2.

[0085] Figure 5 is a flowchart for an optical compensation system LCS according to one embodiment of the present invention. Figure 5 shows the compensation method of the optical compensation system LCS shown in Figure 3, step by step.

[0086] Referring to Figures 3, 4, and 5, the sensor drive circuit SDC can detect whether or not an object (target) on the sensor area SA is in contact with the sensor based on sensor signals and sensor data from the sensor OPD located in the sensor area RA (S1). The sensor drive circuit SDC can determine, for example, whether or not a fingertip has come into contact with the sensor area SA based on the shape and size of the object. In this case, each of the sensor OPDs may be an optical sensor.

[0087] The sensor drive circuit SDC detects whether or not an object is in contact, and then identifies an arbitrary region RA within the sensor region SA (S2). The arbitrary region RA is a part of the sensor region SA, and in this case, it may be, for example, a region for acquiring an image necessary for fingerprint authentication. The arbitrary region SA may be a region from which an image of sufficient size to perform fingerprint authentication can be acquired. In one embodiment of the present invention, the size of the arbitrary region RA shown in Figure 4 may be fixed or variable. If the size of the arbitrary region RA is fixed, it may be easier to set the driving conditions of the scan drive circuit GDC and the sensor drive circuit SDC for driving the sensor OPD. On the other hand, if the size of the arbitrary region RA is variable, for example, if the size of the arbitrary region RA is varied according to the area in contact with the fingertip, then it is only necessary to drive the sensor OPD located in a part of the region corresponding to the size variation, which may reduce the power consumption of the electronic device ED.

[0088] Once an arbitrary region RA is identified, the sensor drive circuit SDC can identify coordinate information CI for that region RA and output the coordinate information CI to the decoder DEC. In this case, the coordinate information CI may correspond to the coordinates where the sensor OPD that sensed an object such as a finger is located within the arbitrary region RA. In one embodiment of the present invention, the decoder DEC can identify a ROM address RCI corresponding to the received coordinate information CI (S3). The identified ROM address RCI may be a ROM address RCI corresponding to any region RA.

[0089] ROM address RCI may be coordinate information for compressed compensation data CCD corresponding to any identified region RA among the compressed compensation data CCD stored in memory ROM. ROM address RCI may also be referred to as memory coordinate information RCI. For example, the memory ROM stores each compressed compensation data CCD corresponding to each sensor OPD located within the sensor region SA, along with the coordinates of each sensor OPD in the sensor region SA (e.g., coordinate information CI). The decoder DEC identifies the ROM address RCI by referring to the coordinates of each sensor OPD in the sensor region SA stored in the memory ROM, based on the coordinate information CI of any region RA. Methods for identifying the ROM address RCI include the column-order method, the row-order method, and the tile-order method. However, the identification of the ROM address RCI may depend on how the compressed and compensated data CCD is stored. For example, if the compressed and compensated data CCD is stored using the column-order method as explained in Figure 4, then the identification of the ROM address RCI can also be done using the column-order method.

[0090] In one embodiment of the present invention, the decoder DEC can output the identified ROM address RCI and the read command signal DS to the memory ROM via the transceiver SAR (S4). The read command signal DS is a command signal for reading the compressed compensation data CCD stored at the corresponding location based on the ROM address RCI.

[0091] The read command signal DS may include a read command code, a read mode, and the starting address of the data to be read. The read command code may include single mode, dual mode, quad mode, etc. For example, a mode in which 1 bit of data can be read from one output in the memory ROM may be single mode, a mode in which 2 bits of data can be read from two outputs may be dual mode, and a mode in which 4 bits of data can be read from four outputs may be quad mode. In one embodiment of the present invention, a read command code including dual mode or quad mode may be output to the memory ROM in order to read a large amount of data in a short time.

[0092] Furthermore, the read mode may include a continuous read mode. In a continuous read mode, when the same read command code is repeated, the system may not send another read command code, but instead send the starting address of the data to be read and perform continuous reading.

[0093] In one embodiment of the present invention, the transmitting / receiving unit SAR activates a select signal to select the memory ROM, and then outputs a read command signal DS to the memory ROM in synchronization with the clock signal of the memory ROM. After the read command signal DS is output and a dummy period of several clock cycles has passed (after the overhead period described later), the reading of compressed and compensated data CCD from the ROM address RCI designated as the starting address to a predetermined consecutive ROM address RCI may begin. For example, referring to Figure 4, the starting address of any region RA may be (X0, Y0), and the reading of data from the starting address (X0, Y0) to consecutive addresses may begin.

[0094] In one embodiment of the present invention, the time from when the select signal is activated until the start of reading the data at the first address may be referred to as read overhead or overhead. When reading data at non-contiguous addresses, overhead always occurs, which can significantly reduce the data reading speed. However, when reading data at consecutive addresses, as in the present invention, overhead occurs only once, which can improve the data reading speed and shorten the data reading time. The overhead period is a preparation period for accurate data reading. During the overhead period, adjustments such as stabilizing the clock are made.

[0095] When the memory ROM receives a read command signal DS from the transmitter / receiver SAR of the decoder DEC, it can read the compressed-compensated data CCD consecutively from the ROM address RCI designated as the starting address (S5). For example, a ROM control unit (not shown) that writes and reads data to and from the memory ROM starts reading after a dummy period of several clock cycles following the activation of the select signal, based on the read command signal DS and the ROM address RCI, and reads the compressed-compensated data CCD corresponding to an arbitrary region RA. The data read may be a single row of data depending on the row-order method, or data for each tile depending on the tile-order method. The ROM control unit (not shown) outputs the compressed and compensated data CCD corresponding to the read area RA to the SAR of the decoder DEC. The read data may be the compressed and compensated data CCD corresponding to any area RA as follows:

[0096] Before restoring the compressed and compensated data CCD corresponding to any region RA, the restoration unit DECC may receive the information RNI necessary for restoration from the first memory SRAM1 (S6). In one embodiment of the present invention, the period during which the information RNI necessary for restoration is output may overlap with the overhead period. Therefore, the restoration unit DECC may receive the information RNI necessary for restoration from the first memory SRAM1 during the overhead period. When the restoration unit DECC receives the information RNI necessary for restoration during the overhead period, time loss can be suppressed compared to when the information RNI necessary for restoration is received in a period separate from the overhead period. That is, for example, if the restoration unit DECC receives the compressed compensation data CCD after the overhead period has elapsed, and then receives the information RNI necessary for restoration, the restoration unit DECC cannot decode the compressed compensation data CCD until at least the time A required to receive the compressed compensation data CCD and the time B required to receive the information RNI necessary for restoration have elapsed after the overhead period. However, according to the above embodiment, since the restoration unit DECC receives the information RNI necessary for restoration during the overhead period, once the compressed compensation data CCD is received after the overhead period, it can immediately decode the compressed compensation data CCD using the information RNI necessary for restoration. Therefore, the time loss due to receiving the RNI information necessary for restoration is reduced, while the restoration speed of the compressed and compensated data CCD performed in the restoration unit DECC can be increased. In other words, the total time required for restoring the compressed and compensated data CCD, including the time required for reading and the time required for restoration, can be kept short.

[0097] The restoration unit DECC can use the information RNI necessary for restoration received from the first memory SRAM1 and the compressed compensation data CCD corresponding to any region RA received from the transmitting / receiving unit SAR to restore, i.e., decode, the compressed compensation data CCD corresponding to any region RA (S7). In this case, the order in which the data is restored can also be determined by the column order method, the row order method, and the tile order method.

[0098] The restored data RCD may be the restored and compensated data RCD described in Figure 3, and can be output sequentially to the second memory SRAM2 in the order in which they are restored. In one embodiment of the present invention, the second memory SRAM2 can output the stored restored and compensated data RCD as optical compensation data ELCD to the sensor drive circuit SDC.

[0099] The restoration unit DECC terminates the restoration process when it has restored all of the compressed compensation data CCDs corresponding to any region RA (S8). In one embodiment of the present invention, whether or not the restoration process can be terminated can be determined by whether or not all of the compressed compensation data CCDs corresponding to any region RA have been restored by the column order method, row order method, and tile order method. If all of the compressed compensation data CCDs corresponding to any region RA have not been restored, the process can be further carried out by identifying the ROM address RCI.

[0100] Once the restoration of all compressed and compensated data CCDs is complete, imaging can be performed on the display panel DP (S9). In one embodiment of the present invention, if any region RA is identified, imaging can be performed only on that region RA. When imaging is performed only on an arbitrary region RA, the sensor drive circuit SDC can generate sensor data (sensor data before optical compensation) only for the sensor OPD located within the arbitrary region RA, and can be driven only for the sensor OPD located within the arbitrary region RA.

[0101] The sensor drive circuit SDC generates sensor data (sensor data before optical compensation) corresponding to any region RA, and can perform optical compensation calculations using the sensor data (sensor data before optical compensation) corresponding to any region RA generated by the sensor drive circuit SDC and the optical compensation data ELCD received from the second memory SRAM2. As an example of optical compensation calculation, if the sensor data is x, the gain data GAIND (see Figure 9) is a, the offset data OFFD (see Figure 9) is b, and the optical compensation data y can be calculated using the formula y = a(xb) + c (where c is a constant). The method of optical compensation calculation is not limited as long as the deviation of the displayed image can be suppressed. The sensor drive circuit SDC can complete the optical compensation calculation and generate optically compensated sensor data LCDD. Furthermore, an optically compensated image of any region RA can be generated using the optically compensated sensor data LCDD of any region RA.

[0102] Figure 6A is a graph illustrating an optical compensation data compression algorithm according to one embodiment of the present invention. Figure 6B is a graph illustrating an optical compensation data compression algorithm according to one embodiment of the present invention.

[0103] Referring to Figures 6A and 6B, the optical compensation data may be offset data, which is the deviation of the sensor data (sensor data before optical compensation) when light of a specific brightness is incident on the sensor OPD (see Figure 2). In one embodiment of the present invention, the offset data, which is the optical compensation data, can be separated into DC component data and AC component data ACD.

[0104] In one embodiment of the present invention, the DC component data may be the average value data described in Figure 3, and the DC component data may be the RNI information necessary for reconstruction. The AC component data ACD of the offset data may be the data obtained by subtracting the DC component data from the offset data. Therefore, the compressed and compensated data CCD that is compressed and stored in the memory ROM may be the AC component data ACD of the offset data.

[0105] Referring to Figure 6A, AC component data ACD may have a spatially random distribution, but generally it may have a normal distribution. Therefore, when compressing AC component data ACD, a nonlinear quantization process can be used, which divides the amplitude interval of the analog signal and shows it as a representative value. In this case, the quantized data may be called distributed data.

[0106] Referring to Figure 6B, when compressing AC component data ACD, the range of the distribution data can be determined so that each code is assigned with the same or similar probability. For example, in the case of 3 bits, the possible values ​​are 000, 001, 010, 011, 100, 101, 110, and 111, and if there are 800 distribution data, the range of the distribution data can be determined so that 100 distribution data are assigned to each code. Figure 6B shows the cumulative distribution of the distribution data.

[0107] In one embodiment of the present invention, the distribution data can be encoded with codes corresponding to each range. For example, the distribution data up to the 100th can be encoded with the code 000. The encoded data can be stored in memory ROM as compressed and compensated data CCD.

[0108] In one embodiment of the present invention, the representative value data LUT(000), LUT(001), ..., LUT(111) of the distribution data corresponding to each range can be quantization error correction data, which can be stored in the first memory SRAM1 as RNI information necessary for reconstruction. In this case, the representative value data LUT(000), LUT(001), ..., LUT(111) can be the mean value, median value, or value that minimizes the squared error of the distribution data in the portion corresponding to each range.

[0109] In addition to the compression algorithm described above, one embodiment of the present invention may have separate representative value data LUT(000), LUT(001), ..., LUT(111) for each column, row, and tile of the optical compensation data. It is also possible to prepare multiple representative value data LUT(000), LUT(001), ..., LUT(111) and select the optimal representative value data LUT(000), LUT(001), ..., LUT(111) for each column, row, and tile. In one embodiment, it is also possible to have a configuration in which the data is transformed to match the value range based on representative value data LUT(000), LUT(001), ..., LUT(111) with a normalized range of values. The transformation (conversion) may be performed by generating transformed data by multiplying the representative value data LUT(000), LUT(001), ..., LUT(111) by a coefficient. In this case, the coefficients may be referred to as transformed data (or scale data). At this time, representative value data LUT(000), LUT(001), ..., LUT(111) and transformed data may be stored in the first memory SRAM1 as RNI, which is the information necessary for restoration.

[0110] Optical compensation data can fluctuate due to deviations in production quality during the manufacturing of the sensor OPD (see Figure 2), as explained in Figure 2. Furthermore, optical compensation data may fluctuate randomly within the sensor region SA. Therefore, a compression algorithm like that of the present invention may be advantageous in reducing errors caused by the compression of optical compensation data.

[0111] Furthermore, optical compensation data can be gain data that shows the ratio of the increase in sensor data (sensor data before optical compensation) to the increase in the brightness of the light incident on the sensor OPD (see Figure 2). Similar compression algorithms can be used for gain data as well, just like for offset data.

[0112] Figure 7 is a flowchart illustrating a restoration algorithm according to one embodiment of the present invention.

[0113] Referring to FIGS. 3, 4, and 7, variables corresponding to the coordinates of the sensor OPD arranged in any region RA can be set as i and j (i = 0 to A x -1, j = 0 to A y -1). In one embodiment of the present invention, the initial state can be set as i = 0 and j = 0. The coordinates of the initial state can be (X0, Y0) which is the upper left end of any region RA.

[0114] Referring to FIG. 6B together, the restoration unit DECC can restore (decode) the compressed compensation data CCD of the (X0 + i, Y0 + j) coordinates received from the memory ROM through the restoration necessary information RNI such as representative value data LUT(000), LUT(001),..., LUT(111) (D1).

[0115] One embodiment of the present invention can compare the representative value data LUT(000), LUT(001),..., LUT(111) corresponding to the (X0 + i, Y0 + j) coordinates with the representative value data LUT(000), LUT(001),..., LUT(111) corresponding to the Y0 + j row (D2). At this time, if there is abnormal value data, the compressed compensation data CCD of the coordinates having the abnormal value data among the data of the Y0 + j row can be restored through the abnormal value data (D3). If there is no abnormal value data, it can be restored through the corresponding representative value data LUT(000), LUT(001),..., LUT(111) (D3).

[0116] After determining whether all the compressed compensation data CCD of the Y0 + j row has been restored, the restoration unit DECC can repeat the restoration of the next column of the Y0 + j row (D4). That is, the restoration unit DECC can repeat the restoration A x times (i = 0 to A x -1).

[0117] After the restoration of the Y0 + j row is completed, after determining whether all the compressed compensation data CCD of all the rows including it has been restored, the restoration unit DECC can repeat the restoration of the rows that have not been restored (D5). That is, the restoration unit DECC can perform the restoration A y times (j = 0 to A y-1) Repeat the process until all rows of compressed and compensated data CCD have been restored, at which point the restoration can be completed.

[0118] Figure 8A is a diagram illustrating a method for calculating the ROM address RCI according to one embodiment of the present invention. Figure 8B is a diagram illustrating a method for calculating the ROM address RCI according to one embodiment of the present invention.

[0119] Referring to Figures 3, 4, 8A, and 8B, the ROM address RCI, which indicates the coordinates of the compressed compensation data CCD stored in the memory ROM, can be in units of 8 bits (1 byte). Therefore, if the compressed compensation data CCD is in units other than 8 bits, when storing the coordinates of the compressed compensation data CCD sequentially, one compressed compensation data CCD can be stored across multiple ROM address RCIs.

[0120] In one embodiment of the present invention, the case in which the compressed compensation data CCD is in 6-bit units will be explained as an example, as shown in Figure 8A. If the compressed compensation data CCD is in 6-bit units, the compressed compensation data CCD for the (0,0) coordinate can be stored in one ROM address RCI, but the compressed compensation data CCD for the (1,0) coordinate can be stored across two ROM addresses RCI. The same may be true for the compressed compensation data CCD for the (2,0) and (3,0) coordinates.

[0121] Therefore, as shown in Figure 8B, when reading compressed compensation data CCD for consecutive ROM addresses RCI, unnecessary compressed compensation data (UND1, UND2) may be read. Reading unnecessary compressed compensation data (UND1, UND2) can induce a time loss, but as in the present invention, by reading a large amount of compressed compensation data CCD for consecutive ROM addresses RCI, the actual time loss can be reduced.

[0122] One embodiment of the present invention can calculate the number of bits of unnecessary leading data (UND1), the number of bits of unnecessary last data (UND2), and the number of clock cycles required for reading compressed and compensated data from a CCD.

[0123] The compressed and compensated data CCD has N bits in units and can be stored in the order of (x,y) coordinates starting from the initial address of the ROM address RCI. In this case, the ROM address RCI is provided in 8-bit (1-byte) data units, and the explanation will take a quad mode, where 4 bits are read per clock cycle, as an example.

[0124] In one embodiment of the present invention, the y-th row (y=0~A) of any region RA y -1), that is, the coordinates of the sensor OPD (x,y) = (X0,Y0+y) ~ (X0+A x When reading compressed and compensated data CCD of -1, Y0+y), the initial ROM address RCI can be calculated as initial address + (((Xs*(Y0+y)+X0)*N)>>3). Also, the number of clock cycles required for reading is (((Xs*(Y0+y)+X0+A x )*N+3)>>2)-((((Xs*(Y0+y)+X0)*N)>>3)*2).

[0125] In one embodiment of the present invention, the number of bits of the unnecessary first data (UND1) is calculated as ((Xs*(Y0+y)+X0)*N)-((((Xs*(Y0+y)+X0)*N)>>3)*8), and the number of bits of the unnecessary last data (UND2) is ((((Xs*(Y0+y)+X0+A x )*N+3)>>2)*4)-((Xs*(Y0+y)+X0+A x It can be calculated as )*N).

[0126] As mentioned above, when reading compressed and compensated data from a CCD, the number of bits in the unnecessary leading data (UND1), the number of bits in the unnecessary last data (UND2), and the number of clock cycles required for reading become clear, which can improve the reliability of the decoder (DEC).

[0127] Figure 9 is a block diagram of a decoder DEC design according to one embodiment of the present invention.

[0128] Referring to Figures 3, 4, 6B, and 9, the decoder DEC may include a clock circuit CLK. The clock circuit CLK is a circuit included in the decoder DEC and can output a clock signal.

[0129] The first memory SRAM1 may include the 1-1 memory SRAM1-1, the 1-2 memory SRAM1-2, the 1-3 memory SRAM1-3, the 1-4 memory SRAM1-4, the 1-5 memory SRAM1-5, and the 1-6 memory SRAM1-6. In explaining Figure 9 below, we will refer to the contents explained in Figure 6B as well.

[0130] The first-first memory SRAM 1-1 may store coding numbers for compressing optical compensation data. For example, the first-first memory SRAM 1-1 may store coding numbers for compressing AC component data ACD. The first-second memory SRAM 1-2 may store RNI information necessary for restoring the compressed compensation data CCD. For example, the first-second memory SRAM 1-2 may store representative value data LUT(000), LUT(001), ..., LUT(111) necessary for restoring the compressed compensation data CCD.

[0131] Memory 1-3 SRAM1-3 may store deformation data for normalized representative value data LUT(000), LUT(001), ..., LUT(111). In this case, the deformation data may be deformation coefficients. Memory 1-4 SRAM1-4 may store the number of abnormal value data. Memory 1-5 SRAM1-5 may store abnormal value data and the coordinates of said abnormal value data. Memory 1-6 SRAM1-6 may store DC component data.

[0132] In one embodiment of the present invention, the decoder DEC can output a ROM address RCI and a read command signal DS, which are specified in the memory ROM, via the transceiver SAR. The transceiver SAR can sequentially receive and output each signal via the FIFO circuit FIFO. The signal output from the FIFO circuit FIFO can be transmitted to the first interface circuit IFC1 via the initial loader circuit IR. The restorer DECC can send and receive signals with the first-1 to first-6 memories SRAM1-1, ..., SRAM1-6 via the first interface circuit IFC1.

[0133] The first circuit portion CC1 of the restoration unit DECC may read the number of abnormal value data for the corresponding row from the first to fourth memory SRAM1-4 during the overhead period and store it in a register. The first circuit portion CC1 may also read the abnormal value data and the coordinates of the abnormal value data from the first to fifth memory SRAM1-5 and store them in a register.

[0134] The second circuit portion CC2 of the restoration unit DECC may read the DC component data of the corresponding row from the first to sixth memory SRAM 1-6 during the overhead period and store it in a register. In one embodiment of the present invention, the number of abnormal value data, the abnormal value data, the coordinates of the abnormal value data, and the DC component data may each be stored in the corresponding registers.

[0135] In one embodiment of the present invention, the number of abnormal value data stored in the 1-4 memory SRAM 1-4 is the number from row 1 to the relevant row, and the abnormal value data stored in the 1-5 memory SRAM 1-5 can be stored sequentially from row 1 to the relevant row in the coordinate order of the sensor OPD. Furthermore, only the x coordinate of the abnormal value data stored in the 1-5 memory SRAM 1-5 can be stored. For example, when restoring the data of row a, the number of abnormal value data from row a-1 to row a-1 in the 1-4 memory SRAM 1-4 can be compared and read, and the abnormal value data and the coordinates of the abnormal value data can be read from the 1-5 memory SRAM 1-5 to save all the abnormal value data and x coordinates of row a.

[0136] In one embodiment of the present invention, the compressed compensation data CCD is read sequentially from the memory ROM to the transmitting / receiving unit SAR and stored (inserted or pushed) into the FIFO circuit FIFO. Each time that N bits corresponding to the compressed compensation data CCD are additionally stored (inserted or pushed) into the FIFO circuit FIFO, a new N bits of data is sent from the FIFO circuit FIFO to the first circuit CLC1, and the second circuit CLC2 updates the coordinates. In other words, the first circuit CLC1 sends out the compressed compensation data CCD in coordinate order, and the second circuit CLC2 sends out the coordinates of the compressed compensation data CCD. The third circuit portion CC3 of the restoration unit DECC corresponds to the coordinates of the compressed compensation data CCD and can read the coded number from the first memory SRAM1-1.

[0137] The fourth circuit section CC4 of the restoration unit DECC can read representative value data LUT(000), LUT(001), ..., LUT(111), which are the RNI information necessary for restoration, from the first and second memory SRAM1-2 using the coded number and the compressed compensation data CCD. Since the coded number can be assigned to each row or range of each row, the optimal representative value data LUT(000), LUT(001), ..., LUT(111) can be selected.

[0138] The fifth circuit section CC5 of the restoration unit DECC corresponds to the coordinates of the compressed compensation data CCD and can read deformation coefficients (or scale counts) for the normalized representative value data LUT(000), LUT(001), ..., LUT(111) from the first-to-third memory SRAM1-3. The sixth circuit section CC6 of the restoration unit DECC can generate the first data DAT1 using the deformation coefficients and the values ​​read from the first-to-second memory SRAM1-2.

[0139] In one embodiment of the present invention, the seventh circuit portion CC7 of the restoration unit DECC can determine whether the x-coordinate of the compressed compensation data CCD matches any one of the x-coordinates of the abnormal value data stored in the register described above. If there is corresponding abnormal value data, that abnormal value data can be generated as the second data DAT2; if there is no corresponding abnormal value data, the first data DAT1 can be used.

[0140] In one embodiment of the present invention, the eighth circuit portion CC8 of the restoration unit DECC can add the first data DAT1 or the second data DAT2 with the DC component data to generate the offset data OFFD of the restoration compensation data RCD. In this case, the DC component data can be read from the first to sixth memories SRAM1 to 6.

[0141] In one embodiment of the present invention, the ninth circuit portion CC9 of the restoration unit DECC can calculate the gain data GAIND based on the offset data OFFD. For example, the gain data GAIND and the offset data OFFD may be related by a linear transformation equation.

[0142] The recovery compensation data RCD may include offset data OFFD and gain data GAIND. The offset data OFFD and gain data GAIND may be stored in the second memory SRAM2 corresponding to the coordinates of the sensor OPD.

[0143] The second memory SRAM2 may include the second-first memory SRAM2-1 and the second-second memory SRAM2-2, where offset data OFFD may be stored in the second-first memory SRAM2-1 and gain data GAIND may be stored in the second-second memory SRAM2-2. By repeating the restoration described above, the decoder DEC may eventually complete the restoration.

[0144] The recovery unit DECC can send and receive signals with the second-first memory SRAM2-1 and the second-second memory SRAM2-2 via the second interface circuit IFC2.

[0145] The operation of the first circuit CLC1, the second circuit CLC2, and the third through ninth circuits CC3, CC4, CC5, CC6, CC7, CC8, and CC9 can be handled using a pipeline technique. Therefore, the decoding operation can be performed more efficiently.

[0146] As described above, the electronic device may include a display panel, a decoder, and a memory. The sensor area of ​​the display panel can detect whether an object is in contact with it, and an arbitrary area can be identified for acquiring the necessary image (or data). The decoder can receive coordinate information of the arbitrary area from the panel and receive corresponding compressed and compensated data from the memory.

[0147] The decoder's restoration unit can generate and output restoration compensation data using the compression compensation data corresponding to the arbitrary region and the information necessary for restoration corresponding to the arbitrary region stored in the decoder's first memory.

[0148] Because electronic devices can compensate for only a specific region of the image, power consumption can be reduced and the recovery speed can be increased. In other words, instead of performing optical compensation on the entire sensor region SA, or on a wide area of ​​the sensor region SA, optical compensation only needs to be performed on a limited, arbitrary area of ​​the sensor region SA. Therefore, the power consumption required for calculating optical compensation can be reduced. In addition, the memory storage space required to store data related to optical compensation can be reduced, thereby suppressing the increase in memory costs. Furthermore, the processing time related to optical compensation, such as the operating time of the sensor OPD in an arbitrary region RA, the time required to access compressed compensation data in memory and the time required to output compressed compensation data from memory, the time required for calculation and output of restored compensation data, and the time required for saving restored compensation data to and outputting it from memory, can be reduced, thereby increasing the recovery speed.

[0149] Furthermore, when compressing optical compensation data, the compression ratio can be increased by using methods such as column order, row order, or tile order, which may be advantageous in terms of memory storage space and cost.

[0150] (1) In the above embodiment, the sensor OPD senses a fingerprint and identifies an arbitrary region RA for acquiring an image necessary for fingerprint authentication. However, the arbitrary region RA is not limited to the region for acquiring an image necessary for fingerprint authentication, but may also be, for example, simply a region where the sensor OPD detects that an object such as the user's fingertip has come into contact with the sensor region SA.

[0151] Furthermore, the arbitrary region RA is not limited to the region sensed by the sensor OPD. The arbitrary region RA is not limited to this, but may be, for example, a desired region where optical compensation is required, a desired region specified by, for example, the user via an input unit (not shown), or a region specified by, for example, a control unit including a drive controller DC.

[0152] As mentioned above, even if an arbitrary region RA is an area for acquiring images unrelated to fingerprint authentication, and even if the arbitrary region RA is not identified via the sensor OPD, by compensating the captured image of only that arbitrary region RA based on optical compensation data, it is possible to obtain effects such as reduced power consumption and increased recovery speed, similar to the above embodiment.

[0153] (2) In this invention, by compensating only an arbitrary region of the captured image, effects such as reduced power consumption and improved recovery speed can be obtained. Therefore, the type of data and calculation method required are not limited, as long as the data necessary to compensate only an arbitrary region of the captured image can be acquired and calculations can be performed. For example, the optical compensation data stored in the memory ROM does not need to be compressed. However, storing compressed CCD data in the memory ROM can reduce the memory storage space. Also, for example, the recovery unit DECC may receive the information RNI necessary for recovery in a period different from the overhead period. However, receiving the information RNI necessary for recovery in the recovery unit DECC in advance during the overhead period can shorten the overall recovery time.

[0154] Although preferred embodiments of the present invention have been described so far with reference, a person skilled in the art or a person with ordinary knowledge in the art will understand that the present invention can be modified and altered in various ways without departing from the spirit and technical domain of the invention as described in the claims below. Therefore, the technical scope of the present invention should not be limited to what is described in the detailed description of the specification, but should be determined by the claims. [Explanation of Symbols]

[0155] ED: Electronic device SA: Sensor area OPD: Multiple sensors SDS: Sensor drive circuit DEC: Decoder ROM: Memory DECC: Restoration Unit SAR: Transmitter / Receiver Unit SRAM1: First memory SRAM2: Second memory CCD: Compressed and compensated data RNI: Information required for recovery RCD: Restored compensation data; ELCD: Optical compensation data

Claims

1. A display panel including multiple pixels and multiple sensors, A sensor drive circuit that drives the plurality of sensors, A decoder that receives coordinate information relating to an arbitrary region from the aforementioned sensor drive circuit, A memory that receives memory coordinate information and a read command signal corresponding to the arbitrary region from the decoder and outputs the corresponding compressed compensation data to the decoder, The decoder mentioned above is A first memory that stores information necessary for restoring the compressed compensation data, A restoration unit that outputs restoration compensation data using the aforementioned compression compensation data and the information necessary for restoration, An electronic device including a second memory that receives and stores the restoration compensation data from the restoration unit and outputs the restoration compensation data to the sensor drive circuit.

2. The sensor drive circuit receives sensor signals from the plurality of sensors, converts the sensor signals to generate sensor data, The electronic device according to claim 1, wherein the sensor drive circuit performs optical compensation calculations on the sensor data via the restoration compensation data to generate optically compensated sensor data.

3. The electronic device according to claim 1, wherein the first memory includes a first-1 memory, a first-2 memory, a first-3 memory, a first-4 memory, a first-5 memory, and a first-6 memory, each storing different information necessary for the restoration.

4. The electronic device according to claim 1, wherein the restoration compensation data includes offset data and gain data.

5. The electronic device according to claim 4, wherein the second memory includes a second-first memory for storing the offset data and a second-second memory for storing the gain data.

6. The electronic device according to claim 1, wherein each of the plurality of sensors is an optical sensor.

7. The electronic device according to claim 1, wherein the aforementioned arbitrary region is a region necessary for fingerprint authentication.

8. The electronic device according to claim 1, wherein the period during which the information necessary for restoration is output from the first memory to the restoration unit overlaps with the overhead period.

9. The electronic device according to claim 1, wherein the information necessary for the restoration is encoded table data.

10. The electronic device according to claim 1, wherein the information necessary for the restoration is quantization error correction data.

11. The electronic device according to claim 1, wherein the information necessary for the restoration is abnormal value data.

12. The aforementioned memory is non-volatile memory, The electronic device according to claim 1, wherein the first memory and the second memory are volatile memories.

13. The aforementioned compression compensation data is data obtained by compressing the AC component data. The electronic device according to claim 1, wherein the AC component data is data obtained by subtracting the DC component data from the optical compensation data.

14. A decoder that receives coordinate information for an arbitrary region, A memory that receives memory coordinate information and a read command signal corresponding to the arbitrary region from the decoder and outputs the corresponding compressed compensation data to the decoder, The decoder mentioned above is A first memory that stores information necessary for restoring the compressed compensation data, A restoration unit that outputs restoration compensation data using the aforementioned compression compensation data and the information necessary for restoration, Includes a second memory that receives and stores the restoration compensation data from the restoration unit and outputs the restoration compensation data, An optical compensation system in which the memory is a non-volatile memory, and the first memory and the second memory are volatile memories.

15. The optical compensation system according to claim 14, wherein the aforementioned arbitrary region is a region necessary for fingerprint authentication.

16. The optical compensation system according to claim 14, wherein the period during which the information necessary for restoration is output from the first memory to the restoration unit overlaps with the overhead period.

17. The optical compensation system according to claim 14, wherein the information necessary for the restoration is encoded table data, quantization error correction data, or outlier data.

18. A step of identifying any area that the object has come into contact with, The steps include identifying the ROM address corresponding to the coordinate information of the arbitrary region, The steps include: reading consecutive data from the beginning address of the ROM address; The steps include:

1. Recovering the compressed and compensated data, which is the read data, through the information necessary for recovery, to generate the recovered data; A method for driving an electronic device, comprising the step of generating optically compensated sensor data by performing optical compensation calculations on sensor data via the recovered data.

19. The step of reading consecutive data from the beginning address of the ROM address is as follows: The steps include calculating the number of bits of unnecessary leading data, The steps include calculating the number of bits of the last data that is unnecessary, A method for driving an electronic device according to claim 18, comprising the step of calculating the number of clock cycles required for reading.

20. The aforementioned restoration step is, (X ０ +i, Y ０ +j) Representative value data corresponding to the coordinate and Y ０ + The step of comparing the representative value data corresponding to row j, If there is abnormal data, Y ０ The steps include: restoring the compressed compensation data of the coordinates having the outlier data among the data of row +j via the outlier data; If there is no abnormal value data, the compressed compensation data is restored via the corresponding representative value data. The aforementioned Y ０ A method for driving an electronic device according to claim 18, comprising the step of repeating the restoration of the remaining rows once the restoration of the data for row +j has been completed.

Images