An apparatus and method for determining status of flexible display

Abstract

A method for determining status of flexible display is provided. The method may include obtaining baseline values of flexible display for comparison with raw values. The method may include obtaining the raw values of flexible display. The method may include identifying variation of raw values from the baseline values. The method may include determining the status of the flexible display as having deformity based on the identified variation of the raw values.

Description

AN APPARATUS AND METHOD FOR DETERMINING STATUS OF FLEXIBLE DISPLAY

[0001] The disclosure discloses a system and method for determining status of flexible display. The disclosure particularly relates to the detection of deformities for the affected pixels and applying a deformation compensation to the flexible display.

[0002] Displays provides information as a visual representation, making them the essential building blocks for visualizing data in modern electronics, including smartphones, laptops. Electronics have recently made progress towards becoming flexible, thin, lightweight, and wearable so that they can be bent, folded, or stretched without compromising the performance. The flexible touch display is required to be repeatedly and severely bent, flexed or folded during service.

[0003] A flexible panel is composed of a flexible backplane, a flexible display, and a flexible touch screen panel (TSP). The flexible backplane is made up of flexible materials. When a flexible panel is stretched or bent, different characteristics of the panel may change. The flexible touch screen panel has become a key element in various electronic devices such as televisions (TVs), hand-held devices, and laptops, and the increasing demand for a more interactive user interface has influenced the broadening of the touch screen panel application area. There are different types of touch screen panels, the most popular being the resistive and capacitive. The resistive type of touch screen panel senses the resistance change caused by the deformation of the touch screen panel film and the capacitive type of touch screen panel senses the capacitance change associated with the disturbance of fringe electric fields due to the finger touch. The transition between a folded state and a planar state of the flexible display devices causes a tension to be created, wherein the tension is particularly a pushing force towards two sides of the panel when the flexible display devices are transformed from a planar state to a folded state. More particularly, a pulling force towards a folding area comes into action when they are switched from the folded state to the planar state. The tension concentrated in the folding area of the flexible display screens causes some deformation, waving or warpage, and damage to internal components of the flexible display screens such as line breakage of TFT (Thin Film Transistor), resulting in poor display.

[0004] Hence, there exists a need for detecting deformities on the screen and providing a visual compensation to reduce deformation visibility to the user.

[0005] In an embodiment, a method for determining status of flexible display is provided. The method may include obtaining baseline values of flexible display for comparison with raw values. The method may include obtaining the raw values of flexible display. The method may include identifying variation of raw values from the baseline values. The method may include determining the status of the flexible display as having deformity based on the identified variation of the raw values.

[0006] In an embodiment, an apparatus for determining status of flexible display is provided. The apparatus may comprise a memory configured to store instructions, and at least one processor configured to execute the instructions. The at least one processor may be configured to obtain baseline values of flexible display for comparison with raw values. The at least one processor may be configured to obtain the raw values of flexible display. The at least one processor may be configured to identify variation of raw values from the baseline values. The at least one processor may be configured to determine the status of the flexible display as having deformity based on the identified variation of the raw values.

[0007] In an embodiment, a computer-readable storage medium, storing instructions for executing the method for determining status of flexible display is provided. The method may include obtaining baseline values of flexible display for comparison with raw values. The method may include obtaining the raw values of flexible display. The method may include identifying variation of raw values from the baseline values. The method may include determining the status of the flexible display as having deformity based on the identified variation of the raw values.

[0008] The foregoing and other features of embodiments will become more apparent from the following detailed description of embodiments when read in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements.

[0009] Figure 1 illustrates a flowchart of the method for diagnosing status of a flexible touch screen display

[0010] Figure 2 illustrates a flowchart of the method of diagnosing the screen topology for determining pixels defect for the affected one or more pixels.

[0011] Figure 3 illustrates a flowchart of the method of applying a deformation compensation.

[0012] Figure 4 illustrates a block diagram of a system for diagnosing status of a flexible screen.

[0013] Figure 5 illustrates a block diagram representation of the raw data acquisition module.

[0014] Figure 6 illustrates a block diagram representation of the screen deformation estimator unit.

[0015] Figure 7 illustrates an electronic display panel according to an embodiment of the present invention.

[0016] Figure 8 illustrates a block diagram of the screen-deformation correction unit.

[0017] Figure 9 illustrates a functional block diagram of the damage detection module.

[0018] Figure 10 illustrates a diagram showing an upper panel and a lower panel of the flexible screen display.

[0019] Figure 11a and 11b illustrates a non-deformed screen and a deformed screen.

[0020] Figure 12 illustrates a snapshot of the flexible display according to an embodiment of the present invention.

[0021] Figure 13 illustrates a used case according to an embodiment of the present invention.

[0022] Figure 14 illustrates a flow chart of the method for determining status of flexible display.

[0023] Figure 15 illustrates a block diagram of the apparatus.

[0024] It may be advantageous to set forth definitions of certain words and phrases used throughout this patent document. The terms "transmit," "receive," and "communicate," as well as derivatives thereof, encompass both direct and indirect communication. The terms "include" and "comprise," as well as derivatives thereof, mean inclusion without limitation. The term "or" is inclusive, meaning and / or. The phrase "associated with," as well as derivatives thereof, means to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, have a relationship to or with, or the like.

[0025] Moreover, various functions described below can be implemented or supported by one or more computer programs, each of which is formed from computer readable program code and embodied in a computer readable medium. The terms "application" and "program" refer to one or more computer programs, software components, sets of instructions, procedures, functions, objects, classes, instances, related data, or a portion thereof adapted for implementation in a suitable computer readable program code. The phrase "computer readable program code" includes any type of computer code, including source code, object code, and executable code. The phrase "computer readable medium" includes any type of medium capable of being accessed by a computer, such as read only memory (ROM), random access memory (RAM), a hard disk drive, a compact disc (CD), a digital video disc (DVD), or any other type of memory.

[0026] As used here, terms and phrases such as "have," "may have," "include," or "may include" a feature (like a number, function, operation, or component such as a part) indicate the existence of the feature and do not exclude the existence of other features. Also, as used here, the phrases "A or B," "at least one of A and / or B," or "one or more of A and / or B" may include all possible combinations of A and B. For example, "A or B," "at least one of A and B," and "at least one of A or B" may indicate all of (1) including at least one A, (2) including at least one B, or (3) including at least one A, and at least one B. Further, as used here, the terms "first" and "second" may modify various components regardless of importance and do not limit the components. These terms are only used to distinguish one component from another. For example, a first user device and a second user device may indicate different user devices from each other, regardless of the order or importance of the devices. A first component may be denoted a second component and vice versa without departing from the scope of this disclosure.

[0027] It will be understood that, when an element (such as a first element) is referred to as being (operatively or communicatively) "coupled with / to" or "connected with / to" another element (such as a second element), it can be coupled or connected with / to the other element directly or via a third element. In contrast, it will be understood that, when an element (such as a first element) is referred to as being "directly coupled with / to" or "directly connected with / to" another element (such as a second element), no other element (such as a third element) intervenes between the element and the other element.

[0028] As used here, the phrase "configured (or set) to" may be interchangeably used with the phrases "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of" depending on the circumstances. The phrase "configured (or set) to" does not essentially mean "specifically designed in hardware to." Rather, the phrase "configured to" may mean that a device can perform an operation together with another device or parts. For example, the phrase "processor configured (or set) to perform A, B, and C" may mean a generic-purpose processor (such as a CPU or application processor) that may perform the operations by executing one or more software programs stored in a memory device or a dedicated processor (such as an embedded processor) for performing the operations.

[0029] The terms and phrases as used here are provided merely to describe some embodiments of this disclosure but not to limit the scope of other embodiments of this disclosure. It is to be understood that the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. All terms and phrases, including technical and scientific terms and phrases, used here have the same meanings as commonly understood by one of ordinary skill in the art to which the embodiments of this disclosure belong. It will be further understood that terms and phrases, such as those defined in commonly-used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined here. In some cases, the terms and phrases defined here may be interpreted to exclude embodiments of this disclosure.

[0030] Examples of an "apparatus" according to embodiments of this disclosure may include at least one of a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop computer, a netbook computer, a workstation, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device (such as smart glasses, a head-mounted device (HMD), electronic clothes, an electronic bracelet, an electronic necklace, an electronic accessory, an electronic tattoo, a smart mirror, or a smart watch) including flexible display. Note that, according to various embodiments of this disclosure, an apparatus may be one or a combination of the above-listed devices. According to some embodiments of this disclosure, the apparatus may be a flexible apparatus. The apparatus disclosed here is not limited to the above-listed devices and may include new apparatuses depending on the development of technology.

[0031] In the following description, apparatuses are described with reference to the accompanying drawings, according to various embodiments of this disclosure. As used here, the term "user" may denote a human or another device (such as an artificial intelligent electronic device) using the electronic device.

[0032] Definitions for other certain words and phrases may be provided throughout this patent document. Those of ordinary skill in the art should understand that in many if not most instances, such definitions apply to prior as well as future uses of such defined words and phrases.

[0033] None of the description in this application should be read as implying that any particular element, step, or function is an essential element that must be included in the claim scope.

[0034] In an embodiment of the disclosure, at least one of the plurality of modules may be implemented through an AI model. A function associated with AI may be performed through the non-volatile memory, the volatile memory, and the processor. The processor may include one or a plurality of processors. At this time, one or a plurality of processors may be a general-purpose processor, such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and / or an AI-dedicated processor such as a neural processing unit (NPU).

[0035] The one or a plurality of processors control the processing of the input data in accordance with a predefined operating rule or artificial intelligence (AI) model stored in the non-volatile memory and the volatile memory. The predefined operating rule or artificial intelligence model is provided through training or learning. Here, being provided through learning means that, by applying a learning algorithm to a plurality of learning data, a predefined operating rule or AI model of a desired characteristic is made. The learning may be performed in a device itself in which AI according to an embodiment is performed, and / or may be implemented through a separate server / system.

[0036] The AI model may consist of a plurality of neural network layers. Each layer has a plurality of weight values and performs a layer operation through calculation of a previous layer and an operation of a plurality of weights. Examples of neural networks include, but are not limited to, convolutional neural network (CNN), deep neural network (DNN), recurrent neural network (RNN), restricted Boltzmann Machine (RBM), deep belief network (DBN), bidirectional recurrent deep neural network (BRDNN), generative adversarial networks (GAN), and deep Q-networks. The learning algorithm is a method for training a predetermined target device (for example, a robot) using a plurality of learning data to cause, allow, or control the target device to make a determination or prediction. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0037] Reference will now be made in detail to the description of the present subject matter, one or more examples of which are shown in the figures. Each example is provided to explain the subject matter and not a limitation. Various changes and modifications obvious to one skilled in the art to which the invention pertains are deemed to be within the spirit, scope and contemplation of the invention.

[0038] Referring now to Figure 1, a flowchart of the method for diagnosing status of a flexible touch screen display is illustrated, wherein the method (100) comprises the steps of interpreting and pre-processing raw values of a touch sensitive screen of flexible display for generating base line values by a raw data acquisition module (201a) in the step (101).

[0039] In an embodiment of the invention, the raw values of the touch sensitive screen of the flexible display are read by scanning the electrodes, every time the flexible display is turned ON. The raw values of the touch sensitive screen of flexible display are capacitance, inductance, and resistance values. Further, the raw data is preprocessed to obtain clean data. More particularly, high frequency or unwanted signals are removed from the raw data to obtain clean raw data. Furthermore, baseline values of capacitance, inductance, and resistance are obtained from the storage of the touch screen display.

[0040] In step (102), variations of raw values are calculated from the baseline values by a capacitance shift estimation module (201b) and a resistance estimation module (201c). In an embodiment of the disclosure, the variations of the capacitance, inductance and resistance value from the baseline values arises due to change in the mechanical property in surface of the touch sensitive screen of flexible display.

[0041] In step (103), variations in values are analyzed over a pre-defined period of time by a screen deformation estimator unit (202) to identify affected one or more pixels of the flexible display. In an embodiment of the disclosure, the change in the baseline capacitance and inductance is detected to analyze and estimate the health of the pixel structure, power profile of pixels, flexible display screen, and inform users of the screen's potential failure.

[0042] In step (104), a screen topology is diagnosed for determining at least one deformity for the affected one or more pixels based on pre-defined threshold by a screen-deformation correction unit (203). In an embodiment of the disclosure, the screen topology is diagnosed for determining an arc angle or valley formation across the surface of the touch sensitive screen of flexible display for the affected one or more pixels. In an embodiment of the disclosure, the screen topology is diagnosed for determining at least one of a deformity for bending detection / calculation, image inversion and pixel defect for the identified affected one or more pixels.

[0043] In an embodiment of the disclosure, the affected one or more pixels are determined to detect at least one of a point, an area or a zone for the number of pixels with variations in values exceeding a predetermined threshold in comparison to the normal surface. The variations in values are analyzed over a pre-defined period of time to identify one or more touch screen pixels that are affected without causing a visible change to the touch sensitive screen of flexible display.

[0044] Figure 2 illustrates a flowchart of the method of diagnosing the screen topology for determining pixels defect for the affected one or more pixels by the screen- deformation correction unit (203), wherein the method (104) comprises the steps of retrieving a threshold value for change for pixel damage of the touch sensitive screen of flexible display from storage in step (104a). In step (104b) change in the pre-determined threshold for the capacitance, inductance, resistance, and power consumption value for each pixel point is calculated. Further, in step (104c) the pixel structure is identified as damaged if the change is above or matches with the pre-determined threshold value.

[0045] Figure 3 illustrates a flowchart of a method of applying a deformation compensation to an image displayed, to reduce visual artifact near the deformed region of the flexible display by the screen- deformation correction unit (203), wherein the method (300) comprises the steps of analyzing crease deformation in step (301).

[0046] In step (302) the two-dimensional profile of the crease is extracted. In step (303) an inverse deformation pattern is generated and in step (304) the inverse deformation pattern is generated and applied to an image rendered at the flexible display. Further, in step (305) the deformation compensated image is rendered to the flexible display.

[0047] Figure 4 illustrates a block diagram of a system for diagnosing status of a flexible screen, wherein the system (200) comprises a raw data acquisition module (201a) for interpreting and pre-processing raw values of a touch sensitive screen of flexible display for generating base line values. In an embodiment, the raw values of the touch sensitive screen of flexible display are capacitance, inductance, and resistance values and the change in the capacitance value is due to the deformation in x, y and z directions.

[0048] Further, the system (200) comprises a capacitance shift estimation module (201b) for calculating variation in the capacitance value from baseline value. Further, the system (200) comprises a resistance estimation module (201c) for calculating electrical resistance change of a receiver and a transmitter electrode.

[0049] Furthermore, the system (200) comprises a screen deformation estimator unit (202) for analyzing variations in values over a pre-defined period of time to identify affected pixels of the flexible display. Further, the system (200) comprises a screen-deformation correction unit (203) for diagnosing screen topology for determining at least one deformity for the affected one or more pixels based on pre-defined threshold.

[0050] Figure 5 illustrates a block diagram representation of the raw data acquisition module (201a), wherein the raw data acquisition module (201a) comprises the processor (501) more particularly a host processor for communicating with a touch controller Integrated Circuit (IC) (502) and further sending a request for reading the raw values of capacitance from a plurality of touch electrodes (503). In an embodiment, the processor (501) communicates with the touch controller integrated circuit (502) through half duplex communication such as Inter-Integrated Circuit (IIC / 12C) or full duplex communication such as Serial Peripheral interface (SPI).

[0051] In an embodiment, a system for diagnosing status of a flexible screen may include the processor (501) and a memory which stores a plurality of instructions. The plurality of instructions, upon execution by the processor, may cause the processor (501) to extract baseline values of the capacitance, inductance, and resistance. Further, the plurality of instructions, upon execution by the processor, may cause the processor (501) to calculate the variation in the values. The system (200) may be coupled to a database via a communication network. Examples of devices having touch sensitive flexible display may include, but are not limited to, a laptop, a tablet, a smartphone, a mobile phone, or the like.

[0052] The processor (501) may include appropriate logic, circuitry, interfaces, and / or code that may be configured to automatically manage a plurality of baseline values related to the display screen. The processor may be implemented based on a variety of processor technologies, which may be known to one ordinarily skilled in the art. Examples of implementations of the processor may include a Graphics Processing Unit (GPU), a Reduced Instruction Set Computing (RISC) processor, an Application-Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set Computing (CISC) processor, a microcontroller, Artificial Intelligence (AI) accelerator chips, a co-processor, a central processing unit (CPU), and / or a combination thereof.

[0053] The memory may also store various data (for example, baseline values, updated values of various parameters related with the screen and the like) that may be captured, processed, and / or required by the system (200). The memory may be a non-volatile memory or a volatile memory. Examples of non-volatile memory may include, but are not limited to, a flash memory, a Read-Only Memory (ROM), a Programmable ROM (PROM), Erasable PROM (EPROM), and Electrically EPROM (EEPROM) memory. Examples of volatile memory may include, but are not limited to, Dynamic Random-Access Memory (DRAM), and Static Random-Access memory (SRAM).

[0054] In an embodiment, the capacitance shift estimation module (201b) is configured to receive the capacitance value from the integrated circuit (502) of the touch sensitive display of the flexible screen and further the capacitance shift estimation module (201b) calculates variation in the capacitance value from baseline value, wherein the baseline values of the capacitance are stored in the memory and furthermore, the values of capacitances are calculated and updated periodically by the touch sensitive screen of the flexible display.

[0055] In an embodiment, the resistance estimation module (201c) is responsible for calculating change in the electrical resistance value of a receiver and a transmitter electrode. The resistance change of the receiver and the transmitter electrode is calculated by calculating the Resistance Capacitance (RC) time constant change, wherein the Resistance Capacitance (RC) time constant is calculated by using the equation:

[0056]

[0057] wherein is the time constant in seconds of the RC circuit, R is the resistance of the circuit and C is the capacitance of the circuit. The time constant for each of the electrodes is evaluated using the following equations:

[0058]

[0059]

[0060]

[0061]

[0062] wherein RTX is the resistance of the transmitter electrode, RRX is the resistance of the receiver electrode, is the parasitic capacitance of electrode, and are the touched equivalent capacitance and and are the untouched equivalent capacitance.

[0063] In an embodiment, the resistances of the transmitter and receiver electrodes is given by the equation:

[0064]

[0065] wherein,

[0066] is the sheet resistance, is the bulk resistivity of the sheet, t is the thickness of the sheet, L is the length of the electrode and W is the width of the electrode.

[0067] In an embodiment, the method (102) of calculating the variation in the resistance value may comprise of the following steps such as reading the three-dimensional (3D) resistance drift / variation with respect to the number of bends and temperature. The method (102) may further comprise reading the present temperature and number of bends for the screen from sensors and storage. Furthermore, the method (102) may comprise determining the drift matrix for each electrode.

[0068] Figure 6 illustrates a block diagram representation of the screen deformation estimator unit (202), wherein the screen deformation estimator unit (202) comprises a surface deformity map engine module (202a) for determining change in bridge gap between a plurality of electrodes and generating a surface deformity map. Further, the screen deformation estimator unit (202) comprises a pixel deformity matrix module (202b) for creating a power profile of pixel, calculating change in power consumption of group of pixels corresponding to each touch sensor node of the plurality of electrodes, determining change in the resistance value of the electrode due to deformation and formation of a pixel deformation matrix. In an embodiment, the change in the bridge gap between a plurality of electrodes is determined using the equation 1:

[0069] (equation 1)

[0070] wherein, DC is the surface deformation matrix, is the dielectric constant for interface material of the touch screen, is the sheet area of the electrode junction and is the mutual capacitance shift calculated for the transmitter and receiver electrode. In an embodiment, the apparatus may obtain capacitance data as output of the resistance estimation module (201c). And, the apparatus may obtain capacitance shift matrix from the output of the resistance estimation module (201c). And the apparatus may obtain surface deformation matrix by surface deformation estimation according to the above equation 1. In an embodiment, the procedure of creating power profile of pixel comprises the steps of generating the images based on number and location of electrodes. In an embodiment, the standard power images for generating images based on number and location of electrodes are retrieved from the storage. Further, the procedure of creating power profile of pixel comprises displaying power images for all pixel groups. Further, the procedure comprises measuring power for all images of all the pixel groups. Furthermore, the procedure comprises creating a matrix for mapping with capacitance locations or power for each pixel.

[0071] In an embodiment, an electronic display panel is considered as shown in Figure 7, having an active-matrix area or pixel array in which an array of pixels are arranged in a row and column configuration. In an embodiment, the apparatus may calculate the current consumed by display depends on the number of pixels which that are "ON". So, the current in the black image is zero, and the current in the white image is maximum current. In an embodiment, the method (104b) for calculating pixel power consumption profile comprises of the following steps grouping pixels into blocks corresponding to each touch Electrode node for e.g.: G1, G2, G3, and G4. Further, specific images with only one group of pixels activated are displayed, such as G1 group of pixels activated for Red, Green, Blue (R, G, B) pixels separately. Further, the current drawn by the power management module of the system (200) is measured. Subsequently, the previous steps are repeated for all required groups of pixels to be tested. Furthermore, the total power consumed by any group of pixels is calculated such as total power (P = Pr + Pg + Pb), In an embodiment, the apparatus may identify the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value. The pre-defined threshold value may be associated with power value.

[0072] In an embodiment, the procedure of formation of a pixel deformation matrix comprises the steps of obtaining the surface deformity map from the surface deformity map engine module (202a). Further, change in the resistance value of the electrode due to deformation is obtained subsequent to which the power profile of the pixel is obtained. Furthermore, the procedure comprises the formation of a pixel deformation matrix using matrix concatenation operation. In an embodiment, the matrix concatenation operation is an operation to join two sub matrices horizontally / vertically into one matrix. In an embodiment, the apparatus may identify the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value.

[0073] Figure 8 illustrates a block diagram of the screen-deformation correction unit (203), wherein the screen-deformation correction unit (203) comprises a damage detection module (203a) for classifying a pixel damage using pre-defined thresholds. The damage detection module may analyze deformation matrix, calculate pixel power consumption, analyze electrode resistance change, and identify damage type. Further, the screen-deformation correction unit (203) comprises a bend determination engine module (203b) for estimating a bend angle of the flexible display, analyzing crease deformation, and calculating panel to panel distance. And, the screen-deformation correction unit (203) comprises a visual artifacts correction engine module (203c) for analyzing crease deformation, extracting deformation profile, generating, applying an inverse deformation effect and further rendering compensated image to element visual artifacts.

[0074] Figure 9 illustrates a functional block diagram of the damage detection module (203a), wherein the damage detection module (203a) is configured to receive the deformation matrix and further extract the deformation matrix for determining the pixel location corresponding to the deformation identified / detected. Further, the damage detection module (203a) comprises a pixel damage classifier (901) for classifying the damage detected. For example, there are the identified damage types. First case, if the deformation identified is greater than the threshold deformation, damage identified for touch electrode is greater than the threshold damage for touch electrode, and power calculated is greater than the threshold power, the pixel and touch point are classified as damaged. Second case, if the deformation identified is greater than the threshold deformation, and power calculated is greater than the threshold power, the pixels are worn out and some possible failure in future is predicted. Third case, if deformation identified for touch electrode is greater than the threshold deformation for touch electrode, the touch electrodes are worn out, and possible touch issues in future are predicted. Meanwhile, the variations include the affected one or more pixels that are affected without causing a visible change to flexible display. Each case is only an example, and is not limited thereto.

[0075] In one embodiment, the bend determination engine module (203b) is configured to receive the deformation matrix. Further, the bend determination engine module (203b) extracts the crease part from the deformation matrix. Further, the bend determination engine module (203b) generates a two-dimensional profile of the crease deformation and estimate valley angle from the two-dimensional profile of the crease deformation. Further, the bend determination engine module (203b) is responsible for calculating the panel-to-panel angle and estimating the bend angle of the flexible screen. In an embodiment, the panel-to-panel angle is calculated using capacitive or inductive sensing structure.

[0076] Figure 10 illustrates a diagram showing an upper panel and a lower panel of the flexible display. In an embodiment, the procedure of calculating the panel-to-panel electrode angle comprises the steps of configuring the electrodes in the two planes as transmitters and receivers. Further, the mutual capacitance or inductance of the electrodes in the bend condition and the distance between the parallel electrodes on two planes of panel are estimated. And, the apparatus may estimate bend angle. In an embodiment, when the screen is folded making an obtuse angle between the two panels of the screen then the adjacent electrodes are out of maximum distance range.

[0077] In an embodiment, the method of diagnosing status of a flexible screen comprises applying a deformation compensation to the image displayed, to reduce visual artifact near the deformed region of the flexible display by the screen- deformation correction unit (203), which further comprises the steps of analyzing crease deformation, extracting the two-dimensional profile of the crease, generating an inverse deformation pattern, generating and applying the inverse deformation pattern to an image rendered at the flexible display and rendering the deformation compensated image to the flexible display. In an embodiment, the apparatus may determine angle between two plane of the flexible display or valley formation of the flexible display according to the variation. And the apparatus may determine crease line identification or bend detection based on the angle or valley formation.

[0078] Figure 11a and 11b illustrate a non-deformed screen and a deformed screen.

[0079] In an embodiment, Figure 11a illustrates a cross section of the non-deformed screen. A non-deformed screen is the one with no affected pixels. And, the capacitance between all electrodes are consistent. In an embodiment, Figure 11b illustrates a cross section of the deformed screen. The deformed screen is the one with affected one or more pixels. More particularly, there is change in the capacitance value due to deformation in x - y and z directions. In an embodiment, the screen is composed of three layers namely top flexible glass coating, electrodes forms the middle layer of the screen and a polymer substrate such as polyethylene terephthalate (PET) forms the third bottom layer of the screen. In an embodiment, the apparatus may obtain surface deformation matrix by using the capacitance value in the same or similar way as described for Figure 6.

[0080] Referring to Figure 12, a snapshot of the flexible display according to an embodiment of the disclosure is illustrated, wherein a scenario is considered such that the screen health and damage monitoring can be easily viewed by the user for e.g., for an undamaged screen "GREAT" is displayed on the third screen (1230) and for a damaged screen "BAD" is displayed on the fourth screen (1240).

[0081] In an embodiment, the apparatus may obtain request for the information associated with the screen health and the damage monitoring of flexible display. A first screen (1210) and a second screen (1220) is an example of the obtaining of the request for the information associated with the screen health or the damage monitoring of the flexible display. The apparatus may provide the status of the flexible display. If the flexible display have deformity, the apparatus may provide the status of the flexible display as having the deformity corresponding to user input for requesting the information associated with the screen health or damage monitoring of the flexible display through the third screen (1230) or the fourth screen (1240). The first to fourth screens (1210, 1220, 1230, and 1240) are examples, and the displayed screens are not limited thereto.

[0082] In an embodiment of the disclosure is illustrated with the help of a Figure 13, consider an image taken by a flexible device. Straight line appears to be uneven due to deformity of one or more pixels and with the help of the disclosure the straight line appears to be straight because of the application of the visual compensation for artifacts which are caused due to screen deformation.

[0083] In an embodiment, where there is crease line, capacitance change is observed. For visual artifact correction, the apparatus may receive deformation matrix, and then, identify crease location by using deformation matrix. The deformation matrix may be derived, as a geometric transformation for pixel shift. The apparatus may extract 2D profile of crease. The apparatus may generate and apply warping effect to image using the profile based on the orientation and the image frame to be displayed. In other words, the apparatus may generate inverse deformation pattern based on identifying the image inversion. And then, the apparatus may obtain deformation compensated image based on the inverse deformation pattern. Apparatus may provide the deformation compensated image through the flexible display. The displayed image may be inverse deformed.

[0084] The disclosure provides a method (100) for determining the health of a flexible touch screen display. With the help of this technique, a specific type of user can locate flaws or indentations on a screen. Additionally, the method (100) makes it easier to predict screen failure and gives users the option to schedule data backups, allowing them to tailor screen replacements to the needs of different user types without the use of additional sensors. Furthermore, the disclosure offers a method (100) of determining the folding angle for a device.

[0085] Figure 14 illustrates a flow chart of the method for determining status of flexible display.

[0086] At step S1410, the apparatus may obtain baseline values of flexible display for comparison with raw values. In an embodiment, the apparatus may obtain baseline values including at least one of capacitance, inductance, resistance, and power values of flexible display. The baseline values may be values determined by experiment, may be one the measured raw values at first time point.

[0087] At step S1420, the apparatus may obtain the raw values of flexible display. The apparatus may obtain the raw values indicating the status of the flexible display at second time point. The second time point may be a time point after the first time point, and may be different from the first time point. The raw values may also include at least one of capacitance, inductance, resistance, and power values of flexible display.

[0088] At step S1430, the apparatus may identify variation of raw values from the baseline values. In an embodiment, the apparatus may identify that difference between the raw values and the baseline values is greater than or equal to the threshold values. If the difference is not greater than or equal to the threshold values.

[0089] At step S1440, the apparatus may determine the status of the flexible display as having deformity based on the identified variation of the raw values. Based on the difference, the apparatus may determine the flexible display have deformity. The deformity may include at least one of pixel defect, crease line, bend detection, and image inversion. The deformity is not limited to the disclosed example as long as it can be identified using variation or difference in capacitor, inductor, resistance, and power values. Meanwhile, since the way for identifying the deformity has been described in detail above, it will be omitted.

[0090] Figure 15 illustrates a block diagram of the apparatus.

[0091] In an embodiment, the apparatus for determining status of flexible display is include a memory (1510) and at least one processor (1520). The memory (1510) stores an application program executable by the at least one processor (1520) to cause the at least one processor to perform at least one step of the method described above. In embodiments, a system or apparatus with a storage medium may be provided. Software program codes capable of implementing the functions of any one of the above embodiments are stored in the storage medium, capable of making a computer (or a central processing unit (CPU) or a microprocessor unit (MPU)) of the system or apparatus read out and execute the program codes stored in the storage medium. Furthermore, some or all of actual operations may be completed by an operating system or the like running in the computer through instructions based on the program codes. The program codes read out from the storage medium may also be written into a memory provided in an extension board inserted into the computer or into a memory provided in an extension unit connected to the computer. Then, an instruction based on the program codes causes a CPU or the like installed on the extension board or the extension unit to perform some or all of the actual operations, to realize the functions of any one of the embodiments of the above method.

[0092] In an embodiment, the memory (1510) may be implemented by various storage media such as an electrically erasable programmable read-only memory (EEPROM), a flash memory, and a programmable program read-only memory (PROM). The at least one processor (120) may be implemented to include one or multiple central processing units or one or multiple field programmable gate arrays. The field programmable gate arrays are integrated with one or multiple central processing unit cores. In embodiments, the central processing unit or central processing unit core may be implemented as a CPU or an MCU.

[0093] In an embodiment, the at least one processor (1520) may be operable to perform the above examples. Also, the at least one processor (120) may perform operation performed by at least one of the Raw data acquisition module (201a), Capacitance shift estimation module (201b), Resistance estimation module (201c), Screen deformation estimator unit (202), Surface deformity map engine module (202a), Pixel deformity matrix module (202b), Screen-deformation correction unit (203), Damage detection module (203a), Bend determination engine module (203b), and Visual artifacts correction engine module (203c). Detailed descriptions are omitted because it is redundant.

[0094] In an embodiment of the disclosure, at least one processor (1520) controls the overall operation of the other components included in the apparatus.

[0095] In an embodiment the disclosure, the modules and the units are units in which operations performed by at least one processor are classified according to functions or purposes, and may refer to software modules. Of course, each module or each unit may be composed of independent hardware.

[0096] In an embodiment, the disclosure, operations performed by modules and units may actually be performed by a processor of a server.

[0097] In an embodiment of the disclosure, the method may include pertaining to analyzing and processing the existing display modules deployed in products to extract information of deformation or the defect that has occurred due to the wear and repeated use or folding of the screen.

[0098] In an embodiment of the disclosure, when bending occurs in a flexible screen, the touch screen carried in a module is subjected to deformation accordingly with the result that the capacitance changes. Through the acquisition of the data concerning the capacitance change to determine the bending degree of the flexible screen, it is possible to accurately determine whether the flexible screen is subjected to bending or excessive bending without increasing the thickness of the flexible screen module, therefore, raising the user's use experience. However, the prior art does not disclose applying a deformation compensation to the image displayed to reduce visual artifact near the deformed region of the flexible display.

[0099] In an embodiment of the disclosure, the method may include determining deformity for the affected pixels based on pre-defined threshold and also does not discloses applying deformation compensation for the affected pixels to reduce visual artifact near the deformed region of the flexible display.

[0100] In an embodiment of the disclosure, the method may include analyzing and processing the screen topology based on pre-defined threshold for determining deformation, or the defect that has occurred due to the wear and repeated use or folding of the screen.

[0101] Hence, there exists a need for detecting deformities on the screen and providing a visual compensation to reduce deformation visibility to the user.

[0102] In an embodiment, a method for diagnosing status of a flexible touch screen display is provided. The method (100) may comprising the steps of interpreting and pre-processing raw values of a touch sensitive screen of flexible display for generating base line values by a raw data acquisition module (201a), calculating variations of raw values from the baseline values by a capacitance shift estimation module (201b) and a resistance estimation module (201c), analyzing variations in values over a pre-defined period of time by a screen deformation estimator unit (202) to identify affected one or more pixels of the flexible display, diagnosing a screen topology for determining at least one deformity for the affected one or more pixels based on pre-defined threshold by a screen- deformation correction unit (203).

[0103] In an embodiment, the raw values of the touch sensitive screen of flexible display may be capacitance, inductance, and resistance values.

[0104] In an embodiment, the variations of the capacitance, inductance and resistance value from the baseline values may arise due to change in the mechanical property in surface of the touch sensitive screen of flexible display.

[0105] In an embodiment, the screen topology may be diagnosed for determining an arc angle or valley formation across the surface of the touch sensitive screen of flexible display for the affected one or more pixels.

[0106] In an embodiment, the change in the baseline capacitance and inductance may be detected to analyze and estimate the health of the pixel structure, power profile of pixels, flexible display screen, and inform users of the screen's potential failure.

[0107] In an embodiment, the screen topology may be diagnosed for determining at least one of a deformity for bending detection / calculation, image inversion and pixel defect for the identified affected one or more pixels.

[0108] In an embodiment, the affected one or more pixels may be determined to detect at least one of a point, an area or a zone for the number of pixels with variations in values exceeding a predetermined threshold in comparison to the normal surface.

[0109] In an embodiment, the affected one or more pixels may be classified based on the pre-defined threshold by a damage detection module (203a) of the screen- deformation correction unit (203).

[0110] In an embodiment, the variations in values may be analyzed over a pre-defined period of time to identify one or more touch screen pixels that are affected without causing a visible change to the touch sensitive screen of flexible display.

[0111] In an embodiment, the deformation compensation may be applied for the affected one or more pixels to an image displayed, to reduce visual artifact near the deformed region of the flexible display by the visual artifacts correction engine module (203c) of the screen- deformation correction unit (203).

[0112] In an embodiment, the method may include retrieving a threshold value for change for pixel damage of the touch sensitive screen of flexible display from storage. The method may include calculating change in the pre-determined threshold for the capacitance, inductance, resistance and power consumption value for each pixel point. The method may include identifying the pixel structure as damaged, if change is above or matches with the threshold.

[0113] In an embodiment, the method may include analyzing crease deformation. The method may include extracting the two-dimensional profile of the crease. The method may include generating an inverse deformation pattern. The method may include generating and applying the inverse deformation pattern to an image rendered at the flexible display. The method may include rendering the deformation compensated image to the flexible display.

[0114] In an embodiment, a system for diagnosing status of a flexible screen. The system may include a raw data acquisition module (201a) for interpreting and pre-processing raw values of a touch sensitive screen of flexible display for generating base line values. The system may include a capacitance shift estimation module (201b) for calculating variation in the capacitance value from baseline value. The system may include a resistance estimation module (201c) for calculating electrical resistance change of a receiver and a transmitter electrode. The system may include a screen deformation estimator unit (202) for analyzing variations in values over a pre-defined period of time to identify affected one or more pixels of the flexible display. The system may include a screen-deformation correction unit (203) for diagnosing screen topology.

[0115] In an embodiment, the screen deformation estimator unit (202) may comprises a surface deformity map engine module (202a) for determining change in bridge gap between a plurality of electrodes and generating a surface deformity map. The screen deformation estimator unit (202) may comprises a pixel deformity matrix module (202b) for creating a power profile of pixel, calculating change in power consumption of group of pixels corresponding to each touch sensor node of the plurality of electrodes, determining change in the resistance value of the electrode due to deformation and formation of a pixel deformation matrix.

[0116] In an embodiment, the screen-deformation correction unit (203) may comprises a damage detection module (203a) for classifying a pixel damage using pre-defined thresholds. The screen-deformation correction unit (203) may comprise a bend determination engine module (203b) for estimating a bend angle of the flexible display. The screen-deformation correction unit (203) may comprise a visual artifacts correction engine module (203c) for generating and applying an inverse deformation effect and further rendering compensated image to element visual artifacts.

[0117] In an embodiment, a method for determining status of flexible display is provided. The method may include obtaining baseline values of flexible display for comparison with raw values. The method may include obtaining the raw values of flexible display. The method may include identifying variation of raw values from the baseline values. The method may include determining the status of the flexible display as having deformity based on the identified variation of the raw values.

[0118] In an embodiment, the raw values of the flexible display and the baseline values may include at least one of capacitance, inductance, resistance values, and power consumption values.

[0119] In an embodiment, the deformity includes at least one of pixel defect, crease line, bend detection, and image inversion.

[0120] In an embodiment, the method may include determining angle between two plane of the flexible display, or valley formation of the flexible display according to the variation. The method may include determining crease line identification or bend detection based on the angle or valley formation.

[0121] In an embodiment, the method may include generating inverse deformation pattern based on identifying the image inversion. The method may include obtaining deformation compensated image based on the inverse deformation pattern. The method may include providing the deformation compensated image through the flexible display.

[0122] In an embodiment, the method may include identifying the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value.

[0123] In an embodiment, the variations include the affected one or more pixels that are affected without causing a visible change to flexible display.

[0124] In an embodiment, providing the status of the flexible display as having the deformity corresponding to user input for requesting the information associated with the screen health or damage monitoring of the flexible display.

[0125] In an embodiment, an apparatus for determining status of flexible display is provided. The apparatus may comprise a memory configured to store instructions, and at least one processor configured to execute the instructions. The at least one processor may be configured to obtain baseline values of flexible display for comparison with raw values. The at least one processor may be configured to obtain the raw values of flexible display. The at least one processor may be configured to identify variation of raw values from the baseline values. The at least one processor may be configured to determine the status of the flexible display as having deformity based on the identified variation of the raw values.

[0126] In an embodiment, the raw values of the flexible display and the baseline values may include at least one of capacitance, inductance, resistance values, and power consumption values.

[0127] In an embodiment, the deformity may include at least one of pixel defect, crease line, bend detection, and image inversion.

[0128] In an embodiment, the at least one processor is configured to determine angle between two plane of the flexible display, or valley formation of the flexible display according to the variation. The at least one processor may be configured to determine crease line identification or bend detection based on the angle or valley formation.

[0129] In an embodiment, the at least one processor may be configured to generate inverse deformation pattern based on identifying the image inversion. The at least one processor may be configured to obtain deformation compensated image based on the inverse deformation pattern. The at least one processor may be configured to provide the deformation compensated image through the flexible display.

[0130] In an embodiment, the at least one processor is configured to identify the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value.

[0131] In an embodiment, a computer-readable storage medium, storing instructions for executing the method for determining status of flexible display is provided. The method may include obtaining baseline values of flexible display for comparison with raw values. The method may include obtaining the raw values of flexible display. The method may include identifying variation of raw values from the baseline values. The method may include determining the status of the flexible display as having deformity based on the identified variation of the raw values.

Claims

1.A method for determining status of flexible display, the method comprising:obtaining baseline values of flexible display for comparison with raw values (S1410);obtaining raw values of flexible display (S1420);identifying variations of the raw values from the baseline values (S1430); anddetermining the status of the flexible display as having deformity based on the identified variations of the raw values (S1440).2.The method of claim 1, wherein the raw values of the flexible display and the baseline values include at least one of capacitance, inductance, resistance values, and power consumption values.3.The method of any one of claims 1 to 2, wherein the deformity includes at least one of pixel defect, crease line identification, bend detection, and image inversion.4.The method of any one of claims 1 to 3, wherein the determining the status of the flexible display as having deformity comprising:determining angle between two plane of the flexible display or valley formation of the flexible display according to the variation; anddetermining crease line identification or bend detection based on the angle or valley formation.5.The method of any one of claims 1 to 4, further comprising:generating inverse deformation pattern based on identifying the image inversion;obtaining deformation compensated image based on the inverse deformation pattern; andproviding the deformation compensated image through the flexible display.6.The method of any one of claims 1 to 5, wherein the determining the status of the flexible display as having deformity comprising:identifying the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value.7.The method of any one of claims 1 to 6, wherein the variations include the affected one or more pixels that are affected without causing a visible change to flexible display.8.The method of any one of claims 1 to 7, further comprising:providing the status of the flexible display as having the deformity corresponding to user input for requesting the information associated with the screen health or damage monitoring of the flexible display.9.An apparatus (1500) for determining status of flexible display, comprising:a memory (1510) configured to store instructions; andat least one processor (1520) configured to execute the instructions to:obtain baseline values of flexible display for comparison with raw values;obtain the raw values of flexible display;identify variation of raw values from the baseline values; anddetermine the status of the flexible display as having deformity based on the identified variation of the raw values.10.The apparatus (1500) of claim 9, wherein the raw values of the flexible display and the baseline values include at least one of capacitance, inductance, resistance values, and power consumption values.11.The apparatus (1500) of any one of claims 9 to 10, wherein the deformity includes at least one of pixel defect, crease line, bend detection, and image inversion.12.The apparatus (1500) of any one of claims 9 to 11, wherein the at least one processor (1520) is configured to execute the instructions to:determine angle between two plane of the flexible display or valley formation of the flexible display according to the variation; anddetermine crease line identification or bend detection based on the angle or valley formation.13.The apparatus (1500) of any one of claims 9 to 12, wherein the at least one processor (1520) is configured to execute the instructions to:generate inverse deformation pattern based on identifying the image inversion;obtain deformation compensated image based on the inverse deformation pattern; andprovide the deformation compensated image through the flexible display.14.The apparatus (1500) of any one of claims 9 to 13, wherein the at least one processor (1520) is configured to execute the instructions to:identify the pixel defect based on the variation of the raw values corresponding to each pixel being greater than the pre-defined threshold value.15.A computer-readable storage medium, storing instructions for executing the method of any one of claims 1 to 8.

Images