Electronic device including display for providing glint, operating method thereof, and storage medium

Abstract

According to an embodiment of the present invention, in an electronic device (101, 201) including a display (260), the display includes: a cover glass (261); a pixel layer (263) including a plurality of sub-pixels; and a thin film transistor (TFT) layer (264), disposed below the pixel layer, for driving the subpixels, wherein at least a portion of the plurality of subpixels of the pixel layer may include a plurality of glint pixels.

Description

Electronic device including a display for providing a flash, method of operation thereof and storage medium

[0001] One embodiment disclosed in this document relates to an electronic device including a display for providing a flash, a method of operating the same, and a storage medium.

[0002] As the variety of services and additional features offered through electronic devices such as smartphones continues to increase, a variety of applications capable of running on these devices are being developed. Furthermore, the hardware and / or software components of these devices are also continuously evolving.

[0003] In line with recent consumer trends that prioritize design, the design of graphic objects—visual elements such as wallpapers, icons, and widgets displayed on displays—is increasingly considered crucial in the development of electronic devices. Furthermore, in addition to developing electronic devices that consider graphic object design, technological development to display (or play, or output) content more naturally can be crucial for enhancing user emotion, immersion, and / or realism.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device including a display includes a cover glass, a pixel layer including a plurality of sub-pixels, and a thin film transistor (TFT) layer disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0006] According to one embodiment, an electronic device may include a display, at least one processor including a processing circuit, and a memory storing instructions.

[0007] According to one embodiment, the display includes a cover glass, a pixel layer including a plurality of sub-pixels, and a thin film transistor (TFT) layer disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0008] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may be configured to cause the electronic device to analyze an image in each of two or more consecutively input image frames.

[0009] According to one embodiment, the instructions may be configured to cause the electronic device to identify a sparkling area within an image frame from the image analysis results.

[0010] According to one embodiment, the instructions may be configured to cause the electronic device to determine, among the plurality of blinking pixels, blinking pixels corresponding to a blinking area within the image frame.

[0011] In one embodiment, the instructions may be configured to cause the electronic device to output light through the blink pixels corresponding to the blink area.

[0012] According to one embodiment, a method for providing a twinkle in an electronic device including a display, the display including a cover glass, a pixel layer including a plurality of sub-pixels, and a thin film transistor (TFT) layer disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of twinkle pixels.

[0013] According to one embodiment, the method may include analyzing an image in each of two or more consecutively input image frames.

[0014] In one embodiment, the method may include an operation of identifying a sparkling region within an image frame from the image analysis results.

[0015] According to one embodiment, the method may include an operation of determining, among the plurality of sparkling pixels, sparkling pixels corresponding to a sparkling area within the image frame.

[0016] In one embodiment, the method may include outputting light through sparkle pixels corresponding to the sparkle area.

[0017] According to one embodiment, a non-transitory storage medium storing instructions may be configured to cause the electronic device to perform at least one operation when the instructions are individually or collectively executed by at least one processor of the electronic device including the display.

[0018] According to one embodiment, the display includes a cover glass, a pixel layer including a plurality of sub-pixels, and a thin film transistor (TFT) layer disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0019] In one embodiment, the at least one operation may include analyzing an image in each of two or more consecutively input image frames.

[0020] In one embodiment, the at least one operation may include identifying a sparkling region within an image frame from the image analysis results.

[0021] In one embodiment, the at least one operation may include determining, among the plurality of sparkling pixels, sparkling pixels corresponding to a sparkling area within the image frame.

[0022] In one embodiment, the at least one operation may include outputting light through sparkle pixels corresponding to the sparkle area.

[0023] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0024] Figure 2a is a drawing for explaining the output of content indicating sparkle.

[0025] Figure 2b is an internal block diagram of an electronic device according to one embodiment.

[0026] Figure 3 is a cross-sectional view of a display according to one embodiment.

[0027] FIG. 4A is a drawing illustrating a sparkling pixel including a sparkling pearl according to one embodiment.

[0028] FIG. 4b is a drawing illustrating another sparkle pixel including a sparkle pearl according to one embodiment.

[0029] FIG. 5 is a drawing for explaining a twinkling pixel using an optical element according to one embodiment.

[0030] FIG. 6 is a flowchart illustrating an operation of an electronic device including a display for providing a flash according to one embodiment.

[0031] Figure 7 is a flowchart of the operation of an electronic device according to a type of sparkle according to one embodiment.

[0032] Figure 8 is an exemplary diagram for explaining the specular reflection mode and twinkle mode according to one embodiment.

[0033] FIG. 9A is a cross-sectional view of a first type of twinkle pixel according to one embodiment.

[0034] FIG. 9b is a cross-sectional view of a second type of twinkle pixel according to one embodiment.

[0035] FIG. 9c is a cross-sectional view of a third type of sparkling pixel according to one embodiment.

[0036] FIG. 9d is a cross-sectional view of a fourth type of sparkling pixel according to one embodiment.

[0037] FIG. 9e is a cross-sectional view of a fifth type of sparkling pixel according to one embodiment.

[0038] FIG. 10 is a cross-sectional view of a display having a first type of laminated structure according to one embodiment.

[0039] FIG. 11 is a cross-sectional view of a display having a second type of laminated structure according to one embodiment.

[0040] FIG. 12 is a cross-sectional view of a display having a third type of laminated structure according to one embodiment.

[0041] FIG. 13 is a cross-sectional view of a display having a fourth type of laminated structure according to one embodiment.

[0042] FIG. 14 is a cross-sectional view of a display having a laminated structure of the fifth type according to one embodiment.

[0043] FIG. 15a is a drawing for explaining a first example of use of a display using an optical element according to one embodiment.

[0044] FIG. 15b is a drawing for explaining a second example of use of a display using an optical element according to one embodiment.

[0045] FIG. 16 is a drawing for explaining a third example of use of a display using an optical element according to one embodiment.

[0046] FIG. 17 is a drawing for explaining a fourth example of use of a display using an optical element according to one embodiment.

[0047] Fig. 18 is a drawing for explaining a control method using color coordinates according to one embodiment.

[0048] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0049] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0050] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0051] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0052] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0053] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0054] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0055] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0056] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0057] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0058] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0059] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0060] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0061] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0062] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0063] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0064] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0065] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0066] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0067] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0068] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0069] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0070] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0071] In the detailed description below, reference numerals in the drawings may be used interchangeably or omitted for components that can be easily understood through the preceding embodiments, and their detailed descriptions may also be omitted. The electronic device (101) according to one embodiment disclosed in this document may be implemented by selectively combining components of different embodiments, and components of one embodiment may be replaced by components of another embodiment. For example, it should be noted that the present invention is not limited to specific drawings or embodiments.

[0072] Figure 2a is a drawing for explaining the output of content indicating sparkle.

[0073] Referring to FIG. 2A, the electronic device (201) provides increased immersion and realism by adjusting elements such as the resolution and / or brightness of the display. For example, when outputting (or playing, displaying) content (10) that exhibits sparkles (20) such as fireworks, the electronic device (201) can provide visual effects such as sparkles by simply adjusting the color or brightness of a specific area within the image. However, it is difficult to implement visual effects such as sparkles that exist in the real world by simply adjusting the color or brightness. If the electronic device (201) can provide sparkling visual effects such as the sparkles of diamonds, fireworks, stars in the night sky, or glitter, the immersion and realism can be further enhanced.

[0074] To achieve a more natural, sparkling visual effect, it's necessary to consider the size, brightness, and / or scattering of the light source. For example, if the light source is smaller than the specified size on the display, its brightness is higher than a certain level compared to its surroundings, and scattering exists around the light source, the user may perceive it as a sparkle distinct from general brightness.

[0075] In one embodiment, an electronic device including a display for providing a sparkle, a method of operating the same, and a storage medium may be provided.

[0076] According to one embodiment, a display can be provided with a sparkle effect, thereby enhancing immersion and realism when outputting (or playing, displaying) content such as videos, photos, movies, cartoons, dramas, or nature documentaries. Furthermore, the display for providing sparkle can also be utilized as an entertainment display in places such as dome displays, building exterior walls, and amusement parks. Furthermore, the display for providing sparkle can be utilized in digital billboards (e.g., signage), TV and / or mobile advertising to enhance advertising and sales effects, and can also be utilized in various fields, including home or exhibition art wall displays.

[0077] Figure 2b is an internal block diagram of an electronic device according to one embodiment.

[0078] Referring to FIG. 2B, an electronic device (201) (e.g., the electronic device (101) of FIG. 1) may include at least one processor (220), a memory (230), a display driver IC (265), and / or a touch sensor IC (266). In addition, a display (260) of the electronic device (201) may have a laminated structure as illustrated in FIG. 3. According to one embodiment, the display (260) may include a window, a polarizer, a touch sensor panel (TSP), and / or a display panel. The window may include a cover glass.

[0079] The touch sensor panel may be positioned on the upper side of the display panel and may include an optical layer on the touch sensor panel, wherein the optical layer may include a polarizer. As another example, the touch sensor panel may be positioned on the upper side of the polarizer.

[0080] First, the display driver IC (DDI) (265) can receive image data, or image information including an image control signal corresponding to a command to control the image data, from the processor (220) (e.g., the main processor (121) of FIG. 1 (e.g., an application processor) or an auxiliary processor (123) that operates independently of the function of the main processor (121)) through an interface module, for example. In addition, the display driver IC (265) can store at least a portion of the received image information in the memory (230), for example, on a frame basis. The display driver IC (265) can, for example, perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based at least on characteristics of the image data or characteristics of the display (260).

[0081] According to one embodiment, the touch sensor IC (266) controls the touch sensor panel (263) to detect a touch input or hovering input for a specific location of the display (260), for example, by measuring a change in a signal (e.g., capacitance) for the specific location, and provide information (e.g., location, area, pressure, or time) about the detected touch input or hovering input to the processor (220).

[0082] According to one embodiment, the processor (220) can control the overall operation of the electronic device (201). For example, the processor (220) can output (or display, reproduce) content with a sparkle effect applied through a display based on a plurality of image frames constituting the content. Here, the content can be a still image or a moving image that can be displayed on the display (260).

[0083] According to one embodiment, the memory (230) may store instructions that, when executed, control the processor (220) to perform various operations.

[0084] According to one embodiment, the memory (230) may store a control program for controlling the electronic device (201), a UI related to an application provided by the manufacturer or downloaded from an external source, images for providing the UI, user information, documents, databases, or related data.

[0085] According to one embodiment, the memory (230) stores instructions, which, when executed individually or collectively by at least one processor, may be configured to cause the electronic device (201) to analyze images in each of two or more sequentially input image frames. The input images may be images received (or downloaded) from an external source or images stored in the memory (230).

[0086] The processor (220) can analyze the input image on a frame-by-frame or scene-by-scene basis. For example, the processor (220) can analyze at least one of the average brightness level, pixel-by-pixel brightness (or brightness), and color on a frame-by-frame or scene-by-scene basis of the input image. For example, the processor (220) can determine whether the color of the input image is white and the brightness of the input image is equal to or greater than a first threshold value, and can detect an area where the color of the input image is white and equal to or greater than the first threshold value as a sparkling area.

[0087] The processor (220) can identify the location of a sparkling area (e.g., coordinate values ​​of the area in the image frame) among the plurality of sparkling pixels within the image frame from the image analysis results. The processor (220) can determine sparkling pixels corresponding to the sparkling area (or the area having the coordinate values) within the image frame among the plurality of sparkling pixels. Through this method, the processor (220) can identify a sparkling area in each of the image frames between the start image frame and the Nth image frame among the image frames.

[0088] According to one embodiment, the processor (220) may drive an on-device AI (e.g., a machine learning model, a generative AI model) to output light through a sparkling pixel by identifying a sparkling area. The processor (220) may use the on-device AI to generate a sparkling area and aspect, or a sparkling degree, to which a sparkling effect will be applied. In this way, the processor (220) may define and algorithmize input value conditions of the sparkling pixels of the sparkling area, and control the sparkling pixels based on the conditions to output a sparkling effect. For example, the sparkling effect may include at least one of specular reflection in which light is reflected without being greatly scattered, diffuse reflection in which light is reflected and spread in all directions, or twinkling reflection.

[0089] According to one embodiment, the area to which the sparkle effect is applied may be an area in which at least one of the color, brightness, duration, or on / off cycle of a sparkle pixel, which is a component for expressing sparkle, is adjusted through scene analysis (or understanding) using a generative AI model.

[0090] The processor (220) determines the on / off cycle (or frequency, blinking degree) and intensity of the blinking pixels based on the brightness within the blinking area of ​​the input image based on the image analysis results, and can control the blinking pixels corresponding to the blinking area to output light according to the determined frequency and intensity.

[0091] As described above, the processor (220) can identify brightness and color within the sparkle area and control the intensity and frequency of light output through the sparkle pixels based on the identified brightness and color.

[0092] According to one embodiment, the display panel may include an element for displaying a screen, and the window may be composed of a transparent material. To specifically explain the structure of the display (260), reference will be made to FIG. 3. To aid in understanding the description of FIG. 3, reference will be made to FIGS. 4A to 5. FIG. 3 is a cross-sectional view of a display according to one embodiment.

[0093] Referring to FIG. 3, the display (260) may largely include a cover glass (261), a protective layer (encap.) (262), a pixel layer (263), and a thin film transistor (TFT) layer (264). A cover glass (261) may be bonded to the protective layer (262) via an adhesive layer on the protective layer (262). The protective layer (262) may encapsulate the sub-pixels of the pixel layer (263) and may be bonded to the cover glass (261) via a black resin to prevent reflection of external light. In addition, the cover glass (261) may include an anti-reflection film (e.g., pol, reflective pol) to prevent reflection of external light.

[0094] According to one embodiment, the pixel layer (263) has a plurality of sub-pixels arranged thereon, and at least some of the sub-pixels may include a plurality of blinking pixels. The TFT layer (264) is arranged below the pixel layer (263) and may drive the sub-pixels of the pixel layer (263). The TFT layer (264) may be arranged (or formed) on a substrate (SUB) (not shown), and the pixel layer (263) may be positioned on the substrate (SUB).

[0095] For example, the TFT layer (264) can be turned on or off according to a control signal of a control circuit (e.g., a display driver IC (265) of FIG. 2B, or a processor (220)) to control the amount of current change (e.g., current amount, cycle) applied to at least one sub-pixel among a plurality of sub-pixels of the pixel layer (263) connected to the TFT layer (264).

[0096] According to one embodiment, at least some of the plurality of blinking pixels included in the plurality of sub-pixels may be controlled to output blinking according to brightness, on / off cycle (or frequency), and intensity that change in response to the amount of current applied through the TFT layer (264). Accordingly, by controlling the blinking pixels corresponding to the blinking area, an image in which at least some of the blinking occurs may be output (or displayed, reproduced) through the display (260) through image processing.

[0097] According to one embodiment, a sparkling pixel that outputs light corresponding to a sparkling visual effect may be implemented with a structure largely as shown in FIGS. 4A to 5. FIG. 4A is a drawing for explaining a sparkling pixel including a sparkling pearl according to one embodiment, FIG. 4B is a drawing for explaining another sparkling pixel including a sparkling pearl according to one embodiment, and FIG. 5 is a drawing for explaining a sparkling pixel using an optical element according to one embodiment.

[0098] Referring to FIG. 4A, a sparkling pixel may be a pixel in which a glint pearl is applied to at least some of a plurality of sub-pixels of a pixel layer (263). The electronic device (201) may control at least one of the color, brightness, duration, or on / off cycle of the sparkling pixel to output a sparkling visual effect. There may be a plurality of sparkling pixels, and the electronic device (201) may selectively generate a sparkling visual effect by individually controlling the plurality of sparkling pixels.

[0099] According to one embodiment, as illustrated in FIG. 4A, in the case of a 4-pixel arrangement, a sparkling pixel may be implemented by applying a glint pearl to a white sub-pixel among a plurality of sub-pixels (410, 412, 414) that implement red, green, blue, and white. Alternatively, a sparkling pixel may be implemented by applying a glint pearl to any one sub-pixel among a plurality of sub-pixels (420, 422, 430, 440) that implement red, green, and blue. In the case of a 4-pixel arrangement such as RGBW, RGGB, or diamond, it may be configured with three RGB pixels and one sparkling pixel. In the case of a 3-pixel arrangement, a sparkling pixel may be implemented by applying a pearl of any one of red, green, and blue to at least one pixel among the three RGB pixels. Here, the glint pearl may be a material that sparkles when exposed to light (reflective / transmissive). Crystal beads and crushed optical fibers can be used to implement glint pearls in a transparent manner, but the materials are not limited thereto.

[0100] According to one embodiment, in the case of a 4-pixel arrangement as illustrated in FIG. 4B, any one of a plurality of sub-pixels (450, 452, 454, 460, 462, 470, 480) that implement red, green, and blue may implement a twinkle pixel. Here, the twinkle pixel may be a light-emitting material that emits light using an electric field or light. For example, in the case of a 4-pixel arrangement such as RGBW, RGGB, or diamond, it may be configured with 3 RGB pixels and 1 twinkle pixel, and the 1 twinkle pixel may be a white light-emitting element.

[0101] According to one embodiment, a glittering pixel layer (563) may be implemented using a light element (or light source) as illustrated in FIG. 5. Referring to FIG. 5, a cover glass (561) may be disposed on a pixel layer (563) including a plurality of sub-pixels, and a backlight unit (570) having a light element (or light source) (572) disposed below the pixel layer (563) may be disposed. A plurality of light elements (572) may be provided, and may emit (or generate) light through a hole (567) formed below or in the pixel layer (563) to provide glittering. For example, the light element (572) may irradiate light toward a sub-pixel (565) of the pixel layer (563) or emit light through a hole (567) adjacent to a sub-pixel (565). The optical element (572) may be formed at a position corresponding to the sub-pixel (565) or the hole (567). According to one embodiment, the optical element (572) may include an optical fiber or an LED element so that light can be output through the hole (567). Among the plurality of sub-pixels arranged in the pixel layer (563), the twinkling pixels may output light by turning on / off the optical fiber or the LED element.

[0102] In one embodiment, a sparkling pixel may be formed by placing a crystal, cubic, or teardrop-shaped lens within a portion of the pixel layer (563). For example, a crystal, cubic, or teardrop-shaped lens may be placed within a hole penetrating the pixel layer (563) so as to allow light to be emitted from the rear to the front through the hole.

[0103] Meanwhile, in Fig. 5, an example of an optical element (572) is illustrated in which an LED element is arranged, but the optical fibers may be formed in a sheet shape in which they are arranged at regular intervals. For example, the pixel layer (573) may include a first sheet in which a plurality of sub-pixels are arranged and a second sheet in which optical fibers are arranged at regular intervals. Here, each of the optical fibers may include a plurality of light-emitting portions at regular intervals, and each of the twinkling pixels may be formed in a shape in which it includes one of the plurality of light-emitting portions.

[0104] In the above, the method for implementing the sparkling pixel has been described separately from FIGS. 4A to 5, but one or a combination of the above methods may be used to provide a sparkling visual effect.

[0105] According to one embodiment, in an electronic device (101, 201) including a display (260), the display includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, and a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0106] In one embodiment, each of the plurality of sparkle pixels may include a hole formed in the pixel layer and configured to provide sparkle.

[0107] According to one embodiment, each of the plurality of twinkling pixels may be a white sub-pixel including a twinkling pearl among the plurality of sub-pixels implementing red, green, blue, and white colors.

[0108] According to one embodiment, each of the plurality of twinkling pixels may be any one of the plurality of sub-pixels that implement red, green, and blue and include a twinkling pearl.

[0109] In one embodiment, the display may further include a reflective layer disposed over the pixel layer and configured to reflect light emitted from the plurality of sparkling pixels.

[0110] In one embodiment, the display may further include a reflective structure disposed on an outer surface of each of the plurality of twinkling pixels and configured to reflect light from the plurality of twinkling pixels.

[0111] In one embodiment, the display may further include light sources positioned below the pixel layer or below the hole for providing the sparkle.

[0112] According to one embodiment, the hole for providing the sparkle may include a crystal or a lens so that light emitted from the light source through the hole can be reflected and output.

[0113] According to one embodiment, the light sources may include optical fibers or LED elements so that light can be output through the holes.

[0114] According to one embodiment, the plurality of twinkling pixels may output light through turning on / off the optical fiber or the LED element.

[0115] According to one embodiment, the pixel layer includes a first sheet on which the plurality of sub-pixels are arranged and a second sheet on which optical fibers are arranged at regular intervals, each of the optical fibers including a plurality of light-emitting portions at regular intervals, and each of the plurality of twinkling pixels may include one of the plurality of light-emitting portions.

[0116] According to one embodiment, an electronic device (201) including a display (260) may include a display (260), at least one processor (220) including a processing circuit, and a memory (230) storing instructions.

[0117] According to one embodiment, the display (260) includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, and at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0118] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may be configured to cause the electronic device to analyze an image in each of two or more continuously input image frames, identify a sparkling area within the image frame from the image analysis result, determine sparkling pixels corresponding to the sparkling area within the image frame among the plurality of sparkling pixels, and output light through the sparkling pixels corresponding to the sparkling area.

[0119] In one embodiment, the instructions may be configured to cause the electronic device to identify brightness and color within the blinking area and, based on the identified brightness and color, control the intensity and frequency of light output through the blinking pixels.

[0120] In one embodiment, each of the plurality of sparkle pixels may include a hole formed in the pixel layer and configured to provide sparkle.

[0121] According to one embodiment, the display (260) further includes light sources disposed below the pixel layer or below the hole for providing the sparkle, wherein the light sources may include optical fibers or LED elements so that light can be output through the hole.

[0122] According to one embodiment, the instructions may be configured to cause the electronic device to output light through the twinkling pixels corresponding to the twinkling area by controlling the on / off of the optical fiber or LED element.

[0123] According to one embodiment, each of the plurality of twinkling pixels may be a white sub-pixel including a twinkling pearl among the plurality of sub-pixels implementing red, green, blue, and white colors.

[0124] According to one embodiment, each of the plurality of twinkling pixels may be any one of the plurality of sub-pixels that implement red, green, and blue and include a twinkling pearl.

[0125] FIG. 6 is a flowchart illustrating an operation of an electronic device including a display for providing a flicker according to an embodiment. Referring to FIG. 6, the operation method may include operations 605 to 620. Each operation of the operation method of FIG. 6 may be performed by an electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2B), or at least one processor of the electronic device (e.g., the processor 120 of FIG. 1, the processor 220 of FIG. 2B). In an embodiment, at least one of operations 605 to 620 may be omitted, the order of some operations may be changed, or another operation may be added.

[0126] Referring to FIG. 6, in operation 605, the electronic device (201) can analyze an image in each of two or more image frames that are input continuously.

[0127] In operation 610, the electronic device (201) can identify a sparkling area within an image frame from the image analysis results.

[0128] In operation 615, the electronic device (201) can determine, among the plurality of sparkling pixels, sparkling pixels corresponding to a sparkling area within the image frame.

[0129] In operation 620, the electronic device (201) can output light through the sparkling pixels corresponding to the sparkling area.

[0130] According to one embodiment, the electronic device (201) can identify brightness and color within the sparkle area and control the intensity and frequency of light output through the sparkle pixels based on the identified brightness and color.

[0131] FIG. 7 is a flowchart illustrating an operation of an electronic device according to a twinkle type according to an embodiment. Referring to FIG. 7, the operation method may include operations 710 to 730. Each operation of the operation method of FIG. 7 may be performed by an electronic device (e.g., the electronic device 101 of FIG. 1, the electronic device 201 of FIG. 2B), or at least one processor of the electronic device (e.g., the processor 120 of FIG. 1, the processor 220 of FIG. 2B). In an embodiment, at least one of operations 710 to 730 may be omitted, the order of some operations may be changed, or other operations may be added. In order to help understand the description of FIG. 7, the description will be made with reference to FIG. 8. FIG. 8 is an exemplary diagram for explaining a specular reflection mode and a twinkle mode according to an embodiment.

[0132] Referring to FIG. 7, in operation 710, the electronic device (201) can analyze an image through scene recognition in each of two or more image frames that are input continuously.

[0133] In operation 720, the electronic device (201) may determine a specular reflection mode or a twinkle mode from the image analysis results. For example, referring to FIG. 8, the electronic device (201) may identify a twinkle area within the input image through scene recognition based on not only the color of the input image but also the amount of brightness change, and may determine a mode for controlling the output of twinkle pixels corresponding to the identified twinkle area. For example, if the electronic device (201) determines that an input image such as 800a includes a strong twinkle area (810) having a brightness higher than a threshold value that emits white light due to light reflection, the electronic device (201) may determine the mode for controlling the output of the twinkle pixel as the specular reflection mode. On the other hand, if the electronic device (201) determines that the input image, such as 800b, includes a twinkling area (820) that emits light of various colors, such as sparkles and fireworks, and has a brightness higher than a threshold, the electronic device (201) may determine the mode for controlling the output of the twinkling pixel as the twinkle mode.

[0134] In operation 730, the electronic device (201) can control the twinkling pixels to express differently according to the brightness and size of the twinkling area within the image frame in response to the determined mode.

[0135] According to one embodiment, the electronic device (201) can output a twinkling visual effect through the twinkling area by identifying brightness, size, or color within the twinkling area, and adjusting at least one of color, brightness, duration, or on / off cycle of a twinkling pixel corresponding to the twinkling area based on the amount of change in color and brightness. Here, the visual effect output through the twinkling area can be expressed by terms such as twinkling, glint, or glitter.

[0136] FIG. 9A is a cross-sectional view of a first type of twinkle pixel according to one embodiment.

[0137] FIG. 9A illustrates a cross-sectional view of a display (e.g., display (260) of FIG. 2B), in which a cover glass (961) is arranged on top of a pixel layer (963), and a transparent glint pearl is applied on one of the sub-pixels of the pixel layer (963). Here, a TFT layer and a substrate (SUB) may be positioned below the pixel layer (963), and the pixel layer (963) and the cover glass (961) may be bonded to each other through an adhesive layer (e.g., resin) (971). The adhesive layer (e.g., resin) (971) may be bonded to the cover glass (261) through a black resin to prevent reflection of external light. In addition, the cover glass (261) may include an anti-reflection film (e.g., pol, reflective pol) to prevent reflection of external light.

[0138] As illustrated in FIG. 9A, a plurality of sub-pixels implement red, green, blue, and white colors, and among them, a glittering pixel can be implemented by applying a glint pearl (965) to a white-colored sub-pixel. The glint pearl (965) can be formed on the white-colored sub-pixel in various ways (e.g., resin mixing or application), and can be formed in a transparent form that glitters when exposed to light.

[0139] FIG. 9b is a cross-sectional view of a second type of twinkle pixel according to one embodiment.

[0140] As illustrated in FIG. 9B, a sparkling pixel can be formed by applying a glint pearl (e.g., a light emitting element) to one of a plurality of sub-pixels or mixing glint pearls. At this time, when the sparkling pixel to which the glint pearl is applied is made to receive light and emit light using a light element (972), the light through the sparkling pixel can be reflected by a reflection layer (973) and sparkle. In addition, in the case of a sub-pixel mixed with glint pearls, the sparkling pixel can be induced to emit light through a light element (974). In addition, in the case of a sparkling pixel formed by mixing glint pearls, the sparkling pixel can be reflected by an adhesive layer (e.g., resin) (971) and sparkle. In this way, the sparkling pixel can be induced to emit light by an electrical or optical method.

[0141] According to one embodiment, the glint pearl may be formed into a reflective shape that sparkles when exposed to light, and for a more detailed explanation, refer to FIGS. 9C and 9D.

[0142] FIG. 9c is a cross-sectional view of a third type of sparkling pixel according to one embodiment.

[0143] Referring to FIG. 9C, a TFT layer (964) for driving sub-pixels is positioned on the substrate, and a plurality of sub-pixels implement red, green, blue, and white colors. Among them, a glitter pearl may be applied to a white sub-pixel to implement a twinkle pixel. For example, the display (260) may further include a reflective layer (980) positioned on the pixel layer (963) and configured to reflect light emitted from the twinkle pixel. The reflective layer (980) may be formed on one side of the cover glass (961) corresponding to the position of the twinkle pixel.

[0144] FIG. 9d is a cross-sectional view of a fourth type of sparkling pixel according to one embodiment.

[0145] Referring to FIG. 9D, a twinkle pixel may be any one of a plurality of sub-pixels that implement red, green, and blue colors and include a twinkle pearl. Here, the display (260) may further include a reflection cup (990) to reflect light emitted from the twinkle pixel. The reflection cup (990) may be arranged on an outer surface of each of the twinkle pixels and configured to reflect light from the twinkle pixels.

[0146] Meanwhile, although the above description exemplifies a case where a twinkle pixel is implemented using one of the sub-pixels, the twinkle pixel may also be implemented through a hole formed in the pixel layer, as illustrated in FIG. 9E. FIG. 9E is a cross-sectional view of a fifth type of twinkle pixel according to an embodiment.

[0147] Referring to FIG. 9E, each of the plurality of sparkling pixels may include a hole formed in the pixel layer (963) to provide sparkling. In one embodiment, a sparkling visual effect may be output by emitting or reflecting light through a hole penetrating the pixel layer (963) using an optical element (e.g., an LED element). For example, the sparkling effect may be further enhanced by filling the hole with a resin or an optical fiber together with the aforementioned sparkling pixels (e.g., the sparkling pixels in FIGS. 9A to 9D ).

[0148] Referring to FIG. 9E, the twinkling pixel may be any one sub-pixel including a twinkling pearl among white or color-mixable red, green, and blue pixels. A hole filled with resin or optical fiber may be formed between the red, green, and blue pixels, and an optical element (e.g., an LED element) may be positioned at one end of the hole. The electronic device (201) may output a twinkling visual effect by controlling the optical element (e.g., on / off, output intensity). A control signal for controlling the optical element may be transmitted through a separate control line or through display drive wiring. Here, the color of the optical element may be a single color or a color combining at least one of red, green, and blue. At this time, the area other than the area where light is output may be molded to prevent light from leaking from the light source.

[0149] FIG. 10 is a cross-sectional view of a display having a first type of laminated structure according to one embodiment.

[0150] Referring to FIG. 10, a display (260) for providing a sparkle may include a cover glass (1061), a pixel layer (1063), a panel (1064) having holes arranged therein, and a backlight unit (1070). The pixel layer (1063) includes a plurality of sub-pixels, and at least some of the plurality of sub-pixels may include a plurality of sparkle pixels (e.g., the sparkle pixels in FIGS. 9A to 9D).

[0151] A panel (1064) having holes arranged therein may be arranged under a transparent pixel layer (1064). Here, when a transparent pixel layer (1064) is used, even if holes are not positioned at positions corresponding to each sub-pixel, light emitted from an optical element (e.g., an LED element) through the holes may pass through the transparent pixel layer (1064) and be output. The backlight unit (1070) may include an optical element (e.g., an LED element) arranged at positions corresponding to the holes. The optical elements may be arranged at equal intervals corresponding to the spacing of the holes in the backlight unit (1070) so that light may be output through the holes, but the number of optical elements and their arrangement positions are not limited thereto.

[0152] FIG. 11 is a cross-sectional view of a display having a second type of laminated structure according to one embodiment.

[0153] Referring to FIG. 11, a display (260) for providing a sparkle may include a cover glass (1161), a pixel layer (1163), a panel (or film, sheet) (1164) on which optical fibers are arranged, and a backlight unit (1170). According to one embodiment, the pixel layer (1163) includes a plurality of sub-pixels, and at least some of the plurality of sub-pixels may include a plurality of sparkle pixels (e.g., the sparkle pixels in FIGS. 9A to 9D). In addition, a hole (e.g., see FIG. 5) for providing a sparkle may be formed in the pixel layer (1163).

[0154] As illustrated in FIG. 11, the panel (1164) on which the optical fibers (1165) are arranged may be positioned above or below the pixel layer (1173). For example, the optical fibers (1165) may be formed at positions corresponding to holes formed in the pixel layer (1163). The panel (1164) on which the optical fibers (1165) are arranged may have a pattern of optical fiber sections formed based on at least one of a core, a cladding refractive index, and a hole size of the optical fiber to correspond to the hole positions. In this way, a combination of a film on which the optical fibers are patterned, a pixel layer on which holes for providing sparkle are arranged, and an optical element for driving the sparkle pixel can output a sparkle visual effect.

[0155] FIG. 12 is a cross-sectional view of a display having a third type of laminated structure according to one embodiment.

[0156] Referring to FIG. 12, a display (260) for providing a twinkle may include a cover glass (1261), a pixel layer (1263), and a panel (or film, sheet) (1264) on which optical fibers are arranged. According to one embodiment, the pixel layer (1263) includes a plurality of sub-pixels, and at least some of the plurality of sub-pixels may include a plurality of twinkle pixels (e.g., twinkle pixels in FIGS. 9A to 9D).

[0157] Although FIG. 12 illustrates a case where the panel on which optical fibers are arranged is positioned on top of the pixel layer (1263), the pixel layer (1263) may be formed to include a first sheet on which a plurality of sub-pixels are arranged and a second sheet on which optical fibers (1265) are arranged at regular intervals. Here, each of the optical fibers (1265) may include a plurality of light-emitting portions (1266) at regular intervals. Each of the twinkling pixels may include one of the plurality of light-emitting portions or correspond to one of the light-emitting portions. As illustrated in FIG. 12, twinkling may be output using an optical fiber of a side-emitting type and a light source for twinkling (e.g., an LED element). At this time, the light-emitting portion of the side-emitting optical fiber may be selectively turned on / off. The color of the light source output through the plurality of light-emitting portions may be a single color or a color that combines at least one of red, green, and blue.

[0158] FIG. 13 is a cross-sectional view of a display having a fourth type of laminated structure according to one embodiment.

[0159] Referring to FIG. 13, a display (260) for providing a twinkle may include a cover glass (1361), a pixel layer (1363), a panel (or film, sheet) (1364) on which optical fibers are arranged, and a back plate (1366). According to one embodiment, the pixel layer (1363) includes a plurality of sub-pixels, and at least some of the plurality of sub-pixels may include a plurality of twinkle pixels (e.g., twinkle pixels in FIGS. 9A to 9D). According to one embodiment, the pixel layer (1363) may be formed as a transparent plate so that light emitted through a plurality of light-emitting portions at regular intervals from a panel (1364) on which optical fibers (1365) are arranged, located underneath, may pass through. At this time, since the optical fibers (1365) may emit light through the light emitting portions, but some of the emitted light may travel backward, the display (260) may further include a back plate (1366) (or reflective sheet, reflective film) for reflecting the light emitted backward from the light source forward.

[0160] FIG. 14 is a cross-sectional view of a display having a laminated structure of the fifth type according to one embodiment.

[0161] Referring to FIG. 14, at least some of the plurality of sub-pixels of the pixel layer (1463) include a plurality of twinkling pixels, and optical fibers (1465) can be arranged with their cross-sections facing forward on the plurality of twinkling pixels. Here, a cover glass (1461) is arranged on the pixel layer (1463), and optical fibers (1465) can be arranged between the pixel layer (1463) and the cover glass (1461). The electronic device (201) can output twinkling by controlling the on / off of the optical fibers formed on the twinkling pixels.

[0162] FIG. 15a is a drawing for explaining a first example of use of a display using an optical element according to one embodiment, and FIG. 15b is a drawing for explaining a second example of use of a display using an optical element according to one embodiment.

[0163] FIG. 15A illustrates a display device in which holes are formed at regular intervals on a panel of an LED display and each hole is filled with an optical fiber. As illustrated in FIG. 15A, an optical element connected to a backlight unit (1510) including a display driver is connected to the holes of the LED display, so that a sparkle emitted from the optical fiber through the LED display can be emitted through the holes. In addition, as illustrated in FIG. 15B, a transparent display can be placed in front of the hole plate (or panel on which holes are arranged) instead of the LED display. Accordingly, light passing through the holes can pass through the transparent display. According to one embodiment, the display devices of the aforementioned type can also be manufactured in the form of a modular display, so that a sparkling visual effect can be output even on an ultra-large display device.

[0164] Meanwhile, the present invention may be applied to various devices other than the aforementioned display device. For example, as shown in FIGS. 16 and 17, a projector may be used to output a sparkling visual effect. Here, FIG. 16 is a drawing illustrating a third example of use of a display using an optical element according to one embodiment, and FIG. 17 is a drawing illustrating a fourth example of use of a display using an optical element according to one embodiment.

[0165] As illustrated in FIG. 16, in the case of a projector, a device that outputs a sparkling visual effect can be positioned at a screen position located in front of the projector. At this time, the screen can include holes arranged at regular intervals through which light output from a light source can be emitted. Additionally, as illustrated in FIG. 17, a light source sheet including optical fibers that include evenly emitted portions arranged at regular intervals can be placed behind the screen. At this time, side-emitting optical fibers can be used for even emission.

[0166] Fig. 18 is a drawing for explaining a control method using color coordinates according to one embodiment.

[0167] FIG. 18 illustrates the definition of a color gamut and color coordinates. The electronic device (201) can change and apply a color mixing ratio when driving a glint pixel. Accordingly, the electronic device (201) can generate a glint effect while maintaining the color coordinates.

[0168] For example, if the sub-pixel is RGGB and one of the two G sub-pixels is to be used as a twinkle pixel, the electronic device (201) can maintain the color coordinate value by changing the color coordinate mapping value.

[0169] In the case of color mapping, the colors within the RGB triangle of Fig. 18 can be implemented by combining the luminance ratios of the R, G, and B sub-pixels at a certain ratio. For example, the color white can be created by mixing (or combining) the R, G, and B luminance ratios at a ratio of 3:6:1.

[0170] Here's how to redefine the gamut in RGBW subpixels. For example, if you want to generate yellow by combining the luminance ratios of the R, G, and B subpixels at a constant ratio and output a sparkle through a sparkling pixel, you can express yellow (e.g., Y(0.4, 0.5)) by adjusting the R and G luminance ratios. At this time, if you turn on the white subpixel corresponding to the sparkling pixel to output the sparkle through the sparkling pixel, the yellow (e.g., Y(0.4, 0.5)) will move to another color on the WY line depending on the luminance intensity of the white color, and the white color can be output more clearly as you increase the intensity of the sparkling pixel. Therefore, in order to prevent the color of the pixel from changing from yellow to white, you can prevent the color from changing to white by increasing the luminance of R and G to a certain extent.

[0171] According to one embodiment, a display can be provided with a sparkle to enhance immersion and realism when outputting (or playing, displaying) content such as a video, photo, movie, cartoon, drama, or nature documentary.

[0172] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0173] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0174] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0175] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0176] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0177] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0178] According to one embodiment, in a non-transitory storage medium storing instructions, the instructions may be configured to cause the electronic device (101, 201) to perform at least one operation when individually or collectively executed by at least one processor (220) of the electronic device (101, 201) including the display (260).

[0179] According to one embodiment, the display includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, and a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer may include a plurality of blinking pixels.

[0180] In one embodiment, the at least one operation may include analyzing an image in each of two or more consecutively input image frames.

[0181] In one embodiment, the at least one operation may include identifying a sparkling region within an image frame from the image analysis results.

[0182] In one embodiment, the at least one operation may include determining, among the plurality of sparkling pixels, sparkling pixels corresponding to a sparkling area within the image frame.

[0183] In one embodiment, the at least one operation may include outputting light through sparkle pixels corresponding to the sparkle area.

Claims

1. In an electronic device (101, 201) including a display (260), The above display is, cover glass (261), a pixel layer (263) comprising a plurality of sub-pixels, and It is placed below the pixel layer and includes a thin film transistor (TFT) layer (264) for driving the sub-pixels, An electronic device, wherein at least some of the plurality of sub-pixels of the pixel layer comprise a plurality of twinkling pixels.

2. In the first paragraph, each of the plurality of twinkling pixels, An electronic device comprising a hole formed in the pixel layer and configured to provide sparkle.

3. In the first or second paragraph, each of the plurality of twinkling pixels, An electronic device, wherein a white subpixel including a sparkling pearl among a plurality of subpixels implementing red, green, blue, and white colors, or one subpixel including a sparkling pearl among a plurality of subpixels implementing red, green, and blue colors.

4. An electronic device according to any one of claims 1 to 3, wherein the display further comprises a reflective layer disposed on the pixel layer and configured to reflect light emitted from the plurality of sparkling pixels.

5. An electronic device according to any one of claims 1 to 4, further comprising a reflective structure disposed on an outer surface of each of the plurality of twinkling pixels and configured to reflect light from the plurality of twinkling pixels.

6. In any one of the first to fifth paragraphs, further comprising light sources arranged under the pixel layer or under the hole for providing the sparkle, An electronic device in which a hole for providing the above-mentioned sparkle includes a crystal or a lens so that light emitted from the light source through the hole can be reflected and output.

7. In any one of the first to sixth paragraphs, the light sources include optical fibers or LED elements so that light can be output through the holes, The above plurality of sparkling pixels are, An electronic device in which light is output through turning on / off the optical fiber or the LED element.

8. In any one of the first to seventh paragraphs, the pixel layer, It comprises a first sheet on which the plurality of sub-pixels are arranged and a second sheet on which optical fibers are arranged at regular intervals, An electronic device, wherein each of the optical fibers includes a plurality of light-emitting portions spaced at regular intervals, and each of the plurality of twinkling pixels includes one of the plurality of light-emitting portions.

9. In the electronic device (101, 201), A display (260); the display includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, and a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer include a plurality of blinking pixels, At least one processor (220) comprising a processing circuit; and Includes a memory (230) for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Analyze the image from each of two or more consecutively input image frames, Identify the sparkling area within the video frame from the video analysis results, Among the plurality of sparkling pixels, sparkling pixels corresponding to the sparkling area within the image frame are determined, An electronic device configured to output light through sparkling pixels corresponding to the sparkling area.

10. In the 9th paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Identify the brightness and color within the above sparkle area, An electronic device configured to control the intensity and frequency of light output through the blinking pixels based on the identified brightness and color.

11. In the 9th or 10th paragraph, each of the plurality of twinkling pixels, An electronic device comprising a hole formed in the pixel layer and configured to provide sparkle.

12. In any one of claims 9 to 11, the display further comprises light sources disposed below the pixel layer or below the hole for providing the sparkle, wherein the light sources comprise optical fibers or LED elements so that light can be output through the hole. The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device configured to output light through blinking pixels corresponding to the blinking area by controlling the on / off of the optical fiber or LED element.

13. In any one of paragraphs 9 to 12, each of the plurality of twinkling pixels, An electronic device, wherein a white subpixel including a sparkling pearl among a plurality of subpixels implementing red, green, blue, and white colors, or one subpixel including a sparkling pearl among a plurality of subpixels implementing red, green, and blue colors.

14. A method for providing a sparkle in an electronic device (101, 201) including a display (260), The display includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, and a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer include a plurality of blinking pixels. An operation of analyzing an image from each of two or more consecutively input image frames; An operation of identifying a sparkling area within a video frame from the results of video analysis; An operation of determining sparkling pixels corresponding to a sparkling area within the image frame among the plurality of sparkling pixels; and A method for providing a sparkle, comprising an operation of outputting light through sparkle pixels corresponding to the sparkle area.

15. In a non-transitory storage medium storing instructions, the instructions are configured to cause the electronic device (101, 201) to perform at least one operation when individually or collectively executed by at least one processor (220) of the electronic device including the display, wherein the at least one operation is: The display (260) includes a cover glass (261), a pixel layer (263) including a plurality of sub-pixels, and a thin film transistor (TFT) layer (264) disposed below the pixel layer and driving the sub-pixels, wherein at least some of the plurality of sub-pixels of the pixel layer include a plurality of blinking pixels. An operation of analyzing an image from each of two or more consecutively input image frames; An operation of identifying a sparkling area within a video frame from the results of video analysis; An operation of determining sparkling pixels corresponding to a sparkling area within the image frame among the plurality of sparkling pixels; and A storage medium comprising an operation of outputting light through sparkling pixels corresponding to the sparkling area.

Images