Display device and operation method of display device

Abstract

A display device according to an embodiment disclosed herein can acquire a first image, which is a target image, and a second image captured through at least one camera, extract a common component of the first image and the second image, divide a first region including the common component into a plurality of first sub-regions in the first image, identify attribute values associated with at least one of color or brightness corresponding to each of the plurality of first sub-regions as attribute values specific to the first sub-regions, divide a second region including the common component into a plurality of second sub-regions in the second image, identify attribute values associated with at least one of color or brightness corresponding to each of the plurality of second sub-regions as attribute values specific to the second sub-regions, identify that the difference between at least one first attribute value corresponding to at least one third sub-region among the plurality of first sub-regions and at least one second attribute value corresponding to at least one fourth sub-region among the plurality of second sub-regions is not within the designated range, and determine, on the basis of the at least one first attribute value, a setting value for controlling at least one light associated with the at least one fourth sub-region among a plurality of lights.

Description

Display devices and methods of operating display devices

[0001] The present disclosure relates to a display device and a method of operating the display device.

[0002] To capture high-quality images in diverse environments, various control operations can be performed depending on the shooting environment. For example, operations may be performed to adjust the camera's aperture and shutter speed, or to control lighting based on ambient brightness. Lighting can be a factor that significantly influences the quality and ambiance of a photo or image. Lighting can be controlled to achieve the desired results depending on the shooting purpose. Because lighting plays a crucial role in the shooting process, appropriate lighting control can be an essential skill for capturing high-quality images.

[0003] When capturing images using a camera, different settings and controls may be required in different environments. For example, users may need to individually perform functional adjustments or device settings appropriate for each environment to obtain images with the desired color or brightness. Even if control actions such as functional adjustments or device settings are performed, users may not be able to obtain the desired image, and control actions must be repeated until the desired image is obtained.

[0004] Embodiments of the present disclosure can provide a display device and a method of operating the display device.

[0005] Embodiments of the present disclosure can provide a display device and a method of operating the display device that provide an image having a color and / or brightness similar to a target image.

[0006] Embodiments of the present disclosure may provide a display device and a method of operating the display device that control at least one light so that an image having a color and / or brightness similar to a target image is obtained.

[0007] Embodiments of the present disclosure may provide a display device and an operating method of the display device that determine a setting value of at least one light based on a shooting purpose or shooting use.

[0008] Embodiments of the present disclosure can provide a display device and a method of operating the display device that can correct the color and / or brightness of not only a subject but also a background using a light source, thereby enabling natural image correction compared to digital correction.

[0009] A display device according to an exemplary embodiment of the present disclosure comprises: at least one camera, a plurality of lights, a memory storing at least one program, and at least one processor electrically connected to the at least one camera, the plurality of lights, the at least one display, and the memory, the processor including a processing circuit, wherein the at least one processor is configured to individually and / or collectively execute commands of the at least one program and perform the following: acquire a first image as a target image and a second image captured through the at least one camera, extract a common component between the first image and the second image, divide a first area including the common component in the first image into a plurality of first sub-regions, and identify an attribute value associated with at least one of a color or brightness corresponding to each of the plurality of first sub-regions as an attribute value for each first sub-region, divide a second area including the common component in the second image into a plurality of second sub-regions, and identify an attribute value associated with at least one of a color or brightness corresponding to each of the plurality of second sub-regions as an attribute value for each second sub-region, Determine whether the difference between the attribute value of each of the first sub-areas and the attribute value of each of the second sub-areas is within a specified range, and based on the determination result, identify that the difference between at least one first attribute value corresponding to at least one third sub-area among the plurality of first sub-areas and at least one second attribute value corresponding to at least one fourth sub-area among the plurality of second sub-areas is not within the specified range, and determine the setting value of at least one light associated with at least one fourth sub-area among the plurality of lights based on the at least one first attribute value,At least one light can be controlled based on the above-determined setting value.

[0010] According to an exemplary embodiment, the first image may include any one of an image previously captured by the at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device, or an image input or received from an external electronic device.

[0011] According to an exemplary embodiment, the attribute value for each of the first sub-regions may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of first sub-regions, and the attribute value for each of the second sub-regions may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of second sub-regions.

[0012] According to an exemplary embodiment, at least one processor may be configured to, individually and / or collectively: identify color information corresponding to the at least one third sub-region based on the at least one first attribute value, and determine a setting value of the at least one light so that light of a color corresponding to the identified color information is irradiated. The color information corresponding to the at least one third sub-region may include information indicating an average color value of the at least one third sub-region.

[0013] According to an exemplary embodiment, the device may further include at least one display. The at least one display may include a plurality of micro light emitting diodes (LEDs). The plurality of lights may correspond to the plurality of micro LEDs.

[0014] According to an exemplary embodiment, at least one processor may be configured, individually and / or collectively: to identify first brightness information corresponding to the at least one third sub-region based on the at least one first attribute value, to identify second brightness information corresponding to the at least one fourth sub-region based on the at least one second attribute value, to determine a brightness value based on the first brightness information and the second brightness information, and to determine a setting value of the at least one light based on the determined brightness value.

[0015] According to an exemplary embodiment, the first brightness information may include information indicating a first brightness deviation. The second brightness information may include information indicating a second brightness deviation. The first brightness deviation may be determined based on a difference between an average brightness value of the entire plurality of first sub-regions and an average brightness value of the at least one third sub-region. The second brightness deviation may be determined based on a difference between an average brightness value of the entire plurality of second sub-regions and an average brightness value of the at least one fourth sub-region.

[0016] According to an exemplary embodiment, the first brightness information may include information indicating an average brightness value of the at least one third sub-region.

[0017] According to an exemplary embodiment, at least one processor may be configured to, individually and / or collectively: determine a setting value of said at least one light based on an average brightness value of said at least one third sub-region or a designated brightness value of said at least one light, and a difference value between said first brightness deviation and said second brightness deviation.

[0018] According to an exemplary embodiment, at least one processor may be configured to individually and / or collectively: control the at least one light based on a specified setpoint, based on a difference between the attribute value for the first sub-region and the attribute value for the second sub-region being within the specified range.

[0019] An operating method of a display device according to an exemplary embodiment of the present disclosure comprises: acquiring a first image as a target image and a second image captured through at least one camera; extracting a common component between the first image and the second image; dividing a first region including the common component in the first image into a plurality of first sub-regions, and identifying an attribute value associated with at least one of color or brightness corresponding to each of the plurality of first sub-regions as an attribute value for each first sub-region; dividing a second region including the common component in the second image into a plurality of second sub-regions, and identifying an attribute value associated with at least one of color or brightness corresponding to each of the plurality of second sub-regions as an attribute value for each second sub-region; determining whether a difference between an attribute value for each first sub-region and an attribute value for each second sub-region is within a specified range; and determining, based on a result of the determination, whether a difference between at least one first attribute value corresponding to a third sub-region of at least one of the plurality of first sub-regions and at least one second attribute value corresponding to a fourth sub-region of at least one of the plurality of second sub-regions is not within the specified range. The method may include an action of identifying a non-determined state, an action of determining a setting value of at least one light associated with at least one fourth sub-region among a plurality of lights based on the at least one first attribute value, and an action of controlling the at least one light based on the determined setting value.

[0020] According to an exemplary embodiment, the first image may include any one of an image previously captured by the at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device, or an image input or received from an external electronic device.

[0021] According to an exemplary embodiment, the attribute value for each of the first sub-regions may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of first sub-regions, and the attribute value for each of the second sub-regions may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of second sub-regions.

[0022] According to an exemplary embodiment, the operation of determining a setting value of the at least one light may include: an operation of identifying color information corresponding to the at least one third sub-region based on the at least one first attribute value; and an operation of determining a setting value of the at least one light such that light of a color corresponding to the identified color information is irradiated. The color information corresponding to the at least one third sub-region may include information indicating an average color value of the at least one third sub-region.

[0023] According to an exemplary embodiment, the plurality of lights may correspond to a plurality of micro light emitting diodes (LEDs). The plurality of micro LEDs may be included in at least one display included in the display device.

[0024] According to an exemplary embodiment, the color information corresponding to the at least one third sub-region may include information indicating an average color value of the at least one third sub-region.

[0025] According to an exemplary embodiment, the operation of determining the setting value of the at least one light may include an operation of identifying first brightness information corresponding to the at least one third sub-area based on the at least one first attribute value, an operation of identifying second brightness information corresponding to the at least one fourth sub-area based on the at least one second attribute value, an operation of determining a brightness value based on the first brightness information and the second brightness information, and an operation of determining a setting value of the at least one light based on the determined brightness value.

[0026] According to an exemplary embodiment, the first brightness information may include information indicating a first brightness deviation. The second brightness information may include information indicating a second brightness deviation. The first brightness deviation may be determined based on a difference between an average brightness value of the entire plurality of first sub-regions and an average brightness value of the at least one third sub-region. The second brightness deviation may be determined based on a difference between an average brightness value of the entire plurality of second sub-regions and an average brightness value of the at least one fourth sub-region.

[0027] According to an exemplary embodiment, the first brightness information may include information indicating an average brightness value of the at least one third sub-region.

[0028] According to an exemplary embodiment, the operation of determining a brightness value based on the first brightness information and the second brightness information may include an operation of determining a setting value of the at least one light based on an average brightness value of the at least one third sub-region or a specified brightness value of the at least one light and a difference value between the first brightness deviation and the second brightness deviation.

[0029] According to an exemplary embodiment, the method may further include an operation of controlling the at least one light based on a specified setting value, based on a difference between the attribute value for each of the first sub-areas and the attribute value for each of the second sub-areas being within the specified range.

[0030] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent in the following detailed description taken in conjunction with the accompanying drawings, in which:

[0031] FIG. 1 is a block diagram illustrating an exemplary configuration of a display device according to various embodiments.

[0032] FIG. 2 is a drawing illustrating a camera unit and a lighting unit included in a display device according to various embodiments.

[0033] FIG. 3A is a diagram illustrating a first image and a second image according to various embodiments.

[0034] FIG. 3b is a diagram illustrating exemplary common components between a first image and a second image according to various embodiments.

[0035] FIG. 3c is a diagram illustrating various example regions including common components within the first image and the second image according to various embodiments.

[0036] FIG. 3D is a diagram illustrating exemplary information associated with object A included in a first image according to various embodiments.

[0037] FIG. 3e is a diagram illustrating exemplary information associated with object B included in a second image according to various embodiments.

[0038] FIG. 3f is a diagram illustrating a third image having similar attribute values ​​to the first image according to various embodiments.

[0039] FIG. 4 is a flowchart illustrating exemplary operations of a display device according to various embodiments.

[0040] FIG. 5 is a flowchart illustrating an operation of a display device according to various embodiments to determine a setting value of at least one light for color correction.

[0041] FIG. 6 is a flowchart illustrating an exemplary operation of a display device according to various embodiments to determine a setting value of at least one light for brightness compensation.

[0042] FIG. 7 is a flowchart illustrating an exemplary operation of a display device acquiring an image according to various embodiments.

[0043] FIG. 8 is a diagram illustrating an exemplary first type of display device according to various embodiments.

[0044] FIGS. 9A, 9B, and 9C are diagrams illustrating examples of a second type of display device according to various embodiments.

[0045] The following description refers to the attached drawings, and specific examples for implementing the disclosed subject matter are illustrated and described within the drawings. Furthermore, other examples may be utilized and structural changes or modifications may be made without departing from the scope of the various examples.

[0046] Hereinafter, various exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. However, the present disclosure may be implemented in various other forms and is not limited to the various exemplary embodiments described herein. In connection with the description of the drawings, identical or similar components may be indicated by identical or similar reference numerals. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0047] FIG. 1 is a block diagram illustrating an exemplary configuration of a display device according to various embodiments.

[0048] Referring to FIG. 1, the display device (100) may include a camera unit (e.g., including a camera) (110), a lighting unit (e.g., including lighting) (120), a display (130), a memory (140), and a processor (e.g., including a processing circuit) (150). According to one example, the display device (100) may include additional components (e.g., an audio output unit for outputting an audio signal to the outside of the display device (100) and / or a communication unit for wired or wireless communication with an external electronic device) in addition to the illustrated components, or may omit at least one of the illustrated components.

[0049] The camera unit (110) may include at least one camera and may capture images (e.g., photographs or still images) or videos. In one example, the camera unit (110) may include N cameras. N may be an integer greater than or equal to 1. Each of the N cameras may include at least one lens and at least one image sensor. In one example, when the camera unit (110) includes two or more cameras (N≥2), the two or more cameras may be positioned at different locations. The two or more cameras positioned at different locations may capture a subject from multiple angles.

[0050] The lighting unit (120) may include various lighting and / or light-emitting circuits and may be operated in conjunction with the camera unit (110). For example, the lighting unit (120) may be operated based on N cameras performing shooting. According to one example, the lighting unit (120) may include M lights. M may be an integer greater than or equal to 1. Each of the M lights may include a tri-color light source. The tri-color light source may produce various colors by mixing light of three colors (e.g., red, green, and blue). Each of the M lights may provide light of various colors and brightness to a subject being shot by the N cameras based on the tri-color light source.

[0051] The display (130) can perform functions for outputting information in the form of numbers, characters, images, and / or graphics. The display (130) can display a screen corresponding to data received from the processor (150). According to one example, the display (130) can display images captured by N cameras or display any one selected from images stored in the memory (140). Depending on the implementation, there may be two or more displays (130), and they may be referred to as an output unit, a display unit, or other terms having equivalent technical meanings.

[0052] In one example, the display (130) may include a micro LED display including micro LEDs (light emitting diodes). Each of the micro LEDs may correspond to M lights and may be used for image display. When the display (130) includes a micro LED display, the display (130) and the lighting unit (120) may have an integrated form.

[0053] According to one example, the display (130) may be configured as a touch screen by forming a layer structure with a touchpad. In this case, the display (130) may be used as an input device in addition to an output device. The display (130) may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display.

[0054] The memory (140) can store at least one program for processing and controlling the processor (150), and can store input and / or output data. According to one example, the memory (140) can store various data used by at least one component of the display device (100) (e.g., the camera unit (110) and / or the processor (150)). For example, the memory (140) can store one or more images captured by N cameras of the camera unit (100), and can store a target image. The target image can include any one of images previously captured by the N cameras, an image selected from among a plurality of images, an image input to the display device (100), or an image input or received from an external electronic device.

[0055] The memory (140) may include a storage medium corresponding to at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., a secure digital (SD) or extreme digital (XD) memory, a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, or an optical disk). The memory (140) may also store an artificial intelligence (AI) model.

[0056] The processor (150) may include various processing circuits and control the operation of the display device (100). The processor (150) may include a computing device, circuit, or circuit board that executes calculations or data processing related to the control of at least one other component of the display device (100). The processor (150) may include at least one of an image signal processor (ISP), a central processing unit (CPU), a neural processing unit (NPU), a graphics processing unit (GPU), a micro processing unit (MPU), a micro controller unit (MCU), an application processor (AP), a communication processor (CP), a system on chip (SoC), an integrated circuit (IC), a sensor hub, a supplementary processor, a communication processor, an application processor, an application specific integrated circuit (ASIC), or a field programmable gate array (FPGA), and may have multiple cores. The processor (150) may include various processing circuits and / or multiple processors. For example, the term "processor" as used in this disclosure, including the claims, may include various processing circuits, including at least one processor, wherein one or more of the at least one processor may be configured individually and / or collectively in a distributed manner to perform the various functions described in this disclosure.When the terms "processor," "at least one processor," and "one or more processors" are used herein to describe a processor configured to perform a number of functions, these terms encompass, for example and without limitation, situations where one processor performs some of the recited functions and other processor(s) perform other recited functions, as well as situations where a single processor can perform all of the recited functions. Furthermore, the at least one processor may comprise a combination of processors that perform various recited / disclosed functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0057] According to one example, the processor (150) may be electrically connected to the camera unit (110), the lighting unit (120), the display (130), and the memory (140), and may execute instructions of at least one program stored in the memory (140). The processor (150) may include a processing circuit that executes instructions of at least one program stored in the memory (140).

[0058] According to an example, the processor (150) can control the camera unit (110) and the lighting unit (120) based on the target image. For example, the processor (150) can compare images acquired by N cameras of the camera unit (110) with the target image, determine setting values ​​of M lights of the lighting unit (120) so that an image with similar brightness and / or color as the target image is acquired based on the comparison result, and control the M lights with the determined setting values.

[0059] According to an example, the processor (150) can perform operations of the display device (100) to be presented below by controlling the camera unit (110), the lighting unit (120), the display (130), and the memory (140).

[0060] FIG. 2 is a drawing illustrating a camera unit and a lighting unit included in a display device according to various embodiments.

[0061] Referring to FIG. 2, the camera unit (110) and the lighting unit (120) may be arranged adjacently. According to an example, M lights included in the lighting unit (120) may be arranged at a position adjacent to the camera unit (110). For example, if the lighting unit (120) includes eight lights (M=8), the eight lights (e.g., the first light (201), the second light (202), the third light (203), the fourth light (204), the fifth light (205), the sixth light (206), the seventh light (207), and the eighth light (208)) may be arranged in a form that surrounds the camera unit (110). However, this is only one example, and the arrangement structure of the camera unit (110) and the lighting unit (120) may be changed in various ways.

[0062] Hereinafter, the lighting control operation of the display device (100) will be described with reference to FIGS. 3a, 3b, 3c, 3d, 3e, and 3f (which may also be referred to as FIGS. 3a to 3f). For convenience of understanding, an example in which the display device (100) includes a camera unit (110) and a lighting unit (120) arranged as in FIG. 2 will be described.

[0063] FIG. 3A is a diagram illustrating a first image and a second image according to various embodiments.

[0064] Referring to FIG. 3a, the first image (310) may be a target image, and the second image (320) may be an image acquired through at least one camera (N cameras, N≥1) included in the camera unit (110).

[0065] In one example, the first image (310) may be used to set a target color and / or target brightness for lighting control. The first image (310) may be an image captured with lighting of a color and / or brightness desired by the user. For example, the first image (310) may include any one of an image previously captured by at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device (100), or an image input or received from an external electronic device.

[0066] In one example, the second image (320) may be used to identify a shooting environment of at least one camera. The second image (320) may include any one of an image shot or captured by at least one camera, a preview image of at least one camera, or an image shot in real time by at least one camera.

[0067] The first image (310) and the second image (320) may each include at least one object. The at least one object may include at least one of a person, an animal, a plant, an object, a structure, or a natural environment.

[0068] As an example, a first image (e.g., a passport photo) (310) may include an object A (e.g., a face of user A), and a second image (e.g., a preview image) (320) may include an object B (e.g., a face of user B). Object B may be a subject being photographed, but may also be a background. User A and User B may be the same user or different users.

[0069] FIG. 3b is a diagram illustrating exemplary common components between a first image and a second image according to various embodiments.

[0070] Referring to FIG. 3B, the display device (100) can extract common components having common characteristics from the first image (310) and the second image (320) based on the acquisition of the first image (310) and the second image (320). For example, the display device (100) can extract the first component (e.g., left eye) (311), the second component (e.g., right eye) (312), and the third component (e.g., mouth) (313) included in object A and the fourth component (e.g., left eye) (321), the fifth component (e.g., right eye) (322), and the sixth component (e.g., mouth) (323) included in object B as common components. The display device (100) can extract common components of the first image (310) and the second image (320) using feature matching technology, but the method of extracting the common components is not limited thereto and can be used in various ways.

[0071] FIG. 3c is a diagram illustrating various example regions including common components within the first image and the second image according to various embodiments.

[0072] Referring to FIG. 3c, the display device (100) can generate an area including common components in each of the first image (310) and the second image (320) based on the common components extracted from the first image (310) and the second image (320).

[0073] According to one example, the display device (100) can generate a first region (314) that is an region that includes common components (e.g., the first component (311), the second component (312), and the third component (313) of FIG. 3B) in the first image (310).

[0074] According to one example, the display device (100) can generate a second region (324) that is an region that includes common components (e.g., the fourth component (321), the fifth component (322), and the sixth component (323) of FIG. 3B) in the second image (320).

[0075] The first region (314) and the second region (324) may each be rectangular regions outside the common component, but the first region (314) and the second region (324) may also be regions of a shape other than the rectangular region (e.g., triangular or circular regions).

[0076] According to one example, the display device (100) may divide the first region (314) into multiple sub-regions based on the generation of the first region (314). For example, the display device (100) may divide the first region (314) into multiple sub-regions based on the center of the first region (314). The multiple sub-regions may have the same or different sizes.

[0077] According to one example, the display device (100) may divide the second region (324) to create multiple sub-regions based on the generation of the second region (324). For example, the display device (100) may create multiple sub-regions by dividing the second region (324) based on the center of the second region (324). The multiple sub-regions may have the same or different sizes.

[0078] For example, a plurality of sub-regions created by dividing a first region (314) may be referred to as a plurality of first sub-regions, and a plurality of sub-regions created by dividing a second region (324) may be referred to as a plurality of second sub-regions.

[0079] In the following, for the convenience of understanding, an example is given where each of the plurality of first sub-regions and the plurality of second sub-regions has eight sub-regions, but the number of sub-regions can be varied.

[0080] FIG. 3D is a diagram illustrating exemplary information associated with object A included in a first image according to various embodiments.

[0081] Referring to FIG. 3D, in (a), the first region (314) associated with object A in the first image (310) may include a plurality of first sub-regions, and the plurality of first sub-regions may correspond to a plurality of zones. For example, the plurality of zones corresponding to eight first sub-regions may be eight zones including a first zone (331), a second zone (332), a third zone (333), a fourth zone (334), a fifth zone (335), a sixth zone (336), a seventh zone (337), and an eighth zone (338).

[0082] According to one example, the display device (100) can identify an attribute value for each of a plurality of zones. The attribute value for each of the plurality of zones may be associated with at least one of a color or brightness corresponding to each of the plurality of zones. For example, the attribute value for each of the plurality of zones may be associated with at least one of color information for each zone of object A, brightness information for each zone of object A, or brightness deviation for each zone of object A, as shown in (b), (c), and (d) of FIG. 3d.

[0083] Referring to FIG. 3d, in (b), the zone-specific color information of object A may include eight zone-specific color information. For example, the zone-specific color information of object A may include an average color value representing the average of the color values ​​(e.g., RGB values ​​for each pixel) included in each zone. Each zone-specific average color value may be indicated by a color code or RGB value. For example, the average color value (331-1) of the first zone (331), the average color value (332-1) of the second zone (332), the average color value (333-1) of the third zone (333), the average color value (334-1) of the fourth zone (334), the average color value (335-1) of the fifth zone (335), the average color value (336-1) of the sixth zone (336), the average color value (337-1) of the seventh zone (337), and the average color value (338-1) of the eighth zone (338) may each be indicated by the color code F1F0E1.

[0084] Referring to FIG. 3d, in (c), the brightness information for each zone of object A may include eight brightness information for each zone. As an example, the brightness information for each zone of object A may include an average brightness value representing the average of brightness values ​​(e.g., brightness values ​​for each pixel) included in each zone. For example, the average brightness value (331-2) of the first zone (331) may be 90, the average brightness value (332-2) of the second zone (332) may be 90, the average brightness value (333-2) of the third zone (333) may be 85, the average brightness value (334-2) of the fourth zone (334) may be 80, the average brightness value (335-2) of the fifth zone (335) may be 85, the average brightness value (336-2) of the sixth zone (336) may be 80, the average brightness value (337-2) of the seventh zone (337) may be 90, and the average brightness value (338-2) of the eighth zone (338) may be 80.

[0085] Referring to FIG. 3d, in (d), the brightness deviation by zone of object A can be determined based on the difference between the overall average brightness value and the average brightness value by zone for eight zones. For example, when the overall average brightness value is 85, the brightness deviation (331-3) of the first zone (331) can be -5, which is the value obtained by subtracting the average brightness value (331-2) of 90 of the first zone (331) from the overall average brightness value 85. The brightness deviation (332-3) of the second zone (332) can be -5, which is the value obtained by subtracting the average brightness value (332-2) of 90 of the second zone (332) from the overall average brightness value 85. The brightness deviation (333-3) of the third zone (333) can be 0, which is the value obtained by subtracting the average brightness value (333-2) of 85 of the third zone (333) from the overall average brightness value 85. The brightness deviation (334-3) of the fourth zone (334) may be 5, which is the value obtained by subtracting 80 from the average brightness value (334-2) of the fourth zone (334) from the overall average brightness value 85. The brightness deviation (335-3) of the fifth zone (335) may be 0, which is the value obtained by subtracting 85 from the average brightness value (335-2) of the fifth zone (335) from the overall average brightness value 85. The brightness deviation (336-3) of the sixth zone (336) may be 5, which is the value obtained by subtracting 80 from the average brightness value (336-2) of the sixth zone (336) from the overall average brightness value 85. The brightness deviation (337-3) of the seventh zone (337) may be -5, which is the value obtained by subtracting 90 from the average brightness value (337-2) of the seventh zone (337) from the overall average brightness value 85. The brightness deviation (338-3) of the 8th zone (338) may be 5, which is the value obtained by subtracting the average brightness value (338-2) of 80 of the 8th zone (338) from the overall average brightness value of 85.

[0086] FIG. 3e is a diagram illustrating exemplary information associated with object B included in a second image according to various embodiments.

[0087] Referring to FIG. 3e, in (a), the second region (324) associated with object B in the second image (320) may include a plurality of second sub-regions, and the plurality of second sub-regions may correspond to a plurality of zones. For example, the plurality of zones corresponding to eight second sub-regions may be eight zones including a first zone (351), a second zone (352), a third zone (353), a fourth zone (354), a fifth zone (355), a sixth zone (356), a seventh zone (357), and an eighth zone (358).

[0088] According to one example, the display device (100) can identify an attribute value for each of a plurality of zones. The attribute value for each of the plurality of zones may be associated with at least one of a color or brightness corresponding to each of the plurality of zones. For example, the attribute value for each of the plurality of zones may be associated with at least one of color information for each zone of object B, brightness information for each zone of object B, or brightness deviation for each zone of object B, as shown in (b), (c), and (d) of FIG. 3e.

[0089] Referring to FIG. 3e, in (b), the zone-specific color information of object B may include eight zone-specific color information. For example, the zone-specific color information of object B may include an average color value representing an average of color values ​​(e.g., RGB values ​​for each pixel) included in each zone. The zone-specific average color values ​​may each be indicated by a color code or an RGB value. For example, the average color value (351-1) of the first zone (351), the average color value (352-1) of the second zone (352), the average color value (353-1) of the third zone (353), the average color value (354-1) of the fourth zone (354), the average color value (356-1) of the sixth zone (356), and the average color value (357-1) of the seventh zone (357) may each be indicated by a color code 01F0E1. For example, the average color value (355-1) of the fifth zone (355) may be indicated by color code 11F0E1, and the average color value (358-1) of the eighth zone (358) may be indicated by color code 0100E1.

[0090] Referring to FIG. 3e, in (c), the area-specific brightness information of object B may include eight area-specific brightness information. As an example, the area-specific brightness information of object B may include an average brightness value representing the average of brightness values ​​(e.g., brightness values ​​per pixel) included in each area. For example, the average brightness value (351-2) of the first zone (351) may be 90, the average brightness value (352-2) of the second zone (352) may be 95, the average brightness value (353-2) of the third zone (353) may be 85, the average brightness value (354-2) of the fourth zone (354) may be 80, the average brightness value (355-2) of the fifth zone (355) may be 70, the average brightness value (356-2) of the sixth zone (356) may be 30, the average brightness value (357-2) of the seventh zone (357) may be 40, and the average brightness value (358-2) of the eighth zone (358) may be 70.

[0091] Referring to FIG. 3e, in (d), the brightness deviation by zone of object B can be determined based on the difference between the overall average brightness value and the average brightness value by zone for the eight zones. For example, if the overall average brightness value is 70, the brightness deviation (351-3) of the first zone (351) can be -20, which is the value obtained by subtracting the average brightness value (351-2) of 90 of the first zone (351) from the overall average brightness value of 70. The brightness deviation (352-3) of the second zone (352) can be -25, which is the value obtained by subtracting the average brightness value (352-2) of 95 of the second zone (352) from the overall average brightness value of 70. The brightness deviation (353-3) of the third zone (353) may be -15, which is the value obtained by subtracting the average brightness value (353-2) of 85 of the third zone (353) from the overall average brightness value of 70. The brightness deviation (354-3) of the fourth zone (354) may be -10, which is the value obtained by subtracting the average brightness value (354-2) of 80 of the fourth zone (354) from the overall average brightness value of 70. The brightness deviation (355-3) of the fifth zone (355) may be 0, which is the value obtained by subtracting the average brightness value (335-2) of 70 of the fifth zone (355) from the overall average brightness value of 70. The brightness deviation (356-3) of the sixth zone (336) may be 40, which is the value obtained by subtracting the average brightness value (356-2) of 30 of the sixth zone (356) from the overall average brightness value of 70. The brightness deviation (357-3) of the 7th zone (357) may be 30, which is the value obtained by subtracting 40 from the average brightness value (357-2) of the 7th zone (357) from the overall average brightness value of 70. The brightness deviation (358-3) of the 8th zone (358) may be 0, which is the value obtained by subtracting 70 from the average brightness value (358-2) of the 8th zone (358).

[0092] According to one example, the display device (100) can compare the information illustrated in (b), (c), and (d) in FIG. 3d with the information illustrated in (b), (c), and (d) in FIG. 3e by region.

[0093] According to one example, the display device (100) can compare the average color values ​​of multiple zones of object A as exemplified in (b) of FIG. 3d with the average color values ​​of multiple zones of object B as exemplified in (b) of FIG. 3e.

[0094] For example, the display device (100) can compare the average color value A-1 (e.g., F1F0E1) (331-1) of the first zone (331) associated with object A with the average color value B-1 (e.g., 01F0E1) (351-1) of the first zone (351) associated with object B.

[0095] The display device (100) may not perform an operation for color correction of the first zone (351) associated with object B if the average color value A-1 (331-1) and the average color value B-1 (351-1) are the same as a result of the comparison.

[0096] The display device (100) may perform or not perform color correction of the first zone (351) associated with object B based on whether the difference between the average color value A-1 (331-1) and the average color value B-1 (351-1) is within a preset range (e.g., a specified range) when the average color value A-1 (331-1) and the average color value B-1 (351-1) are different as a result of the comparison.

[0097] For example, the display device (100) can convert F1F0E1 corresponding to the average color value A-1 (331-1) and 01F0E1 corresponding to the average color value B-1 (351-1) into RGB values ​​(241, 240, 225) and (17, 240, 225), respectively, and then calculate the RGB difference value (224, 0, 0). The display device (100) can use the RGB difference value (224, 0, 0) to calculate the Euclidean distance ( ) is calculated, and the calculated Euclidean distance 224 can be obtained as the difference between the average color value A-1 (331-1) and the average color value B-1 (351-1).

[0098] The display device (100) can determine whether the difference between the average color value A-1 (331-1) and the average color value B-1 (351-1) is within a preset range. If the difference between the average color value A-1 (331-1) and the average color value B-1 (351-1) is within a preset range, the display device (100) can determine that the average color value A-1 (331-1) and the average color value B-1 (351-1) are similar and not perform an operation for color correction.

[0099] If the difference between the average color value A-1 (331-1) and the average color value B-1 (351-1) is not within a preset range, the display device (100) can determine that the average color value A-1 (331-1) and the average color value B-1 (351-1) are not similar and perform an operation for color correction.

[0100] According to one example, the display device (100) can determine the setting value of at least one light (e.g., the first light (201) of FIG. 2) that provides light to the first zone (351) associated with object B so that the first zone (351) associated with object B can have an average color value similar to the average color value A-1 (331-1) of the first zone (331) associated with object A.

[0101] For example, when the display device (100) includes a micro LED display, the micro LEDs included in the first zone (351) associated with the object B can be controlled to have a color value similar to the average color value A-1 (331-1) of the first zone (331) associated with the object A.

[0102] The display device (100) can compare the average color values ​​of the remaining zones of objects A and B in a similar manner as described above, and determine the setting value of at least one lighting corresponding to at least one zone of object B based on the zone-by-zone comparison result.

[0103] In one example, the settings of at least one light may include a color value of at least one light.

[0104] For example, if the average color values ​​of each area of ​​objects A and B are different, the color value of the corresponding light can be determined based on the following [Formula 1].

[0105]

[0106] In [Formula 1], light x may represent a light associated with the x-th zone among multiple zones of object B (1 ≤ x ≤ M, where M is the maximum number of lights). For example, light x may represent the x-th zone (1 ≤ x ≤ 8) among 8 zones of object B, and may represent the x-th zone among the first lights (201) to the eighth lights (208) of FIG. 2. The color of light x may represent a color value set for light x. The average color value of Ax may represent an average color value of the x-th zone among multiple zones of object A. For example, Ax may represent an average color value of the x-th zone (1 ≤ x ≤ 8) among the 8 average color values ​​exemplified in (b) of FIG. 3d.

[0107] According to one example, the display device (100) can compare the average brightness values ​​of multiple zones of object A as exemplified in (c) of FIG. 3d with the average brightness values ​​of multiple zones of object B as exemplified in (c) of FIG. 3e.

[0108] For example, the display device (100) can compare the average brightness values ​​of multiple zones of object A as exemplified in (c) of FIG. 3d with the average brightness values ​​of multiple zones of object B as exemplified in (c) of FIG. 3e.

[0109] The display device (100) may not perform an operation for brightness correction if, as a result of the comparison, the average brightness values ​​of multiple zones of object A as exemplified in (c) of FIG. 3d and the average brightness values ​​of multiple zones of object B as exemplified in (c) of FIG. 3e are the same.

[0110] The display device (100) may perform or not perform an operation for brightness correction based on whether the difference between the average brightness values ​​is within a preset range, if at least one of the average brightness values ​​of the plurality of zones of the object A as exemplified in (c) of FIG. 3d is different from at least one of the average brightness values ​​of the plurality of zones of the object B as exemplified in (c) of FIG. 3e as a result of the comparison.

[0111] For example, the display device (100) may not perform an operation for brightness compensation if the difference between average brightness values ​​is within a preset range.

[0112] For example, the display device (100) can perform an operation for brightness compensation when the difference between average brightness values ​​is not within a preset range.

[0113] [Table 1] below is a table illustrating whether the display device (100) determines whether to perform an operation for brightness compensation based on the difference between the average brightness values ​​of multiple zones of object A as exemplified in (c) of FIG. 3d and the average brightness values ​​of multiple zones of object B as exemplified in (c) of FIG. 3e.

[0114]

[0115] Referring to [Table 1], the display device (100) may not perform an operation for brightness correction of the first zone (351), the third zone (353), and the fourth zone (354) associated with the object B based on the fact that the average brightness value (331-2) of the first zone (331) associated with the object A and the average brightness value (351-2) of the first zone (351) associated with the object B are equal to 90, the average brightness value (333-2) of the third zone (333) associated with the object A and the average brightness value (353-2) of the third zone (353) associated with the object B are equal to 85, and the average brightness value (334-2) of the fourth zone (334) associated with the object A and the average brightness value (354-2) of the fourth zone (354) associated with the object B are equal to 80.

[0116] The display device (100) can calculate the difference between the average brightness values ​​(332-2, 335-2 to 338-2) of the second zone (332), the fifth zone (335) to the eighth zone (338) associated with object A and the average brightness values ​​(352-2, 355-2 to 358-2) of the second zone (352), the fifth zone (355) to the eighth zone (358) associated with object B, and determine whether the calculated difference (e.g., K) is within a preset range (e.g., -20 ≤ K ≤ 20).

[0117] For example, the difference between the average brightness value (332-2) of the second zone (332) associated with object A and the average brightness value (352-2) of the second zone (352) associated with object B may be within a preset range of -5. Based on this, the display device (100) may not perform an operation for brightness compensation of the second zone (352) associated with object B.

[0118] For example, the difference between the average brightness value (335-2) of the fifth zone (335) associated with object A and the average brightness value (355-2) of the fifth zone (355) associated with object B may be within a preset range of 5. Based on this, the display device (100) may not perform an operation for brightness correction of the fifth zone (355) associated with object B.

[0119] For example, the difference between the average brightness value (336-2) of the sixth zone (336) associated with object A and the average brightness value (356-2) of the sixth zone (356) associated with object B may not be within the preset range of 50. Based on this, the display device (100) may perform an operation for brightness correction of the sixth zone (356) associated with object B.

[0120] For example, the difference between the average brightness value (337-2) of the seventh zone (337) associated with object A and the average brightness value (357-2) of the seventh zone (357) associated with object B may not be within the preset range of 50. Based on this, the display device (100) may perform an operation for brightness correction of the seventh zone (357) associated with object B.

[0121] For example, the difference between the average brightness value (338-2) of the 8th zone (338) associated with object A and the average brightness value (358-2) of the 8th zone (358) associated with object B may not be within a preset range of 10. Based on this, the display device (100) may not perform an operation for brightness correction of the 8th zone (358) associated with object B.

[0122] When the display device (100) performs an operation for brightness compensation, it can control the brightness of the lighting so that there is no difference in brightness between objects A and B. According to one example, the display device (100) can control the brightness of the lighting using the following [Formula 2].

[0123]

[0124] In [Formula 2], light x may represent a light associated with the xth zone among multiple zones of object B (1 ≤ x ≤ M, where M is the maximum number of lights). For example, light x may represent the xth light among the first to eighth lights (201) to (208) of FIG. 2 as a light associated with the xth zone among eight zones of object B (1 ≤ x ≤ 8). The brightness of light x may represent a brightness value set for light x.

[0125] pLx can represent the average brightness value of Ax or the brightness value set for the previous light x. For example, the initial value of pLx can be the average brightness value of Ax, and pLx after the initial value is used can represent the brightness value set for the previous light x.

[0126] The brightness deviation of Ax can represent the brightness deviation value of the xth zone among multiple zones of object A. For example, Ax can represent the brightness deviation value of the xth zone among the eight brightness deviation values ​​illustrated in (d) in Fig. 3d.

[0127] The brightness deviation of Bx can represent the brightness deviation value of the xth zone among multiple zones of object B. For example, Bx can represent the brightness deviation value of the xth zone among the eight brightness deviation values ​​illustrated in (d) in Fig. 3e.

[0128] FIG. 3f is a diagram illustrating a third image having similar attribute values ​​to the first image according to various embodiments.

[0129] According to one example, the display device (100) can re-capture the subject object B after performing color correction and / or brightness correction for at least one light. When capturing the object B, at least one light can irradiate light corresponding to the corrected color and / or brightness to the object B.

[0130] The display device (100) can acquire a third image (330) by re-capturing object B. In the third image (330), object B may have similar attribute values ​​to object A in the first image (310). For example, object B in the third image (330) may have similar color and / or brightness to object A in the first image (310). Object B in the third image (330) may not include a shadow on the left side of the face, unlike object B in the second image (320) of FIG. 3A. In this way, correction using a light source can enable more natural image correction compared to digital correction, and can correct not only the subject but also the background, so more precise correction can be possible.

[0131] Hereinafter, operations of the display device (100) will be described with reference to FIGS. 4, 5, 6, and 7 (which may also be referred to as FIGS. 4 to 7). The operations illustrated in FIGS. 4 to 7 are not limited to the illustrated order and may be performed in various orders. At least one of the operations illustrated in FIGS. 4 to 7 may be omitted, and more operations than those illustrated in FIGS. 4 to 7 may be performed by the display device (100).

[0132] FIG. 4 is a flowchart illustrating exemplary operations of a display device according to various embodiments.

[0133] Referring to FIG. 4, in operation 402, the display device (100) may acquire a first image (e.g., the first image (310) of FIG. 3A) which is a target image and a second image (e.g., the second image (320) of FIG. 3A) captured through at least one camera. According to one example, the first image may include any one of an image previously captured by at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device (100), or an image input or received from an external electronic device.

[0134] In operation 404, the display device (100) can extract common components between the first image and the second image.

[0135] In operation 406, the display device (100) can divide a first region (e.g., the first region (314) of FIG. 3c) including common components (e.g., the first component (311), the second component (312), and the third component (313) of FIG. 3b) in the first image into a plurality of first sub-regions and identify attribute values ​​for each first sub-region.

[0136] In one example, a plurality of first sub-regions may correspond to a plurality of zones (e.g., eight zones) as shown in (a) in FIG. 3d.

[0137] According to one example, the attribute value for each first sub-region may be related to at least one of the information illustrated in (b), (c), and (d) in FIG. 3D, and may be associated with at least one of a color or brightness corresponding to each of the plurality of first sub-regions. For example, the attribute value for each first sub-region may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of first sub-regions.

[0138] In operation 408, the display device (100) can divide a second region (e.g., the second region (324) of FIG. 3c) including common components (e.g., the fourth component (321), the fifth component (322), and the sixth component (323) of FIG. 3b) in the second image into a plurality of second sub-regions and identify attribute values ​​for each second sub-region.

[0139] In one example, the plurality of second sub-regions may correspond to a plurality of zones (e.g., eight zones) as shown in (a) in FIG. 3e.

[0140] In one example, the attribute value for each second sub-region may be related to at least one of the information illustrated in (b), (c), and (d) in FIG. 3e, and may be associated with at least one of a color or brightness corresponding to each of the plurality of second sub-regions. For example, the attribute value for each second sub-region may include a value indicating at least one of an average color value or an average brightness value of each of the plurality of second sub-regions.

[0141] In operation 410, the display device (100) can determine whether the difference between the attribute value for each of the first sub-areas and the attribute value for each of the second sub-areas is within a preset (e.g., specified) range.

[0142] In operation 412, the display device (100) determines, based on the judgment result, at least one first attribute value (e.g., the average color value (336-1) and the average color value (337-1) of (b) in FIG. 3D and / or the average brightness value (336-2) and the average brightness value (337-2) of (c) in FIG. 3D) corresponding to at least one third sub-region (e.g., the sixth zone (336) and the seventh zone (337) of (a) in FIG. 3D) among the plurality of first sub-regions, and at least one second attribute value (e.g., the average color value (356-1) and the average color value (357-1) of (b) in FIG. 3E and / or the average brightness value (357-2) of (c) in FIG. 3D) corresponding to at least one fourth sub-region (e.g., the sixth zone (356) and the seventh zone (357) of (a) in FIG. 3E) among the plurality of second sub-regions. It can be identified that the difference between the brightness value (356-2) and the average brightness value (357-2) is not within a preset range.

[0143] In operation 414, the display device (100) may determine a setting value of at least one light (e.g., the sixth light (206) and the seventh light (207) of FIG. 2) associated with at least one fourth sub-region among the plurality of lights based on at least one first attribute value. In one example, the plurality of lights may be lights configured separately from the display (130) or may correspond to a plurality of micro LEDs included in the display (130).

[0144] In operation 416, the display device (100) can control at least one light based on the determined setting value.

[0145] According to one example, the display device (100) can control at least one light based on a previously determined setting value based on the determination result of operation 410 that the difference between the attribute value for each of the first sub-areas and the attribute value for each of the second sub-areas is within a preset range.

[0146] FIG. 5 is a flowchart illustrating an exemplary operation of a display device according to various embodiments to determine a setting value of at least one light for color correction.

[0147] As an example, the operations illustrated in FIG. 5 can be performed in operation 414 of FIG. 4.

[0148] Referring to FIG. 5, in operation 502, the display device (100) can identify color information corresponding to at least one third sub-region based on at least one first attribute value.

[0149] In operation 504, the display device (100) may determine a setting value of at least one light so that light of a color corresponding to the identified color information is irradiated. In one example, the color information corresponding to at least one third sub-region may include information indicating an average color value of at least one third sub-region.

[0150] FIG. 6 is a flowchart illustrating an exemplary operation of a display device according to various embodiments to determine a setting value of at least one light for brightness compensation.

[0151] As an example, the operations illustrated in FIG. 6 can be performed in operation 414 of FIG. 4.

[0152] Referring to FIG. 6, in operation 602, the display device (100) may identify first brightness information corresponding to at least one third sub-region based on at least one first attribute value. According to an example, the first brightness information may include information indicating an average brightness value of at least one third sub-region and / or information indicating a first brightness deviation. The first brightness deviation may be determined based on a difference between an average brightness value of all of the plurality of first sub-regions and an average brightness value of at least one third sub-region.

[0153] In operation 604, the display device (100) can identify second brightness information corresponding to at least one fourth sub-region based on at least one second attribute value. In one example, the second brightness information can include information indicating an average brightness value of at least one fourth sub-region and / or information indicating a second brightness deviation. The second brightness deviation can be determined based on a difference between an average brightness value of all of the plurality of second sub-regions and an average brightness value of at least one fourth sub-region.

[0154] In operation 606, the display device (100) may determine a brightness value based on the first brightness information and the second brightness information. In one example, the display device (100) may determine the brightness value based on an average brightness value of at least one third sub-region or a previously set brightness value of at least one light, and a difference value between the first brightness deviation and the second brightness deviation. For example, the display device (100) may determine the brightness value based on [Formula 2].

[0155] In operation 608, the display device (100) can determine a setting value of at least one light based on the determined brightness value.

[0156] FIG. 7 is a flowchart illustrating an exemplary operation of a display device acquiring an image according to various embodiments.

[0157] Referring to FIG. 7, in operation 702, the display device (100) can obtain a first image, which is a target image.

[0158] In operation 704, the display device (100) can capture B through at least one camera to obtain a second image.

[0159] In one example, actions 702 and 704 may be performed concurrently, or action 704 may be performed before action 702.

[0160] In operation 706, the display device (100) can compare the first image and the second image.

[0161] In operation 708, the display device (100) can determine whether the color and / or brightness difference between the first image and the second image is within a preset range.

[0162] According to one example, the display device (100) can extract common components (e.g., a subject and / or a background) from the first image and the second image, and determine whether the color and / or brightness difference for each common component is within a preset range.

[0163] In each of the first and second images, areas containing common elements may or may not be segmented. For example, areas containing common elements may be segmented if they are larger than a preset size, and areas containing common elements may not be segmented if they are smaller than the preset size. When areas containing common elements are segmented, the display device (100) may determine whether the color and / or brightness differences in each segmented area are within a preset range.

[0164] The display device (100) may terminate the operation based on whether the color and / or brightness difference between the first image and the second image is within a preset range ('Yes' in operation 708). In one example, if the color and / or brightness difference between the first image and the second image is within a preset range, the display device (100) may determine that the color and / or brightness of the first image and the second image are similar, and control at least one light based on a previously determined setting value.

[0165] The display device (100) may perform color and / or brightness correction for at least one light in operation 710 based on whether the color and / or brightness difference between the first image and the second image is not within a preset range ('No' in operation 708). For example, the display device (100) may perform color and / or brightness correction for at least one light based on operations similar to operations 412 to 416.

[0166] In operation 712, the display device (100) may capture B again through at least one camera to obtain a third image. In one example, at least one light source with color and / or brightness correction may be utilized when B is captured again by at least one camera. The obtained third image may be an image with similar color and / or brightness to the first image.

[0167] For example, the display device (100) may repeatedly perform operations 706 and below after performing operation 712. The display device (100) may use a third image instead of the second image in the repeatedly performed operations 706 and below. The display device (100) may repeatedly perform operations 706 and below until the third image has a color and / or brightness similar to that of the first image.

[0168] For example, the display device (100) may be a display device of various types. For example, the display device (100) may be a first type of display device that may be included in a large-scale photographing system, or a second type of display device such as a smart mirror or a mobile device.

[0169] If the display device (100) is a first type of display device, the display device (100) may be configured as illustrated in FIG. 8. If the display device (100) is a second type of display device, the display device (100) may be configured as illustrated in FIG. 9. However, this is merely an exemplary configuration, and the configuration of the display device (100) may be changed in various forms.

[0170] FIG. 8 is a diagram illustrating an exemplary first type of display device according to various embodiments.

[0171] Referring to FIG. 8, the display device (100) may be a first type of display device that can be included in a large-scale photographing system. When the display device (100) is a first type of display device, the camera unit (110), the lighting unit (120), and the display unit (130) included in the display device (100) may be included in different devices to form a single system.

[0172] For example, a large-scale photographing system may include a photographing device and an electronic device, such as a personal computer (PC) (810). If the photographing device and the PC (810) are configured as separate devices, the photographing device and the PC (810) may be connected by wire or wirelessly. If the photographing device and the PC (810) are not configured as separate devices, the photographing device may be included in the PC (810).

[0173] The photographing device may include a camera unit (110) and a lighting unit (120), and the PC (810) may include a display unit (130) or may be connected to a display unit (130) configured as a monitor. If the display unit (130) is configured as a monitor, the photographing device may be included inside or outside the monitor.

[0174] The camera unit (110) and the lighting unit (120) can be configured in various forms within the photographing device. The camera unit (110) and the lighting unit (120) can be configured as illustrated in FIG. 2, or can be configured differently from that illustrated in FIG. 2. For example, the camera unit (110) can include five cameras, namely a first camera (801), a second camera (802), a third camera (803), a fourth camera (804), and a fifth camera (805), and the lighting unit (120) can include more than five lights.

[0175] When photographing a subject using at least one of the five cameras included in the camera unit (100), the lights of the lighting unit (120) can be used for color and / or brightness correction for each area associated with the subject. The lights of the lighting unit (120) can be arranged to surround the camera unit (110), but the configuration of the camera unit (110) and the lighting unit (120) is not limited to the configuration illustrated in FIG. 8 and can be varied in various ways.

[0176] FIGS. 9A, 9B, and 9C are diagrams illustrating examples of a second type of display device according to various embodiments.

[0177] Referring to FIGS. 9A, 9B, and 9C, the display device (100) may be a second type of display device. In one example, the second type of display device may be a smart mirror (e.g., a table-top or wall-mounted smart mirror, or a smart mirror of a set size (e.g., 17 inches)) or a mobile device (e.g., a mobile phone or tablet). In one example, the second type of display device (100) may include a camera unit (110) and a display (130) on the same surface (e.g., the front or back surface of the display device (100), but is not limited thereto.

[0178] When the display device (100) is a second type of display device, the display (130) of the display device (100) may include a micro LED display including micro LEDs. The micro LED display may be a display that includes a lighting function in addition to a display function. The micro LEDs included in the micro LED display may each correspond to lighting and may be individually controlled for color and / or brightness correction.

[0179] Referring to FIGS. 9a, 9b, and 9c, the display device (100) can display an image (910) acquired through at least one camera of the camera unit (110) on the display (130). For example, the image (910) can include any one of an image photographed or captured through at least one camera, a preview image of at least one camera, or an image photographed in real time by at least one camera.

[0180] The images (910) shown in FIGS. 9A, 9B, and 9C may be images acquired in different shooting environments. The images (910) shown in FIGS. 9A, 9B, and 9C may be images acquired based on controlled lighting in the shooting environments. In one example, the controlled lighting may include at least one lighting that has been light-compensated (e.g., color and / or brightness-compensated) based on a method as described above.

[0181] Referring to FIG. 9A, the display device (100) can control the left micro LEDs (901) to correct the color of the left area of ​​the image (910). For example, the display device (100) can control the left micro LEDs (901) to emit light in the shape of a bar of a specific color (e.g., yellow).

[0182] The display device (100) can control the right micro LEDs (902) to increase the brightness of the right area of ​​the image (910). For example, the display device (100) can control the right micro LEDs (902) to emit light in the form of a bar of a specific color (e.g., white) to the right area of ​​the image (910) by utilizing the high brightness of each micro LED.

[0183] For example, if the display device (100) is a smart mirror, a subject (e.g., a user) may be light-compensated based on the left micro LEDs (901) and the right micro LEDs (902). The display device (100) may display an image (910) including the light-compensated subject on the display (130) in a form reflected by the mirror.

[0184] Referring to FIG. 9B, the display device (100) can control the upper micro LEDs (903) and the lower micro LEDs (904) so ​​that light compensation of the upper and lower regions of the image (910) is performed. For example, the display device (100) can control the upper micro LEDs (903) to emit light in the shape of a bar of a specific color for brightness compensation, and can control the lower micro LEDs (904) to emit light in the shape of a bar of a specific color for color compensation.

[0185] For example, if the display device (100) is a mobile device and the user takes a selfie of his or her face, the user's face may be optically corrected based on the upper micro LEDs (903) and the lower micro LEDs (904). The display device (100) may display an image (910) including the optically corrected user's face on the display (130).

[0186] Referring to FIG. 9C, the display device (100) can control the upper micro LEDs (905), the left micro LEDs (906), and the lower micro LEDs (907) so that light compensation is performed on the upper, left, and lower regions of the image (910). For example, the display device (100) can control the upper micro LEDs (905) to emit light in the shape of a bar of a specific color for brightness compensation, and can control the left micro LEDs (906) and the lower micro LEDs (907) to emit light in the shape of a bar of a specific color for color compensation.

[0187] Although FIGS. 9A, 9B, and 9C illustrate examples of light emitted in a rod shape for light compensation, the present invention is not limited thereto and light of various shapes may be emitted. When two or more micro LEDs are used as lighting, light of two or more colors and / or different brightnesses may be emitted. For example, two or more micro LEDs may emit light of different colors to create a gradient, or emit light of different colors or brightnesses to perform more precise light compensation.

[0188] Light for light compensation can be emitted from various locations within the display (130). For example, the display device (100) can control micro LEDs around the image (910) for light compensation as shown in FIGS. 9A, 9B, and 9C, but can also control micro LEDs displaying the image (910) for light compensation. The display device (100) can perform light compensation by adjusting the color and / or brightness of the micro LEDs displaying the image (910).

[0189] As described above, the display device (100) can control at least one light so that an image with a color and / or brightness similar to that of the target image is acquired. For example, when a user inputs a photo taken with desired lighting as the target image, the display device (100) can set the lighting so that an image with a color and brightness similar to that of the target image is acquired.

[0190] In one example, the display device (100) can control at least one lighting based on a plurality of target images. For example, the display device (100) can determine preferred lighting settings based on photos stored in a photo album of a mobile device. The display device (100) can select photos (e.g., selfie photos) that include common elements among the photos stored in the photo album of the mobile device, and determine preferred lighting settings based on the selected photos. The display device (100) can perform the photo selection operation based on a user's selection, by using an AI model stored in the memory (140), or through an external server (e.g., an AI server or an application server).

[0191] The display device (100) can determine a preferred lighting setting based on the average of the color values ​​and / or the average of the brightness values ​​of each zone of the selected photos. When a user takes a selfie, the display device (100) can control at least one light based on the preferred lighting setting.

[0192] According to one example, the lighting of the display device (100) can be controlled to an optimal setting value based on various shooting purposes or shooting applications.

[0193] For example, if the display device (100) is a skin analysis device, the lighting of the display device (100) can be controlled to color and / or brightness settings that allow all skin on the face to be clearly visible. In this case, accurate skin analysis can be performed regardless of the surrounding environment or skin color.

[0194] For example, if the display device (100) is a two-dimensional (2D) or three-dimensional (3D) capture device, the lighting of the display device (100) can be controlled with color and / or brightness settings that allow all sides of the subject to be captured.

[0195] For example, when the display device (100) is used for photo shoots, product shoots, passport photos, personal broadcast shoots, or studio shoots, the color and / or brightness settings can be controlled to suit the production purpose even if the subject changes.

[0196] In addition, the display device (100) can perform lighting control operations in various fields.

[0197] The various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the various embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In the present disclosure, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0198] The term "module" used in various embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0199] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0200] While the present disclosure has been described and illustrated with reference to various exemplary embodiments, it will be understood that the various exemplary embodiments are illustrative and not limiting. Those skilled in the art will further appreciate that various changes in form and detail may be made without departing from the full scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it will be appreciated that any of the embodiment(s) described herein may be utilized in conjunction with any other embodiment(s) described herein.

Claims

1. In the display device, At least one camera; Multiple lights; memory for storing at least one program; and At least one processor electrically connected to the at least one camera, the plurality of lights and the memory, and including a processing circuit; At least one processor is configured to individually and / or collectively execute instructions of said at least one program and to: Acquire a first image, which is a target image, and a second image captured through at least one camera, Extract common components between the first image and the second image, Divide the first region including the common component in the first image into a plurality of first sub-regions, and identify an attribute value associated with at least one of color or brightness corresponding to each of the plurality of first sub-regions as an attribute value for each first sub-region, Dividing the second region including the common component in the second image into a plurality of second sub-regions, and identifying an attribute value associated with at least one of color or brightness corresponding to each of the plurality of second sub-regions as an attribute value for each second sub-region, Determine whether the difference between the attribute values ​​of the first sub-area and the attribute values ​​of the second sub-area is within a specified range, Based on the above judgment result, it is identified that the difference between at least one first attribute value corresponding to at least one third sub-area among the plurality of first sub-areas and at least one second attribute value corresponding to at least one fourth sub-area among the plurality of second sub-areas is not within the specified range, Based on the at least one first attribute value, determining a setting value of at least one light associated with the at least one fourth sub-area among the plurality of lights, A display device that controls at least one light based on the determined setting value.

2. In paragraph 1, A display device, wherein the first image comprises any one of an image previously captured by the at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device, or an image input or received from an external electronic device.

3. In paragraph 1, The attribute value for each of the first sub-areas includes a value indicating at least one of the average color value or average brightness value of each of the plurality of first sub-areas, A display device, wherein the attribute value for each of the second sub-regions includes a value indicating at least one of an average color value or an average brightness value of each of the plurality of second sub-regions.

4. In paragraph 1, At least one processor, individually and / or collectively: Identifying color information corresponding to at least one third sub-region based on at least one first attribute value, It is configured to determine the setting value of at least one light so that light of a color corresponding to the identified color information is irradiated, A display device, wherein the color information corresponding to the at least one third sub-region includes information indicating an average color value of the at least one third sub-region.

5. In paragraph 1, Including at least one more display, wherein at least one display comprises a plurality of micro LEDs (light emitting diodes), A display device wherein the plurality of lights correspond to the plurality of micro LEDs.

6. In paragraph 1, At least one processor, individually and / or collectively: Identifying first brightness information corresponding to at least one third sub-region based on at least one first attribute value; Identifying second brightness information corresponding to at least one fourth sub-region based on at least one second attribute value; Determine the brightness value based on the first brightness information and the second brightness information, A display device configured to determine a setting value of at least one light based on the determined brightness value.

7. In paragraph 6, The above first brightness information includes information indicating a first brightness deviation, The second brightness information includes information indicating a second brightness deviation, The first brightness deviation is determined based on the difference between the average brightness value of the entire plurality of first sub-regions and the average brightness value of the at least one third sub-region, A display device, wherein the second brightness deviation is determined based on the difference between the average brightness value of the entire plurality of second sub-regions and the average brightness value of the at least one fourth sub-region.

8. In paragraph 6 or 7, A display device, wherein the first brightness information includes information indicating an average brightness value of at least one third sub-area.

9. In paragraph 8, At least one processor, individually and / or collectively: A display device configured to determine a setting value of the at least one light based on an average brightness value of the at least one third sub-area or a specified brightness value of the at least one light and a difference value between the first brightness deviation and the second brightness deviation.

10. In paragraph 1, At least one processor, individually and / or collectively: A display device configured to control at least one light based on a specified setting value based on the difference between the attribute value for each of the first sub-areas and the attribute value for each of the second sub-areas being within the specified range.

11. In a method for operating a display device, An operation of acquiring a first image, which is a target image, and a second image captured through at least one camera; An operation of extracting common components between the first image and the second image; An operation of dividing a first region including the common component in the first image into a plurality of first sub-regions, and identifying an attribute value associated with at least one of color or brightness corresponding to each of the plurality of first sub-regions as an attribute value for each first sub-region; An operation of dividing a second region including the common component in the second image into a plurality of second sub-regions, and identifying an attribute value associated with at least one of color or brightness corresponding to each of the plurality of second sub-regions as an attribute value for each second sub-region; An operation for determining whether the difference between the attribute values ​​of the first sub-area and the attribute values ​​of the second sub-area is within a specified range; An operation of identifying that a difference between at least one first attribute value corresponding to at least one third sub-area among the plurality of first sub-areas and at least one second attribute value corresponding to at least one fourth sub-area among the plurality of second sub-areas is not within the specified range based on the judgment result; An operation of determining a setting value of at least one light associated with at least one fourth sub-area among a plurality of lights based on at least one first attribute value; and A method comprising an operation of controlling at least one light based on the determined setting value.

12. In paragraph 11, A method wherein the first image comprises any one of an image previously captured by the at least one camera, a pre-stored image, an image selected from a plurality of images, an image downloaded from a server, an image input to the display device, or an image input or received from an external electronic device.

13. In paragraph 11, The attribute value for each of the first sub-areas includes a value indicating at least one of the average color value or average brightness value of each of the plurality of first sub-areas, A method wherein the attribute value for each of the second sub-regions includes a value indicating at least one of an average color value or an average brightness value of each of the plurality of second sub-regions.

14. In paragraph 11, The operation of determining the setting value of at least one light is: An operation of identifying color information corresponding to at least one third sub-region based on at least one first attribute value; and An operation of determining a setting value of at least one light so that light of a color corresponding to the identified color information is irradiated, A method wherein the color information corresponding to the at least one third sub-region includes information indicating an average color value of the at least one third sub-region.

15. In paragraph 11, The above plurality of lights correspond to a plurality of micro LEDs (light emitting diodes), A method wherein the plurality of micro LEDs are included in at least one display included in the display device.

Images