Electronic device and operation method of electronic device
The integration of an optical layer and lenticular lens in electronic devices ensures high-resolution 3D image display across all view areas by enlarging images and dividing pixels, addressing the resolution deterioration challenge and enhancing user experience.
Patent Information
- Application Number
- PCT/KR2024/007770
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-10
- Filing Date
- 2024-06-07
- Publication Date
- 2025-01-02
AI Technical Summary
Electronic devices that display 3D images using lenticular lenses face challenges in maintaining high image quality due to the deterioration of resolution when images are refracted across different view areas, leading to potential image quality issues for users.
The electronic device incorporates a display with an optical layer and a lenticular lens, which enlarges images and divides pixels into view pixels based on an optical correction map, ensuring that each view area receives a high-resolution image by using sub-displays and an optical layer that overlaps the bezel area, preventing any gaps in the image display.
This solution maintains high image resolution across all view areas, enhancing user experience by providing a seamless and high-quality 3D image display without any gaps or heterogeneity, effectively addressing the resolution deterioration issue.
Smart Images

Figure KR2024007770_02012025_PF_FP_ABST
Abstract
Description
Electronic devices and methods of operating electronic devices
[0001] The present disclosure relates to an electronic device and a method of operating the electronic device. Specifically, the present disclosure relates to an electronic device including a display, an optical layer, and a lenticular lens, and a method of operating the electronic device.
[0002] Advances in electronic technology have led to the development and proliferation of various types of electronic devices. Electronic devices, including display devices that display images, have been rapidly evolving in recent years.
[0003] As electronic devices advance, the types of images they display have diversified. Devices capable of displaying not only 2D (two-dimensional) images but also 3D (three-dimensional) images are being developed.
[0004] Recently, electronic devices and methods have been proposed that utilize the characteristics of lenticular lenses to display 3D images. Using lenticular lenses, electronic devices are being developed that provide users with different images depending on their viewing position.
[0005] In addition, as multiple images from various viewpoints must be displayed on the display in order to provide different images depending on the user's viewpoint, electronic devices and methods for increasing the resolution of each of the multiple images displayed on the display are being developed.
[0006] One embodiment of the present disclosure provides an electronic device. The electronic device may include a display that displays an image including a plurality of pixels. The electronic device may include an optical layer disposed on the display and configured to magnify the image to provide an enlarged image including a plurality of enlarged pixels. The electronic device may include a lenticular lens disposed on the optical layer and configured to provide a plurality of view images based on the enlarged image. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor that executes at least one instruction stored in the memory. The at least one processor may obtain a plurality of input images, each corresponding to a plurality of views. The at least one processor may obtain an optical correction map that includes positional information of the plurality of pixels and positional information of the plurality of enlarged pixels. The at least one processor may distinguish the plurality of enlarged pixels into a plurality of enlarged view pixels on which the plurality of view images will be displayed, based on the positional information of the plurality of enlarged pixels and a plurality of view areas included in the lenticular lens. At least one processor can display a plurality of input images as images to each of a plurality of view pixels, each of which corresponds to a plurality of enlarged view pixels among the plurality of pixels, based on the acquired optical correction map.
[0007] One embodiment of the present disclosure provides a method of operating an electronic device. The method of operating the electronic device may include a step of acquiring a plurality of input images, each corresponding to a plurality of views. The method of operating the electronic device may include a step of acquiring an optical correction map, which includes positional information of a plurality of pixels included in an image displayed through a display and positional information of a plurality of magnification pixels included in an enlarged image, which is an enlarged image provided through an optical layer disposed on the display. The method of operating the electronic device may include a step of dividing a plurality of magnification pixels into a plurality of magnification view pixels on which the plurality of view images are to be displayed, based on the positional information of the plurality of magnification pixels and a plurality of view regions corresponding to the plurality of view images provided through a lenticular lens disposed on the optical layer. The method of operating the electronic device may include a step of displaying a plurality of input images as images on a display, each of the plurality of view pixels corresponding to the plurality of magnification view pixels, respectively, among the plurality of pixels, based on the acquired optical correction map.
[0008] As one embodiment of the present disclosure, a computer-readable recording medium having recorded thereon a program for performing at least one method of the disclosed operating method on a computer may be provided.
[0009] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.
[0010] The present disclosure may be understood in conjunction with the following detailed description and accompanying drawings, wherein reference numerals refer to structural elements.
[0011] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0012] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0013] FIG. 3 is a drawing for explaining a bezel area and a display area included in a display according to one embodiment of the present disclosure.
[0014] FIG. 4 is a drawing for explaining an enlarged image provided through an optical layer according to one embodiment of the present disclosure.
[0015] FIG. 5 is a drawing for explaining an image displayed through a display according to one embodiment of the present disclosure and an enlarged image provided through an optical layer.
[0016] FIG. 6 is a drawing for explaining the arrangement of a display, an optical layer, and a lenticular lens according to one embodiment of the present disclosure.
[0017] FIG. 7A is a diagram for explaining an operation of dividing a plurality of pixels included in an image displayed through a display into a plurality of view pixels according to one embodiment of the present disclosure.
[0018] FIG. 7b is a drawing for explaining the relationship between a plurality of enlarged view pixels and a plurality of view areas included in a lenticular lens according to one embodiment of the present disclosure.
[0019] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure.
[0020] FIG. 9 is a drawing for explaining the operation of an electronic device including an optical layer according to one embodiment of the present disclosure.
[0021] FIG. 10A is a diagram for explaining an optical correction map including position information of a plurality of pixels and position information of a plurality of enlarged pixels according to one embodiment of the present disclosure.
[0022] FIG. 10b is a diagram for explaining an optical correction map including position information of a plurality of pixels and position information of a plurality of enlarged pixels according to one embodiment of the present disclosure.
[0023] FIG. 11A is a drawing for explaining an operation of distinguishing an enlarged view pixel and a view pixel using a lenticular lens and a plurality of enlarged pixels included in an enlarged image provided through an optical layer according to one embodiment of the present disclosure.
[0024] FIG. 11b is a drawing for explaining an operation of distinguishing a plurality of enlarged pixels included in an enlarged image provided through an optical layer according to one embodiment of the present disclosure and an enlarged view pixel using a lenticular lens.
[0025] FIG. 12 is a flowchart illustrating the operation of an electronic device that displays an image using a plurality of converted images whose resolutions are converted using an optical correction map according to one embodiment of the present disclosure.
[0026] FIG. 13 is a diagram for explaining the operation of an electronic device that displays an image using a plurality of converted images whose resolutions are converted using an optical correction map according to one embodiment of the present disclosure.
[0027] FIG. 14 is a flowchart illustrating an operation of determining a plurality of selected images among a plurality of transformed images according to one embodiment of the present disclosure.
[0028] FIG. 15A is a diagram for explaining a magnification ratio between the area of an image and the area of an enlarged image according to one embodiment of the present disclosure and a plurality of converted images converted to a second resolution.
[0029] FIG. 15b is a diagram for explaining a plurality of input images and a plurality of converted images whose resolutions are converted using a magnification ratio according to one embodiment of the present disclosure.
[0030] FIG. 15c is a diagram for explaining an operation of determining a plurality of selected pixels among a plurality of converted pixels according to one embodiment of the present disclosure.
[0031] The terms used in this disclosure will be briefly explained, and one embodiment of the present disclosure will be specifically described.
[0032] The terms used in this disclosure are selected from widely used, current terms, taking into account the functions of one embodiment of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant embodiments of the disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of the disclosure.
[0033] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art described herein.
[0034] Throughout this disclosure, when a part is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," and the like described herein refer to a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software.
[0035] The expression “configured to” as used herein can be used interchangeably with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” does not necessarily mean something that is “specifically designed to” in terms of hardware. Instead, in some contexts, the expression “a system configured to” can mean that the system is “capable of” doing something together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor (e.g., an embedded processor) for performing those operations, or a generic-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in memory.
[0036] Additionally, when a component is referred to as being “connected” or “connected” to another component in the present disclosure, it should be understood that the component may be directly connected or connected to the other component, but may also be connected or connected via another component in between, unless otherwise specifically stated.
[0037] Below, with reference to the attached drawings, embodiments of the present disclosure are described in detail so that those skilled in the art can easily implement the present disclosure. However, one embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted to clearly describe one embodiment of the present disclosure, and similar parts are designated with similar drawing reference numerals throughout the present disclosure.
[0038] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.
[0039] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.
[0040] Referring to FIG. 1, in one embodiment, an electronic device (100) is illustrated that provides content (131) to a user. In one embodiment, the electronic device (100) may include a display (110), an optical layer (120), and a lenticular lens (130).
[0041] In one embodiment, the electronic device (100) is illustrated in FIG. 1 as having the shape of a television, but the present disclosure is not limited thereto. The electronic device (100) may be implemented as electronic devices of various shapes, such as a digital signage, a mobile device, a smart phone, a laptop computer, a desktop, a tablet PC, a wearable device, a head-mounted display (HMD) device, and the like.
[0042] In one embodiment, the electronic device (100) may acquire a plurality of input images, each corresponding to a plurality of different views. The plurality of input images may be images acquired by photographing a real object from a plurality of different views. However, the present disclosure is not limited thereto, and the plurality of input images may also be images generated to provide images of an object from a plurality of different views. In this case, a 'view' may correspond to a position where a user can view different sides of an object included in content (131) provided through the electronic device (100).
[0043] In one embodiment, content (131) may be provided so that the user can view different sides of an object in each of a plurality of views, depending on the user's position while viewing the electronic device (100). In one embodiment, the content (131) provided by the electronic device (100) to the user may vary depending on the user's position. In one embodiment, the content (131) may be an image that can provide a three-dimensional effect to the user (150) using the electronic device (100).
[0044] In one embodiment, the electronic device (100) may control the display (110) to display an image (111) including a plurality of pixels. The display (110) may display an image (111) including a plurality of pixels. In one embodiment, the plurality of pixels may be individual components constituting the image (111). As the resolution of the image (111) increases, the number of the plurality of pixels included in the image (111) may increase. In one embodiment, the resolution of the image (111) may refer to the resolution of the plurality of pixels constituting the display (110) that displays the image (111).
[0045] In one embodiment, the lenticular lens (130) may include a plurality of lenses. An image (111) displayed on the display (110) may be refracted through the lenticular lens (130) and provided to the user as content (131). Based on the positions of each of the plurality of pixels included in the image (111) and the shape or characteristics of the lenticular lens (130), the content (131) provided to the user after the image (111) is refracted through the lenticular lens (130) may vary depending on the user's position.
[0046] In one embodiment, the lenticular lens (130) may include a plurality of view areas. Images provided through the plurality of view areas may be refracted by the lenticular lens (130) to provide a plurality of view images provided in different views. Each of the view images may be an image provided to a user located in a different view. In one embodiment, the content (131) may be composed of a plurality of view images.
[0047] In one embodiment, the image (111) included in the display (110) may include a plurality of pixel images corresponding to a plurality of view images provided through the lenticular lens (130). In one embodiment, when the lenticular lens (130) includes n view areas for providing different images with n views, the image (111) may include n pixel images corresponding to the n view images. In this case, the n pixel images corresponding to each of the n view images may be displayed at positions corresponding to the n view areas included in the lenticular lens (130).
[0048] In one embodiment, the resolution of the image (111) in the present disclosure may refer to the resolution of each of n pixel images. In one embodiment, each of the n pixel images may be an image composed of 1 / n times the number of pixels included in the display (110). In one embodiment, each of the n pixel images may have a resolution that is 1 / n times the resolution of the resolution specified in the display (110). Accordingly, the resolution of the content (131) provided to the user through the electronic device (100) in different views may be lower than the resolution specified in the display (110).
[0049] Accordingly, by displaying an image (111) through a display (110) having a high resolution, even if content (131) is provided to a user in different views through an electronic device (100), the user can avoid noticing any deterioration in the image quality of the content (131).
[0050] To this end, the display (110) may include a plurality of sub-displays, each capable of displaying a sub-image with a high resolution. The electronic device (100) may display an image (111) through a plurality of sub-images displayed on each of the plurality of sub-displays. In one embodiment, the electronic device (100) may control the plurality of sub-displays to display the image (111) through the plurality of sub-images. When the image (111) is displayed using sub-displays with a high resolution, the resolution of the image (111) may also be high.
[0051] In one embodiment, an image (111) displayed through a plurality of sub-displays may be refracted by a lenticular lens (130) and provided to a user as content (131). The image (111) displayed through the plurality of sub-displays may be an image composed of a plurality of sub-images having a high resolution displayed on each of the plurality of sub-displays. Accordingly, even if each of the n view images provided through the lenticular lens (130) has a resolution that is 1 / n times the resolution of the display specifications, content (131) having a higher resolution can be provided to the user than when the image (111) is displayed through a single display.
[0052] However, the display (110) may include a display area (112) where an image (111) is displayed and a bezel area (113) adjacent to the display area (112). In one embodiment, the bezel area (113) may be an area where the image (111) is not displayed. In this case, an optical layer (120) may be disposed on the display (110) so that the image (111) is displayed even in the bezel area (113). The optical layer (120) may provide an enlarged image (121) that enlarges the image (111) displayed on the display (110). In one embodiment, the enlarged image (121) may provide an enlarged image (121) that overlaps the display area (112) and the bezel area (113) by enlarging the image (111) displayed on the display area (112).
[0053] Additionally, in one embodiment, a plurality of sub-displays may be arranged adjacent to each other and controlled to display a single image (111) through a plurality of sub-images. In this case, each of the plurality of sub-displays may include a sub-display area where the sub-image is displayed and a sub-bezel area adjacent to the sub-display area. In one embodiment, the sub-bezel area may be an area where the sub-image is not displayed.
[0054] In one embodiment, a plurality of sub-images may be enlarged by the optical layer (120) to provide an enlarged image (121) so that an area where a sub-image is not displayed due to a sub-bezel area is not included in the image (111). In one embodiment, the enlarged image (121) may include a plurality of enlarged sub-images. The enlarged plurality of sub-images may be images in which a sub-image is enlarged to an area where a sub-image is not displayed due to a sub-bezel area. Accordingly, the enlarged image (121) may not include an area where a sub-image is not displayed due to a sub-bezel area.
[0055] In one embodiment, the enlarged image (121) may be refracted by a lenticular lens (130) and provided to a user as content (131). The enlarged image (121) may include a plurality of enlarged pixel images corresponding to a plurality of view images provided to a plurality of view areas of the lenticular lens (130). In this case, since the enlarged image (121) is an enlarged image (111) displayed at a high resolution by a plurality of sub-displays, each of the plurality of enlarged pixel images may also have a high resolution. In addition, a plurality of view images may be provided to a user through an entire enlarged image (121) without a portion where the image (111) is not displayed due to a sub-bezel area between adjacent sub-displays.
[0056] In one embodiment, the magnified image (121) may include a plurality of magnification pixels. The plurality of magnification pixels may correspond to each of the plurality of pixels included in the image (111). The plurality of magnification pixels may be each of the plurality of pixels magnified through the optical layer (120). In one embodiment, the plurality of magnification pixels may be a plurality of pixels overlapping the display area (112) magnified to overlap the display area (112) and the bezel area (113).
[0057] At this time, at least one enlarged pixel corresponding to each of the plurality of view areas among the plurality of enlarged pixels and at least one pixel corresponding to each of the plurality of view areas among the plurality of pixels may be different. In one embodiment, the plurality of enlarged pixel images corresponding to each of the plurality of view images may be different from the plurality of pixel images corresponding to each of the plurality of view images. Therefore, the positions at which the plurality of pixel images corresponding to the plurality of view images provided through the lenticular lens (130) are displayed on the display (110) may be determined by considering the positional relationship between the plurality of view areas and the plurality of enlarged pixels, rather than the positional relationship between the plurality of view areas and the plurality of pixels included in the lenticular lens (130).
[0058] In one embodiment, the positions of a plurality of enlarged pixel images corresponding to a plurality of view images within an enlarged image (121) may be calculated by considering the positional relationship between a plurality of view areas and a plurality of enlarged pixels, and the positions of a plurality of pixel images included in an image (111) for providing content (131) may be calculated by considering the positional relationship between a plurality of enlarged pixels and a plurality of pixels.
[0059] In one embodiment, the electronic device (100) can calculate the positions of a plurality of pixel images included in an image (111) to be displayed through the display (110) by considering a plurality of view areas, a plurality of magnified pixels, and a positional relationship between the plurality of pixels. The electronic device (100) can display the image (111) on the display (110) according to the calculated positions, and the displayed image (111) can be provided as an magnified image (121) by the optical layer (120), and the magnified image (121) can be provided as content (131) to the user through the lenticular lens (130).
[0060] In one embodiment, the enlarged image (121) may be an image provided by enlarging an image adjacent to the bezel area (113) among the images (111) displayed in the display area (112). In one embodiment, the optical layer (120) may provide an enlarged image (121) by enlarging an image displayed in an area adjacent to the bezel area (113) among the images (111) displayed in the display area (112). An image displayed in an area spaced apart from the bezel area (113) among the images (111) may be provided in a state in which it is not enlarged by the optical layer (120).
[0061] In this case, only the image (111) displayed on the display (110) displayed in a certain area (for example, the image displayed in an area adjacent to the bezel area (113)) is enlarged, and the image displayed in the remaining areas may be provided as an enlarged image (121) without being enlarged. Therefore, the user may feel a sense of incongruity with respect to the content (131) provided using the enlarged image (121).
[0062] Accordingly, the electronic device (100) of the present disclosure can determine the image (111) to be displayed on the display (110) by considering that only a portion of the image (111) displayed on the display (110) is enlarged by the optical layer (120). Through this, the electronic device (100) can provide the user with content (131) by an enlarged image (121) that is enlarged in its entirety, rather than content (131) by an enlarged image (121) in which only a portion of the image is enlarged.
[0063] To this end, the electronic device (100) can calculate the magnification ratio of the area of the image (111) and the area of the magnified image (121), and convert the resolutions of the acquired plurality of input images using the calculated magnification ratio. In one embodiment, when the resolution of the image (111) displayed on the display (110) is the first resolution, the electronic device (100) can convert the resolutions of the acquired plurality of input images to have a second resolution obtained by multiplying the magnification ratio by the first resolution to display the image (111). In one embodiment, when the resolutions of the acquired plurality of input images are the first resolution, the electronic device (100) can convert the resolutions of the plurality of input images into a plurality of converted images of the second resolution.
[0064] In one embodiment, the electronic device (100) may determine a plurality of selected images to be displayed on a plurality of enlarged pixels included in an enlarged image (121) among a plurality of converted images converted to a second resolution. The electronic device (100) may determine, as a plurality of selected images, images corresponding to a plurality of enlarged pixels having the first resolution but different areas among a plurality of converted images converted to a second resolution.
[0065] In one embodiment, the electronic device (100) can display a plurality of selected images, which are determined, on a plurality of pixels corresponding to a plurality of enlarged pixels through the display (110). Through this, the enlarged image (121) in which the image (111) displayed on the display (110) is enlarged by the optical layer (120) can appear as if an image having a second resolution is provided, rather than an image in which only a portion of an image having a first resolution is enlarged.
[0066] In one embodiment, the electronic device (100) can provide a user with content (131) by means of an enlarged image (121) provided by enlarging an image (111) including a plurality of selected images determined from among a plurality of input images converted to a second resolution.
[0067] Through this, the electronic device (100) can provide content (131) having a high resolution to the user by displaying an image (111) using a plurality of sub-displays, each having a high resolution. In one embodiment, the electronic device (100) can use an optical layer (120) to prevent the bezel area between the plurality of sub-displays from being visible to the user.
[0068] In addition, the electronic device (100) can provide the user with content (131) using an enlarged image (121) that is enlarged so that only a portion of the image is enlarged so that the bezel area is not visible to the user, but rather with content (131) using an enlarged image (121) that is enlarged so that the resolution is naturally increased, so that the user does not feel a sense of incongruity.
[0069] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.
[0070] Hereinafter, the electronic device (100) and the operating method of the electronic device (100) of the present disclosure will be described in detail.
[0071] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0072] Referring to FIGS. 1 and 2, the electronic device (100) may include a display (110), an optical layer (120), a lenticular lens (130), a memory (200), at least one processor (210), and an input / output interface (220). However, not all of the components illustrated in FIG. 2 are essential components of the electronic device (100). The electronic device (100) may be implemented with more components than the components illustrated in FIG. 2, or may be implemented with fewer components.
[0073] In one embodiment, the display (110), the optical layer (120), the lenticular lens (130), the memory (200), at least one processor (210), and the input / output interface (220) may each be electrically and / or physically connected to one another.
[0074] In one embodiment, the display (110) may include any one of a liquid crystal display, an organic light emitting diode display, and an inorganic light emitting diode display. However, the present disclosure is not limited thereto, and the display (110) may include other types of displays capable of displaying an image (111). In one embodiment, the display (110) may include a plurality of sub-displays. Each of the plurality of sub-displays may display a sub-image, and the image (111) may be displayed using a plurality of sub-images displayed through the plurality of sub-displays.
[0075] In one embodiment, the optical layer (120) may be a layer including an optical fiber. In one embodiment, the optical layer (120) may include, but is not limited to, glass or a polymer. In one embodiment, the optical layer (120) may transmit light provided to the optical layer (120) to the outside of the optical layer (120). In one embodiment, light incident on the optical layer (120) may propagate through a total reflection phenomenon and be transmitted to the outside of the optical layer (120). In one embodiment, the direction in which light incident on the optical layer (120) propagates may be determined by the shape of the optical layer (120) or optical characteristics such as the refractive index of a material included in the optical layer (120).
[0076] In one embodiment, the optical layer (120) may be disposed on the display (110). The optical layer (120) may transmit an image (111) displayed through the display (110) and transmitted to the optical layer (120) to the outside of the optical layer (120). In one embodiment, the image (111) provided to the optical layer (120) may be enlarged and provided as an enlarged image (121) to the outside of the optical layer (120) due to optical characteristics such as the shape of the optical layer (120) or the refractive index of the material included in the optical layer (120). Hereinafter, the optical layer (120) will be described later with reference to FIGS. 4 to 6.
[0077] In one embodiment, the lenticular lens (130) may include a plurality of lenses having a convex shape. In one embodiment, each of the plurality of lenses included in the lenticular lens (130) may have a cylindrical shape with a hemispherical cross-section. In one embodiment, the lenticular lens (130) may have an upper surface in which a convex shape is repeated by the plurality of lenses, and a lower surface that is flat. At this time, the lenticular lens (130) may be formed of one layer or may be formed of two or more layers. The lenticular lens (130) may include a base layer for arranging the plurality of lenses, and a lens layer including the plurality of lenses arranged on the base layer. In one embodiment, the flat surface of the lens layer may be a surface that is in contact with the base layer.
[0078] In one embodiment, the lenticular lens (130) can refract light provided to the lenticular lens (130). The path of light passing through the lenticular lens (130) can be changed by being refracted through the lenticular lens (130). In one embodiment, the path along which light provided to the lenticular lens (130) is refracted can vary depending on the shape or size of the plurality of lenses included in the lenticular lens (130), the refractive index of the material included in the plurality of lenses, etc.
[0079] In one embodiment, when each of the plurality of lenses has a cylindrical shape with a hemispherical cross-section, the diameter of the hemispherical cross-section may be referred to as the pitch. However, the pitch is a criterion for dividing a single lens into multiple view areas, and the present disclosure is not limited thereto. In one embodiment, the distance between the center points of two adjacent lenses may also be referred to as the pitch.
[0080] In one embodiment, a pitch may be divided into multiple view areas. Each of the multiple view areas may be an area where light provided to each of the multiple view areas is refracted in different directions. In one embodiment, each of the multiple pixel images or each of the multiple magnified pixel images provided to each of the multiple view areas may be refracted along different paths by the lens.
[0081] In one embodiment, each of the plurality of lenses may include a plurality of view areas. In one embodiment, each of the plurality of pixel images or the plurality of magnified pixel images provided to the plurality of view areas may be refracted in different directions by the lenses included in the lenticular lens (130) to provide multiple view images to users positioned at different views. The optical layer (120) will be described below with reference to FIGS. 6, 7A, and 11A.
[0082] In one embodiment, the memory (200) may store instructions, data structures, and program codes that can be read by at least one processor (210). In one embodiment, there may be more than one memory (200). In the disclosed embodiments, operations performed by at least one processor (210) may be implemented by executing instructions or codes of a program stored in the memory (200).
[0083] In one embodiment, the memory (200) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a mask ROM, a flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD).
[0084] In one embodiment, the memory (200) may store instructions or program codes for performing functions or operations of the electronic device (100). The instructions, algorithms, data structures, program codes, and application programs stored in the memory (200) may be implemented in a programming or scripting language such as, for example, C, C++, Java, or an assembler.
[0085] In one embodiment, the memory (200) may store an optical correction map acquisition module (201), a magnified view pixel allocation module (202), a view pixel allocation module (203), an image conversion module (204), an image selection module (205), and an image rendering module (206). However, not all of the modules illustrated in FIG. 2 are essential modules. The memory (200) may store more or fewer modules than the modules illustrated in FIG. 2. In addition, the memory (200) may store an optical correction map (1040, see FIG. 10b) to be described later.
[0086] In one embodiment, a 'module' included in the memory (200) may mean a unit that processes a function or operation performed by at least one processor (210). The 'module' included in the memory (200) may be implemented as software such as instructions, an algorithm, a data structure, or a program code.
[0087] In one embodiment, the optical correction map acquisition module (201) may be configured with instructions or program codes relating to an operation or function of acquiring an optical correction map (1040, see FIG. 10b) that includes positional information of a plurality of pixels included in an image (111) displayed on a display (110) and positional information of a plurality of enlarged pixels included in an enlarged image (121) enlarged by an optical layer (120).
[0088] In one embodiment, at least one processor (210) can obtain an optical correction map (1040) by executing instructions or program code of an optical correction map acquisition module (201). At least one processor (210) can obtain an optical correction map (1040) by executing instructions or program code of an optical correction map acquisition module (201) through a communication interface.
[0089] In one embodiment, the optical correction map (1040) may be a map including positional information of a plurality of pixels included in an image (111) calculated by comparing an image (111) displayed through a display (110) with an enlarged image (121) provided through an optical layer (120) and positional information of a plurality of enlarged pixels included in an enlarged image (121). In one embodiment, the optical correction map (1040) may be a map calculated in advance using the resolution of the image (111) displayed through the display (110), the positional relationship between the display (110) and the optical layer (120), the optical characteristics of the optical layer (120), the shape of the optical layer (120), etc.
[0090] In one embodiment, the optical correction map acquisition module (201) may be configured with instructions or program codes relating to an operation or function of calculating the area of each of the plurality of pixels and the area of each of the plurality of enlarged pixels based on the positional information of the plurality of pixels included in the acquired optical correction map (1040) and the positional information of the plurality of enlarged pixels. However, the present disclosure is not limited thereto, and the area of each of the plurality of pixels and the area of each of the plurality of enlarged pixels may be calculated in advance and included in the optical correction map (1040).
[0091] In one embodiment, the optical correction map acquisition module (201) may be configured with instructions or program codes related to an operation or function of calculating the center point of each of the plurality of pixels and the center point of each of the plurality of enlarged pixels based on the positional information of the plurality of pixels included in the acquired optical correction map (1040) and the positional information of the plurality of enlarged pixels. In one embodiment, the center point of each of the plurality of pixels and the center point of each of the plurality of enlarged pixels may be calculated in advance and included in the optical correction map (1040). Hereinafter, the optical correction map (1040) will be described later with reference to FIGS. 10A and 10B.
[0092] In one embodiment, the enlarged view pixel allocation module (202) may be configured with instructions or program codes relating to an operation or function of dividing a plurality of enlarged pixels into a plurality of enlarged view pixels on which a plurality of enlarged pixel images are to be displayed, based on positional information of a plurality of enlarged pixels included in an enlarged image (121) and a plurality of view areas included in a lenticular lens (130).
[0093] In one embodiment, a magnification view pixel may be a group of magnification pixels for displaying an magnification pixel image of one of a plurality of magnification pixels. In one embodiment, a plurality of magnification pixels included in one magnification view pixel may display an magnification pixel image corresponding to a view image provided to a user in one view. In one embodiment, a resolution of the magnification view pixel may refer to a resolution of an magnification pixel image displayed in the magnification view pixel. As the number of magnification pixels included in the magnification view pixel increases, the resolution of the magnification view pixel may increase.
[0094] In one embodiment, each of the plurality of lenses included in the lenticular lens (130) may be divided into a plurality of view areas. In one embodiment, the shape of the plurality of view areas included in each of the plurality of lenses may be a shape determined according to at least one of the shape or size of the plurality of lenses included in the lenticular lens (130) or the refractive index of a material included in the plurality of lenses. In one embodiment, the enlarged view pixel allocation module (202) may be configured with instructions or program codes related to an operation or function of dividing or allocating the plurality of enlarged pixels into a plurality of enlarged view pixels corresponding to the plurality of view areas, respectively, based on the arrangement of the plurality of enlarged pixels and the arrangement of the plurality of view areas.
[0095] In one embodiment, at least one processor (210) may execute instructions or program codes of the enlarged view pixel allocation module (202) to divide a plurality of enlarged pixels into a plurality of enlarged view pixels. The operation of allocating or dividing a plurality of enlarged pixels into a plurality of enlarged view pixels will be described later with reference to FIGS. 11A and 11B.
[0096] In one embodiment, the view pixel allocation module (203) may be configured with instructions or program codes relating to an operation or function of dividing a plurality of pixels into a plurality of view pixels each corresponding to a plurality of enlarged view pixels based on the optical correction map (1040).
[0097] In one embodiment, the acquired optical correction map (1040) includes information about the correspondence between a plurality of pixels included in the image (111) and a plurality of enlarged pixels included in the enlarged image (121) enlarged by the optical layer (120). In one embodiment, the view pixel allocation module (203) may be configured with commands or program codes for an operation or function of using the optical correction map (1040) to divide a plurality of pixels into a plurality of view pixels that are respectively corresponding to a plurality of enlarged view pixels and are respectively divided to correspond to a plurality of view areas.
[0098] In one embodiment, at least one processor (210) may execute instructions or program codes of the view pixel allocation module (203) to divide a plurality of pixels into a plurality of view pixels corresponding to a plurality of enlarged view pixels, respectively. Hereinafter, an operation of allocating or dividing a plurality of pixels into a plurality of view pixels corresponding to a plurality of enlarged view pixels, respectively, will be described later with reference to FIGS. 11A and 11B.
[0099] In one embodiment, the image conversion module (204) may be configured with instructions or program codes related to an operation or function for converting the resolution of a plurality of acquired input images. In one embodiment, the image conversion module (204) may include a model for performing upscaling to increase the resolution of a plurality of input images. In one embodiment, the image conversion module (204) may include an interpolation algorithm such as Nearest-Neighbor Interpolation, Bilinear Interpolation, or Bicubic Interpolation.
[0100] However, the present disclosure is not limited thereto, and the image conversion module (204) may include an artificial intelligence model trained to receive an image and infer an image with increased resolution. In one embodiment, the artificial intelligence model included in the image conversion module (204) may include a plurality of neural network layers. Each neural network layer has a plurality of weight values, and may perform an operation of the current neural network layer through an operation result of a previous neural network layer and an operation of the plurality of weights. Examples of artificial intelligence models include CNN (Convolutional Neural Network), DNN (Deep Neural Network), RNN (Recurrent Neural Network), RBM (Restricted Boltzmann Machine), DBN (Deep Belief Network), BRDNN (Bidirectional Recurrent Deep Neural Network), Deep Q-Networks, GAN (Generative Adversarial Networks), CGAN (Conditional Generative Adversarial Networks), DCGAN (Deep Convolutional Generative Adversarial Network), and VAE (Variational Auto Encoder), and the artificial intelligence models included in the image transformation module (204) of the present disclosure are not limited to the examples described above.
[0101] In one embodiment, at least one processor (210) can convert the resolution of a plurality of input images by executing instructions or program codes of the image conversion module (204). In one embodiment, at least one processor (210) can convert the resolution of a plurality of input images to be higher by the magnification ratio by using an magnification ratio between the area of the image (111) calculated using the acquired optical correction map (1040) and the area of the magnified image (121). In one embodiment, at least one processor (210) can convert a plurality of input images into a plurality of converted images having a high resolution by executing instructions or program codes of the image conversion module (204).
[0102] In one embodiment, the image selection module (205) may be configured with instructions or program codes relating to an operation or function of determining a plurality of selected images corresponding to each of a plurality of enlarged view pixels among a plurality of converted images whose resolutions have been converted by the image conversion module (204). In one embodiment, each of the plurality of input images may be an image corresponding to a plurality of enlarged view pixels. Each of the plurality of converted images may be an image corresponding to a plurality of enlarged view pixels.
[0103] In one embodiment, the resolution of each of the plurality of transformed images may be higher than the resolution of each of the plurality of magnified view pixels. In one embodiment, the resolution of each of the plurality of transformed images may be higher than the resolution of the magnified pixel image displayed in any one of the magnified view pixels.
[0104] In one embodiment, the image selection module (205) may be configured with instructions or program codes related to an operation or function for determining a selection image corresponding to the resolution of each magnified view pixel among each converted image. In one embodiment, the image selection module (205) may be configured with instructions or program codes related to an operation or function for determining a selection image corresponding to the resolution of each magnified pixel image among each converted image. In one embodiment, the resolution of the selection image may be the same as the resolution of the magnified view pixel. The resolution of the selection image may be the same as the resolution of the magnified pixel image.
[0105] In one embodiment, at least one processor (210) can determine a plurality of selected images corresponding to each of a plurality of enlarged view pixels among a plurality of converted images whose resolutions have been converted by the image conversion module (204) by executing instructions or program codes of the image selection module (205).
[0106] In one embodiment, the image rendering module (206) may be configured with commands or program codes related to an operation or function of rendering a plurality of input images acquired to each of a plurality of view pixels distinguished through the view pixel allocation module (203). In one embodiment, the image rendering module (206) may be configured with commands or program codes related to an operation or function of rendering a plurality of input images to each of a plurality of view pixels and displaying them as images (111) to each of the plurality of view pixels.
[0107] In one embodiment, the image rendering module (206) may be configured with instructions or program codes related to operations or functions for preprocessing a plurality of acquired input images. The image rendering module (206) may render and display the plurality of preprocessed input images on each of a plurality of view pixels.
[0108] In one embodiment, the image rendering module (206) may be configured with commands or program codes related to an operation or function of rendering a plurality of selected images determined through the image conversion module (204) and the image selection module (205) to each of a plurality of view pixels distinguished through the view pixel allocation module (203). In one embodiment, the image rendering module (206) may be configured with commands or program codes related to an operation or function of rendering a plurality of selected images to each of a plurality of view pixels and displaying them as images (111) to each of the plurality of view pixels. Hereinafter, the operations of the image conversion module (204), the image selection module (205), and the image rendering module (206) will be described later with reference to FIGS. 12 to 15B.
[0109] In addition, although FIG. 2 illustrates multiple modules for performing operations of the electronic device (100) as being stored separately in the memory (200), the present disclosure is not limited thereto. Some of the multiple modules illustrated in FIG. 2 may be stored as a single module. Furthermore, a module illustrated as a single module in FIG. 2 may be stored separately as two or more modules.
[0110] In one embodiment, at least one processor (210) may be configured as at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), a Digital Signal Processor (DSPs), a Digital Signal Processing Device (DSPDs), a Programmable Logic Device (PLDs), a Field Programmable Gate Array (FPGAs), a Neural Processing Unit, or an artificial intelligence (AI) processor designed with a hardware structure specialized for learning and processing an artificial intelligence (AI) model, but is not limited thereto.
[0111] In one embodiment of the present disclosure, if one or more processors included in at least one processor (210) are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0112] In one embodiment of the present disclosure, at least one processor (210) may be configured as a circuit (Circuitry) such as a System on Chip (SoC) or an Integrated Circuit (IC).
[0113] In one embodiment of the present disclosure, at least one processor (210) can execute various types of modules stored in the memory (200). At least one processor (210) can execute at least one instruction constituting the various types of modules stored in the memory (200). By executing the program or at least one instruction stored in the memory (200), at least one processor (210) can process data according to predefined operation rules or artificial intelligence models.
[0114] In one embodiment of the present disclosure, at least one processor (210) can execute at least one module among an optical correction map acquisition module (201), an enlarged view pixel allocation module (202), a view pixel allocation module (203), an image conversion module (204), an image selection module (205), or an image rendering module (206) stored in a memory (200).
[0115] In one embodiment of the present disclosure, at least one processor (210) may include a plurality of processors. In one embodiment of the present disclosure, at least one module among the optical correction map acquisition module (201), the enlarged view pixel allocation module (202), the view pixel allocation module (203), the image conversion module (204), the image selection module (205), or the image rendering module (206) stored in the memory (200) may be executed by any one of the plurality of processors.
[0116] In one embodiment, the input / output interface (220) can receive a plurality of input images, each corresponding to a plurality of views, from a peripheral electronic device or the like, under the control of at least one processor (210). In one embodiment, the plurality of input images can include still images or moving images. The input / output interface (220) can receive audio (e.g., a voice signal, a music signal, etc.) and additional information, etc. from an external device or the like, under the control of at least one processor (210). The input / output interface (220) can include at least one of an HDMI port (High-Definition Multimedia Interface port), a component jack, a PC port, or a USB port. However, the present disclosure is not limited thereto, and the input / output interface (220) can also include various types of interfaces that can receive a plurality of input images from peripheral electronic devices.
[0117] In one embodiment, the electronic device (100) may further include a communication interface. In one embodiment, the communication interface may perform data communication with an external server under the control of at least one processor (210). In addition, the communication interface may perform data communication not only with the external server but also with other peripheral electronic devices. The communication interface may perform data communication with the server or other peripheral electronic devices using at least one of data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, zigbee, Wi-Fi Direct (WFD), infrared Data Association (IrDA), Bluetooth Low Energy (BLE), Near Field Communication (NFC), Wireless Broadband Internet (Wibro), World Interoperability for Microwave Access (WiMAX), Shared Wireless Access Protocol (SWAP), Wireless Gigabit Alliance (WiGig), and RF communication.
[0118] In one embodiment, at least one processor (210) may receive a pre-calculated optical correction map from an external server or peripheral electronic devices via a communication interface.
[0119] Additionally, the present disclosure is not limited thereto, and at least one processor (210) may receive a plurality of input images from an external server (e.g., a web server or a cloud service, etc.) through a communication interface.
[0120] FIG. 3 is a drawing for explaining a bezel area and a display area included in a display according to one embodiment of the present disclosure. FIG. 4 is a drawing for explaining an enlarged image provided through an optical layer according to one embodiment of the present disclosure. FIG. 5 is a drawing for explaining an image displayed through a display and an enlarged image provided through an optical layer according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIGS. 1 and 2 are given the same reference numerals, and redundant descriptions are omitted.
[0121] In one embodiment, referring to FIGS. 1 and 3, FIG. 3 illustrates a display (110). While FIG. 3 illustrates the display (110) as having a rectangular shape, the present disclosure is not limited thereto. In one embodiment, the display (110) may have various shapes, such as a circular shape.
[0122] In one embodiment, the display (110) may include a display area (112) where an image (111) is displayed and a bezel area (113) adjacent to the display area (112). In one embodiment, the bezel area (113) may be an area surrounding the display area (112). The bezel area (113) may be an area for protecting the display area (112) from external impact. The bezel area (113) may be an area where a circuit for displaying the image (111) in the display area (112) is arranged.
[0123] In one embodiment, the display area (112) may include a plurality of pixels. In one embodiment, the resolution of the image (111) displayed in the display area (112) may be determined based on the number of the plurality of pixels. In one embodiment, the resolution of the image (111) may refer to the resolution of the plurality of pixels.
[0124] In one embodiment, the plurality of pixels may include a plurality of first pixels (114) adjacent to the bezel area (113) and a plurality of second pixels (115) spaced apart from the bezel area (113). In one embodiment, the plurality of second pixels (115) may be located in a central portion of the display area (112), and the plurality of first pixels (114) may be located in an outer portion of the display area (112).
[0125] In one embodiment, the bezel area (113) included in the display (110) is illustrated in FIG. 3 as being located on all four sides of the display (110), but the present disclosure is not limited thereto. In one embodiment, the bezel area (113) may be located on at least one side of the display (110).
[0126] Referring to FIGS. 1, 3, and 4, in one embodiment, an optical layer (120) may be disposed on a display (110). In one embodiment, an image (111) displayed on the display (110) may be provided to the optical layer (120). The image (111) provided to the optical layer (120) may be transmitted within the optical layer (120) along the shape of the optical layer (120). In one embodiment, the image (111) provided to the optical layer (120) may be transmitted along the optical layer (120) and then provided to the outside of the optical layer (120).
[0127] In one embodiment, an image provided to the optical layer (120) may be enlarged and transmitted to the outside of the optical layer (120) depending on the shape of the optical layer (120). At this time, the optical layer (120) may have a shape in which the lower surface adjacent to the display (110) is relatively narrow and the upper surface facing the lower surface is relatively wide. In one embodiment, the lower surface of the optical layer (120) may overlap with the display area (112) of the display (110), and the upper surface of the optical layer (120) may overlap with the display area (112) and the bezel area (113).
[0128] Through this, the image (111) provided on the lower surface of the optical layer (120) and overlapping with the display area (112) can be enlarged by the optical layer (120) and provided to the outside of the optical layer (120) as an enlarged image (121) overlapping with the display area (112) and the bezel area (113) through the upper surface of the optical layer (120). In one embodiment, the area of the enlarged image (121) can be larger than the area of the image (111).
[0129] In one embodiment, an image displayed in a plurality of first pixels (114) adjacent to a bezel area (113) of an image (111) may be enlarged to overlap the display area (112) and the bezel area (113) by the optical layer (120). An image displayed in a plurality of second pixels (115) of an image (111) may be provided to overlap the display area (112) by the optical layer (120).
[0130] Referring to FIGS. 1, 3, and 5, in one embodiment, the display (110) may include a plurality of sub-displays. Each of the plurality of sub-displays may include a sub-display area (116) in which a sub-image is displayed and a sub-bezel area (117) adjacent to the sub-display area (116).
[0131] In one embodiment, the display (110) may display an image (111) by combining a plurality of sub-images displayed on a plurality of sub-displays. At this time, the image (111) may include an area where the sub-image is not displayed due to a sub-bezel area (117).
[0132] In one embodiment, the optical layer (120) may be arranged to overlap a plurality of sub-displays. In one embodiment, the optical layer (120) may be arranged to overlap a plurality of sub-display areas and a plurality of sub-bezel areas. Accordingly, an enlarged image (121) enlarged through the optical layer (120) may be overlapped on all of the plurality of sub-displays without any area where the sub-image is not displayed due to the sub-bezel area (117).
[0133] In one embodiment, although FIG. 5 illustrates the display (110) as including four sub-displays, the present disclosure is not limited thereto. The display (110) may include three or fewer sub-displays or five or more sub-displays. Furthermore, although FIG. 5 illustrates the optical layer (120) as providing an enlarged image (111) that overlaps a plurality of sub-bezel areas included in the borders of each of the four sub-displays, the present disclosure is not limited thereto. In one embodiment, depending on the shape of the optical layer (120), the enlarged image (121) may overlap only some of the plurality of sub-bezel areas included in the plurality of sub-displays.
[0134] FIG. 6 is a drawing for explaining the arrangement of a display, an optical layer, and a lenticular lens according to one embodiment of the present disclosure. Hereinafter, the same components as those described in FIG. 4 are given the same drawing reference numerals, and redundant descriptions are omitted.
[0135] Referring to FIGS. 1, 3, and 6, in one embodiment, a lenticular lens (130) may be disposed on an optical layer (120). In one embodiment, a lower surface of the lenticular lens (130) adjacent to the optical layer (120) may be flat, and an upper surface facing the lower surface may have a convex shape in which a plurality of lenses are repeated. However, the present disclosure is not limited thereto, and the lower surface of the lenticular lens (130) may also have various surfaces depending on the shape of the optical layer (120), etc.
[0136] In one embodiment, a magnified image (121) provided through an optical layer (120) may be provided to a lenticular lens (130). In one embodiment, the magnified image (121) provided to the lenticular lens (130) may be refracted in different directions through a plurality of lenses included in the lenticular lens (130) to be provided as a plurality of view images in different views. In one embodiment, the electronic device (100) may provide content (131) to a user through a plurality of view images each provided in a plurality of different views.
[0137] FIG. 7A is a diagram for explaining an operation of dividing a plurality of pixels included in an image displayed through a display according to one embodiment of the present disclosure into a plurality of view pixels. FIG. 7B is a diagram for explaining a relationship between a plurality of enlarged view pixels and a plurality of view areas included in a lenticular lens according to one embodiment of the present disclosure.
[0138] Referring to FIGS. 1, 4 and 7A, in one embodiment, FIG. 7A illustrates that a plurality of pixels (700) included in an image (111) are divided into a plurality of view pixels in order to display a plurality of pixel images corresponding to a plurality of view images provided through a lenticular lens (130) in correspondence with a plurality of view areas (710).
[0139] In one embodiment, FIG. 7A illustrates a case where an image (111) displayed through a display (110) is provided through a lenticular lens (130) rather than an image (121) enlarged by an optical layer (120). In one embodiment, FIG. 7A illustrates an electronic device (100) dividing a plurality of pixels (700) included in an image (111) into a plurality of view pixels without considering that the image is enlarged by the optical layer (120).
[0140] In one embodiment, the lenticular lens (130) may include a plurality of lenses, each of which may include a plurality of view areas (710). In one embodiment, FIG. 7A illustrates one lens as including n view areas (710), but the present disclosure is not limited thereto. The number of multiple view areas included in one lens may vary depending on the shape of the lens, the refractive index of the lens, the size of the lens, and the like.
[0141] In one embodiment, for convenience of explanation, in FIG. 7A, the first view is illustrated as v1, the second view as v2, the third view as v3, the (n-1)th view as vn-1, and the nth view as vn. One lens is illustrated with n view areas (710) corresponding to the first to nth views, respectively. Although FIG. 7A illustrates n view areas (710) included in one lens, each of the plurality of lenses included in the lenticular lens (130) may include n view areas. In one embodiment, the arrangement of the n view areas (710) included in one lens may be repeated in the plurality of lenses. In one embodiment, n may be a natural number greater than 1.
[0142] In one embodiment, a plurality of pixels corresponding to each of n view areas (710) among a plurality of pixels (700) are determined, and a plurality of pixels that are identified as corresponding to the same view area can be identified as view pixels.
[0143] In one embodiment, the plurality of pixels (700) may be divided into a plurality of view pixels corresponding to n view areas (710), respectively. At this time, the plurality of pixels (700) may be divided into n view pixels. In one embodiment, each of the view pixels may include a plurality of pixels corresponding to any one of the n view areas (710) of the lenticular lens (130). In one embodiment, as the n view areas (710) included in the lenticular lens (130) are repeated according to the plurality of lenses, the divided n plurality of view pixels may also be repeated.
[0144] At this time, there may be several methods for determining a pixel corresponding to each of n view areas (710) among a plurality of pixels (700). In one embodiment, among at least one view area overlapping with a pixel, a view area with the largest overlapping area with a pixel may be determined as the view area corresponding to the pixel. In addition, a center point of a pixel may be calculated, and a view area overlapping with the center point may be determined as the view area corresponding to the pixel. However, the present disclosure is not limited to any one method. Hereinafter, for convenience of explanation, it will be described that a center point of a pixel is calculated, and a view area overlapping with the center point is determined as the view area corresponding to the pixel.
[0145] Referring to FIG. 7a, in the case of a pixel overlapping the third view area and the fourth view area among a plurality of pixels, the center point of the pixel overlaps the fourth view area, and thus the pixel is classified as a view pixel overlapping the fourth view area.
[0146] In one embodiment, at least one processor (210) can display a pixel image for providing a view image in a view area of a lenticular lens (130) corresponding to each of a plurality of view pixels. In one embodiment, the view image is an image provided to a user in one of n views, and the pixel image is an image that can be provided in a view area of one of n views, refracted through the lenticular lens (130), and provided as a view image in the corresponding view. In one embodiment, at least one processor (210) can control the display (110) to display a pixel image corresponding to each of a plurality of view pixels based on acquired input images.
[0147] At this time, the acquired input images may be images acquired by photographing a real object through a camera located at n views. However, the present disclosure is not limited thereto, and the acquired input images may be images generated to provide images of an object in n views. In addition, the acquired input images may be corresponding images in views smaller or larger than n, and at least one processor (210) may generate and use n view images as needed.
[0148] Referring to FIGS. 4, 6, 7a and 7b, in one embodiment, in FIG. 7b, considering that the image (111) is not enlarged due to the absence of the optical layer (120), when a pixel image corresponding to each of the plurality of view pixels distinguished in FIG. 7a is displayed, an enlarged image (121) and a lenticular lens (130) are illustrated according to the optical layer (120).
[0149] In one embodiment, a plurality of magnification pixels (720) included in an enlarged image (121) may be divided into a plurality of magnification view pixels (730) corresponding to a plurality of view pixels, respectively. In one embodiment, the plurality of magnification pixels (720) may correspond one-to-one with a plurality of pixels (700). In one embodiment, a group including a plurality of magnification pixels corresponding to a plurality of pixels included in a view pixel may be divided into an magnification view pixel. The plurality of magnification pixels included in an magnification view pixel may correspond to a plurality of pixels included in a view pixel corresponding to the magnification view pixel.
[0150] In one embodiment, a pixel image displayed on a view pixel may be magnified by the optical layer (120) into an enlarged pixel image displayed on an enlarged view pixel. When the electronic device (100) includes the optical layer (120), an enlarged pixel image, rather than a pixel image, may be provided to the lenticular lens (130).
[0151] In one embodiment, for convenience of explanation, FIG. 7B illustrates seven view areas (710) included in one lens. In one embodiment, each of the view areas (710) from 1 to 7 may be an area in which the pitch (740) of one lens is divided into seven. In one embodiment, the lenticular lens (130) may be arranged slanted compared to the plurality of pixels (700) included in the image (111) or the plurality of magnification pixels (720) included in the magnification image (121). In one embodiment, being slanted may mean that each view area does not overlap with the plurality of pixels (700) or the plurality of magnification pixels (720) located in a certain row or a certain column, but overlaps with the plurality of pixels (700) or the plurality of magnification pixels (720) located in different rows and columns.
[0152] In one embodiment, the hatched area in FIG. 7B may be an enlarged view pixel corresponding to a view pixel identified to correspond to view area 1. At this time, the view pixel identified to correspond to view area 1 may include at least one pixel adjacent to the bezel area (113) of the display (110). Accordingly, the enlarged view pixel, which is an enlarged view pixel identified to correspond to view area 1, may be enlarged toward the bezel area (113), so that the area of the view pixel and the area of the enlarged view pixel may be different.
[0153] Accordingly, the enlarged pixel image displayed in the enlarged view pixel may not correspond to the view area 1. Referring to FIG. 7B, it is illustrated that the hatched area includes enlarged pixels that do not overlap with the view area 1. Therefore, even if the pixel image is displayed in the view pixel of the display (110) to provide a view image corresponding to view 1 through view area 1, the pixel image may be enlarged by the optical layer (120) and the enlarged pixel image may be provided to a view area other than view area 1. In this case, the desired view image may not be provided depending on the view in which the user is located, and thus the user's visibility may be reduced.
[0154] FIG. 8 is a flowchart illustrating the operation of an electronic device according to one embodiment of the present disclosure. FIG. 9 is a diagram illustrating the operation of an electronic device including an optical layer according to one embodiment of the present disclosure.
[0155] Referring to FIGS. 1, 2 and 8, in one embodiment, FIG. 8 illustrates a method of operating an electronic device (100) of the present disclosure.
[0156] In one embodiment, the operating method of the electronic device (100) may include a step (S100) of acquiring a plurality of input images each corresponding to a plurality of views.
[0157] Referring to FIGS. 2, 8, and 9, in one embodiment, in the step (S100) of acquiring a plurality of input images, at least one processor (210) may acquire a plurality of input images corresponding to each of a plurality of views through an input / output interface (220). However, the present disclosure is not limited thereto, and at least one processor (210) may also acquire a plurality of input images stored in a memory (200).
[0158] Referring to FIGS. 1, 2, 8, and 9, in one embodiment, an operating method of an electronic device (100) may include a step (S200) of obtaining an optical correction map (1040, see FIG. 10b) including position information of a plurality of pixels included in an image (111) displayed through a display (110) and position information of a plurality of enlarged pixels included in an enlarged image (121) obtained by enlarging an image (111) provided through an optical layer (120) disposed on the display (110).
[0159] In one embodiment, in step S200 of obtaining an optical correction map (1040), at least one processor (210) may obtain the optical correction map by executing commands or program codes of an optical correction map obtaining module (201). At this time, the optical correction map may be pre-calculated and stored in the memory (200). In addition, at least one processor (210) may obtain the optical correction map from an external server or peripheral electronic device through a communication interface.
[0160] In one embodiment, the operating method of the electronic device (100) may include a step of calculating a center point of each of a plurality of enlarged pixels corresponding to each of the plurality of pixels using the acquired optical correction map. In one embodiment, in the step of calculating the center point of each of the plurality of pixels, at least one processor (210) may calculate the center point of each of the plurality of enlarged pixels based on position information of the plurality of enlarged pixels included in the acquired optical correction map. However, the present disclosure is not limited thereto, and the center point of each of the plurality of enlarged pixels may be calculated in advance and included in the acquired optical correction map.
[0161] In one embodiment, the operating method of the electronic device (100) may include a step (S300) of dividing the plurality of magnification pixels (720) into a plurality of magnification view pixels (730) that display magnification pixel images corresponding to the plurality of view images based on positional information of the plurality of magnification pixels included in the acquired optical correction map (1040) and a plurality of view areas (710, see FIG. 7B) corresponding to the plurality of view images provided through the lenticular lens (130) disposed on the optical layer (120).
[0162] In one embodiment, in the step (S300) of dividing a plurality of magnification pixels (720) into a plurality of magnification view pixels (730), at least one processor (210) executes commands or program codes of the magnification view pixel allocation module (202), and based on the positional information of the plurality of magnification pixels included in the acquired optical correction map (1040) and the plurality of view areas (710) corresponding to the plurality of view images provided through the lenticular lens (130) arranged on the optical layer (120), the plurality of magnification pixels (720) can be divided into a plurality of magnification view pixels (730) that will display magnification pixel images corresponding to the plurality of view images. Hereinafter, the operation of dividing the plurality of magnification pixels (720) into a plurality of magnification view pixels (730) that will display magnification pixel images corresponding to the plurality of view images will be described later with reference to FIGS. 11A and 11B.
[0163] In one embodiment, the operating method of the electronic device (100) may include a step of distinguishing a plurality of pixels (700) into a plurality of view pixels corresponding to a plurality of magnified view pixels (730), respectively, based on the acquired optical correction map (1040). In one embodiment, at least one processor (210) may distinguish a plurality of pixels (700) into a plurality of view pixels corresponding to a plurality of magnified view pixels (730), by executing instructions or program codes of the view pixel allocation module (203), in the step of distinguishing a plurality of pixels (700) into a plurality of view pixels. In this case, distinguishing a plurality of pixels (700) into a plurality of view pixels may also be expressed as allocating a plurality of pixels (700) into a plurality of view pixels.
[0164] In one embodiment, the operating method of the electronic device (100) may include a step (S400) of displaying a plurality of input images as images (111) on the display (110) on each of a plurality of view pixels corresponding to a plurality of enlarged view pixels (730) among a plurality of pixels (700). In one embodiment, at least one processor (210) may display a plurality of input images as images (111) on each of the plurality of view pixels by executing commands or program codes of the image rendering module (206). In one embodiment, at least one processor (210) may control the display (110) to preprocess the acquired plurality of input images or convert them into data to be displayed on the plurality of pixels, and then display them as images (111) by executing commands or program codes of the image rendering module (206).
[0165] In one embodiment, the operation of dividing a plurality of magnification pixels (720) into a plurality of magnification view pixels (730) and the operation of dividing a plurality of pixels (700) into a plurality of view pixels may be performed together in a single step. In addition, as illustrated in FIG. 8, the operation of dividing a plurality of pixels (700) into a plurality of view pixels and displaying a plurality of input images as images (111) on each of the plurality of divided view pixels may be performed in a single step.
[0166] FIG. 10A is a diagram for explaining an optical correction map including positional information of a plurality of pixels and positional information of a plurality of enlarged pixels according to one embodiment of the present disclosure. FIG. 10B is a diagram for explaining an optical correction map including positional information of a plurality of pixels and positional information of a plurality of enlarged pixels according to one embodiment of the present disclosure.
[0167] Referring to FIGS. 1, 4, 10a and 10b, in one embodiment, the optical correction map (1040) may include position information of a plurality of pixels (1000) included in an image (111) and position information of a plurality of enlarged pixels (1020) included in an enlarged image (121) corresponding to the plurality of pixels (1000).
[0168] In one embodiment, the position information of the plurality of pixels (1000) may include coordinate information of the plurality of pixels (1000). In one embodiment, the coordinate information may include coordinate information measured based on the upper left corner of each pixel (e.g., (1,1), (2,1), (1,2), ..., (1920, 1080)).
[0169] In one embodiment, the plurality of magnification pixels (1020) included in the magnified image (121) may be provided such that each of the plurality of pixels (1000) is provided through the optical layer (120). In one embodiment, depending on the shape of the optical layer (120), the area of the plurality of magnification pixels corresponding to the plurality of first pixels adjacent to the bezel area (113) among the plurality of magnification pixels (1020) may be larger than the area of the corresponding plurality of first pixels. In one embodiment, the area of each of the plurality of magnification pixels corresponding to the plurality of first pixels may be larger than the area of each of the plurality of first pixels. In one embodiment, the area of the plurality of magnification pixels corresponding to the plurality of second pixels among the plurality of magnification pixels (1020) may be the same as the area of the corresponding plurality of second pixels.
[0170] In one embodiment, the degree to which a pixel is enlarged by the optical layer (120) may increase as the pixel is closer to the bezel area (113). In one embodiment, the area of each of the plurality of pixels (1000) may be the same. In one embodiment, the area of each of the plurality of enlarged pixels (1020) may increase as the pixel is closer to the bezel area (113).
[0171] In one embodiment, the position information of the plurality of enlarged pixels (1020) may include coordinate information of the plurality of enlarged pixels (1020). In one embodiment, the coordinate information measured based on the upper left corner of each of the enlarged pixels (e.g., (x1, y1), (x2, y2), (x3, y3), ..., (x K , y L )) may be included.
[0172] In one embodiment, the optical correction map (1040) may include position information of a plurality of pixels (1000) and position information of a plurality of enlarged pixels (1020) corresponding to the plurality of pixels (1000), respectively. In one embodiment, when the resolution of the image (111) is 1920*1080, the optical correction map (1040) may include position information of 1920*1080 pixels included in the image (111) and position information of 1920*1080 enlarged pixels corresponding to the pixels, respectively. In one embodiment, the position information of the plurality of pixels may be from (1,1) to (1920, 1080). The position information of the plurality of enlarged pixels may be from (x1, y1) to (x K , y L ) may be. At this time, K may be 1920 and L may be 1080. In one embodiment, x and y may be real numbers. x and y may be determined according to the degree to which the image (111) is enlarged, such as according to the shape of the optical layer (120), the refractive index of the optical layer (120), etc. In one embodiment, as the degree to which the image (111) is enlarged increases, x and y may increase.
[0173] In one embodiment, each of the plurality of pixels (1000) may include at least one sub-pixel. In one embodiment, FIG. 10A illustrates that each pixel includes three sub-pixels. In one embodiment, the three sub-pixels may be a red pixel, a green pixel, and a blue pixel, respectively. The red pixel may emit light of a red wavelength, the green pixel may emit light of a green wavelength, and the blue pixel may emit light of a blue wavelength. Each pixel may display an image based on a combination of light emitted from the red pixel, the green pixel, and the blue pixel.
[0174] In one embodiment, the size ratio and shape of the red pixel, the green pixel, and the blue pixel within one pixel may be predetermined according to the characteristics of the display (110). In one embodiment, at least one processor (210) may calculate the center point (1010) of each of the three sub-pixels based on the position information of each of the plurality of pixels (1000) included in the acquired optical correction map (1040) and the size ratio and shape of the red pixel, the green pixel, and the blue pixel within one predetermined pixel. Hereinafter, for convenience of explanation, the three sub-pixels illustrated in FIG. 10A are described as having the same size and dividing one pixel into three equal parts in a square shape.
[0175] In one embodiment, at least one processor (210) may calculate the horizontal length and the vertical length of one pixel using coordinate information of two adjacent pixels included in the optical correction map (1040). At least one processor (210) may calculate the horizontal length and the vertical length of three sub-pixels included in one pixel based on the calculated horizontal length and the vertical length of one pixel. At least one processor (210) may calculate the first center point (1010) included in each of the sub-pixels based on the calculated horizontal length and the vertical length of each of the three sub-pixels. At this time, the first center point (1010) may be the horizontal and vertical center of the sub-pixel. In one embodiment, at least one processor (210) may store the calculated first center point (1010) of each of the sub-pixels in the optical correction map (1040).
[0176] Additionally, in one embodiment, at least one processor (210) may calculate the area of each pixel based on the calculated horizontal and vertical lengths of one pixel. At least one processor (210) may also calculate the area of each sub-pixel based on the calculated horizontal and vertical lengths of three sub-pixels. In one embodiment, at least one processor (210) may store the calculated area of each sub-pixel in the optical correction map (1040).
[0177] In one embodiment, each of the plurality of magnification pixels (1020) may also include at least one sub-magnification pixel. In one embodiment, if each of the plurality of pixels (1000) includes three sub-pixels, each of the plurality of magnification pixels (1020) may also include three sub-magnification pixels. The three sub-magnification pixels may be pixels corresponding to the three sub-pixels, respectively.
[0178] In one embodiment, three sub-magnification pixels within one magnification pixel each have the same size and can divide one magnification pixel into three equal parts in a square shape. However, the present disclosure is not limited thereto, and the size ratio and shape of the three sub-magnification pixels included in one magnification pixel may vary depending on the size ratio and shape of the three sub-pixels included in one pixel.
[0179] In one embodiment, at least one processor (210) may calculate the horizontal length and the vertical length of one magnification pixel using coordinate information of two adjacent magnification pixels included in the optical correction map (1040). At least one processor (210) may calculate the horizontal length and the vertical length of three sub-magnification pixels included in one magnification pixel based on the calculated horizontal length and the vertical length of one magnification pixel. At least one processor (210) may calculate the second center point (1030) included in each of the sub-magnification pixels based on the calculated horizontal length and the vertical length of each of the three sub-magnification pixels. At this time, the second center point (1030) may be the horizontal and vertical center of the sub-magnification pixel. In one embodiment, at least one processor (210) may store the second center point (1030) of each of the calculated sub-magnification pixels in the optical correction map (1040).
[0180] Additionally, in one embodiment, at least one processor (210) may calculate the area of each of the magnification pixels based on the calculated horizontal and vertical lengths of one magnification pixel. At least one processor (210) may also calculate the area of each of the sub-magnification pixels based on the calculated horizontal and vertical lengths of three sub-magnification pixels. In one embodiment, at least one processor (210) may store the calculated area of each of the sub-magnification pixels in the optical correction map (1040).
[0181] However, the present disclosure is not limited thereto, and the optical correction map (1040) acquired by at least one processor (210) may include at least one of position information of a plurality of pre-measured pixels (1000), position information of a plurality of pre-measured enlarged pixels (1020), an area of a plurality of pre-calculated pixels (1000), an area of a plurality of pre-calculated enlarged pixels (1020), a first center point (1010) of each of the plurality of pre-calculated pixels (1000), or a second center point (1030) of each of the plurality of pre-calculated enlarged pixels (1020).
[0182] FIG. 11A is a diagram for explaining an operation of distinguishing an enlarged view pixel and a view pixel using a lenticular lens and a plurality of enlarged pixels included in an enlarged image provided through an optical layer according to an embodiment of the present disclosure. FIG. 11B is a diagram for explaining an operation of distinguishing an enlarged view pixel using a lenticular lens and a plurality of enlarged pixels included in an enlarged image provided through an optical layer according to an embodiment of the present disclosure. Hereinafter, the same components as those described in FIGS. 4, 7A, and 7B are given the same reference numerals, and redundant descriptions are omitted.
[0183] Referring to FIGS. 1, 2, 4 and 11A, in one embodiment, FIG. 11A illustrates an image (111) displayed on a display (110), an enlarged image (121) enlarged by an optical layer (120), and a lenticular lens (130) providing the enlarged image (121).
[0184] In one embodiment, the image (111) can be enlarged by the optical layer (120) to overlap the bezel area (113) of the display (110). The enlarged image (121) can overlap the display area (112) and the bezel area (113) of the display (110).
[0185] In one embodiment, a plurality of magnification pixels (1020) included in the magnified image (121) may correspond to each of a plurality of pixels (1000) included in the image (111). In one embodiment, the magnified image (121) may include a plurality of magnification pixels (1020), each of which is a plurality of pixels (1000) included in the image (111) magnified by the optical layer (120).
[0186] However, depending on the location within the enlarged image (121), some of the plurality of enlarged pixels (1020) included in the enlarged image (121) may be provided as the corresponding plurality of pixels (1000) through the optical layer (120). In one embodiment, among the plurality of pixels (1000), a plurality of first pixels (114, see FIG. 3) adjacent to the bezel area (113) may be enlarged through the optical layer (120) and included in the enlarged image (121), and among the plurality of pixels (1000), a plurality of second pixels (115, see FIG. 3) spaced apart from the bezel area (113) may be included in the enlarged image (121) as is through the optical layer (120).
[0187] In one embodiment, the magnified image (121) may be provided to a lenticular lens (130). In one embodiment, each of the plurality of lenses included in the lenticular lens (130) may include n view areas (710). Hereinafter, for convenience of explanation, the n view areas (710) included in one lens will be used for explanation.
[0188] In one embodiment, a plurality of magnification pixels (1020) included in an enlarged image (121) may correspond to a plurality of view areas (710). In one embodiment, at least one processor (210) may determine a plurality of magnification pixels corresponding to each of a plurality of view areas (710) among the plurality of magnification pixels (1020), and may distinguish a plurality of magnification pixels that are distinguished as corresponding to the same view area as magnification view pixels.
[0189] In one embodiment, at least one processor (210) may divide the plurality of magnification pixels (1020) into a plurality of magnification view pixels corresponding to the plurality of view areas (710), respectively. In one embodiment, at least one processor (210) may divide the plurality of magnification pixels (1020) into n magnification view pixels. In one embodiment, each of the magnification view pixels may include a plurality of magnification pixels corresponding to any one of the n view areas (710) of the lenticular lens (130). In one embodiment, as the n view areas (710) included in the lenticular lens (130) are repeated according to the plurality of lenses, the divided n plurality of magnification view pixels may also be repeated.
[0190] In one embodiment, at least one processor (210) may determine a view area in which the center points of each of the magnification pixels overlap among the n view areas (710) as a view area corresponding to each of the magnification pixels. In one embodiment, the center points of each of the magnification pixels may be calculated using an optical correction map (1040) acquired by at least one processor (210). However, the present disclosure is not limited thereto, and the center points of each of the magnification pixels may be information included in the acquired optical correction map (1040).
[0191] In one embodiment, the shape, size, position information, etc. of each of the n view areas (710) may be determined by the shape, size, refractive index, number, arrangement, etc. of a plurality of lenses included in the lenticular lens (130). The shape, size, position information, etc. of each of the n view areas (710) may be measured in advance and stored in the memory (200).
[0192] In one embodiment, at least one processor (210) may use the center point of each magnification pixel calculated using the acquired optical correction map (1040) and shape, size, or position information of each of the n view areas (710) to divide the plurality of magnification pixels (1020) into n magnification view pixels.
[0193] In one embodiment, among the plurality of pixels (1000), pixels corresponding to the plurality of magnified view pixels may be classified into a plurality of view pixels. At least one processor (210) may use the acquired optical correction map (1040) to classify the pixels corresponding to the plurality of magnified view pixels among the plurality of pixels (1000) into a plurality of view pixels. In one embodiment, the plurality of view pixels may correspond to the plurality of magnified view pixels, respectively.
[0194] In one embodiment, FIG. 11A illustrates that, when a magnification pixel overlaps a first view area and a second view area among a plurality of magnification pixels (1020), the center point of the magnification pixel overlaps the second view area, and thus the magnification pixel is distinguished as an magnification view pixel overlapping the second view area. In this case, the view pixel corresponding to the magnification view pixel may also correspond to the second view area.
[0195] In one embodiment, FIG. 11A illustrates that, in the case of an enlargement pixel overlapping the third and fourth view areas among a plurality of enlargement pixels (1020), the center point of the enlargement pixel overlaps the fourth view area, and thus the enlargement pixel is distinguished as an enlargement view pixel overlapping the 24th view area. In this case, the view pixel corresponding to the enlargement view pixel may also correspond to the fourth view area.
[0196] In one embodiment, FIG. 11A illustrates that, when the center point of the magnification pixel overlaps the first view area of the next lens among a plurality of magnification pixels (1020), the magnification pixel is divided into an magnification view pixel overlapping the first view area. In this case, the view pixel corresponding to the magnification view pixel may also correspond to the first view area.
[0197] In one embodiment, at least one processor (210) may control the display (110) to display a pixel image for providing a view image corresponding to a corresponding view area to each of the plurality of view pixels. At this time, the pixel image displayed on each of the plurality of view pixels may be enlarged through the optical layer (120) and provided as an enlarged pixel image to the corresponding view area.
[0198] Referring to FIGS. 1, 4, 11a and 11b, in one embodiment, in FIG. 11b, considering that the image (111) is enlarged due to the presence of an optical layer (120), when a pixel image corresponding to each of the plurality of view pixels distinguished in FIG. 11a is displayed, an enlarged image (121) and a lenticular lens (130) according to the optical layer (120) are illustrated.
[0199] In one embodiment, when a pixel image is displayed on each of a plurality of view pixels, an enlarged pixel image enlarged according to the optical layer (120) can be provided to the lenticular lens (130).
[0200] In one embodiment, the hatched area in FIG. 11B may be an enlarged view pixel corresponding to a view pixel that is distinguished to correspond to the first view area. Compared to FIG. 7B, the enlarged view pixel corresponding to the first view area illustrated in FIG. 11B may not include an enlarged pixel that is distinguished to correspond to a view area other than the first view area. Therefore, in order to provide a view image corresponding to the first view through the first view area, a pixel image is displayed on the view pixel of the display (110), and even if the corresponding pixel image is enlarged by the optical layer (120), an enlarged pixel image in which the corresponding pixel image is enlarged is prevented from being provided to a view area other than the first view area.
[0201] In one embodiment, at least one processor (210) may divide a plurality of magnification pixels into a plurality of view pixels through the relationship between the positional information of the plurality of magnification pixels obtained using the optical correction map (1040) and the plurality of view areas included in the lenticular lens (130), and thereafter divide the plurality of pixels into a plurality of view pixels corresponding to the divided plurality of magnification pixels through the optical correction map (1040).
[0202] Through this, even if an image enlarged by the optical layer (120) is provided to the lenticular lens (130), the image can be displayed on the display (110) by considering the degree to which the image is enlarged by the optical layer (120). Therefore, by using a plurality of sub-displays included in the display (110) and the optical layer (120), a plurality of view images can be provided to the user through an all-enlarged image (121) without an area in the middle where the image is not displayed at a high resolution, and a desired view image can be provided according to the view in which the user is located, thereby improving the user's visibility.
[0203] FIG. 12 is a flowchart for explaining the operation of an electronic device for displaying an image using a plurality of converted images whose resolutions are converted using an optical compensation map according to an embodiment of the present disclosure. FIG. 13 is a diagram for explaining the operation of an electronic device for displaying an image using a plurality of converted images whose resolutions are converted using an optical compensation map according to an embodiment of the present disclosure. FIG. 14 is a flowchart for explaining the operation of determining a plurality of selected images among a plurality of converted images according to an embodiment of the present disclosure. Hereinafter, the same components as those described in FIG. 9 are given the same reference numerals and redundant descriptions are omitted.
[0204] Referring to FIGS. 1, 2, 12, and 13, in one embodiment, the operating method of the electronic device (100) may include, after the step (S200) of obtaining an optical correction map (1040, see FIG. 10b), the step (S210) of calculating an enlargement ratio between the area of the image (111) and the area of the enlarged image (121) using the obtained optical correction map (1040).
[0205] At this time, the magnification ratio may be the ratio between the area of the magnified image (121) and the area of the image (111). In one embodiment, when the area of the magnified image (121) is 1.2 times the area of the image (111), the magnification ratio may be 1.2.
[0206] In one embodiment, in the step of calculating the magnification ratio (S210), the magnification ratio may be calculated using the area of the image (111) and the area of the magnified image (121) calculated based on the positional information of the plurality of pixels (1000, see FIG. 11A) included in the optical correction map (1040) and the positional information of the plurality of magnified pixels (1020, see FIG. 11A). In one embodiment, in the step of calculating the magnification ratio (S210), the magnification ratio may also be calculated using the area of the plurality of pixels (1000) calculated using the optical correction map (1040) and the area of the plurality of magnified pixels (1020).
[0207] In one embodiment, in the step of calculating the magnification ratio (S210), at least one processor (210) can calculate the magnification ratio between the area of the image (111) and the area of the magnified image (121) using the acquired optical correction map (1040).
[0208] In one embodiment, the operating method of the electronic device (100) may include a step (S310) of converting the resolutions of a plurality of input images using the calculated magnification ratio. In one embodiment, in the step (S310) of converting the resolutions of a plurality of input images, the plurality of input images may be converted into a plurality of converted images having a high resolution using the calculated magnification ratio.
[0209] In one embodiment, when the resolution of each of the plurality of input images acquired is the first resolution, the resolution of the image (111) displayed on the display (110) may also be the first resolution. At this time, the resolution of the image (111) may refer to the resolution of the pixel image displayed on each of the plurality of view pixels. Each of the input images may be an input image corresponding to a different view, and the pixel image displayed on each of the plurality of view pixels may also be an image displayed to provide a view image in a different view. Hereinafter, for the convenience of explanation, it will be described that the resolution of the image (111) displayed on the display (110) is the first resolution.
[0210] However, the present disclosure is not limited thereto, and even if the resolution of the acquired plurality of input images is not the first resolution, the resolution of the acquired plurality of input images may be converted to display an image (111) of the first resolution on the display (110). Hereinafter, for convenience of explanation, it is described that the resolution of the acquired plurality of input images and the resolution of the image (111) displayed on the display (110) are each the first resolution.
[0211] In one embodiment, in the step (S310) of converting the resolution of a plurality of input images, the plurality of input images may be converted into a plurality of converted images using a magnification ratio so that the plurality of input images have a second resolution obtained by multiplying the magnification ratio by the first resolution. In this case, the plurality of input images may be images having a first resolution, and the plurality of converted images may be images having a second resolution.
[0212] In one embodiment, at least one processor (210) can convert a plurality of input images into a plurality of converted images by executing instructions or program codes of the image conversion module (204) so that the plurality of input images have a second resolution obtained by multiplying the first resolution by the magnification ratio using the calculated magnification ratio. At least one processor (210) can convert a plurality of input images having a first resolution into a plurality of converted images having a second resolution obtained by multiplying the first resolution by the magnification ratio by executing instructions or program codes of the image conversion module (204).
[0213] Hereinafter, the operation of converting a plurality of input images of the first resolution into a plurality of converted images of the second resolution will be described later in FIG. 15a.
[0214] In one embodiment, the operating method of the electronic device (100) may include a step (S320) of determining a plurality of selected images to be displayed on a plurality of view pixels among a plurality of transformed images using an optical correction map (1040).
[0215] In one embodiment, the plurality of transformed images have a second resolution higher than the first resolution, and a pixel image having the first resolution is displayed on each of the plurality of view pixels. Therefore, in order to display a pixel image based on the plurality of transformed images, an image to be displayed on the plurality of view pixels must be selected from among the plurality of transformed images. In one embodiment, the plurality of selected images may be images selected to be displayed on the plurality of view pixels from among the plurality of transformed images. In this case, the plurality of selected images may have the first resolution.
[0216] In one embodiment, in the step (S320) of determining a plurality of selection images, at least one processor (210) may execute instructions or program codes of the image selection module (205) to determine a plurality of selection images to be displayed on a plurality of view pixels among the plurality of transformed images using the optical correction map (1040).
[0217] Referring to FIGS. 12 and 14, in one embodiment, in the step (S320) of determining a plurality of selection images, a plurality of selection images corresponding to each of a plurality of enlarged view pixels among a plurality of transformed images can be determined based on the positional information of a plurality of enlarged pixels.
[0218] In one embodiment, the plurality of converted pixels may be pixels included in the plurality of converted images. In one embodiment, the second resolution of the plurality of converted images may refer to the number of the plurality of converted pixels included in the plurality of converted images. In one embodiment, the plurality of converted images may be images in which a plurality of input images corresponding to an area of an image (111) and having a first resolution are converted to a second resolution so as to correspond to an area of an enlarged image (121). In one embodiment, the area of each of the plurality of converted pixels and the area of each of the plurality of pixels may be the same, and the number of the plurality of converted pixels may be greater than the number of the plurality of pixels.
[0219] In one embodiment, the area of at least one magnification pixel adjacent to the bezel area (113) among the plurality of magnification pixels may be larger than the area of the corresponding at least one pixel. The number of the plurality of magnification pixels may be equal to the number of the plurality of pixels.
[0220] In one embodiment, the step (S320) of determining a plurality of selection images may include a step (S321) of determining a plurality of selection pixels corresponding to a plurality of enlarged view pixels among the plurality of conversion pixels based on positional information of the plurality of conversion pixels and positional information of the plurality of enlarged pixels.
[0221] In one embodiment, in the step (S321) of determining a plurality of selected pixels corresponding to a plurality of enlarged pixels among a plurality of converted pixels, a plurality of selected pixels corresponding to a plurality of enlarged pixels having a number of first resolutions may be determined among a plurality of converted pixels having a number of second resolutions based on the positional information of the plurality of converted pixels and the positional information of the plurality of enlarged pixels.
[0222] In one embodiment, in the step (S321) of determining a plurality of selected pixels among a plurality of conversion pixels, at least one processor (210) may execute instructions or program codes of the image selection module (205) to determine a plurality of selected pixels corresponding to a plurality of enlarged pixels among the plurality of conversion pixels based on positional information of the plurality of conversion pixels and positional information of the plurality of enlarged pixels.
[0223] In one embodiment, the step (S320) of determining a plurality of selected images may include a step (S322) of determining an image displayed in a plurality of selected pixels among the plurality of transformed images as the plurality of selected images.
[0224] In one embodiment, the plurality of selected pixels may be part of a plurality of transformed pixels included in each of the plurality of transformed images. The plurality of selected images may be part of each of the plurality of transformed images. Each of the plurality of selected images may have a first resolution, and each of the plurality of transformed images may be an image having a second resolution.
[0225] In one embodiment, in the step (S322) of determining a plurality of selected images among a plurality of converted images, at least one processor (210) may execute commands or program codes of the image selection module (205) to determine images displayed in a plurality of selected pixels among the plurality of converted images as the plurality of selected images.
[0226] Although the step (S321) of determining a plurality of selected pixels corresponding to a plurality of enlarged view pixels among a plurality of converted pixels and the step (S322) of determining a plurality of selected images that are images displayed on a plurality of selected pixels among a plurality of converted images are separately illustrated in FIG. 14, the present disclosure is not limited thereto. In one embodiment, the operation of determining a plurality of selected pixels corresponding to a plurality of enlarged view pixels among a plurality of converted pixels and the operation of determining a plurality of selected images that are images displayed on a plurality of selected pixels among a plurality of converted images may be performed in a single step.
[0227] Hereinafter, the operation of determining a plurality of selected images among a plurality of transformed images using the optical correction map (1040) will be described later with reference to FIGS. 15a to 15c.
[0228] In one embodiment, the operating method of the electronic device (100) may include a step (S410) of displaying a plurality of selected images as images (111) on each of a plurality of view pixels.
[0229] In one embodiment, in the step (S410) of displaying a plurality of selected images as images (111), at least one processor (210) may display the plurality of selected images on the plurality of view pixels, respectively, by executing commands or program codes of the image rendering module (206). The plurality of selected images displayed on the plurality of view pixels may be provided to the lenticular lens (130) as a plurality of enlarged view pixels through the optical layer (120) and provided to the user as content (131).
[0230] FIG. 15A is a diagram for explaining a magnification ratio between the area of an image and the area of an enlarged image and a plurality of converted images converted to a second resolution according to one embodiment of the present disclosure. FIG. 15B is a diagram for explaining a plurality of input images and a plurality of converted images whose resolutions have been converted using a magnification ratio according to one embodiment of the present disclosure. FIG. 15C is a diagram for explaining an operation of determining a plurality of selected pixels among a plurality of converted pixels according to one embodiment of the present disclosure.
[0231] Referring to FIGS. 1, 10B, 15A, and 15B, FIG. 15A illustrates one input image (1500) among a plurality of input images having a first resolution and one transformed image (1510) among a plurality of transformed images transformed to have a second resolution. Hereinafter, for convenience of explanation, the description will be based on one input image (1500) and one transformed image (1510), but the present disclosure is not limited thereto.
[0232] In one embodiment, the plurality of input images may include a plurality of input pixels. The first resolution may correspond to the number of the plurality of input pixels included in the plurality of input images. In one embodiment, the plurality of transformed images may include a plurality of transformed pixels. The second resolution may correspond to the number of the plurality of transformed pixels included in the plurality of transformed images.
[0233] In one embodiment, the area of the image (111) and the area of the enlarged image (121) can be calculated using the acquired optical correction map (1040). In one embodiment, the area of the image (111) and the area of the enlarged image (121) can be calculated using the positional information of each of the plurality of pixels included in the acquired optical correction map (1040) and the positional information of each of the plurality of enlarged pixels.
[0234] In one embodiment, referring to the optical correction map (1040) illustrated in FIG. 10b, it can be confirmed that the position information of the first pixel at the upper left corner among a plurality of pixels is (1, 1), and the position information of the last pixel at the lower right corner is (1920, 1080). Based on this, the area of the image (111) can be calculated to have a size of 1920 in width and 1080 in height. At this time, the unit of the width and height of the image (111) may be the size of a unit pixel, and may be calculated relatively. In one embodiment, the area of the image (111) may be a size in which 1920 pixels are arranged horizontally and 1080 pixels are arranged vertically.
[0235] In one embodiment, referring to the optical correction map (1040) illustrated in FIG. 10b, the position information of the pixel at the upper left of the first of the plurality of enlarged pixels is (x1, y1), and the position information of the pixel at the lower right of the last is (x K , y L ) can be confirmed. Based on this, the area of the enlarged image (111) is width x K -x1, vertical y L -y1 can be calculated as having a size of y1. At this time, the unit of the horizontal and vertical size of the enlarged image (111) may be the size of a unit pixel and may be calculated relatively. In one embodiment, the area of the enlarged image (121) is x horizontally. K -x1 pixels are arranged vertically, y L -y1 pixels may be arranged in a size. In one embodiment, in Fig. 15a, x K -x1 is shown as 2038, and y L -y1 is shown as 1180. However, this can be determined according to the degree to which the image (111) is enlarged depending on the shape of the optical layer (120), the refractive index of the optical layer (120), etc., and is not limited to any one.
[0236] In one embodiment, at least one processor (210) may execute instructions or program codes of the image transformation module (204) to upscale an input image (1500) having a first resolution and transform it into a transformed image (1510) having a second resolution. In one embodiment, at least one processor (210) may generate a plurality of transformed pixels from a plurality of pixels included in an input image (1500) using an interpolation algorithm to generate a transformed image (1510).
[0237] In one embodiment, the first resolution may include 1920 pixels horizontally and 1080 pixels vertically. In one embodiment, a plurality of input pixels included in one input image (1500) may have the first resolution. In this case, one input image (1500) having the first resolution may be an image corresponding to an image (111) displayed in the display area (112). The image (111) may be displayed in the display area (112) at the first resolution.
[0238] In one embodiment, the second resolution may include 2038 pixels horizontally and 1180 pixels vertically. In one embodiment, a plurality of conversion pixels included in one conversion image (1510) may have the second resolution. In this case, one conversion image (1510) having the second resolution may be an image corresponding to an enlarged image (121) provided in the display area (112) and the bezel area (113). The enlarged image (121) may be enlarged like an image having the size of the second resolution in the display area (112) and the bezel area (113) and provided with the first resolution.
[0239] Referring to FIGS. 15A and 15B, in one embodiment, a plurality of pixels (1000) included in an image (111) displayed through a display (110) may have a first resolution, and the size of the image (111) may be a first area (1520) corresponding to the first resolution.
[0240] In one embodiment, a plurality of enlarged pixels (1020) included in an enlarged image (121) provided by enlarging an image (111) by an optical layer (120) may have a first resolution, and a size of the enlarged image (121) may be a second area (1530) corresponding to a second resolution. Since an area of at least one enlarged pixel among the plurality of enlarged pixels (1020) is larger than an area of at least one corresponding pixel enlarged by the optical layer (120), the plurality of enlarged pixels (1020) arranged in the second area (1530) may have the first resolution.
[0241] In one embodiment, a plurality of conversion pixels (1540) included in a conversion image (1510) into which the input image (111) is converted may have a second resolution, and the size of the conversion image (1510) may be a second area (1530) corresponding to the second resolution. In one embodiment, the conversion image (1510) converted to the second resolution may be an image in which the entire area of the input image (111) of the first resolution is naturally converted to the second resolution through an interpolation algorithm, rather than an image in which only a specific area (e.g., an image displayed in pixels adjacent to the bezel area (113)) is enlarged like the enlarged image (121). In one embodiment, when the magnification ratio is 1.2, the conversion image (1510) may be an image converted by creating 6 conversion pixels using 5 pixels in the entire area of the input image (111) through an interpolation algorithm.
[0242] In one embodiment, at least one processor (210) may determine a selection image to be displayed on a view pixel of a display (110) among the converted images (1510) by executing instructions or program codes of an image selection module (205). However, since the selection image displayed on the view pixel is enlarged through the optical layer (120) and provided to the lenticular lens (130), at least one processor (210) may determine the selection image among the converted images (1510) by considering that the image displayed on the view pixel is enlarged through the optical layer (120).
[0243] Referring to FIGS. 15A, 15B, and 15C, in one embodiment, at least one processor (210) may execute instructions or program codes of an image selection module (205) to determine a selection pixel corresponding to a plurality of enlarged pixels (1020) among a plurality of converted pixels (1541, 1542, 1543, 1544) included in a converted image (1510).
[0244] In one embodiment, at least one processor (210) may use the optical correction map (1040) to calculate a center point (1550) of each of a plurality of enlarged pixels (1020), and determine a conversion pixel closest to the calculated center point (1550) among the center points of each of a plurality of conversion pixels (1541, 1542, 1543, 1544) as a plurality of selected pixels. In one embodiment, when a plurality of conversion pixels (1541, 1542, 1543, 1543) include a first conversion pixel (1541), a second conversion pixel (1542), a third conversion pixel (1543), and a fourth conversion pixel (1544), and each of the conversion pixels includes a center point (1560), at least one processor (210) may calculate a distance between a center point (1550) of any one of the plurality of enlargement pixels (1020) and a center point (1560) of each of the first to fourth conversion pixels (1541, 1542, 1543, 1544), and determine a first conversion pixel having a center point (1560) that is closest to the center point (1550) of the enlargement pixel (1020) as a selection pixel corresponding to the enlargement pixel (1020).
[0245] However, the present disclosure is not limited thereto, and at least one processor (210) may determine a first conversion pixel (1541) in which the center point (1550) of the enlarged pixel (1020) overlaps among a plurality of conversion pixels (1541, 1542, 1543, 1544), as a selection pixel.
[0246] In one embodiment, at least one processor (210) may determine an image displayed on a plurality of selected pixels among a converted image (1510) as a selected image by executing instructions or program codes of an image selection module (205). In one embodiment, a plurality of converted pixels included in the converted image (1510) may have a second resolution, and a plurality of selected pixels may have a first resolution. At least one processor (210) may determine an image corresponding to the determined plurality of selected pixels among the converted image (1510) as a selected image.
[0247] In one embodiment, a selection image selected from a converted image (1510) having a second resolution may have a first resolution. At least one processor (210) may control the display (110) to display the selection image on view pixels that are separated to correspond to enlarged view pixels through the view pixel allocation module (203).
[0248] In one embodiment, the enlarged image (121) provided through the optical layer (120) can be selected from the converted image (1510) of the second resolution. Accordingly, even if the selected image displayed as the image (111) in the view pixel is enlarged to a second area (1530) in a portion adjacent to the bezel area (113) by the optical layer (120), the enlarged image (121) may appear as if only an image displayed in a portion of the input image of the first resolution (e.g., an area adjacent to the bezel area (113)) is awkwardly enlarged, and the converted image (1510) of the second resolution is naturally provided by a plurality of enlarged pixels of the first resolution.
[0249] Through this, the electronic device (100) can provide the user with content (131) using an enlarged image (121) that is enlarged so that the resolution naturally increases, rather than content (131) using an enlarged image (121) in which only a portion of the image is awkwardly enlarged by the optical layer (120) so that the bezel area is not visible to the user, so that the user does not feel a sense of incongruity.
[0250] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the present disclosure.
[0251] To solve the above-described technical problem, in one embodiment of the present disclosure, an electronic device is provided. The electronic device may include a display that displays an image including a plurality of pixels. The electronic device may include an optical layer disposed on the display and configured to magnify the image to provide an enlarged image including a plurality of enlarged pixels. The electronic device may include a lenticular lens disposed on the optical layer and configured to provide a plurality of view images based on the enlarged image. The electronic device may include a memory that stores at least one instruction. The electronic device may include at least one processor that executes at least one instruction stored in the memory. The at least one processor may obtain a plurality of input images corresponding to a plurality of views, respectively. The at least one processor may obtain an optical correction map including positional information of the plurality of pixels and positional information of the plurality of enlarged pixels. The at least one processor may distinguish the plurality of enlarged pixels into a plurality of enlarged view pixels that display enlarged pixel images corresponding to the plurality of view images, based on the positional information of the plurality of enlarged pixels and a plurality of view areas included in the lenticular lens. At least one processor can display a plurality of input images as images to each of a plurality of view pixels, each of which corresponds to a plurality of enlarged view pixels among the plurality of pixels, based on the acquired optical correction map.
[0252] In one embodiment of the present disclosure, a display may include a display area where an image is displayed and a bezel area adjacent to the display area. The area of the magnified image may be larger than the area of the image. The magnified image may overlap the display area and the bezel area.
[0253] In one embodiment of the present disclosure, a display may include a plurality of sub-displays. Each of the plurality of sub-displays may include a sub-display area in which a sub-image is displayed and a sub-bezel area adjacent to the sub-display area. An optical layer may provide an enlarged image by enlarging the plurality of sub-images displayed on each of the plurality of sub-displays. The enlarged image may be provided to overlap the plurality of sub-display areas of the plurality of sub-displays and the plurality of sub-bezel areas of the plurality of sub-displays.
[0254] In one embodiment of the present disclosure, the plurality of pixels may include a plurality of first pixels adjacent to the bezel area and a plurality of second pixels spaced apart from the bezel area. The plurality of enlarged pixels may each correspond to the plurality of pixels. The area of each of the plurality of enlarged pixels corresponding to the plurality of first pixels among the plurality of enlarged pixels may be larger than the area of each of the plurality of first pixels.
[0255] In one embodiment of the present disclosure, the optical correction map may include position information of each of a plurality of pixels and position information of each of a plurality of enlarged pixels corresponding to each of the plurality of pixels enlarged by the optical layer.
[0256] In one embodiment of the present disclosure, when the resolution of an image displayed on a display is referred to as a first resolution, at least one processor can calculate a magnification ratio between an area of the image and an area of an enlarged image. The at least one processor can use the calculated magnification ratio to convert the plurality of input images into a plurality of converted images so that the plurality of input images have a second resolution that is obtained by multiplying the first resolution by the magnification ratio. The at least one processor can use an optical correction map to determine a plurality of selected images to be displayed on a plurality of view pixels among the plurality of converted images. The at least one processor can display the plurality of selected images as images on each of the plurality of view pixels.
[0257] In one embodiment of the present disclosure, at least one processor may determine a plurality of selected images corresponding to each of a plurality of enlarged view pixels among a plurality of transformed images based on positional information of a plurality of enlarged pixels. At least one processor may display the plurality of selected images as images on each of the plurality of view pixels corresponding to the plurality of enlarged view pixels.
[0258] In one embodiment of the present disclosure, at least one processor may upscale a plurality of input images having a first resolution and convert them into a plurality of converted images having a second resolution. The resolution of a plurality of selected images determined from among the plurality of converted images may be the first resolution.
[0259] In one embodiment of the present disclosure, a plurality of transformed images may include a plurality of transformed pixels. At least one processor may determine a plurality of selected pixels corresponding to a plurality of enlarged view pixels among the plurality of transformed pixels based on positional information of the plurality of transformed pixels and positional information of the plurality of enlarged pixels. At least one processor may determine images displayed on the plurality of selected pixels among the plurality of transformed images as the plurality of selected images.
[0260] In one embodiment of the present disclosure, at least one processor may determine, as the plurality of selected pixels, conversion pixels having a center point closest to a center point of each of at least one magnification pixel included in the plurality of magnification view pixels among the plurality of conversion pixels.
[0261] In order to solve the above-described technical problem, one embodiment of the present disclosure provides an operating method of an electronic device. The operating method of the electronic device may include a step of acquiring a plurality of input images, each corresponding to a plurality of views. The operating method of the electronic device may include a step of acquiring an optical correction map, which includes positional information of a plurality of pixels included in an image displayed through a display and positional information of a plurality of magnification pixels included in an enlarged image, which is an enlarged image provided through an optical layer disposed on the display. The operating method of the electronic device may include a step of dividing a plurality of magnification pixels into a plurality of magnification view pixels for displaying magnification pixel images corresponding to the plurality of view images, based on the positional information of the plurality of magnification pixels and a plurality of view regions corresponding to the plurality of view images provided through a lenticular lens disposed on the optical layer. The operating method of the electronic device may include a step of displaying a plurality of input images as images on a display, each of the plurality of view pixels corresponding to the plurality of magnification view pixels, respectively, among the plurality of pixels, based on the acquired optical correction map.
[0262] In one embodiment of the present disclosure, the resolution of an image displayed on a display may be referred to as a first resolution. An operating method of an electronic device may include a step of calculating a magnification ratio between an area of an image and an area of an enlarged image. The operating method of the electronic device may include a step of converting a plurality of input images into a plurality of converted images using the calculated magnification ratio so that the plurality of input images have a second resolution obtained by multiplying the first resolution by the magnification ratio. The operating method of the electronic device may include a step of determining a plurality of selected images to be displayed on a plurality of view pixels among the plurality of converted images using an optical compensation map. The operating method of the electronic device may include a step of displaying the plurality of selected images as images on each of the plurality of view pixels.
[0263] In one embodiment of the present disclosure, in the step of determining a plurality of selected images, a plurality of selected images corresponding to each of a plurality of enlarged view pixels among the plurality of transformed images may be determined based on positional information of a plurality of enlarged pixels. In the step of displaying a plurality of selected images as images, a plurality of selected images may be displayed as images on each of a plurality of view pixels corresponding to a plurality of enlarged view pixels.
[0264] In one embodiment of the present disclosure, in the step of converting a plurality of input images into a plurality of converted images, the plurality of input images having a first resolution may be upscaled to be converted into a plurality of converted images having a second resolution. In the step of determining a plurality of selected images among the plurality of converted images, the plurality of selected images determined may have the first resolution.
[0265] In one embodiment of the present disclosure, the plurality of transformed images may include a plurality of transformed pixels. The step of determining the plurality of selected images may include a step of determining a plurality of selected pixels corresponding to a plurality of enlarged view pixels among the plurality of transformed pixels based on positional information of the plurality of transformed pixels and positional information of the plurality of enlarged pixels. The step of determining the plurality of selected images may include a step of determining images displayed on the plurality of selected pixels among the plurality of transformed images as the plurality of selected images.
[0266] In order to solve the above-described technical problem, a computer-readable recording medium having recorded thereon a program for performing at least one method of the method of operating an electronic device disclosed in one embodiment can be provided.
[0267] The program executed by the electronic device described in this disclosure may be implemented as hardware components, software components, and / or a combination of hardware components and software components. The program may be executed by any system capable of executing computer-readable instructions.
[0268] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to do a desired thing or may independently or collectively command a processing device to do a desired thing.
[0269] Software may be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable storage media include magnetic storage media (e.g., read-only memory (ROM), random-access memory (RAM), floppy disks, hard disks, etc.) and optical readable media (e.g., CD-ROMs, DVDs (Digital Versatile Discs)). The computer-readable storage media may be distributed across network-connected computer systems, so that computer-readable code may be stored and executed in a distributed manner. The storage media may be readable by a computer, stored in a memory, and executed by a processor.
[0270] Computer-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory storage media" simply means a tangible device that does not contain signals (e.g., electromagnetic waves). This term does not distinguish between cases where data is permanently stored in the storage media and cases where data is temporarily stored. For example, a "non-transitory storage medium" may include a buffer in which data is temporarily stored.
[0271] Additionally, programs according to the embodiments disclosed herein may be provided as part of a computer program product. The computer program product may be traded as a commodity between sellers and buyers.
[0272] A computer program product may include a software program and a computer-readable storage medium storing the software program. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable application) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., the Samsung Galaxy Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a server of the electronic device manufacturer, a server of the electronic marketplace, or a storage medium of an intermediary server that temporarily stores the software program.
[0273] Although the embodiments described above have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components such as the described computer system or modules are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
Claims
1. A display (110) that displays an image including multiple pixels; An optical layer (120) disposed on the display (110) and providing an enlarged image (121) including a plurality of enlarged pixels by enlarging the image; A lenticular lens (130) disposed on the optical layer (120) and providing a plurality of view images based on the enlarged image (121); a memory storing at least one instruction; and comprising at least one processor for executing at least one instruction stored in said memory; At least one processor of the above, Obtain multiple input images corresponding to each of the multiple views, Obtaining an optical correction map including position information of the plurality of pixels and position information of the plurality of enlarged pixels, Based on the position information of the plurality of enlarged pixels and the plurality of view areas included in the lenticular lens (130), the plurality of enlarged pixels are divided into a plurality of enlarged view pixels to display enlarged pixel images corresponding to the plurality of view images, An electronic device (100) that displays the plurality of input images as images on each of the plurality of view pixels corresponding to the plurality of enlarged view pixels among the plurality of pixels, based on the acquired optical correction map.
2. In paragraph 1, The above display (110) includes a display area (112) where the image is displayed and a bezel area (113) adjacent to the display area (112). The area of the above enlarged image (121) is larger than the area of the above image, The above enlarged image (121) is provided so as to overlap with the display area (112) and the bezel area (113) of the electronic device (100).
3. In either of the first or second paragraphs, The above display (110) includes a plurality of sub-displays, Each of the above plurality of sub-displays includes a sub-display area in which a sub-image is displayed and a sub-bezel area adjacent to the sub-display area, The above optical layer (120) provides the enlarged image (121) by enlarging the plurality of sub-images displayed on each of the plurality of sub-displays. The above enlarged image (121) is provided as an electronic device (100) so as to overlap with a plurality of sub-display areas of the plurality of sub-displays and a plurality of sub-bezel areas of the plurality of sub-displays.
4. In either of the second or third paragraphs, The plurality of pixels include a plurality of first pixels adjacent to the bezel area and a plurality of second pixels spaced apart from the bezel area, The above plurality of enlarged pixels each correspond to the above plurality of pixels, An electronic device (100) in which the area of each of the plurality of enlarged pixels corresponding to the plurality of first pixels among the plurality of enlarged pixels is larger than the area of each of the plurality of first pixels.
5. In any one of clauses 1 to 4, An electronic device (100) wherein the optical correction map includes the position information of each of the plurality of pixels and the position information of each of the plurality of enlarged pixels corresponding to each of the plurality of pixels enlarged by the optical layer.
6. In any one of clauses 1 to 5, When the resolution of the image displayed on the above display (110) is referred to as the first resolution, At least one processor of the above, Calculate the magnification ratio between the area of the above image and the area of the above enlarged image, Using the calculated magnification ratio, the plurality of input images are converted into a plurality of converted images so that the plurality of input images have a second resolution that is the first resolution multiplied by the magnification ratio, Using the optical correction map, a plurality of selected images to be displayed on the plurality of view pixels among the plurality of transformed images are determined, An electronic device (100) that displays the plurality of selected images as images on each of the plurality of view pixels.
7. In paragraph 6, At least one processor of the above, Based on the position information of the plurality of enlarged pixels, the plurality of selected images corresponding to each of the plurality of enlarged view pixels among the plurality of transformed images are determined, An electronic device (100) that displays the plurality of selected images as images on each of the plurality of view pixels corresponding to the plurality of enlarged view pixels.
8. In either of paragraphs 6 or 7, At least one processor of the above, Upscaling the plurality of input images having the first resolution and converting them into the plurality of converted images having the second resolution, An electronic device (100) wherein the resolution of the plurality of selected images determined from among the plurality of converted images is the first resolution.
9. In any one of paragraphs 6 to 8, The above plurality of transformed images include a plurality of transformed pixels, At least one processor of the above, Based on the position information of the plurality of conversion pixels and the position information of the plurality of enlarged pixels, a plurality of selected pixels corresponding to the plurality of enlarged view pixels among the plurality of conversion pixels are determined, An electronic device (100) that determines an image displayed on the plurality of selected pixels among the plurality of converted images as the plurality of selected images.
10. In paragraph 9, At least one processor of the above, An electronic device (100) that determines conversion pixels having a center point closest to a center point of at least one enlargement pixel included in the plurality of enlarged view pixels among the plurality of conversion pixels as the plurality of selected pixels.
11. In the operating method of an electronic device (100), Step (S100) of obtaining multiple input images each corresponding to multiple views; A step (S200) of obtaining an optical correction map including position information of a plurality of pixels included in an image displayed through a display (110) and position information of a plurality of enlarged pixels included in an enlarged image of the image provided through an optical layer (120) arranged on the display (110); A step (S300) of dividing the plurality of enlarged pixels into a plurality of enlarged view pixels to display enlarged pixel images corresponding to the plurality of view images based on the positional information of the plurality of enlarged pixels and the plurality of view areas corresponding to the plurality of view images provided through the lenticular lens (130) arranged on the optical layer (120); and An operating method (S400) of an electronic device, comprising the step of displaying the plurality of input images as images on the display (110) on each of the plurality of view pixels corresponding to the plurality of enlarged view pixels among the plurality of pixels, based on the acquired optical correction map.
12. In paragraph 11, The above display (110) includes a display area (112) where the image is displayed and a bezel area (113) adjacent to the display area (112). The area of the above enlarged image is larger than the area of the above image, The above enlarged image is provided as an electronic device (100) so as to overlap with the display area (112) and the bezel area.
13. In either of paragraphs 11 or 12, The above display (110) includes a plurality of sub-displays, Each of the above plurality of sub-displays includes a sub-display area in which a sub-image is displayed and a sub-bezel area adjacent to the sub-display area, The above optical layer (120) provides the enlarged image by enlarging the plurality of sub-images displayed on each of the plurality of sub-displays. The above enlarged image (121) is provided so as to overlap with a plurality of sub-display areas of the plurality of sub-displays and a plurality of sub-bezel areas of the plurality of sub-displays. The method of operating the electronic device (100).
14. In either of paragraphs 12 or 13, The plurality of pixels include a plurality of first pixels adjacent to the bezel area and a plurality of second pixels spaced apart from the bezel area, The above plurality of enlarged pixels each correspond to the above plurality of pixels, An operating method of an electronic device (100), wherein the area of each of the plurality of enlarged pixels corresponding to the plurality of first pixels among the plurality of enlarged pixels is larger than the area of each of the plurality of first pixels.
15. A computer-readable recording medium having recorded thereon a program for performing the method described in any one of claims 11 to 14 on a computer.
Citation Information
Patent Citations
Video display device and video display system
JP2014092720A
Large size display device of tiled method
KR1020060072737A
Stereoscopic image display device
KR1020140082512A
Apparatus for Video Wall Display
KR1020180045527A
Seamless display with tapered fused fiber bundle overlay
US9274369B1