Electronic device and method for displaying visual content

Abstract

An electronic device and method for displaying content are provided. A method by which the electronic device displays visual content comprises the operations of: identifying (201) configuration information related to a rendering dimension configured for first visual content; identifying (203), on the basis of the configuration information, a first display area corresponding to a first rendering dimension among display areas of the first visual content; and displaying (205) a first rendering image of the first rendering dimension of the first visual content together with a second rendering image of a second rendering dimension of the first visual content such that the first rendering image is displayed in the first display area and the second rendering image is displayed in a second display area.

Description

Electronic device and method for displaying visual content

[0001] The present disclosure relates to an electronic device and method for displaying visual content.

[0002] With the development of various three-dimensional (3D) display technologies, content in various fields, including movies, games, and education, is being developed. Along with this, applications for producing such content are becoming widespread.

[0003] Generally, 3D images are created based on the principle of stereoscopic vision through the human eyes, and binocular parallax, which arises from the distance between the two eyes, is an important factor in the sense of depth. Technologies for displaying 3D images include 3D image display technology using glasses and 3D image display technology without glasses. Glasses-free 3D image display technology can provide 3D images to the user without the use of glasses and can obtain 3D images by separating the left eye image and the right eye image.

[0004] In addition, among glasses-free methods, a multiview method based on a directional backlight is being developed. This multiview method based on a directional backlight forms directional light through a diffraction grating structure formed on the surface of the light guiding plate (LGP) of the backlight unit, and can provide a 3D image by implementing low cross-talk.

[0005] However, 3D images have lower resolution than 2D images, and in providing visual content, technology is required to effectively provide 2D images and 3D images.

[0006] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0007] According to one embodiment, a display structure comprising a display panel (156), a polarizing layer (155), a lens layer (153), and a touch panel (151); a control circuit (154) for controlling the refractive indices of a plurality of regions of the lens layer; and a memory (1530) for storing commands; An electronic device for displaying visual content may be provided, comprising: and at least one processor (1520); wherein, when the instructions are executed by the at least one processor, the electronic device is configured to: identify (201) setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; and based on the setting information, identify (203) a first display area corresponding to the first rendering dimension and a second display area corresponding to the second rendering dimension among the display areas where the first visual content is to be displayed, wherein the first rendering dimension and the second rendering dimension are different; and by controlling the control circuit, the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area, thereby adjusting (205) the refractive index of the lens layer.

[0008] According to one embodiment, an electronic device may provide a method for displaying visual content, comprising: an operation (201) of identifying setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; an operation (203) of identifying a first display area corresponding to the first rendering dimension among the display areas of the first visual content based on the setting information, wherein the first rendering dimension is different from the second rendering dimension; and an operation (205) of displaying the first rendering image and the second rendering image together so that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area.

[0009] According to one embodiment, a computer-readable recording medium may be provided that records a program for executing a method on a computer, comprising: identifying setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; identifying a first display area corresponding to the first rendering dimension among the display areas of the first visual content based on the setting information, wherein the first rendering dimension is different from the second rendering dimension; and displaying the first rendering image and the second rendering image together such that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area.

[0010] According to one embodiment, an electronic device for displaying visual content may be provided, comprising: a display (1560); a memory (1530) for storing instructions; and one or more processors (1520), wherein when the instructions are executed by the one or more processors, the electronic device: sets a rendering dimension related to the visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; receives a user input for displaying the first visual content, and upon receiving the user input, displays a first rendering image of the first visual content based on the first rendering dimension set for the first visual content, receives a user input for selecting a part area of ​​the first rendering image, and generates a second rendering image of the first visual content corresponding to the part area, wherein the second rendering image has a second rendering dimension different from the first rendering dimension, and replaces the part area of ​​the first rendering image with the second rendering image.

[0011] According to one embodiment, a method for an electronic device to display visual content may be provided, comprising: an operation of setting a rendering dimension related to visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; an operation of receiving a user input for displaying a first visual content; an operation of displaying a first rendering image of the first visual content based on the first rendering dimension set for the first visual content upon receiving the user input; an operation of receiving a user input for selecting a part area of ​​the first rendering image; an operation of generating a second rendering image of the first visual content corresponding to the part area, wherein the second rendering image has a second rendering dimension different from the first rendering dimension; and an operation of replacing the part area of ​​the first rendering image with the second rendering image.

[0012] According to one embodiment, a computer-readable recording medium may be provided that records a program for executing a method on a computer, comprising: an operation of setting a rendering dimension related to visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; an operation of receiving a user input for displaying a first visual content; an operation of displaying a first rendering image of the first visual content based on the first rendering dimension set for the first visual content upon receiving the user input; an operation of receiving a user input for selecting a part area of ​​the first rendering image; an operation of generating a second rendering image of the first visual content corresponding to the part area, wherein the second rendering image has a second rendering dimension different from the first rendering dimension; and an operation of replacing the part area of ​​the first rendering image with the second rendering image.

[0013] Other aspects, advantages, and prominent features of the present disclosure will become apparent to those skilled in the art from the following detailed description, which is referenced together with the accompanying drawings. Various embodiments of the present disclosure are disclosed in this detailed description.

[0014] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following description, which is referenced together with the accompanying drawings.

[0015] FIG. 1 is a diagram showing an overview of an electronic device according to one embodiment that displays visual content by replacing a portion of a rendered image of visual content with a rendered image of another rendering dimension.

[0016] FIG. 2a is a flowchart of a method in which an electronic device according to one embodiment displays different rendering images of visual content.

[0017] FIG. 2b is a flowchart of a method in which an electronic device according to one embodiment replaces a portion of a rendered image of visual content with a rendered image of a different rendering dimension.

[0018] FIG. 3 is a flowchart of a method for an electronic device according to one embodiment to set rendering dimensions for visual content.

[0019] FIG. 4a is a drawing showing an example of a setting icon for setting the rendering dimension of visual content according to one embodiment.

[0020] FIG. 4b is a diagram showing an example of setting a three-dimensional rendering dimension for visual content through a menu for setting the rendering dimension of visual content according to one embodiment.

[0021] FIG. 4c is a diagram showing an example of setting a two-dimensional rendering dimension for visual content through a menu for setting the rendering dimension of visual content according to one embodiment.

[0022] FIG. 5 is a flowchart of a method for an electronic device to select a portion of a rendered image according to one embodiment.

[0023] FIG. 6a is a diagram showing an example of user input selecting a portion of a first rendering image according to one embodiment.

[0024] FIG. 6b is a diagram showing an example of a gesture input for selecting a portion of a first rendering image according to one embodiment.

[0025] FIG. 6c is a drawing showing an example of a drag input for selecting a portion of a first rendering image according to one embodiment.

[0026] FIG. 6d is a diagram showing an example of user input selecting a visual object within a first rendering image as a partial area according to one embodiment.

[0027] FIG. 6e is a diagram showing an example of user input selecting a portion of a first rendering image according to one embodiment.

[0028] FIG. 7 is a flowchart of a method for an electronic device according to one embodiment to display rendering images of different dimensions based on settings related to rendering dimensions.

[0029] FIG. 8 is a diagram illustrating an example in which an electronic device according to one embodiment displays rendering images of different dimensions based on a setting value regarding the rendering dimension.

[0030] FIG. 9 is a flowchart of a method in which an electronic device according to one embodiment changes the rendering dimension of another visual content based on user input for visual content.

[0031] FIG. 10 is a diagram illustrating an example in which an electronic device according to one embodiment changes the rendering dimensions of another visual content based on user input for visual content.

[0032] FIG. 11 is a flowchart of a method in which an electronic device according to one embodiment stores information related to a rendering image and changes the dimensions of a rendering image displayed using the stored rendering image.

[0033] FIG. 12 is a drawing showing an example of information related to a rendering image of visual content according to one embodiment.

[0034] FIG. 13a is a drawing showing an example of an electronic device according to one embodiment controlling the brightness of the boundary between a first rendering image and a second rendering image.

[0035] FIG. 13b is a drawing showing an example of an electronic device according to one embodiment controlling the brightness of a first rendering image and a second rendering image.

[0036] FIG. 14a is a drawing showing a display structure providing a two-dimensional display and a three-dimensional display according to one embodiment.

[0037] FIG. 14b is a drawing showing a display structure providing a two-dimensional display and a three-dimensional display according to one embodiment.

[0038] FIG. 15 is a block diagram of an electronic device (1501) in a network environment (1500) according to various embodiments.

[0039] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

[0040] Embodiments of the present disclosure are described below in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0041] The terms used in this disclosure are described in their current, general form considering the functions mentioned herein; however, they may refer to various other terms depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Accordingly, the terms used in this disclosure should not be interpreted solely by their names, but should be interpreted based on the meaning of the terms and the overall content of this disclosure.

[0042] Additionally, terms such as "first," "second," etc., may be used to describe various components, but the components should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another.

[0043] Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components interposed between them. Furthermore, when a part is described as "including" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0044] Phrases such as "in one embodiment" appearing in various places in this disclosure do not necessarily refer to the same embodiment.

[0045] One embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a specific function. Additionally, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as algorithms executed on one or more processors. Furthermore, the present disclosure may employ prior art for electronic configuration, signal processing, and / or data processing, etc. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.

[0046] Furthermore, the connecting lines or connecting members between the components depicted in the drawings are merely illustrative of functional connections and / or physical or circuit connections. In the actual device, connections between components may be represented by various alternative or added functional connections, physical connections, or circuit connections.

[0047] In this document, visual content may be content that an electronic device can visually display through a display. For example, visual content may be content that includes at least one of video, images, photographs, or text. For example, the types of visual content may include, but are not limited to, at least one of video content, still image content, text content, or web content.

[0048] In addition, a rendered image of visual content may be the result of visual content being rendered by an electronic device, and may refer to an image in which the visual content is rendered and displayed on the display of the electronic device. Furthermore, for example, generating a rendered image of visual content may mean that the visual content is rendered and displayed on the display.

[0049] Additionally, the rendering dimension of the rendered image may be the dimension of the rendered image that is rendered and displayed on the display of an electronic device. For example, the rendering dimension may include 2D (2-dimension) rendering dimensions and 3D (3-dimension) rendering dimensions. For example, a 2D rendered image may be displayed on the display as visual content is rendered in 2D, and a 3D rendered image may be displayed on the display as visual content is rendered in 3D.

[0050] Additionally, a visual object may be an object contained within a rendered image displayed on the display of an electronic device. The types of visual objects may include, for example, text objects, object objects, and person objects, but are not limited thereto.

[0051] It should be understood that the blocks of each flowchart and combinations of flowcharts may be executed by one or more computer programs containing instructions. The entirety of one or more computer programs may be stored in a single memory device, or one or more computer programs may be divided so that their respective parts are stored in multiple different memory devices.

[0052] Any of the functions or operations described herein may be processed by a single processor or a combination of processors. The single processor or combination of processors is a circuit that performs processing and includes an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural network processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a Global Positioning System (GPS) chip, a Near Field Communication (NFC) chip, a connectivity chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec (CODEC) chip, a USB controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system-on-chip (SoC), an IC, or similar components.

[0053] The present disclosure will be described in detail below with reference to the attached drawings.

[0054] FIG. 1 is a diagram showing an overview of an electronic device according to one embodiment that displays visual content by replacing a portion of a rendered image of visual content with a rendered image of another rendering dimension.

[0055] Referring to FIG. 1, an electronic device (1000) according to one embodiment may replace a portion of a rendered image of visual content with a rendered image having a different rendering dimension based on user input received while displaying a rendered image of visual content. An electronic device (1000) according to one embodiment may display a portion of visual content as a rendered image of a first rendering dimension and display another portion of visual content as a rendered image of a second rendering dimension based on user input. Additionally, according to one embodiment, an electronic device (1000) may display a portion of visual content as a rendered image of a first rendering dimension and display another portion of visual content as a rendered image of a second rendering dimension based on a preset value in relation to the rendering dimension.

[0056] Referring to identification number 11 of FIG. 1, an electronic device (1000) according to one embodiment can display visual content. For example, the electronic device (1000) can display visual content on the display of the electronic device (1000) by displaying a first rendering image (15) of two dimensions. Additionally, according to one embodiment, the electronic device (1000) can receive user input (16) for selecting a portion of the first rendering image (15) of the visual content.

[0057] Referring to identification number 12 of FIG. 1, an electronic device (1000) according to one embodiment may select a portion area (17) in a first rendering image (15) of visual content based on user input (16) and replace the portion area (17) of the first rendering image (15) with a second rendering image (17-1) in three dimensions. For example, the electronic device (1000) may merge the first rendering image (15-1) from which the portion area (17) has been removed with the second rendering image (17-1) for the portion area (17).

[0058] According to one embodiment, the electronic device (1000) can effectively switch between and provide a two-dimensional rendering image and a three-dimensional rendering image for areas of the display screen when displaying visual content. In addition, the electronic device (1000) can provide the visual content in three dimensions, while also providing high-resolution images for areas requiring detailed identification.

[0059] An electronic device (1000) according to one embodiment may be a smartphone, tablet PC, PC, smart TV, mobile phone, PDA (personal digital assistant), laptop, media player, micro server, GPS (global positioning system) device, e-book terminal, digital broadcasting terminal, navigation, kiosk, MP3 player, digital camera, home appliance, and other mobile or non-mobile computing devices, but is not limited thereto. Additionally, the electronic device (1000) may be a wearable device such as a watch and glasses equipped with communication functions and data processing functions. However, it is not limited thereto, and the electronic device (1000) may include all types of devices capable of displaying visual content.

[0060] FIG. 2a is a flowchart of a method for an electronic device according to one embodiment to display different rendering images of visual content.

[0061] In operation 201, the electronic device (1000) can identify setting information regarding the rendering dimension set for the visual content. The electronic device (1000) can obtain setting information regarding the rendering dimension set for the visual content from memory as user input for executing the visual content is received. For example, as user input for executing an application for displaying the visual content is received, or as user input for selecting the visual content to display the visual content is received, the electronic device (1000) can extract setting information regarding the rendering dimension set for the visual content from memory.

[0062] According to one embodiment, setting information regarding a rendering dimension set for visual content may include information regarding areas where a rendered image is to be displayed in a first rendering dimension and / or a second rendering dimension among the display areas where the visual content is displayed on the screen of the electronic device (1000). For example, the setting information may include information regarding a first display area corresponding to the first rendering dimension and a second display area corresponding to the second rendering dimension among the display areas where the visual content is displayed on the screen of the electronic device (1000). According to one embodiment, the first rendering dimension and the second rendering dimension may be different rendering dimensions. For example, the first rendering dimension may be a 2D rendering dimension and the second rendering dimension may be a 3D rendering dimension. Or, for example, the first rendering dimension may be a 3D rendering dimension and the second rendering dimension may be a 2D rendering dimension.

[0063] According to one embodiment, the setting information may include information regarding rendering dimensions set for visual content according to the type of visual content. For example, the type of visual content may include at least one of video content, still image content, text content, or web content, but is not limited thereto. Additionally, the rendering dimensions may include, for example, 2D (2-dimension) rendering dimensions and 3D (3-dimension) rendering dimensions.

[0064] According to one embodiment, the setting information may include information regarding the set rendering dimensions for a visual object for each type of visual object included in the visual content. The types of visual objects may include, for example, text objects, object objects, and person objects, but are not limited thereto.

[0065] According to one embodiment, the electronic device (1000) may include information regarding rendering dimensions set for an application, for each type of application displaying visual content or for each application. The types of applications may include, for example, video playback applications, gallery applications, video conferencing applications, and messaging applications, but are not limited thereto. Additionally, for example, the execution screen of a keyboard application, the execution screen of a video search application, the execution screen of a web browser application, the execution screen of a chat application, and the execution screen of a calculator application, a two-dimensional rendering image may be set to be displayed, but is not limited thereto.

[0066] In operation 203, the electronic device (1000) can identify a first display area and a second display area among the display areas of the visual content. The electronic device (1000) can identify a first display area corresponding to a first rendering dimension among the display areas of the visual content based on setting information. Additionally, the electronic device (1000) can identify a second display area corresponding to a second rendering dimension among the display areas of the visual content based on setting information. For example, the first display area may be a part of the display area of ​​the visual content, and the second display area may be the remaining area among the display areas of the visual content, but is not limited thereto. Additionally, for example, if the visual content is video content of a movie, the area containing subtitles may be a second display area having a 2D rendering dimension, and the area excluding subtitles may be a first display area having a 3D rendering dimension.

[0067] In operation 205, the electronic device (1000) can display a rendering image of a first rendering dimension in a first display area and display another rendering image of a second rendering dimension in a second display area. The electronic device (1000) can display the rendering image of the first rendering dimension and another rendering image of the second rendering dimension together.

[0068] According to one embodiment, the electronic device (1000) can merge a rendering image of a first rendering dimension to be displayed in a first display area with a rendering image of a second rendering dimension to be displayed in a second display area. Additionally, the electronic device (1000) can display the merged rendering image on the display of the electronic device (1000).

[0069] For example, if a person's face is identified as a second display area and the remaining area is identified as a first display area, the electronic device (1000) can merge a three-dimensional rendering image including the person's face with a two-dimensional rendering image of the area excluding the person's face.

[0070] For example, an electronic device (1000) can identify the coordinates of a first display area to be rendered to a first rendering dimension and the coordinates of a second display area to be rendered to a second rendering dimension in order to render visual content. Additionally, based on the identified coordinates, the electronic device (1000) can render a portion of the visual content corresponding to the first display area to the first rendering dimension and render a portion of the visual content corresponding to the second display area to the second rendering dimension. Accordingly, the electronic device (1000) can display the rendered image of the first rendering dimension and the rendered image of the second rendering dimension together. In this case, the electronic device (1000) can correct at least one of the image quality, color, or brightness of the rendered image of the first rendering dimension and the rendered image of the second rendering dimension.

[0071] FIG. 2b is a flowchart of a method in which an electronic device according to one embodiment replaces a portion of a rendered image of visual content with a rendered image of a different rendering dimension.

[0072] In operation 210, an electronic device (1000) according to one embodiment can set rendering dimensions related to visual content. The electronic device (1000) can set rendering dimensions of a rendered image of visual content.

[0073] According to one embodiment, the electronic device (1000) may set a rendering dimension for the visual content according to the type of visual content. For example, the type of visual content may include at least one of video content, still image content, text content, or web content, but is not limited thereto. Additionally, the rendering dimension may include, for example, a 2D (2-dimension) rendering dimension and a 3D (3-dimension) rendering dimension. When a rendering dimension for the visual content is set according to one embodiment, the electronic device (1000) may display a rendering image of the set rendering dimension on the screen of the electronic device (1000) when displaying a rendering image of the visual content.

[0074] According to one embodiment, the electronic device (1000) may set a rendering dimension for a visual object according to the type of visual object included in the visual content. The types of visual objects may include, for example, text objects, object objects, and person objects, but are not limited thereto. When a rendering dimension for a visual object is set according to one embodiment, when the electronic device (1000) displays a rendering image of the visual content including the visual object, the electronic device (1000) may display a rendering image of the set rendering dimension for the visual object on the screen of the electronic device (1000).

[0075] According to one embodiment, the electronic device (1000) may set a rendering dimension for an application by type of application displaying visual content or by application. The types of applications may include, for example, a video playback application, a gallery application, a video conferencing application, and a message application, but are not limited thereto. Additionally, for, for example, the execution screen of a keyboard application, the execution screen of a video search application, the execution screen of a web browser application, the execution screen of a chat application, and the execution screen of a calculator application, a two-dimensional rendering image may be set to be displayed, but is not limited thereto. When a rendering dimension for an application is set according to one embodiment, the electronic device (1000) may display a rendering image of the set rendering dimension on the screen of the electronic device (1000) when displaying visual content through the application.

[0076] According to one embodiment, the electronic device (1000) displays a graphical user interface (GUI) for setting rendering dimensions related to visual content, and can set rendering dimensions related to visual content based on user input to the GUI.

[0077] Additionally, for example, the electronic device (1000) may add software code that allows for partial processing of 2D rendering and 3D rendering for the visual content in a file that defines the screen of the visual content based on the rendering dimensions set for the visual content.

[0078] According to one embodiment, an object to be displayed as a rendering image having two-dimensional rendering dimensions may be managed as a separate blacklist. For example, an execution screen of an application providing keyboard functions may be managed as an object to be displayed as a rendering image having two-dimensional rendering dimensions. Additionally, for example, an execution screen of a text input-based application, such as a chat application, a note application, and a calculator application, may be managed as an object to be displayed as a rendering image having two-dimensional rendering dimensions. Additionally, for example, a search bar within a screen providing a search service may be managed as an object to be displayed as a rendering image having two-dimensional rendering dimensions.

[0079] Additionally, for example, the electronic device (1000) can manage the subtitle portion of the video content as an object to be displayed as a rendering image having a two-dimensional rendering dimension by using an algorithm that recognizes text within the visual content.

[0080] A method for setting rendering dimensions related to visual content by an electronic device (1000) according to one embodiment will be described in more detail in FIGS. 3 and FIGS. 4, which will be described later.

[0081] In operation 220, an electronic device (1000) according to one embodiment may display a first rendering image of a first visual content. An electronic device (1000) according to one embodiment may receive user input for displaying the first visual content and, in response to the received user input, display a first rendering image of the first visual content. The first rendering image may be a rendering image having a first rendering dimension. The first rendering dimension may include two dimensions or three dimensions.

[0082] According to one embodiment, the electronic device (1000) may identify a rendering dimension set for a first visual content and display a first rendering image of the identified rendering dimension. According to one embodiment, the electronic device (1000) may identify a rendering dimension set for an application that displays the first visual content and display a first rendering image of the identified rendering dimension. According to one embodiment, the electronic device (1000) may display a first rendering image of the first visual content, but for a specific visual object within the first visual content, display a rendering image of a rendering dimension separately set for the specific visual object.

[0083] For example, if the first visual content is a photographic image and the rendering dimension for the photographic image is set to two dimensions, the electronic device (1000) can generate and display a first rendering image having two dimensions based on the data of the photographic image.

[0084] In operation 230, an electronic device (1000) according to one embodiment may select a portion of a first rendering image. The electronic device (1000) receives a user input for selecting a portion of a first rendering image and may select a portion of a first rendering image based on the received user input. In this case, the user input for selecting a portion of a first rendering image may include a user input for changing the rendering dimension of a portion of a first rendering image.

[0085] For example, a user input for selecting a portion of a first rendered image may include a user's touch input. For example, a user input for selecting a portion of a first rendered image may include a user input for dragging to select a portion of a portion of the first rendered image. For example, a user input for selecting a portion of a first rendered image may include a user input for touching a specific visual object within the first rendered image.

[0086] For example, a user input selecting a portion of a first rendering image may include a user gesture input. For example, a user input selecting a portion of a first rendering image may include a gesture input in which the user's hand is moved in a specific shape at a location close to a portion of the first rendering image. In this case, the user gesture input may be captured by a camera (not shown) of the electronic device (1000) and identified by the electronic device (1000).

[0087] For example, a user input selecting a portion of a first rendering image may include a user's gaze input. For example, a user input selecting a portion of a first rendering image may include a user input gazing at a portion of a first rendering image for a specified amount of time. For example, a user input selecting a portion of a first rendering image may include a user input gazing at a specific visual object within the first rendering image for a specified amount of time. In this case, the user's gaze input may be captured by a camera (not shown) of the electronic device (1000) and identified by the electronic device (1000).

[0088] For example, if the first rendering image of the first visual content includes a human face, the electronic device (1000) can receive user input selecting the human face as a part area.

[0089] User input for selecting a portion of a first rendering image of visual content according to one embodiment will be described in more detail in FIGS. 5 and 6, which will be described later.

[0090] In operation 240, an electronic device (1000) according to one embodiment may obtain a second rendering image corresponding to a portion of a first rendering image. The electronic device (1000) may generate a second rendering image corresponding to a portion of a first rendering image of visual content having a second rendering dimension different from the first rendering dimension. The electronic device (1000) may identify the first rendering dimension of the first rendering image and, based on image data corresponding to a portion of a first rendering image of visual content, generate a second rendering image having a second rendering dimension different from the first rendering dimension.

[0091] For example, if a person's face is selected as a part of a region within a first rendering image of two dimensions, the electronic device (1000) can generate a second rendering image of the selected person's face based on image data of the selected person's face so that the second rendering image of the selected person's face has three dimensions rather than two dimensions.

[0092] In operation 250, an electronic device (1000) according to one embodiment may replace a portion of a first rendering image with a second rendering image. The electronic device (1000) may remove a portion of a portion from the first rendering image. Additionally, the electronic device (1000) may display the first rendering image with the portion removed, along with a second rendering image corresponding to the removed portion, on the display of the electronic device (1000).

[0093] According to one embodiment, the electronic device (1000) can merge a first rendering image, in which some areas have been removed, with a second rendering image corresponding to the removed areas. Additionally, the electronic device (1000) can display the merged rendering image on the display of the electronic device (1000).

[0094] For example, if a human face is selected as a part of the area within a first rendering image in two dimensions, the electronic device (1000) can merge the first rendering image in two dimensions from which the human face has been removed with a second rendering image in three dimensions for the human face.

[0095] For example, an electronic device (1000) can identify the coordinates of an area to be rendered in a first rendering dimension and the coordinates of an area to be rendered in a second rendering dimension in order to render visual content. Additionally, based on the identified coordinates, the electronic device (1000) can render a portion of the visual content corresponding to the area to be rendered in the first rendering dimension in the first rendering dimension, and render a portion of the visual content corresponding to the area to be rendered in the second rendering dimension in the second rendering dimension. Accordingly, the electronic device (1000) can display a first rendering image in the first rendering dimension and a second rendering image in the second rendering dimension together. In this case, the electronic device (1000) can correct at least one of the image quality, color, or brightness of the first rendering image and the second rendering image.

[0096] According to one embodiment, the electronic device (1000) can display parts of visual content and other parts of visual content at different rendering dimensions, and can improve the three-dimensionality and visibility of the displayed visual content. Additionally, the electronic device (1000) can flexibly adjust the rendering dimensions for parts of visual content and / or other parts of visual content based on the settings for the rendering dimensions and / or user input received in real time, and can reduce eye strain for the user viewing the visual content.

[0097] Additionally, although FIG. 2b describes that a portion of the first rendering image of the first visual content is replaced with a second rendering image, it is not limited thereto. For example, while the first visual content is displayed through the first rendering image and another rendering image of a different rendering dimension, a selected portion of the first rendering image may be replaced with a second rendering image based on user input selecting a portion of the first rendering image.

[0098] FIG. 3 is a flowchart of a method for an electronic device according to one embodiment to set rendering dimensions for visual content.

[0099] Operations 310 to 330 of FIG. 3 may correspond to operation 210 of FIG. 2.

[0100] In operation 310, an electronic device (1000) according to one embodiment may display an object for setting a rendering dimension on the display of the electronic device (1000). For example, the electronic device (1000) may display an icon for setting a rendering dimension of visual content. For example, the electronic device (1000) may display an icon for setting a rendering dimension of visual content within a tray displayed at the top of the display, but is not limited thereto.

[0101] In operation 320, an electronic device (1000) according to one embodiment may display a menu for setting rendering dimensions based on user input for an object. For example, when an icon for setting rendering dimensions of visual content is selected, the electronic device (1000) may display a menu for setting rendering dimensions.

[0102] For example, a menu for setting rendering dimensions may include, but is not limited to, buttons for selecting rendering dimensions, items indicating the type of visual content, items indicating the type of visual object, and items indicating the type of application.

[0103] In operation 330, an electronic device (1000) according to one embodiment can set rendering dimensions for visual content based on an item selected from a menu. According to one embodiment, the electronic device (1000) can set rendering dimensions for visual content based on user input to a menu.

[0104] For example, by receiving user input to select one of the buttons for selecting a rendering dimension, and then selecting at least one of the items representing the type of visual content, the items representing the type of visual object, and the items representing the type of application, the electronic device (1000) can select items of visual content for displaying a rendering image of the selected rendering dimension.

[0105] An example of an electronic device (1000) according to one embodiment setting rendering dimensions based on user input will be described in more detail in FIG. 4, which will be described later.

[0106] FIG. 4a is a drawing showing an example of a setting icon for setting the rendering dimension of visual content according to one embodiment.

[0107] Referring to FIG. 4a, for example, an electronic device (1000) may display a setting icon (40) for setting rendering dimensions for visual content in the upper part of the display. For example, the setting icon (40) may be displayed in a tray displayed at the top of the display of the electronic device (1000), independent of the window (41) in which the rendered image of the visual content is displayed. Additionally, for example, a user may select the setting icon (40) to set rendering dimensions for the rendered image of the visual content.

[0108] FIG. 4b is a diagram showing an example of setting a three-dimensional rendering dimension for visual content through a menu for setting the rendering dimension of visual content according to one embodiment.

[0109] Referring to FIG. 4b, an electronic device (1000) according to one embodiment may display a menu (42) for setting the rendering dimension of visual content as the setting icon (41) of FIG. 4a is selected.

[0110] According to one embodiment, a menu (42) for setting a rendering dimension of visual content may include buttons (45, 46) for selecting a rendering dimension related to the visual content. Additionally, the menu (42) may include items (1, 2, 3, 4, 5, 6, 7, 8, 9) for selecting a target to which the selected rendering dimension will be applied.

[0111] For example, buttons (45, 46) for selecting rendering dimensions related to visual content may include a button (45) for selecting a 3-dimensional rendering dimension and a button (46) for selecting a 2-dimensional rendering dimension.

[0112] For example, items (1, 2, 3, 4, 5, 6, 7, 8, 9) for selecting a target to apply a selected rendering dimension may include buttons (1, 2, 3) indicating a type of visual content, buttons (4, 5) indicating a type of application for displaying visual content, and buttons (6, 7, 8) indicating a type of visual object.

[0113] According to one embodiment, when one of the buttons (45, 46) for selecting a rendering dimension related to visual content is selected and at least one of the items (1, 2, 3, 4, 5, 6, 7, 8, 9) for selecting a target to which the selected rendering dimension is to be applied is selected, the electronic device (1000) can apply the selected rendering dimension to the visual content and / or visual object corresponding to the selected item.

[0114] For example, if a user selects buttons (1, 2, 3) after selecting button (45), the electronic device (1000) can set the rendering dimension so that a three-dimensional rendered image is displayed for visual content of a type of visual content such as video, presentation, or game.

[0115] FIG. 4c is a diagram showing an example of setting a two-dimensional rendering dimension for visual content through a menu for setting the rendering dimension of visual content according to one embodiment.

[0116] Referring to FIG. 4c, according to one embodiment, when one of the buttons (45, 46) for selecting a rendering dimension related to visual content is selected and at least one of the items (1, 2, 3, 4, 5, 6, 7, 8, 9) for selecting a target to which the selected rendering dimension is to be applied is selected, the electronic device (1000) can apply the selected rendering dimension to the visual content and / or visual object corresponding to the selected item.

[0117] For example, if a user selects buttons (4, 5, 6, 7, 8) after selecting button (46), the electronic device (1000) may apply a two-dimensional rendering dimension to the visual content and / or visual object when the type of visual content is a web page, the type of application displaying the visual content is a messenger application or a document application, or the visual object is text or a person.

[0118] FIG. 5 is a flowchart of a method for an electronic device to select a portion of a rendered image according to one embodiment.

[0119] Operations 510 to 550 of FIG. 5 may correspond to operations 230 and 240 of FIG. 2.

[0120] In operation 510, an electronic device (1000) according to one embodiment may receive user input for dragging a portion of a first rendering image. The electronic device (1000) may receive drag input from a user for changing the rendering dimension of a portion of a first rendering image of the first visual content. For example, the electronic device (1000) may receive drag input for specifying the diagonal vertices of a portion of a rectangle in the entire area of ​​the first rendering image. For example, the electronic device (1000) may receive drag input for drawing the border of a portion of a portion in the entire area of ​​the first rendering image. However, drag input for selecting a portion is not limited thereto.

[0121] In operation 520, an electronic device (1000) according to one embodiment may receive user input gazing at a portion of a first rendering image. For example, a user may gaze at a portion of a portion of a first rendering image to change a portion of a portion of a first rendering image of a first visual content, and the electronic device (1000) may identify the gaze input of the user gazing at a portion of a portion by photographing the user's eyes.

[0122] In operation 530, an electronic device (1000) according to one embodiment may receive user input selecting a visual object within a first rendering image. For example, the electronic device (1000) may receive user input long-touching a visual object within the first rendering image. For example, the electronic device (1000) may receive user input gazing at a visual object within the first rendering image for a specified amount of time.

[0123] In operation 540, an electronic device (1000) according to one embodiment can identify a selected portion of a first rendering image for generating a second rendering image. For example, when the electronic device (1000) receives user input dragging a portion of the first rendering image, the electronic device (1000) can identify a portion of the first rendering image to change the rendering dimension based on the trajectory of the drag input.

[0124] For example, when the electronic device (1000) receives user input gazing at a portion of a first rendering image, the electronic device (1000) may identify a predetermined portion of the portion including the position gazing by the user as a portion of the rendering dimension to be changed, based on the position gazing by the user. In this case, the electronic device (1000) may, for example, select content including the gazing position as a portion of the portion, or select a window including the gazing position as a portion of the portion, but is not limited thereto.

[0125] For example, when the electronic device (1000) receives user input selecting a visual object within a first rendering image, the electronic device (1000) can identify the area where the visual object selected by the user is located as a partial area.

[0126] In operation 550, an electronic device (1000) according to one embodiment may generate a second rendering image for a portion of the area. The electronic device (1000) may generate a second rendering image such that the second rendering image for a portion of the area has a second rendering dimension different from the first rendering dimension of the first rendering image. For example, the electronic device (1000) may extract data for a portion of the area from data of visual content and generate a second rendering image having a second rendering dimension based on the extracted data.

[0127] FIG. 6a is a diagram showing an example of user input selecting a portion of a first rendering image according to one embodiment.

[0128] Referring to FIG. 6a, an electronic device (1000) according to one embodiment may display a first rendering image (60) of visual content and may receive user input for selecting a portion area (62) of the first rendering image (60). For example, the electronic device (1000) may receive user input for specifying the border of a portion area (62) in the first rendering image (60) and long-touching the portion area (62). In this case, the electronic device (1000) may identify to change the rendering dimension of the portion area (62) in response to the reception of user input.

[0129] FIG. 6b is a diagram showing an example of a gesture input for selecting a portion of a first rendering image according to one embodiment.

[0130] Referring to FIG. 6b, an electronic device (1000) according to one embodiment may display a first rendering image (60) of visual content and may receive user input selecting a portion area (62) of the first rendering image (60). For example, the electronic device (1000) may specify the border of a portion area (62) in the first rendering image (60) and receive user input to clench a hand on the portion area (62). In this case, the electronic device (1000) may use a camera to identify the user input to clench a hand and may determine the rendering dimension of the portion area (62) as three dimensions.

[0131] For example, the electronic device (1000) may specify the border of another part area (64) in the first rendering image (60) and receive user input of spreading a hand on the part area (64). In this case, the electronic device (1000) may use a camera to identify the user input of spreading a hand and determine the rendering dimension of the part area (64) as two dimensions.

[0132] FIG. 6c is a drawing showing an example of a drag input for selecting a portion of a first rendering image according to one embodiment.

[0133] Referring to FIG. 6c, an electronic device (1000) according to one embodiment may display a first rendering image (65) of visual content and may receive user input for selecting a portion area (66) of the first rendering image (65). For example, the electronic device (1000) may receive a drag input from a first point (66-1) to a second point (66-2) to select a portion area (66) in the first rendering image (65). As the drag input is received, the electronic device (1000) may identify a rectangular area having the first point (66-1) and the second point (66-2) as opposite vertices as the portion area (66).

[0134] FIG. 6d is a diagram showing an example of user input selecting a visual object within a first rendering image as a partial area according to one embodiment.

[0135] Referring to FIG. 6d, an electronic device (1000) according to one embodiment may display a first rendering image (65) of visual content and may receive user input selecting a visual object (67) within the first rendering image (65) as a partial area. For example, the electronic device (1000) may receive user input long-touching a specific person in the first rendering image (65). In this case, the electronic device (1000) may identify the area where the person, which is the visual object (67) selected by the long touch, is displayed as a partial area.

[0136] In this case, for example, the electronic device (1000) can identify a visual object (67) selected by the user by using an object recognition function for an image. The electronic device (1000) can identify visual objects within the visual content by using an artificial intelligence model trained for object recognition, and can identify a visual object (67) selected by the user among the identified visual objects based on the location of user input (e.g., long touch input).

[0137] FIG. 6e is a diagram showing an example of user input selecting a portion of a first rendering image according to one embodiment.

[0138] Referring to FIG. 6e, an electronic device (1000) according to one embodiment may display a first rendering image (68) of video content, and the first rendering image (68) may have a three-dimensional rendering dimension. In this case, for example, the readability of the characters within the first rendering image (68) may be reduced, and accordingly, the user may input a touch input that rubs the characters within the first rendering image (68) to change the rendering dimension of the area where the characters are located within the first rendering image (68) to two dimensions. Upon receiving the touch input that rubs the characters, the electronic device (1000) may select the area touched by the user as a partial area (69) and display a two-dimensional rendering image for the selected partial area (69).

[0139] According to one embodiment, the electronic device (1000) can recognize text in an area included in or adjacent to the area where the touch input is applied, based on a touch input that rubs a character, and may also select the area containing the recognized text as a partial area (69). Accordingly, for example, even if the rubbing touch input is larger than or smaller than the area where the character is located, the electronic device (1000) can effectively select the area containing the character, and accordingly, the readability and resolution of the character within the visual content can be improved.

[0140] FIG. 7 is a flowchart of a method for an electronic device according to one embodiment to display rendering images of different dimensions based on settings related to rendering dimensions.

[0141] Operations 710 to 750 of FIG. 7 may correspond to operation 220 of FIG. 2. Additionally, in FIG. 7, rendering images of different dimensions may be displayed based on preset values ​​for the rendering dimensions without user input to change the rendering dimensions.

[0142] In operation 710, the electronic device (1000) can identify a first rendering dimension set for the first visual content. According to one embodiment, a rendering dimension for the visual content can be set for each type of visual content. In this case, the electronic device (1000) can identify the type of the first visual content and identify a first rendering dimension corresponding to the type of the first visual content.

[0143] According to one embodiment, a rendering dimension may be set for an application. In this case, the electronic device (1000) may identify an application that has executed the first visual content and identify a first rendering dimension corresponding to the application.

[0144] In operation 720, the electronic device (1000) can identify the type of visual object for which a second rendering dimension is set. According to one embodiment, a rendering dimension for a visual object can be set for each type of visual object included in the visual content. In this case, the electronic device (1000) can identify the types of visual objects for which a second rendering dimension is set.

[0145] In operation 730, the electronic device (1000) can identify a first visual object with a second rendering dimension set within the first visual content. According to one embodiment, the electronic device (1000) can identify a first visual object with a second rendering dimension set that is different from the first rendering dimension among the visual objects included in the first rendering image. For example, the electronic device (1000) can identify a first visual object with a second rendering dimension set among the visual objects in the first rendering image by comparing the types of visual objects with the second rendering dimension set with the visual objects in the first rendering image. For example, the electronic device (1000) can identify a subtitle with a two-dimensional rendering dimension set within the first rendering image.

[0146] In operation 740, the electronic device (1000) can generate a third rendering image for a first visual object. According to one embodiment, the electronic device (1000) can generate a third rendering image such that the third rendering image of the first visual object has a second rendering dimension. For example, the electronic device (1000) can identify data for the first visual object from data of the first visual content and generate a third rendering image having a second rendering dimension based on the identified data.

[0147] In operation 750, the electronic device (1000) can display a first rendering image with the first visual object excluded together with a third rendering image of the first visual object. The electronic device (1000) can merge the first rendering image with the first visual object excluded with the third rendering image of the first visual object. Additionally, the electronic device (1000) can display the merged rendering image on the display of the electronic device (1000).

[0148] FIG. 8 is a diagram illustrating an example in which an electronic device according to one embodiment displays rendering images of different dimensions based on a setting value regarding the rendering dimension.

[0149] Referring to FIG. 8, an electronic device (1000) according to one embodiment can display a rendered image of video content through a video application. For example, when a video application is executed and user input for playing video content through the video application is received, the electronic device (1000) can display video content.

[0150] According to one embodiment, the electronic device (1000) can identify a setting regarding a rendering dimension related to the video content in order to display the video content. For example, if a three-dimensional rendering dimension is set for the video content or a three-dimensional rendering dimension is set for the video application, the electronic device (1000) can identify that the rendering image of the video content should be displayed as a three-dimensional rendering image. Additionally, the electronic device (1000) can identify subtitles within the video content and identify that the subtitles of the video content should be displayed as a two-dimensional rendering image.

[0151] Additionally, for example, the electronic device (1000) can generate a three-dimensional rendering image (80) for the portion of the video content excluding subtitles based on the data of the video content. Additionally, the electronic device (1000) can generate a two-dimensional rendering image (82) for the portion of the video content excluding subtitles based on the data of the video content. Additionally, the electronic device (1000) can merge the three-dimensional rendering image (80) and the two-dimensional rendering image (82) and display the merged rendering image.

[0152] Additionally, for example, the electronic device (1000) can identify frames containing subtitles from frames of a video file and designate the area where the subtitles are located from the identified frames as the subtitle area. For example, the electronic device (1000) can designate the bottom area of ​​the screen where the subtitles are mainly located as the subtitle area, and if text is identified in an area other than the designated subtitle area, the designated subtitle area can be adjusted. Accordingly, the electronic device (1000) can use a text recognition algorithm (e.g., tesseract OCR) on the subtitle area of ​​the video content to check whether there is text within the subtitle area, and can display a two-dimensional rendering image (82) on the identified subtitle area.

[0153] FIG. 9 is a flowchart of a method in which an electronic device according to one embodiment changes the rendering dimension of another visual content based on user input for visual content.

[0154] Operations 910 to 940 of FIG. 9 may be performed after operation 250 of FIG. 2, but are not limited thereto. Operations 910 to 940 of FIG. 9 may also be performed independently of at least some of the operations of FIG. 2.

[0155] In operation 910, the electronic device (1000) may display a fourth rendering image of the second visual content associated with the first visual content. The electronic device (1000) may display a fourth rendering image of the second visual content together with the first rendering image of the first visual content. According to one embodiment, the first visual content and the second visual content may be displayed through a single application, but are not limited thereto. The application providing the first visual content and the application providing the second visual content may be different.

[0156] According to one embodiment, the second visual content related to the first visual content may be visual content that provides detailed information related to the first visual content. For example, the first visual content may be visual content that includes text describing the interior of a building, and the second visual content may be visual content that includes a photograph of the interior of the building.

[0157] According to one embodiment, the first rendering dimension of the first rendering image may be the same as or different from the fourth rendering dimension of the fourth rendering image. For example, the first rendering image may be a two-dimensional rendering image and the fourth rendering image may be a two-dimensional rendering image, but is not limited thereto.

[0158] In operation 920, the electronic device (1000) may receive user input for selecting a first visual content. According to one embodiment, when the first visual content and the second visual content are displayed together, the electronic device (1000) may receive user input for selecting the first visual content. For example, the user input for selecting the first visual content may include at least one of touch input, gaze input, or gesture input, but is not limited thereto.

[0159] In operation 930, the electronic device (1000) may generate a fifth rendering image of the second visual content. According to one embodiment, the electronic device (1000) may generate a fifth rendering image of the second visual content to change the rendering dimension of the second visual content. In this case, the rendering dimension of the fourth rendering image of the second visual content may be different from the rendering dimension of the fifth rendering image of the second visual content. For example, if the fourth rendering image is a two-dimensional rendering image, the electronic device (1000) may generate a three-dimensional fifth rendering image. The electronic device (1000) may generate a three-dimensional fifth rendering image based on the data of the second visual content.

[0160] In operation 940, the electronic device (1000) may replace the fourth rendering image of the second visual content with the fifth rendering image. According to one embodiment, the electronic device (1000) may stop displaying the fourth rendering image of the second visual content and, instead of the fourth rendering image of the second visual content, display the fifth rendering image of the second visual content. Accordingly, the first rendering image of the first visual content and the fifth rendering image of the second visual content may be displayed together.

[0161] FIG. 10 is a diagram illustrating an example in which an electronic device according to one embodiment changes the rendering dimensions of another visual content based on user input for visual content.

[0162] Referring to FIG. 10, for example, an electronic device (1000) can display rendering images of a first visual content (101), a second visual content (102), a third visual content (103), and a fourth visual content (104).

[0163] According to one embodiment, the first visual content (101) may be associated with the second visual content (102). For example, the rendering image of the first visual content (101) may provide first information describing the interior of a building, and the rendering image of the second visual content (102) may provide a photograph of the interior corresponding to the first information. In this case, the rendering image of the first visual content (101) and the rendering image of the second visual content (102) may be two-dimensional rendering images.

[0164] According to one embodiment, the third visual content (103) may be associated with the fourth visual content (104). For example, the rendering image of the third visual content (103) may provide second information describing the interior of a building, and the rendering image of the fourth visual content (104) may provide a photograph of the interior corresponding to the second information. In this case, the rendering image of the third visual content (103) and the rendering image of the fourth visual content (104) may be two-dimensional rendering images.

[0165] Referring to identification number 100a of FIG. 10, for example, if a user gazes at a rendering image of the first visual content (101) for a specified amount of time or longer, the electronic device (1000) can change the rendering image of the second visual content (102) into a three-dimensional rendering image. The electronic device (1000) can generate a three-dimensional rendering image based on the data of the second visual content (102) so that the rendering image of the second visual content (102) has three dimensions. Additionally, the electronic device (1000) can replace the two-dimensional rendering image of the second visual content (102) with a three-dimensional rendering image.

[0166] Referring to identification number 100b in FIG. 10, for example, a user can move their gaze toward the first visual content (101) to the rendering image of the third visual content (103). As the user's gaze moves, the three-dimensional rendering image of the second visual content (102) can be changed to a two-dimensional rendering image.

[0167] Additionally, for example, if a user gazes at the rendering image of the third visual content (103) for a specified period of time or longer, the electronic device (1000) can change the rendering image of the fourth visual content (104) into a three-dimensional rendering image. The electronic device (1000) can generate a three-dimensional rendering image based on the data of the fourth visual content (104) so ​​that the rendering image of the fourth visual content (104) has three dimensions. Additionally, the electronic device (1000) can change the two-dimensional rendering image of the fourth visual content (104) into a three-dimensional rendering image.

[0168] FIG. 11 is a flowchart of a method in which an electronic device according to one embodiment stores information related to a rendering image and changes the dimensions of a rendering image displayed using the stored rendering image.

[0169] Operations 1110 to 1150 of FIG. 11 may be performed after operation 250 of FIG. 2, but are not limited thereto. Operations 1110 to 1150 of FIG. 11 may also be performed independently of at least some of the operations of FIG. 2.

[0170] In operation 1110, the electronic device (1000) may store information related to a second rendering image corresponding to a portion of a first rendering image. According to one embodiment, the electronic device (1000) may generate a second rendering image corresponding to a portion of a first rendering image to have a second rendering dimension, and may store information related to the generated second rendering image in memory. Information related to the second rendering image of the second rendering dimension may include, for example, a second rendering image generated to have a second rendering dimension. Information related to the second rendering image of the second rendering dimension may include, for example, metadata necessary to render to the second rendering image of the second rendering dimension, but is not limited thereto. The metadata may include, for example, coordinate values ​​for identifying a portion of a portion of the first visual content, data corresponding to a portion of the first visual content data, an identification value of the second rendering dimension, and a setting value for generating the second rendering image with the second rendering dimension.

[0171] According to one embodiment, in relation to a file defining a screen configuration of visual content displayed on a display of an electronic device (1000), information related to a second rendering image of a second rendering dimension may be stored as metadata. For example, in a file defining a screen configuration of visual content displayed on a display of an electronic device (1000), the coordinates of a location where a first rendering image of a first rendering dimension is to be displayed and the coordinates of a location where a second rendering image of a second rendering dimension is to be displayed may be set, but are not limited thereto.

[0172] In operation 1120, the electronic device (1000) may end the display of the first visual content. For example, the display of the first visual content may end when the playback of the first visual content is completed. Or, for example, the display of the first visual content may end when user input to end the playback of the first visual content is received.

[0173] In operation 1130, the electronic device (1000) may receive user input for displaying the first visual content. According to one embodiment, after the display of the first visual content is terminated in operation 1120, the electronic device (1000) may receive user input for displaying the first visual content again.

[0174] In operation 1140, the electronic device (1000) can extract information related to the second rendering image from memory. According to one embodiment, before displaying the first visual content again, the electronic device (1000) can search and extract from memory whether there is information related to the second rendering image for a part area of ​​the first visual content.

[0175] In operation 1150, the electronic device (1000) can display a first rendering image with some areas excluded and an extracted second rendering image. According to one embodiment, the electronic device (1000) can display a first rendering image with a first rendering dimension while displaying a second rendering image with a second rendering dimension for some areas. By displaying the second rendering image with a second rendering dimension based on information related to the second rendering image stored in advance, the electronic device (1000) can efficiently display the first rendering image and the second rendering image having different rendering dimensions together with respect to the first visual content.

[0176] According to one embodiment, a real-time conversion method may be provided to support 2D video content. For example, when a 2D video is transmitted to a video playback application, the electronic device (1000) can convert the 2D video into a 3D video through real-time analysis. At this time, the electronic device (1000) may cache conversion data of the 3D video for the input 2D video as data generated during the conversion process, and may store the cached data in a storage device of the electronic device (1000). The stored data may be stored to be used for 3D conversion when the 2D video is replayed, and may include metadata that enables 3D conversion using only the stored data. The video playback application of the electronic device (1000) can convert a specific area of ​​the 2D video into a 3D video at a specific point in time without real-time analysis of the 2D video through the 3D conversion data. Accordingly, in a situation where a re-execution of a previously executed 2D image is requested, if there is 3D conversion data available for the 2D image to be re-executed, the electronic device (1000) can combine the data with the 2D image to convert it into a 3D image.

[0177] According to one embodiment, a new type of video file format may be provided. The video file format may include 2D image information and 3D conversion data. When a file of the video file format is executed, a video playback application of an electronic device (1000) may play a 2D image as a 3D image using the 3D conversion data within the file. For example, the 3D conversion data may include data regarding which area of ​​the 2D image to convert into a specific 3D form at a specific point in time, and may include additional information such as subtitles.

[0178] FIG. 12 is a drawing showing an example of information related to a rendering image of visual content according to one embodiment.

[0179] Referring to FIG. 12, for example, an electronic device (1000) can identify a first partial area (121) corresponding to a person and a second partial area (122) corresponding to a subtitle in the original image (120) of visual content, display a three-dimensional rendering image for the first partial area (121), and display a two-dimensional rendering image for the second partial area (122).

[0180] In this case, the electronic device (1000) may generate and store information (123) for rendering a part of the original image (120) of the visual content in three dimensions and rendering another part in two dimensions. For example, the electronic device (1000) may store information (124) related to three-dimensional rendering of the first part area (121) as information related to a three-dimensional rendering image of the first part area (121). Additionally, for example, the electronic device (1000) may store information (125) related to two-dimensional rendering of the second part area (122) as information related to a two-dimensional rendering image of the second part area (122).

[0181] For example, information related to a rendered image of visual content may include information regarding which object or region in a 2D image should be rendered in 3D at a specific point in time. Referring to FIG. 12, for example, 3D transformation data<Partial 3D> Is <start time="00">It can include information on which effect to apply to which object at a given time.<Partial 3D> Internally, it may include metadata (124) for one 3D Object effect and metadata (125) for one 2D Object effect. The metadata (124) may include the boundary of the object to be represented as a 3D Object and Depth information required to convert the object into 3D in the form of encoded text and DepthInfo values. Additionally, the metadata (125) may include object information that should appear in 2D form at the same time. Accordingly, when the electronic device (1000) renders the original 2D video through a video playback application, it may apply a Partial 3D effect only to the person in the center (121) according to the <<3D Object>> information (124) of the 3D conversion data and apply a 2D effect to the subtitle position of the video according to the <<2D Object>> information (125).

[0182] FIG. 13a is a drawing showing an example of an electronic device according to one embodiment controlling the brightness of the boundary between a first rendering image and a second rendering image.

[0183] Referring to identification number 130 in FIG. 13a, at the boundary portion (a) between the 2D area where a 2D rendering image is displayed and the 3D area where a 3D rendering image is displayed, the brightness of the 2D area and the brightness of the 3D area may differ discretely. For example, the brightness of the 3D rendering image of the visual content may be smaller than the brightness of the 2D rendering image.

[0184] Referring to identification number 131 in FIG. 13a, the electronic device (1000) can make the brightness of the 2D area and the brightness of the 3D area have continuous values ​​by adjusting the brightness of the 2D area and the brightness of the 3D area at the boundary portion (a) of the 2D area where a 2D rendering image is displayed and the 3D area where a 3D rendering image is displayed.

[0185] FIG. 13b is a drawing showing an example of an electronic device according to one embodiment controlling the brightness of a first rendering image and a second rendering image.

[0186] Referring to identification number 133 in FIG. 13b, at the boundary portion (a) where a 2D area where a 2D rendering image is displayed and a 3D area where a 3D rendering image is displayed, the brightness of the 2D area and the brightness of the 3D area may differ discretely. For example, the brightness of the 3D rendering image of the visual content may be smaller than the brightness of the 2D rendering image.

[0187] Referring to identification number 134 in FIG. 13b, the electronic device (1000) can increase the brightness of the 3D area so that the brightness of the 2D area and the brightness of the 3D area have continuous values ​​at the boundary portion (a) between the 2D area where a 2D rendering image is displayed and the 3D area where a 3D rendering image is displayed.

[0188] FIG. 14a is a drawing showing a display structure providing a two-dimensional display and a three-dimensional display according to one embodiment.

[0189] Referring to FIG. 14a, a display panel structure according to one embodiment may include a touch panel (141), an index matching layer (142), a lens layer (143), a polarization rotation layer (144), a polarization rotation control layer (145), a polarization layer (146), and a display panel (147).

[0190] According to one embodiment, the lens layer (143) may be a Micro Lens layer filled with an anisotropic material, and a polarization rotation layer (144) may be disposed below the lens layer (143). The polarization rotation layer (144) may change the direction of polarization, thereby enabling 2D displays and 3D displays.

[0191] According to one embodiment, a polarization rotation control layer (145) for partially controlling the polarization rotation layer (144) may be disposed below the polarization rotation layer (144). For example, the polarization rotation control layer (145) may include a circuit for partially controlling the rotation of the polarization rotation layer (144).

[0192] A lens layer (143) according to one embodiment may be composed of an anisotropic material such as LC (liquid crystal), and an index matching layer (142) may be disposed thereon. The index matching layer (142) may be composed of a material having the same refractive index as no (the lower of the two refractive indices) among ne (the higher of the two refractive indices) and no (the lower of the two refractive indices) of the anisotropic material.

[0193] In one embodiment, when at least a portion of the area of ​​the display is set as a 2D mode area, a two-dimensional rendering image can be displayed in the 2D mode area. According to one embodiment, linear polarization emitted from the polarization layer (146) through the 2D mode area can be emitted to the outside of the display without optical deformation while passing through an off-state polarization rotation layer (144) that does not affect the light path, and passing through a lens layer (143) and an index matching layer (142) having the same refractive index.

[0194] When the display area according to one embodiment is set to a 3D mode area, a three-dimensional rendering image can be displayed in the 3D mode area. As linear polarization emitted through the polarization layer (146) passes through the polarization rotation layer (144) in the on state, the polarization direction of the linear polarization can be rotated by 90 degrees. In this case, the refractive index of the lens layer (143) may differ from the refractive index of the index matching layer (142), and accordingly, due to the difference between the refractive index of the lens layer (143) and the refractive index of the index matching layer (142), the light path of the linear polarization changes, and a three-dimensional rendering image can be displayed in the 3D mode area.

[0195] FIG. 14b is a drawing showing a display structure providing a two-dimensional display and a three-dimensional display according to one embodiment.

[0196] Referring to FIG. 14b, a display panel structure according to one embodiment may include a touch panel (151), an index matching layer (152), a lens layer (153), a lens control layer (154), a polarization layer (155), and a display panel (156).

[0197] According to one embodiment, the lens layer (153) may be a Micro Lens layer filled with an anisotropic material, and a lens control layer (154) may be disposed below the lens layer (153). The lens control layer (154) can adjust the arrangement of liquid crystals (LC) within the lens layer (153) based on a voltage applied to the lens control layer (154), thereby enabling 2D and 3D displays. For example, the lens control layer (154) may include a circuit for partially controlling the arrangement of liquid crystals (LC) within the lens layer (153).

[0198] According to one embodiment, the lens layer (153) may be composed of an anisotropic material such as LC (liquid crystal), and an index matching layer (152) may be disposed thereon. The index matching layer (152) may be composed of a material having the same refractive index as no (the lower of the two refractive indices) among ne (the higher of the two refractive indices) and no (the lower of the two refractive indices) of the anisotropic material.

[0199] In one embodiment, when at least a portion of the area of ​​the display is set as a 2D mode area, a two-dimensional rendering image can be displayed in the 2D mode area. According to one embodiment, linearly polarized light emitted from the polarization layer (155) through the 2D mode area can be emitted outside the display without optical deformation while passing through a lens layer (153) and an index matching layer (152) having the same refractive index.

[0200] In one embodiment, when the area of ​​the display is set to a 3D mode area, a three-dimensional rendering image can be displayed in the 3D mode area. According to one embodiment, when voltage is applied to the lens control layer (154), the LC arrangement within the lens layer (153) can be changed, and accordingly, the refractive index of the linearly polarized light can be changed. Accordingly, the linearly polarized light emitted through the polarization layer (155) passes through the lens layer (153) and the index matching layer (152) having different refractive indices, and due to the difference in refractive index between the lens layer (153) and the index matching layer (152), the light path of the linearly polarized light is changed, and a three-dimensional rendering image can be displayed in the 3D mode area.

[0201] A method for an electronic device to display visual content according to one embodiment may include: an operation (201) of identifying setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; an operation (203) of identifying a first display area corresponding to the first rendering dimension among the display areas of the first visual content based on the setting information, wherein the first rendering dimension is different from the second rendering dimension; and an operation (205) of displaying the first rendering image and the second rendering image together so that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area.

[0202] Additionally, the method may include: an operation (230) of receiving user input selecting a portion of the first rendering image; an operation (240) of generating a third rendering image of the first visual content corresponding to the portion, wherein the third rendering image has a second rendering dimension different from the first rendering dimension; and an operation (250) of replacing the portion of the first rendering image with the third rendering image.

[0203] Additionally, the method may include: an operation (320) of displaying a menu for setting the rendering dimension, wherein the menu includes items indicating the types of the visual contents; an operation of selecting at least one of the items; and an operation (330) of setting the rendering dimension for the first visual content based on the selected at least one item.

[0204] Additionally, the menu includes items indicating types of visual objects included within the visual contents, and the operation of setting the rendering dimension may include: an operation of selecting at least one of the items indicating types of visual objects; and an operation of setting the rendering dimension for a visual object within the first visual content based on the selected at least one item.

[0205] Additionally, the menu includes items indicating types of applications for displaying the visual content, and the operation of setting the rendering dimension may include: an operation of selecting at least one of the items indicating types of applications; and an operation of setting the rendering dimension for an application executing the first visual content based on the selected at least one item.

[0206] Additionally, the operation of receiving user input for selecting the above partial area includes the operation of receiving user input for selecting a visual object within the first rendering image (530); and the operation of generating the third rendering image corresponding to the above partial area can generate the third rendering image of the selected visual object.

[0207] Additionally, the user input for selecting the aforementioned partial area may include at least one of a user input for staring at the aforementioned partial area for a specified amount of time or a user input for touching the aforementioned partial area for a specified amount of time.

[0208] In addition, the above-mentioned replacement operation may display the third rendering image together with the first rendering image and the second rendering image, in which the parts of the area are excluded.

[0209] Additionally, the method includes: an operation (910) of displaying a fourth rendering image of a second visual content related to the first visual content, wherein the fourth rendering image of the second visual content has a first rendering dimension; an operation (920) of receiving user input for selecting the first visual content; and an operation (940) of replacing the fourth rendering image of the second visual content with a fifth rendering image of the second visual content as the first visual content is selected, wherein the fifth rendering image may have a second rendering dimension different from the first rendering dimension.

[0210] Additionally, the display of the first rendering image and the second rendering image may include the operation of merging at least a portion of the first rendering image and at least a portion of the second rendering image; and the operation of displaying the merged rendered image on the display.

[0211] In addition, the first rendering image may include an image of a human face, and the second rendering image may not include an image of a human face.

[0212] FIG. 15 is a block diagram of an electronic device (1501) in a network environment (1500) according to various embodiments. Referring to FIG. 15, in the network environment (1500), the electronic device (1501) may communicate with an electronic device (1502) through a first network (1598) (e.g., a short-range wireless communication network) or may communicate with an electronic device (1504) or a server (1508) through a second network (1599) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1501) may communicate with the electronic device (1504) through a server (1508). According to one embodiment, the electronic device (1501) may include a processor (1520), memory (1530), input module (1550), sound output module (1555), display module (1560), audio module (1570), sensor module (1576), interface (1577), connection terminal (1578), haptic module (1579), camera module (1580), power management module (1588), battery (1589), communication module (1590), subscriber identification module (1596), or antenna module (1597). In some embodiments, at least one of these components (e.g., connection terminal (1578)) may be omitted from the electronic device (1501), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1576), camera module (1580), or antenna module (1597)) may be integrated into a single component (e.g., display module (1560)).

[0213] The processor (1520) can, for example, execute software (e.g., program (1540)) to control at least one other component (e.g., hardware or software component) of the electronic device (1501) connected to the processor (1520) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1520) can store commands or data received from other components (e.g., sensor module (1576) or communication module (1590)) in volatile memory (1532), process the commands or data stored in volatile memory (1532), and store the resulting data in non-volatile memory (1534). According to one embodiment, the processor (1520) may include a main processor (1521) (e.g., a central processing unit or an application processor) or an auxiliary processor (1523) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1501) includes a main processor (1521) and an auxiliary processor (1523), the auxiliary processor (1523) may be configured to use lower power than the main processor (1521) or to be specialized for a specified function. The auxiliary processor (1523) may be implemented separately from the main processor (1521) or as part thereof.

[0214] The auxiliary processor (1523) may control at least some of the functions or states associated with at least one component of the electronic device (1501) (e.g., display module (1560), sensor module (1576), or communication module (1590)) on behalf of the main processor (1521) while the main processor (1521) is in an inactive (e.g., sleep) state, or together with the main processor (1521) while the main processor (1521) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1523) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1580) or communication module (1590)). According to one embodiment, the auxiliary processor (1523) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1501) itself where the artificial intelligence is performed, or through a separate server (e.g., server (1508)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0215] The memory (1530) can store various data used by at least one component of the electronic device (1501) (e.g., processor (1520) or sensor module (1576)). The data may include, for example, software (e.g., program (1540)) and input or output data for related commands. The memory (1530) may include volatile memory (1532) or non-volatile memory (1534).

[0216] The program (1540) may be stored as software in memory (1530) and may include, for example, an operating system (1542), middleware (1544), or an application (1546).

[0217] The input module (1550) can receive commands or data to be used for a component of the electronic device (1501) (e.g., processor (1520)) from outside the electronic device (1501) (e.g., user). The input module (1550) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0218] The sound output module (1555) can output a sound signal to the outside of the electronic device (1501). The sound output module (1555) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0219] The display module (1560) can visually provide information to an external (e.g., user) of the electronic device (1501). The display module (1560) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1560) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0220] The audio module (1570) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1570) can acquire sound through an input module (1550) or output sound through an audio output module (1555) or an external electronic device (e.g., electronic device (1502)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1501).

[0221] The sensor module (1576) can detect the operating state of the electronic device (1501) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1576) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0222] The interface (1577) may support one or more specified protocols that can be used for the electronic device (1501) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1502)). According to one embodiment, the interface (1577) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0223] The connection terminal (1578) may include a connector through which the electronic device (1501) can be physically connected to an external electronic device (e.g., electronic device (1502)). According to one embodiment, the connection terminal (1578) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0224] The haptic module (1579) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1579) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0225] The camera module (1580) can capture still images and video. According to one embodiment, the camera module (1580) may include one or more lenses, image sensors, image signal processors, or flashes.

[0226] The power management module (1588) can manage the power supplied to the electronic device (1501). According to one embodiment, the power management module (1588) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0227] The battery (1589) can supply power to at least one component of the electronic device (1501). According to one embodiment, the battery (1589) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0228] The communication module (1590) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1501) and an external electronic device (e.g., electronic device (1502), electronic device (1504), or server (1508)), and the performance of communication through the established communication channel. The communication module (1590) may include one or more communication processors that operate independently of the processor (1520) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1590) may include a wireless communication module (1592) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1594) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1504) via a first network (1598) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1599) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1592) can identify or authenticate the electronic device (1501) within a communication network such as the first network (1598) or the second network (1599) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1596).

[0229] The wireless communication module (1592) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1592) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1592) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1592) can support various requirements specified in the electronic device (1501), external electronic device (e.g., electronic device (1504)), or network system (e.g., second network (1599)). According to one embodiment, the wireless communication module (1592) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0230] An antenna module (1597) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1597) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1597) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1598) or a second network (1599), may be selected from the plurality of antennas, for example, by a communication module (1590). A signal or power may be transmitted or received between the communication module (1590) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1597).

[0231] According to various embodiments, the antenna module (1597) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0232] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0233] According to one embodiment, commands or data may be transmitted or received between the electronic device (1501) and an external electronic device (1504) through a server (1508) connected to a second network (1599). Each of the external electronic devices (1502, or 1504) may be the same or a different type of device as the electronic device (1501). According to one embodiment, all or part of the operations performed on the electronic device (1501) may be performed on one or more of the external electronic devices (1502, 1504, or 1508). For example, if the electronic device (1501) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1501) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1501). The electronic device (1501) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1501) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1504) may include an Internet of Things (IoT) device. The server (1508) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1504) or server (1508) may be included within the second network (1599). The electronic device (1501) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0234] The electronic device (1501) of FIG. 15 may correspond to the electronic device (1000) of FIG. 1 to FIG. 14, and the electronic device (1501) of FIG. 15 may perform the operation of the electronic device (1000) of FIG. 1 to FIG. 14.

[0235] According to one embodiment, an electronic device for displaying visual content comprises: a display structure including a display panel (156), a polarizing layer (155), a lens layer (153), and a touch panel (151); a control circuit (154) for adjusting the refractive indices for a plurality of regions of the lens layer; and a memory (1530) for storing instructions. The electronic device may include at least one processor (1520); and, when executed by the at least one processor, the instructions may cause the electronic device to: identify (201) setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; and based on the setting information, identify (203) a first display area corresponding to the first rendering dimension and a second display area corresponding to the second rendering dimension among the display areas where the first visual content is to be displayed, wherein the first rendering dimension and the second rendering dimension are different, and by controlling the control circuit, adjust the refractive index (205) of the lens layer so that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area.

[0236] Additionally, the first visual content is video content, and when the instructions are executed by the at least one processor, the electronic device may identify the second display area corresponding to the second rendering dimension among the display areas of the first visual content by identifying subtitles within the video content.

[0237] Additionally, when the above instructions are executed by the at least one processor, the electronic device may: receive user input selecting a portion of the first rendering image, and generate a third rendering image of the first visual content corresponding to the portion, wherein the third rendering image has a second rendering dimension different from the first rendering dimension, and replace the portion of the first rendering image with the third rendering image.

[0238] Additionally, when the above commands are executed by the at least one processor, the electronic device may: display a menu for setting the rendering dimension, wherein the menu includes items indicating types of visual content, at least one of the items is selected, and the rendering dimension for the first visual content is set based on the selected at least one item.

[0239] Additionally, the menu includes items indicating types of visual objects included within the visual contents, and the commands, when executed by the at least one processor, may cause the electronic device to: select at least one of the items indicating types of visual objects, and set a rendering dimension for a visual object within the first visual content based on the selected at least one item.

[0240] Additionally, the menu includes items indicating types of applications for displaying the visual content, and the commands, when executed by the at least one processor, may cause the electronic device to: select at least one of the items indicating types of applications, and based on the selected at least one item, set a rendering dimension for an application executing the first visual content.

[0241] Additionally, when the above instructions are executed by the at least one processor, the electronic device may: receive user input selecting a visual object within the first rendering image, and generate the third rendering image of the selected visual object.

[0242] Additionally, when the above instructions are executed by the at least one processor, the electronic device may: display the third rendering image together with the first rendering image and the second rendering image, with the portion of the area excluded.

[0243] Additionally, the above instructions, when executed by the at least one processor, cause the electronic device to: display a fourth rendering image of a second visual content associated with the first visual content, wherein the fourth rendering image of the second visual content has a first rendering dimension; receive user input selecting the first visual content; and, as the first visual content is selected, replace the fourth rendering image of the second visual content with a fifth rendering image of the second visual content, wherein the fifth rendering image has a second rendering dimension different from the first rendering dimension.

[0244] Additionally, when the above commands are executed by the at least one processor, the electronic device may: store information for rendering a third rendering image of the first visual content corresponding to the partial area, terminate the display of the first visual content, receive user input for displaying the first visual content after the display of the first visual content has been terminated, and, upon receiving the user input, display the third rendering image together with the first rendering image from which the partial area is excluded, based on the stored information.

[0245] According to one embodiment, a computer-readable recording medium may be provided that records a program for executing a method on a computer, comprising: identifying setting information regarding a rendering dimension set for a first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; identifying a first display area corresponding to the first rendering dimension among the display areas of the first visual content based on the setting information, wherein the first rendering dimension is different from the second rendering dimension; and displaying the first rendering image and the second rendering image together such that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area.

[0246] According to one embodiment, one or more non-transient computer-readable storage media may include: receiving user input for selecting a partial area of ​​a first rendering image from a user; generating a third rendering image of a first visual content corresponding to said partial area, wherein the third rendering image has a second rendering dimension different from the first rendering dimension; and replacing said partial area of ​​the first rendering image with said third rendering image.

[0247] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0248] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0249] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0250] Various embodiments of the present document may be implemented as software (e.g., program (1540)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1536) or external memory (1538)) readable by a machine (e.g., electronic device (1501)). For example, a processor (e.g., processor (1520)) of the machine (e.g., electronic device (1501)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0251] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0252] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0253] It should be understood that various embodiments of the present disclosure according to the claims and descriptions in this specification may be implemented in the form of hardware, software, or a combination of hardware and software.

[0254] Such software may be stored on a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium stores one or more computer programs (software modules), and the one or more computer programs include computer execution instructions that cause the electronic device to perform the method of the present disclosure when executed alone or in combination by one or more processors of the electronic device.

[0255] Such software may be stored in the form of a storage device (regardless of whether it is erasable or rewritable), such as read-only memory (ROM), or in the form of memory, such as random access memory (RAM), memory chips, devices, or integrated circuits, or in the form of an optically or magnetically readable medium, such as a compact disc (CD), digital video disc (DVD), magnetic disc, magnetic tape, etc. It will be understood that the storage device and storage medium are various embodiments of a non-transient machine-readable storage medium suitable for storing a computer program containing instructions that implement various embodiments of the present disclosure when executed. Accordingly, various embodiments provide a program containing code for implementing an apparatus or method described in any claim of this specification, and a non-transient machine-readable storage medium for storing such a program.

[0256] Although the present disclosure has been described and illustrated with reference to various embodiments, those skilled in the art will understand that various modifications to the shapes and details are possible without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.< / start>

Claims

In an electronic device for displaying visual content, A display structure comprising a display panel (156), a polarizing layer (155), a lens layer (153), and a touch panel (151); A control circuit (154) for controlling the refractive indices of multiple regions of the lens layer; Memory for storing instructions (1530); and At least one processor (1520); Includes, When the above instructions are executed by the above at least one processor, the electronic device: Identifying setting information (201) regarding a rendering dimension set for the first visual content, wherein the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension, Based on the above setting information, among the display areas where the first visual content is to be displayed, a first display area corresponding to a first rendering dimension and a second display area corresponding to a second rendering dimension are identified (203), wherein the first rendering dimension and the second rendering dimension are different. An electronic device that controls the control circuit to adjust the refractive index (205) of the lens layer so that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area. In Article 1, The above-mentioned first visual content is video content, and When the above instructions are executed by the above at least one processor, the electronic device: An electronic device that identifies a second display area corresponding to the second rendering dimension among the display areas of the first visual content by identifying subtitles within the video content. In Article 1, When the above instructions are executed by the above at least one processor, the electronic device: Receiving user input to select a portion of the first rendering image, and A third rendering image of the first visual content corresponding to the above partial area is generated, wherein the third rendering image has a second rendering dimension different from the first rendering dimension, and An electronic device that replaces the portion of the first rendering image with the third rendering image. In Article 1, When the above instructions are executed by the above at least one processor, the electronic device: Display a menu for setting the above rendering dimensions, wherein the menu includes items indicating the types of visual content, and Select at least one of the above items, and An electronic device that sets a rendering dimension for the first visual content based on at least one selected item. In Paragraph 4, The above menu includes items indicating the types of visual objects included within the above visual contents, and When the above instructions are executed by the above at least one processor, the electronic device: Select at least one of the items indicating the types of the above visual objects, and An electronic device that sets a rendering dimension for a visual object within the first visual content based on at least one selected item. In Paragraph 4, The above menu includes items indicating the types of applications for displaying the above visual contents, and When the above instructions are executed by the above at least one processor, the electronic device: Select at least one of the items indicating the types of the above applications, and An electronic device that sets a rendering dimension for an application executing the first visual content based on at least one selected item above. In Paragraph 3, When the above instructions are executed by the above at least one processor, the electronic device: Receiving user input to select a visual object within the first rendering image, and An electronic device that generates the third rendering image of the selected visual object. In Paragraph 3, When the above instructions are executed by the above at least one processor, the electronic device: An electronic device that displays the third rendering image together with the first rendering image and the second rendering image, wherein the parts of which are excluded are excluded. In Article 1, When the above instructions are executed by the above at least one processor, the electronic device: Display a fourth rendering image of a second visual content related to the first visual content, wherein the fourth rendering image of the second visual content has a first rendering dimension, Receiving user input to select the first visual content, As the first visual content is selected, the fourth rendering image of the second visual content is replaced with the fifth rendering image of the second visual content, and An electronic device in which the above-mentioned fifth rendering image has the above-mentioned second rendering dimension which is different from the above-mentioned first rendering dimension. In Paragraph 3, When the above instructions are executed by the above at least one processor, the electronic device: Information for rendering a third rendering image of the first visual content corresponding to the above partial area is stored, and Terminate the display of the first visual content above, and After the display of the first visual content is terminated, receive user input to display the first visual content, and An electronic device that, upon receiving the above user input, displays the third rendering image together with the first rendering image having some areas excluded, based on the above stored information. In a method for an electronic device to display visual content, Operation (201), wherein setting information regarding a rendering dimension set for a first visual content is identified, and the rendering dimension includes a 2D rendering dimension and a 3D rendering dimension; Based on the above setting information, an operation (203) for identifying a first display area corresponding to a first rendering dimension among the display areas of the first visual content, wherein the first rendering dimension is different from the second rendering dimension; and An operation (205) of displaying the first rendering image and the second rendering image together so that the first rendering image of the first rendering dimension of the first visual content is displayed in the first display area and the second rendering image of the second rendering dimension is displayed in the second display area; A method including In Article 11, An operation (230) of receiving user input to select a portion of the first rendering image; Operation (240), wherein a third rendering image of the first visual content corresponding to the above partial area is generated, the third rendering image has a second rendering dimension different from the first rendering dimension; and The operation (250) of replacing the portion of the first rendering image with the third rendering image; A method including In Article 11, Operation (320), wherein a menu for setting the rendering dimension is displayed, and the menu includes items indicating the types of the visual contents; The action of selecting at least one of the above items; and An operation (330) of setting a rendering dimension for the first visual content based on at least one selected item; A method including In Article 13, The above menu includes items indicating the types of visual objects included within the above visual contents, and The operation of setting the above rendering dimensions is, The action of selecting at least one of the items indicating the types of the above visual objects; and An operation to set a rendering dimension for a visual object within the first visual content based on at least one selected item; A method including In Article 13, The above menu includes items indicating the types of applications for displaying the above visual contents, and The operation of setting the above rendering dimensions is, The operation of selecting at least one of the items indicating the types of the above applications; and An action of setting a rendering dimension for an application executing the first visual content based on at least one selected item; A method including

Images