Electronic device for displaying extended reality (XR) image and control method thereof

Abstract

An electronic device is disclosed. The electronic device comprises: a memory for storing instructions; a display panel including a left-eye display and a right-eye display; and one or more processors including processing circuitry, wherein the instructions, when executed individually or collectively by the one or more processors, control the display panel to display a first extended reality (XR) image including a window for displaying content, receive a user command for enlarging the size of the window to a first size or more, and control the display panel to display a second XR image instead of the first XR image on the basis of the reception of the user command, wherein the second XR image may be an image in which the distance of the window is changed from that in the first XR image.

Description

Electronic device for displaying XR (EXTENDED REALITY) images and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device for displaying an XR (extended reality) image and a method for controlling the same.

[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed. In particular, the recent widespread adoption of electronic devices capable of providing XR (extended reality) experiences is enhancing user convenience.

[0003] However, unlike conventional display devices, the windows provided by electronic devices capable of offering XR experiences have a problem in that they are not limited by display size.

[0004] According to one embodiment of the present disclosure for achieving the above objectives, an electronic device comprises one or more processors including a memory for storing instructions, a display panel including a left-eye display and a right-eye display, and processing circuitry, wherein the instructions, when executed individually or collectively by the one or more processors, control the display panel to display a first XR (extended reality) image including a window displaying content, receive a user command to enlarge the size of the window to a first size or larger, and control the display panel to display a second XR image instead of the first XR image based on the user command, and the second XR image may be an image in which the distance of the window from the first XR image has been changed.

[0005] Additionally, when the above instructions are executed individually or collectively by the one or more processors, when the user command is received, the distance of the window in the first XR image is changed and the size of the window is changed to a size corresponding to the user command to obtain the second XR image.

[0006] And, when the above instructions are executed individually or collectively by the one or more processors, the degree of change in the distance at which the window is displayed is identified based on at least one of the user command or the size of the pixels included in the window, and based on the degree of change, the distance of the window in the first XR image is changed and the size of the window is changed to a size corresponding to the user command to obtain the second XR image.

[0007] Additionally, when the above instructions are executed individually or collectively by the one or more processors, the display panel may be controlled to display a third XR image in which the size of the window has been changed to within the first size, instead of displaying the second XR image, when the user command is received.

[0008] And, when the above instructions are executed individually or collectively by the one or more processors, if a first user command is received to enlarge the size of the window to a second size larger than the first size, the display panel can be controlled to display the second XR image, and if a second user command is received to enlarge the size of the window to between the first size and the second size, the display panel can be controlled to display a third XR image in which the size of the first XR image has been changed to within the first size.

[0009] Additionally, when the above instructions are executed individually or collectively by the one or more processors, the first XR image or the second XR image may be acquired to include at least one of a first graphic object representing the display position of the window or a second graphic object representing the first size.

[0010] And, when the above instructions are executed individually or collectively by the one or more processors, the display panel can be controlled to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise.

[0011] Additionally, when the above instructions are executed individually or collectively by the one or more processors, the display state of the window can be changed to obtain the plurality of additional XR images.

[0012] And, the first size is based on the viewing angle of the user of the electronic device, and when the instructions are executed individually or collectively by the one or more processors, the viewing angle can be identified based on at least one of the type of content, the user's visual acuity, or the size of the pixels included in the window.

[0013] Additionally, when the above instructions are executed individually or collectively by the one or more processors, they provide a virtual environment to the user of the electronic device through the first XR image or the second XR image, and the distance of the window may be the depth at which the window is displayed in the virtual environment.

[0014] Meanwhile, according to one embodiment of the present disclosure, a control method for an electronic device comprises the steps of: controlling a display panel including a left-eye display and a right-eye display to display a first XR (extended reality) image including a window for displaying content; receiving a user command to enlarge the size of the window to a first size or larger; and controlling the display panel to display a second XR image instead of the first XR image based on the reception of the user command, wherein the second XR image may be an image in which the distance of the window from the first XR image has been changed.

[0015] Additionally, the step of controlling the display panel to display the second XR image may involve, upon receiving the user command, changing the distance of the window from the first XR image and changing the size of the window to a size corresponding to the user command to obtain the second XR image.

[0016] And, the step of controlling the display panel to display the second XR image may involve identifying the degree of change in the distance at which the window is displayed based on at least one of the user command or the size of the pixels included in the window, and based on the degree of change, changing the distance of the window in the first XR image and changing the size of the window to a size corresponding to the user command to obtain the second XR image.

[0017] Additionally, the step of controlling the display panel to display the second XR image may, when the user command is received, control the display panel to display a third XR image in which the size of the window is changed to within the first size instead of displaying the second XR image.

[0018] And, the step of controlling the display panel to display the second XR image may involve controlling the display panel to display the second XR image when a first user command is received to enlarge the size of the window to a second size or larger than the first size, and controlling the display panel to display a third XR image in which the size of the first XR image is changed to within the first size when a second user command is received to enlarge the size of the window to a size between the first size and the second size.

[0019] Additionally, the step of controlling the display panel to display the first XR image may involve acquiring the first XR image to include at least one of a first graphic object representing the display position of the window or a second graphic object representing the first size, and the step of controlling the display panel to display the second XR image may involve acquiring the second XR image to include at least one of a first graphic object representing the display position of the window or a second graphic object representing the first size.

[0020] And, the method may further include the step of controlling the display panel to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise.

[0021] In addition, the step of controlling the display panel to display the plurality of additional XR images can be achieved by changing the display state of the window to obtain the plurality of additional XR images.

[0022] And, the first size is based on the viewing angle of the user of the electronic device, and the step of controlling the display panel to display the second XR image can identify the viewing angle based on at least one of the type of content, the user's visual acuity, or the size of the pixels included in the window.

[0023] Meanwhile, according to one embodiment of the present disclosure, in a non-transient computer-readable recording medium storing a program for executing a method of operating an electronic device, the method of operation comprises the steps of: controlling a display panel including a left-eye display and a right-eye display to display a first XR (extended reality) image including a window for displaying content; receiving a user command to enlarge the size of the window to a first size or larger; and controlling the display panel to display a second XR image instead of the first XR image based on the user command, wherein the second XR image may be an image in which the distance of the window from the first XR image has been changed.

[0024] FIG. 1 is a block diagram showing the configuration of an electronic device according to one embodiment of the present disclosure.

[0025] FIG. 2 is a block diagram showing the detailed configuration of an electronic device according to one embodiment of the present disclosure.

[0026] FIG. 3 is a drawing for explaining the structure of an electronic device according to one embodiment of the present disclosure.

[0027] FIG. 4 is a diagram illustrating the operation when a user command to enlarge the size of a window is received according to one embodiment of the present disclosure.

[0028] FIGS. 5a to 5c are drawings for explaining the operation of changing the distance of a window according to one embodiment of the present disclosure.

[0029] FIG. 6 is a drawing for explaining the operation of changing the width and height of a window according to one embodiment of the present disclosure.

[0030] FIGS. 7 to 9 are drawings for explaining a viewing angle according to one embodiment of the present disclosure.

[0031] FIG. 10 is a drawing for explaining a graphic object displayed during a window size change according to one embodiment of the present disclosure.

[0032] FIG. 11 is a flowchart illustrating a method for controlling an electronic device according to one embodiment of the present disclosure.

[0033] The purpose of the present disclosure is to provide an electronic device and a method for controlling the same to resolve user inconvenience caused by the size of a window included in an XR (extended reality) image.

[0034] The present disclosure will be described in detail below with reference to the attached drawings.

[0035] The terms used in the embodiments of this disclosure have been selected to be as widely used as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the relevant explanatory section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0036] In this specification, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, operations, or components such as parts) and do not exclude the presence of additional features.

[0037] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0038] Expressions such as "first," "second," "first," or "second" used in this specification may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0039] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, terms such as "comprising" or "consisting of" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0040] In this specification, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0041] Various embodiments of the present disclosure will be described in more detail below with reference to the attached drawings.

[0042] FIG. 1 is a block diagram showing the configuration of an electronic device (100) according to one embodiment of the present disclosure.

[0043] The electronic device (100) is a device that provides XR (extended reality) images and can be implemented as a device such as smart glasses or a head-mounted display (HMD) device. However, it is not limited thereto, and the electronic device (100) may be any device capable of providing XR images. For example, the electronic device (100) may be implemented as a device such as a desktop PC, laptop, smartphone, tablet PC, TV, projector, etc. Here, XR is intended to combine or mirror a digital twin world that can interact with the physical world, and is also called extended reality; it may include virtual reality, augmented reality, and mixed reality. For convenience of explanation, the electronic device (100) is described below as being worn by a user, such as smart glasses or an HMD device.

[0044] According to FIG. 1, the electronic device (100) includes a memory (110), a display panel (120), and a processor (130).

[0045] Memory (110) may refer to hardware that stores information, such as data, in an electrical or magnetic form so that a processor (130), etc., can access it. To this end, memory (110) may be implemented as at least one piece of hardware among non-volatile memory, volatile memory, flash memory, hard disk drive (HDD) or solid-state drive (SSD), RAM, ROM, etc.

[0046] At least one instruction required for the operation of an electronic device (100) or a processor (130) may be stored in the memory (110). Here, the instruction is a unit of code that directs the operation of the electronic device (100) or the processor (130), and may be written in machine language, which is a language that a computer can understand. Alternatively, a plurality of instructions that perform a specific task of the electronic device (100) or the processor (130) may be stored in the memory (110) as an instruction set.

[0047] Data in the memory (110), which is information in bit or byte units that can represent characters, numbers, images, etc., may be stored. For example, the memory (110) may store user's vision information, field of view information, etc.

[0048] The memory (110) is accessed by the processor (130), and the processor (130) may perform read / write / modify / delete / update, etc. on instructions, instruction sets, or data.

[0049] The display panel (120) is configured to display an XR image and includes a left-eye display and a right-eye display, and each display can be implemented in various forms such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display panel (120) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. Meanwhile, the display panel (120) can be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0050] The display panel (120) can provide a stereoscopic XR image to the user through a left-eye display and a right-eye display. For example, the display panel (120) further includes a viewing area separation unit, and the user can view the XR image displayed through the left-eye display and the right-eye display stereoscopically by separating the left and right viewing areas through the viewing area separation unit.

[0051] The viewing area separator is positioned in front of the left eye display and the right eye display, respectively, to provide different viewing points, i.e., multi-views, for each viewing area. In this case, the viewing area separator can be implemented as a lenticular lens or a parallax barrier.

[0052] When the viewing area separation unit is implemented as a lenticular lens including a plurality of lens regions, the lenticular lens can refract an image displayed on a display panel (120) through the plurality of lens regions. Each lens region is formed with a size corresponding to at least one pixel, so that light passing through each pixel can be dispersed differently according to the viewing area.

[0053] In the case of a lenticular lens method, a lens portion (not shown) may be included. The lens portion may include a substrate, an electrode, a liquid crystal layer, and a medium layer. The lens portion can control the refraction of light corresponding to a multi-view image passing through the lens portion by changing optical properties based on whether an electric field is applied by the electrode.

[0054] When the viewing area separation unit is implemented as a parallax barrier, the parallax barrier may be implemented as a transparent slit array including multiple barrier regions. Accordingly, light can be blocked through slits between barrier regions to allow images at different viewpoints to be projected for each viewing area.

[0055] However, it is not limited to this, and the display panel (120) may be of any shape as long as it can provide the user with a three-dimensional XR image.

[0056] The processor (130) controls the overall operation of the electronic device (100). Specifically, the processor (130) can control the overall operation of the electronic device (100) by being connected to each component of the electronic device (100). For example, the processor (130) can control the operation of the electronic device (100) by being connected to components such as memory (110), a display panel (120), etc.

[0057] One or more processors (130) may include one or more of a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), a MIC (Many Integrated Core), a NPU (Neural Processing Unit), a hardware accelerator, or a machine learning accelerator. One or more processors (130) may control one or any combination of other components of the electronic device (100) and may perform operations or data processing related to communication. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors (130) may perform a method according to one embodiment of the present disclosure by executing one or more instructions stored in memory.

[0058] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0059] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one embodiment of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one embodiment of the present disclosure.

[0060] When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0061] In the embodiments of the present disclosure, one or more processors (130) may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. However, for convenience of explanation, the operation of the electronic device (100) is described below using the expression "processor (130)."

[0062] A processor (130) can control a display panel (120) to display a first XR (extended reality) image including a window for displaying content. For example, the processor (130) can control the display panel (120) to display a first XR image including a window for playing a video according to a user's video playback command. Here, the processor (130) continuously acquires the first XR image according to the playback of content and can control the display panel (120) to display the continuously acquired first XR image. That is, the operation of changing at least one of the size or distance of the window within the first XR image or the operation of displaying a graphic object below may all include acquiring the first XR image.

[0063] The processor (130) can acquire an XR image through software. Additionally, the processor (130) can acquire an XR image by compositing a window with a background image. For example, the processor (130) can acquire a window, and a display IC included in the electronic device (100) can acquire an XR image by compositing the window with the background image. However, this is not limited to this, and there may be many different methods for acquiring an XR image.

[0064] The processor (130) may determine at least one of the size or display position of the window based on at least one of an application or usage history corresponding to the window. For example, when the processor (130) displays a window that plays a video, it may determine the size and display position of the window according to the settings of the video application. Alternatively, when the processor (130) displays a window, it may determine the size and display position of the window based on the history set by the user during a previous usage process. Here, the display position may include not only the up, down, left, and right positions of the window in the first XR image but also the depth. For instance, in the first XR image, the first window may be displayed in the exact center, but the second window may be displayed slightly to the right of the first window. Alternatively, in the first XR image, the first window may be displayed at a depth position where the user feels it is 1m away, but the second window may be displayed at a depth position where the user feels it is 2m away. For convenience of explanation, the depth is described below as the distance of the window.

[0065] When the processor (130) receives a user command to enlarge the size of the window to a first size or larger, it can control the display panel (120) to display a second XR image in which the distance of the window from the first XR image has been changed. Here, the first size may represent a preset area and may be used interchangeably as a range or width.

[0066] For example, when the processor (130) receives a user command to enlarge the size of the window to a first size or larger, it can control the display panel (120) to display a second XR image in which the distance of the window from the first XR image has been increased.

[0067] When the processor (130) receives a user command to enlarge the size of the window to less than the first size, it may control the display panel (120) to acquire a second XR image by maintaining the distance of the window from the first XR image and changing the size of the window to a size corresponding to the user command, and to display the second XR image.

[0068] The processor (130) can identify the degree of change in the distance at which the window is displayed based on at least one of a user command or the size of a pixel included in the window. For example, the processor (130) can increase the distance of the window as the size of the window increases according to the user command. Alternatively, since the size of a single pixel identified by the user increases as the size of the window increases and the size of a single pixel identified by the user decreases as the distance of the window increases, the processor (130) can increase the distance of the window as the size of the window increases, thereby maintaining the size of a single pixel identified by the user at a preset size.

[0069] When a user command is received, the processor (130) may control the display panel (120) to display a third XR image with the window size changed to within a first size instead of displaying a second XR image. For example, when a user command is received, the processor (130) may control the display panel (120) to display a third XR image with the window size changed to a first size based on the user's viewing angle without changing the window distance.

[0070] Whether to display the second XR image or the third XR image can be set by the user. For example, if the user has set a size limit, the processor (130) can control the display panel (120) to display the third XR image instead of the second XR image when a user command is received. Alternatively, if the user has not set a size limit, the processor (130) can display the second XR image when a user command is received.

[0071] However, this is not limited thereto, and whether the second XR image or the third XR image is displayed may be determined according to various conditions. For example, the processor (130) may control the display panel (120) to display the second XR image or the third XR image based on the distance of the window. For instance, the processor (130) may control the display panel (120) to display the second XR image if the distance of the window is less than a preset distance, and to display the third XR image if the distance of the window is greater than or equal to the preset distance.

[0072] When a first user command is received to enlarge the window size to a second size or larger than the first size, the processor (130) controls the display panel (120) to display a second XR image, and when a second user command is received to enlarge the window size to a size between the first size and the second size, the processor (130) may control the display panel (120) to display a third XR image in which the size of the first XR image has been changed to within the first size. That is, the window distance may be changed only when the user intends to enlarge the window size to a size greater than the second size, and the window distance may be maintained when the user intends to enlarge the window size to a size between the first size and the second size.

[0073] The processor (130) may acquire a first XR image or a second XR image to include at least one of a first graphic object representing the display position of a window or a second graphic object representing a first size. For example, the processor (130) may acquire a first XR image or a second XR image to include the shadow of the window as the first graphic object. Through this, the user can detect the distance to the window. Alternatively, the processor (130) may acquire a first XR image or a second XR image to include a second graphic object representing a first size. Through this, the user can identify how much the size of the window changes to change the distance to the window. However, it is not limited thereto, and the processor (130) may acquire a first XR image or a second XR image to include a second graphic object representing a first size only during the time when a user command is received.

[0074] The processor (130) can control the display panel (120) to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise. For example, if the distance of the window is to be changed from 1m to 2m according to a user command, the processor (130) can control the display panel (120) to display a plurality of additional XR images in which the distance of the window is changed stepwise from 1m to 2m. That is, the processor (130) can control the display panel (120) to display the first XR image, then sequentially display a plurality of additional XR images, and then display the second XR image.

[0075] The processor (130) may acquire multiple additional XR images by changing the display state of the window. For example, the processor (130) may acquire multiple additional XR images by increasing the transparency of the window. While the multiple additional XR images are displayed, the user can identify that the transparency of the window has increased and that the distance of the window is changing.

[0076] In one embodiment, the first size may be based on the viewing angle of the user of the electronic device (100). That is, when the processor (130) receives a user command to enlarge the size of the window to a size greater than the first size based on the viewing angle of the user of the electronic device (100), the processor may change the distance of the window in the first XR image and change the size of the first XR image to a size corresponding to the user command to obtain a second XR image.

[0077] The processor (130) can identify a viewing angle based on at least one of the type of content, the user's eyesight, or the size of the pixels included in the window. For example, the processor (130) can identify a viewing angle with a size of 16:9 if the type of content is a first type, and identify a viewing angle with a size of 16:10 if the type of content is a second type. However, it is not limited thereto, and the viewing angle may be a value pre-set by the developer of the electronic device (100), or a value measured by the user using a UI function that measures the viewing angle.

[0078] FIG. 2 is a block diagram showing the detailed configuration of an electronic device (100) according to one embodiment of the present disclosure. The electronic device (100) may include a memory (110), a display panel (120), and a processor (130). Additionally, according to FIG. 2, the electronic device (100) may further include a communication interface (140), a user interface (150), a camera (160), a microphone (170), and a speaker (180). Detailed descriptions of parts of the components shown in FIG. 2 that overlap with the components shown in FIG. 1 are omitted.

[0079] The communication interface (140) is a configuration that performs communication with various types of external devices according to various types of communication methods. For example, an electronic device (100) can perform communication with a server, other electronic devices, user terminal devices, etc. through the communication interface (140).

[0080] The communication interface (140) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0081] The Wi-Fi module and Bluetooth module perform communication using the Wi-Fi and Bluetooth methods, respectively. When using the Wi-Fi or Bluetooth module, various connection information, such as the SSID and session key, is transmitted and received first; after establishing a communication connection using this information, various data can be transmitted and received. The infrared communication module performs communication according to infrared communication (IrDA, Infrared Data Association) technology, which wirelessly transmits data over short distances using infrared rays that lie between visible light and millimeter waves.

[0082] In addition to the communication method described above, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0083] Alternatively, the communication interface (140) may include a wired communication interface such as HDMI, DP, Thunderbolt, USB, RGB, D-SUB, DVI, etc.

[0084] In addition, the communication interface (140) may include at least one of a LAN (Local Area Network) module, an Ethernet module, or a wired communication module that performs communication using a pair cable, a coaxial cable, or a fiber optic cable.

[0085] The user interface (150) may be implemented as a button, touchpad, mouse, and keyboard, or as a touch screen capable of performing display functions and operation input functions. Here, the button may be a various type of button, such as a mechanical button, touchpad, or wheel, formed in any area of ​​the exterior of the main body of the electronic device (100), such as the front, side, or back.

[0086] The camera (160) is configured to capture still images or video. The camera (160) can capture a still image at a specific point in time, but can also capture a series of still images.

[0087] The camera (160) can capture the front of the electronic device (100) to capture the actual environment in front of the electronic device (100). The processor (130) can include the image captured through the camera (160) in the XR image.

[0088] The camera (160) includes a lens, a shutter, an aperture, a solid-state image sensor, an AFE (Analog Front End), and a TG (Timing Generator). The shutter controls the time when light reflected from a subject enters the camera (160), and the aperture controls the amount of light incident on the lens by mechanically increasing or decreasing the size of the opening through which light enters. When light reflected from a subject accumulates as photocharge, the solid-state image sensor outputs an image based on the photocharge as an electrical signal. The TG outputs a timing signal for reading out pixel data from the solid-state image sensor, and the AFE samples and digitizes the electrical signal output from the solid-state image sensor.

[0089] The microphone (170) is configured to receive sound input and convert it into an audio signal. The microphone (170) is electrically connected to the processor (130) and can receive sound under the control of the processor (130).

[0090] For example, the microphone (170) may be formed as an integrated unit on the upper side, front side, or side side of the electronic device (100). Alternatively, the microphone (170) may be provided in a remote control or the like, separate from the electronic device (100). In this case, the remote control may receive sound through the microphone (170) and provide the received sound to the electronic device (100).

[0091] The microphone (170) may include various configurations such as a microphone that collects analog sound, an amplifier circuit that amplifies the collected sound, an A / D conversion circuit that samples the amplified sound and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0092] Meanwhile, the microphone (170) may be implemented in the form of a sound sensor, and any configuration capable of collecting sound is acceptable.

[0093] The speaker (180) is a component that outputs various audio data processed by the processor (130), as well as various notification sounds or voice messages.

[0094] As described above, when the size of the window included in the XR image is expanded to a first size based on the user's viewing angle of the electronic device, the electronic device (100) can change the distance of the window to relieve the user's inconvenience.

[0095] The operation of the electronic device (100) will be described in more detail below through FIGS. 3 to 10. FIGS. 3 to 10 describes individual embodiments for the convenience of explanation. However, the individual embodiments of FIGS. 3 to 10 may be implemented in any combination.

[0096] FIG. 3 is a drawing for explaining the structure of an electronic device (100) according to one embodiment of the present disclosure.

[0097] The electronic device (100) may include a camera (160). The camera (160) may include a pair of first type cameras positioned at a location corresponding to the center of each of the left-eye display and the right-eye display on the display panel, a pair of second type cameras positioned on the left and right sides above the display panel (120), and a pair of second type cameras positioned on the left and right sides below the display panel (120).

[0098] The first type of camera captures the surrounding environment, and the captured images can be used to implement mixed reality. The second type of camera monitors the position of the user's head and can detect the user's hand gestures.

[0099] The electronic device (100) may include a microphone (170) and a speaker (180). Each of the microphone (170) and the speaker (180) may extend from the display panel (120) and be positioned on a leg that wraps around the user's head.

[0100] The electronic device (100) may include a power button (310) and a volume button (320). The processor (130) may turn on or turn off the electronic device (100) based on a long push of the power button (310), turn on or turn off the screen of the electronic device (100) based on a short push of the power button (310), and may identify the user's fingerprint through the power button (310). The processor (130) may change the volume of the electronic device (100) through the volume button (320).

[0101] The electronic device (100) may include a sensor (330) and a status indicator (340). The processor (130) can identify the distance between the electronic device (100) and an object in front of the electronic device (100) through the sensor (330). The processor (130) can display the status of the electronic device (100) through the status indicator (340).

[0102] The electronic device (100) may further include a face tracking camera, an LED for the face tracking camera, an eye tracking camera, and a proximity sensor positioned in the direction in which the user's face touches the electronic device (100).

[0103] A face tracking camera can identify the user's face and detect facial movements. An LED for the face tracking camera can output a light source for implementing an infrared image. An eye tracking camera can detect the user's eyes. A proximity sensor can be used to identify whether the user is wearing the electronic device (100).

[0104] FIG. 4 is a diagram illustrating the operation when a user command to enlarge the size of a window is received according to one embodiment of the present disclosure.

[0105] The processor (130) can control the display panel (120) to display a first XR image including a window that displays content. For example, the processor (130) can control the display panel (120) to display a first XR image including a window of size 1 (410-1), as shown at the top of FIG. 4. At the top of FIG. 4, the first size (420) is a size based on the user's viewing angle and is not displayed to the user, but is shown for convenience of explanation.

[0106] When the processor (130) receives a user command to enlarge the size of the window to a size smaller than a first size based on the user's viewing angle, the processor (130) can control the display panel (120) to display a second XR image in which the window size has been changed from the first XR image. For example, as shown in the middle of FIG. 4, when the processor (130) receives a user command to enlarge the size of the window to a size smaller than a first size based on the user's viewing angle, the processor (130) can control the display panel (120) to display a second XR image in which the window size 1 (410-1) has been changed to size 2 (410-2). In this case, the processor (130) may not adjust the window distance.

[0107] The processor (130) may display a graphic object (430-1) indicating that zooming is possible while a user command is received. Additionally, the processor (130) may display a first size (420) while a user command is received.

[0108] When the processor (130) receives a user command to enlarge the size of the window to a first size based on the user's viewing angle, it can control the display panel (120) to display a second XR image in which the distance of the window in the first XR image has been changed. For example, when the processor (130) receives a user command to enlarge the size of the window to a first size (420) based on the user's viewing angle, as shown at the bottom of FIG. 4, it can control the display panel (120) to display a second XR image in which the size of the window 2 (410-2) has been changed to a size 3 (410-3). However, this may be an operation while the user command is maintained. For example, the user may input the user command via grab and drag, and a window such as the one at the bottom of FIG. 4 may be maintained while the grab is maintained. However, when the grab is released, the processor (130) may change the size of the window or change the distance of the window. That is, the processor (130) identifies that if the size of the window becomes larger than the first size (420), it causes inconvenience to the user's viewing, and can change the size of the window or change the distance of the window, which is explained through FIGS. 5a to 5c.

[0109] However, it is not limited to this, and the processor (130) may maintain a window such as the bottom of FIG. 4 even after the grab is released if the time during which the grab is maintained without dragging is longer than a preset time.

[0110] The processor (130) may display a graphic object (430-2) indicating that zooming in and out is possible while a user command is received, but at least one of the color or shape may differ from the graphic object (430-1) shown in the center of FIG. 4. That is, when the size of the window becomes larger than the first size (420), the processor (130) may inform the user that viewing may be uncomfortable by displaying a graphic object (430-2) in which at least one of the color or shape of the graphic object (430-1) has been changed.

[0111] The processor (130) may display a first size (420) while a user command is received. However, it is not limited thereto, and the processor (130) may display the first size (420) only when a user command is received and the size of the window has grown larger than the first size (420).

[0112] In Fig. 4, for the convenience of explanation, the user command is described as a grab-and-drag method, but the user command can be entered in any variety of ways.

[0113] FIGS. 5a to 5c are drawings for explaining the operation of changing the distance of a window according to one embodiment of the present disclosure.

[0114] The processor (130) can display a first window (510-1) of a second size smaller than a first size (520) based on the user's viewing angle, as shown in FIG. 5a. The processor (130) can display the first window (510-1) at a first position.

[0115] When the processor (130) receives a user command to enlarge the first window (510-1) to a first size (520) or larger while the first window (510-1) is displayed, it can change the first window (510-1) from a first position to a second window (510-2) of a third size, as shown in FIG. 5b.

[0116] If the processor (130) identifies that the third size is greater than or equal to the first size (520), it can increase the distance of the window by 530, as illustrated in FIG. 5c. For example, the processor (130) can display a third window (510-3) by moving the second window (510-2) to a second position that is 530 away from the first position. That is, the processor (130) can change at least one of the size or distance of the window. Through this operation, the inconvenience of a user viewing a very large window from too close a distance can be reduced.

[0117] The processor (130) can identify the degree of change in the distance at which the window is displayed based on at least one of a user command or the size of the pixels included in the window. For example, the processor (130) can increase the distance of the window as the window becomes larger according to a user command. Alternatively, the processor (130) can change the distance of the window so that the size of the pixels included in the window appears to the user as a preset size.

[0118] However, it is not limited thereto, and the processor (130) may identify at least one of the distance at which the window is displayed or the size of the window based on at least one of the size of the pixels included in the window or a user command. That is, the processor (130) may change the distance of the window as well as the size of the window to provide the user with a window of an optimal size.

[0119] FIG. 6 is a drawing for explaining the operation of changing one of the horizontal and vertical dimensions of a window according to one embodiment of the present disclosure.

[0120] When the processor (130) receives a user command to change either the width or the height of the window, it changes either the width or the height of the window according to the user command and can additionally change the other width or the height of the window.

[0121] For example, when the processor (130) receives a user command to change the vertical of a window as shown at the top of FIG. 6, it changes the vertical of the window according to the user command (610-1), and as shown at the middle of FIG. 6, it can further change the horizontal of the window based on the changed vertical (610-2). At this time, the processor (130) can change the horizontal of the window so that the horizontal and vertical ratio of the window prior to the user command is maintained.

[0122] The processor (130) can change at least one of the size or distance of the window when the size of the window becomes larger than a first size based on the viewing angle as the width and height of the window are changed. For example, as shown in the middle of FIG. 6, when the size of the window becomes larger than a first size (620) based on the viewing angle as the width and height of the window are changed, the processor (130) can change the distance of the window as shown in the bottom of FIG. 6 (610-3).

[0123] FIGS. 7 to 9 are drawings for explaining a viewing angle according to one embodiment of the present disclosure.

[0124] The processor (130) can identify the viewing angle based on at least one of the type of content, the user's vision, or the size of the pixels included in the window.

[0125] For example, the processor (130) can identify a 60-degree viewing angle capable of color distinction if the type of content is a movie type, as shown in FIG. 7, and a 20-degree viewing angle capable of reading if the type of content is a reading type.

[0126] Alternatively, the processor (130) may identify a viewing angle such that the size of the pixels included in the window is a preset size. For example, as illustrated in FIG. 8, the pixel size that a user with visual acuity 1.0 can perceive from a distance of 5 m is about 1.5 mm, and the processor (130) may identify a viewing angle that can provide the user with a window containing pixels of a preset size based on this information.

[0127] Alternatively, the processor (130) may identify the viewing angle based on the user's visual acuity. In FIG. 8, it is assumed that the user's visual acuity is 1, but visual acuity may vary depending on the user. For example, as shown in FIG. 9, a user with visual acuity of 0.5 can identify pixels only if the window is 910 in size, a user with visual acuity of 1.0 can identify pixels only if the window is 920 in size, and a user with visual acuity of 2.0 can identify pixels only if the window is 930 in size. That is, a user with visual acuity of 0.5 may find it difficult to identify pixels contained within a window of 920 in size. Therefore, the processor (130) may identify the pixel size that the user can identify based on the user's visual acuity, and identify the viewing angle based on the identified pixel size.

[0128] FIG. 10 is a drawing for explaining a graphic object displayed during a window size change according to one embodiment of the present disclosure.

[0129]

[0130] The processor (130) can display graphic objects while a user command is being entered. For example, the processor (130) can display graphic objects while a user command is being entered, as illustrated in FIG. 10. Additionally, the processor (130) can change the display state based on a first size based on the viewing angle. For example, when the size of the window (1020) according to the user command gradually increases, the processor (130) can display a first graphic object (1030-1) and a second graphic object (1030-2) based on the size of the window (1020), and when the window (1020) increases beyond the first size (1020), it can display a third graphic object (1030-3) with the color of the second graphic object (1030-2) changed to inform the user that it is out of the viewing angle.

[0131] However, it is not limited to this, and the processor (130) may provide a warning that the size of the window has moved out of the viewing angle in various ways. For example, when the size of the window moves out of the viewing angle, the processor (130) may provide a warning sound through the speaker (180).

[0132] The processor (130) may display a graphic object indicating the display location of the window. For example, the processor (130) may acquire a first XR image or a second XR image to include the shadow of the window as the first graphic object. Through this, the user can detect the distance from the window.

[0133] The processor (130) can control the display panel (120) to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise. For example, if the distance of the window is to be changed from 1m to 2m according to a user command, the processor (130) can control the display panel (120) to display a plurality of additional XR images in which the distance of the window is changed stepwise from 1m to 2m. That is, the processor (130) can control the display panel (120) to display the first XR image, then sequentially display a plurality of additional XR images, and then display the second XR image.

[0134] The processor (130) may acquire multiple additional XR images by changing the display state of the window. For example, the processor (130) may acquire multiple additional XR images by increasing the transparency of the window. While the multiple additional XR images are displayed, the user can identify that the transparency of the window has increased and that the distance of the window is changing.

[0135] FIG. 11 is a flowchart illustrating a method for controlling an electronic device according to one embodiment of the present disclosure.

[0136] First, a display panel including a left-eye display and a right-eye display is controlled to display a first XR (extended reality) image including a window that displays content (S1110). Then, when a user command is received to enlarge the size of the window to a first size or larger based on the user's viewing angle of the electronic device, the display panel is controlled to display a second XR image in which the distance of the window in the first XR image has been changed (S1120).

[0137] Additionally, the step (S1120) of controlling the display panel to display the second XR image can acquire the second XR image by changing the distance of the window from the first XR image and changing the size of the window to a size corresponding to the user command when a user command is received.

[0138] And, the step (S1120) of controlling a display panel to display a second XR image identifies the degree of change in the distance at which the window is displayed based on at least one of a user command or the size of a pixel included in the window, and based on the degree of change, changes the distance of the window in the first XR image and changes the size of the window to a size corresponding to the user command to obtain the second XR image.

[0139] Additionally, the step (S1120) of controlling the display panel to display the second XR image may, when a user command is received, control the display panel to display a third XR image in which the window size is changed to within the first size instead of displaying the second XR image.

[0140] And, the step (S1120) of controlling the display panel to display the second XR image can control the display panel to display the second XR image when a first user command is received to enlarge the window size to a second size larger than the first size, and when a second user command is received to enlarge the window size to a size between the first size and the second size, the display panel can control the display panel to display the third XR image in which the size of the first XR image has been changed to within the first size.

[0141] Additionally, the step of controlling a display panel to display a first XR image (S1110) may acquire a first XR image to include at least one of a first graphic object representing a display position of a window or a second graphic object representing a first size, and the step of controlling a display panel to display a second XR image (S1120) may acquire a second XR image to include at least one of a first graphic object representing a display position of a window or a second graphic object representing a first size.

[0142] And, it may further include a step of controlling a display panel to display a plurality of additional XR images in which the distance between the first XR image and the second XR image is changed stepwise.

[0143] In addition, the step of controlling the display panel to display multiple additional XR images can acquire multiple additional XR images by changing the display state of the window.

[0144] And, the step (S1120) of controlling the display panel to display the second XR image can identify the viewing angle based on at least one of the type of content, the user's eyesight, or the size of the pixels included in the window.

[0145] An electronic device according to one embodiment as described above comprises a memory for storing instructions, a display panel including a left-eye display and a right-eye display, and one or more processors including processing circuitry, wherein the instructions, when executed individually or collectively by the one or more processors, control the display panel to display a first XR (extended reality) image including a window displaying content, receive a user command to enlarge the size of the window to a first size or larger, and control the display panel to display a second XR image instead of the first XR image based on the user command, and the second XR image may be an image in which the distance of the window from the first XR image has been changed.

[0146] According to one example, when the instructions are executed individually or collectively by one or more processors, when the user command is received, the distance of the window in the first XR image is changed and the size of the window is changed to a size corresponding to the user command to obtain the second XR image.

[0147] According to one example, when the instructions are executed individually or collectively by one or more processors, the degree of change in the distance at which the window is displayed is identified based on at least one of the user command or the size of the pixels included in the window, and based on the degree of change, the distance of the window in the first XR image is changed and the size of the window is changed to a size corresponding to the user command to obtain the second XR image.

[0148] According to one example, when the instructions are executed individually or collectively by one or more processors, the display panel may be controlled to display a third XR image in which the size of the window has been changed to within the first size, instead of displaying the second XR image, when the user command is received.

[0149] According to one example, when the instructions are executed individually or collectively by one or more processors, if a first user command is received to enlarge the size of the window to a second size larger than the first size, the display panel is controlled to display the second XR image, and if a second user command is received to enlarge the size of the window to between the first size and the second size, the display panel is controlled to display a third XR image in which the size of the first XR image is changed to within the first size.

[0150] According to one example, when the instructions are executed individually or collectively by one or more processors, the first XR image or the second XR image may be acquired to include at least one of a first graphic object representing a display position of the window or a second graphic object representing a first size.

[0151] According to one example, when the instructions are executed individually or collectively by the one or more processors, the display panel may be controlled to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise.

[0152] According to one example, when the instructions are executed individually or collectively by one or more processors, the display state of the window can be changed to obtain the plurality of additional XR images.

[0153] According to one example, the first size is based on the viewing angle of the user of the electronic device, and the instructions, when executed individually or collectively by the one or more processors, can identify the viewing angle based on at least one of the type of content, the user's visual acuity, or the size of the pixels included in the window.

[0154] According to one example, when the instructions are executed individually or collectively by one or more processors, they provide a virtual environment to the user of the electronic device through the first XR image or the second XR image, and the distance of the window may be the depth at which the window is displayed in the virtual environment.

[0155] A control method for an electronic device according to one embodiment includes the steps of: controlling a display panel including a left-eye display and a right-eye display to display a first XR (extended reality) image including a window for displaying content; receiving a user command to enlarge the size of the window to a size greater than or equal to a first size; and controlling the display panel to display a second XR image instead of the first XR image based on the user command, wherein the second XR image may be an image in which the distance of the window from the first XR image has been changed.

[0156] According to one example, the step of controlling the display panel to display the second XR image may be to obtain the second XR image by changing the distance of the window from the first XR image and changing the size of the window to a size corresponding to the user command when the user command is received.

[0157] According to one example, the step of controlling the display panel to display the second XR image may involve identifying the degree of change in the distance at which the window is displayed based on at least one of the user command or the size of the pixels included in the window, and based on the degree of change, changing the distance of the window in the first XR image and changing the size of the window to a size corresponding to the user command to obtain the second XR image.

[0158] According to one example, the step of controlling the display panel to display the second XR image may, when the user command is received, control the display panel to display a third XR image in which the size of the window is changed to within the first size instead of displaying the second XR image.

[0159] According to one example, the step of controlling the display panel to display the second XR image may involve controlling the display panel to display the second XR image when a first user command is received to enlarge the size of the window to a second size greater than the first size, and controlling the display panel to display a third XR image in which the size of the first XR image is changed to within the first size when a second user command is received to enlarge the size of the window to a size between the first size and the second size.

[0160] According to one example, the step of controlling the display panel to display the first XR image may involve acquiring the first XR image to include at least one of a first graphic object representing the display position of the window or a second graphic object representing the first size, and the step of controlling the display panel to display the second XR image may involve acquiring the second XR image to include at least one of a first graphic object representing the display position of the window or a second graphic object representing the first size.

[0161] According to one example, the method may further include the step of controlling the display panel to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise.

[0162] According to one example, the step of controlling the display panel to display the plurality of additional XR images can be to obtain the plurality of additional XR images by changing the display state of the window.

[0163]

[0164] According to one example, the first size is based on the viewing angle of the user of the electronic device, and the step of controlling the display panel to display the second XR image can identify the viewing angle based on at least one of the type of content, the user's visual acuity, or the size of the pixels included in the window.

[0165] In a non-transient computer-readable recording medium storing a program for executing a method of operation of an electronic device according to one embodiment, the method of operation may include the step of controlling a display panel including a left-eye display and a right-eye display to display a first XR (extended reality) image including a window displaying content, and the step of controlling the display panel to display a second XR image in which the distance of the window from the first XR image has been changed when a user command is received to enlarge the size of the window to a first size or larger based on the viewing angle of the user of the electronic device.

[0166] According to various embodiments of the present disclosure as described above, when the size of a window included in an XR image is enlarged to a first size or larger based on the user's viewing angle of the electronic device, the electronic device can resolve the user's inconvenience by changing the distance of the window.

[0167] The electronic device according to one or more embodiments disclosed in this disclosure may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this disclosure is not limited to the devices described above.

[0168] One or more embodiments of the present disclosure and the terms used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In the present disclosure, each of phrases such as “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “at least one of A, B, or C” may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0169] The term “module” as used in one or more embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0170] One or more embodiments of the present disclosure may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0171] According to one embodiment, the method according to one or more embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0172] According to one or more embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one or more embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one or more embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, Memory for storing instructions; A display panel including a left-eye display and a right-eye display; and One or more processors including processing circuitry; and When the above instructions are executed individually or collectively by the one or more processors, Control the display panel to display a first XR (extended reality) image including a window for displaying content, and Receiving a user command to enlarge the size of the above window to a first size or larger, and Based on the reception of the above user command, the display panel is controlled to display a second XR image instead of the first XR image, and The above second XR image is, An electronic device, which is an image in which the distance of the window in the first XR image is changed.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, An electronic device that, upon receiving the above user command, changes the distance of the window in the first XR image and changes the size of the window to a size corresponding to the above user command to acquire the second XR image.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, Identifying the degree of change in the distance at which the window is displayed based on at least one of the above user command or the size of the pixels included in the window, and An electronic device that acquires a second XR image by changing the distance of the window in the first XR image and changing the size of the window to a size corresponding to the user command based on the degree of change.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, An electronic device that, upon receiving the above user command, controls the display panel to display a third XR image in which the size of the window has been changed to within the first size, instead of displaying the second XR image.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, When a first user command is received to enlarge the size of the above window to a second size or larger than the first size, the display panel is controlled to display the second XR image, and An electronic device that controls the display panel to display a third XR image in which the size of the first XR image is changed to within the first size when a second user command is received to enlarge the size of the window between the first size and the second size.

6. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, An electronic device for acquiring the first XR image or the second XR image to include at least one of a first graphic object indicating the display position of the window or a second graphic object indicating the first size.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, An electronic device that controls a display panel to display a plurality of additional XR images in which the distance of the window between the first XR image and the second XR image is changed stepwise.

8. In Paragraph 7, When the above instructions are executed individually or collectively by the one or more processors, An electronic device that acquires a plurality of additional XR images by changing the display state of the above window.

9. In Paragraph 1, The above first size is, Based on the user's viewing angle of the above electronic device, When the above instructions are executed individually or collectively by the one or more processors, An electronic device that identifies the viewing angle based on at least one of the type of content, the user's vision, or the size of the pixels included in the window.

10. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, A virtual environment is provided to the user of the electronic device through the first XR image or the second XR image, and The distance of the above window is, An electronic device, which is the depth at which the window is displayed in the above virtual environment.

11. In a method for controlling an electronic device, A step of controlling a display panel including a left-eye display and a right-eye display to display a first XR (extended reality) image including a window for displaying content; A step of receiving a user command to enlarge the size of the above window to a first size or larger; and The method includes the step of controlling the display panel to display a second XR image instead of the first XR image based on the reception of the user command; The above second XR image is, A control method in which the distance of the window in the first XR image is changed.

12. In Paragraph 11, The step of controlling the display panel to display the second XR image is: A control method for obtaining a second XR image by changing the distance of the window in the first XR image and changing the size of the window to a size corresponding to the user command when the above user command is received.

13. In Paragraph 11, The step of controlling the display panel to display the second XR image is: Identifying the degree of change in the distance at which the window is displayed based on at least one of the above user command or the size of the pixels included in the window, and A control method for obtaining a second XR image by changing the distance of the window in the first XR image based on the degree of change and changing the size of the window to a size corresponding to the user command.

14. In Paragraph 11, The step of controlling the display panel to display the second XR image is: A control method for controlling the display panel to display a third XR image in which the size of the window is changed to within the first size, instead of displaying the second XR image, when the above user command is received.

15. In Paragraph 11, The step of controlling the display panel to display the second XR image is: When a first user command is received to enlarge the size of the above window to a second size or larger than the first size, the display panel is controlled to display the second XR image, and A control method for controlling a display panel to display a third XR image in which the size of the first XR image has been changed to within the first size when a second user command to expand the size of the window between the first size and the second size is received.

Images