Wearable device, method, and non-transitory computer-readable storage medium for displaying screen on basis of user's eyesight

Abstract

Disclosed is a wearable device. The wearable device may receive an input for changing the distance between the user and the virtual window. The wearable device, on the basis of changing the distance between the user and the virtual window from the first distance while receiving the input, can identify that the size of the at least one content included in the virtual window corresponds to eyesight information of the user in the gaze of the user at a second distance, changed from the first distance, of the virtual window from the user, and on the basis of identifying the second distance of the virtual window on the basis of the eyesight information, can stop changing the distance between the user and the virtual window according to the received input.

Description

Wearable device, method, and non-transient computer-readable storage medium for displaying a screen based on a user's eyesight

[0001] The present disclosure relates to a wearable device, a method, and a non-transient computer-readable storage medium for displaying a screen based on a user's vision.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide augmented reality (AR) services by displaying computer-generated information in conjunction with external objects within the real world. The electronic device may be a wearable device that can be worn by a user. For example, the electronic device may be AR glasses and / or a head-mounted device (HMD). The display of the electronic device may display the screen of an external electronic device.

[0003] A wearable device according to one embodiment is disclosed. The wearable device may include a display assembly comprising displays arranged to face the two eyes of a user based on the user wearing the wearable device, at least one processor comprising a processing circuit, and a memory comprising one or more storage media for storing instructions. When the above instructions are executed individually or collectively by the at least one processor, the wearable device displays a virtual window containing at least one content at a position at a first distance from the user in the user's line of sight on the display assembly, receives an input to change the distance between the user and the virtual window, and while receiving the input, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content included in the virtual window corresponds to the user's visual information in the user's line of sight at a second distance from the user to the virtual window changed from the first distance, and based on identifying the second distance of the virtual window based on the visual information, may cause the device to stop changing the distance between the user and the virtual window according to the received input.

[0004] A method according to one embodiment is disclosed. The method may be performed in a wearable device comprising a display assembly including displays arranged to face the two eyes of a user based on the user wearing the wearable device. The method may include: displaying a virtual window containing at least one content at a position at a first distance from the user in the user’s line of sight on the display assembly; receiving an input to change the distance between the user and the virtual window; while receiving the input, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content included in the virtual window corresponds to the user’s visual information in the user’s line of sight at a second distance from the user to the virtual window changed from the first distance; and stopping the change of the distance between the user and the virtual window according to the received input based on identifying the second distance of the virtual window based on the visual information.

[0005] A non-transitory computer-readable storage medium according to one embodiment is disclosed. The non-transitory computer-readable storage medium may store a program including instructions. When the above instructions are executed individually or collectively by at least one processor comprising a processing circuit of a wearable device including a display assembly comprising displays arranged to face the two eyes of the user based on the user wearing the wearable device, the wearable device may display a virtual window containing at least one content at a position of a first distance from the user on the user's line of sight on the display assembly, receive an input to change the distance between the user and the virtual window, and while receiving the input, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content contained in the virtual window corresponds to the user's visual information in the user's line of sight, based on changing the distance between the user and the virtual window from the first distance, and based on identifying the second distance of the virtual window from the user that has been changed from the first distance, may cause the device to stop changing the distance between the user and the virtual window according to the received input.

[0006] The above-described and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the detailed description below together with the accompanying drawings.

[0007] FIG. 1 is a block diagram illustrating an exemplary electronic device in a network environment according to various embodiments.

[0008] FIG. 2a is a perspective view of an exemplary wearable device according to various embodiments.

[0009] FIG. 2b is a perspective view illustrating one or more hardware components disposed within an exemplary wearable device according to various embodiments.

[0010] FIG. 3a is a perspective view illustrating an example of the appearance of a wearable device according to various embodiments.

[0011] FIG. 3b is a perspective view illustrating an example of the appearance of a wearable device according to various embodiments.

[0012] FIG. 4a is a block diagram illustrating an exemplary configuration of a wearable device according to various embodiments.

[0013] FIG. 4b is a diagram illustrating an example of a virtual three-dimensional space depicted by a wearable device according to various embodiments.

[0014] FIG. 4c is a diagram illustrating an example of a user's field of vision displayed by a wearable device according to various embodiments.

[0015] FIG. 5a is a diagram illustrating an example of a depth range in which a user can resolve content according to the user's vision within a virtual three-dimensional space according to various embodiments.

[0016] FIG. 5b is a diagram illustrating an example of a size range in which content can be resolved by a user according to the user's vision at a specific depth within a virtual three-dimensional space according to various embodiments.

[0017] FIG. 5c is a diagram illustrating an example of contents having different sizes displayed within a depth range in a virtual three-dimensional space according to various embodiments.

[0018] FIG. 5d is a diagram illustrating an example of content having different sizes displayed within a depth range in a virtual three-dimensional space according to various embodiments, among which content has a size that is resolvable by the user according to the user's visual acuity.

[0019] FIG. 5e is a diagram illustrating an example of content within a size range and depth range that can be resolved by the user according to the user's vision in a virtual three-dimensional space according to various embodiments.

[0020] FIG. 6a is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments.

[0021] FIG. 6b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0022] FIG. 6c is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments.

[0023] FIG. 6d is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0024] FIG. 6e is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments.

[0025] FIG. 6f is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0026] FIG. 7a is a diagram illustrating an example of an operation in which a wearable device according to various embodiments displays a two-dimensional window within a depth range that is resolvable by a user.

[0027] FIG. 7b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments changes the display position of a two-dimensional window based on user input.

[0028] FIG. 7c illustrates an example of operation in which a wearable device according to various embodiments displays a two-dimensional window at a changed position within a depth range that is resolvable by the user.

[0029] FIG. 8a is a diagram illustrating an example of an operation in which a wearable device according to various embodiments moves a two-dimensional window to a position determined by the user's eyesight within a depth range that the user can resolve.

[0030] FIG. 8b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments moves two-dimensional windows to a position determined by the user's vision within a depth range that the user can resolve.

[0031] FIG. 8c is a diagram illustrating a planar view of two-dimensional windows moved by a wearable device according to various embodiments.

[0032] FIG. 9a is a diagram illustrating in a planar view a situation in which a wearable device according to various embodiments positions two-dimensional windows at different depths.

[0033] FIG. 9b is a diagram illustrating in a plane a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0034] FIG. 9c is a diagram illustrating a situation in which a wearable device according to various embodiments changes its size as it moves a two-dimensional window.

[0035] FIG. 9d is a diagram illustrating in a plane a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0036] FIG. 9e is a diagram illustrating a situation in which a wearable device according to various embodiments changes its size as it moves a two-dimensional window.

[0037] FIG. 10a is a diagram illustrating in a planar view a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0038] FIG. 10b is a diagram illustrating a situation in which a wearable device according to various embodiments changes its size as it moves a two-dimensional window.

[0039] FIG. 10c is a diagram illustrating in a plane a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0040] FIG. 10d is a diagram illustrating a situation in which a wearable device according to various embodiments changes its size as it moves a two-dimensional window.

[0041] FIG. 11a is a diagram illustrating in a planar view a situation in which a wearable device according to various embodiments bends a two-dimensional window as it moves the two-dimensional window.

[0042] FIG. 11b is a diagram illustrating a situation in which a wearable device according to various embodiments bends a two-dimensional window in the left and right directions as it moves the two-dimensional window.

[0043] FIG. 11c is a diagram illustrating a situation in which a wearable device according to various embodiments bends a two-dimensional window in the up and down direction as it moves the two-dimensional window.

[0044] FIG. 12 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0045] FIG. 13 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0046] FIG. 14 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0047] FIG. 15 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0048] FIG. 16 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0049] FIG. 17 is a flowchart illustrating exemplary operation of a wearable device according to various embodiments.

[0050] FIG. 1 is a block diagram illustrating an exemplary electronic device in a network environment according to various embodiments.

[0051] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some various embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some various embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0052] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof. Thus, the processor (120) may include various processing circuits and / or multiple processors. For example, the term "processor" as used herein, including in the claims, may include various processing circuits including at least one processor, and at least one of the at least one processor may be configured to perform the various functions described herein individually and / or collectively in a distributed manner.When "one processor," "at least one processor," and "one or more processors" as used herein are described as being configured to perform multiple functions, these terms include, for example and without limitation, situations where one processor performs part of the mentioned functions and other processor(s) perform other parts of the mentioned functions, and situations where a single processor can perform all the mentioned functions. Additionally, at least one processor may include a combination of processors that perform the various described / disclosed functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform the various functions.

[0053] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0054] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0055] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0056] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0057] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0058] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0059] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0060] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0061] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0062] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0063] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0064] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0065] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0066] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0067] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0068] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 664 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 6 ms or less) for realizing URLLC.

[0069] An antenna module (197) can transmit a signal or power to an external source (e.g., an external electronic device) or receive it from an external source. According to one embodiment, the antenna module (197) may include an antenna comprising a radiator that includes a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0070] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0071] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0072] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In an embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0073] FIG. 2a is a perspective view of a wearable device (200) according to various embodiments. FIG. 2b is a perspective view illustrating one or more hardware components disposed within the wearable device (200) according to various embodiments. The wearable device (200) of FIG. 2a and FIG. 2b may correspond to the electronic device (101) of FIG. 1. As shown in FIG. 2a, the wearable device (200) according to one embodiment may include at least one display (250) and a frame supporting at least one display (250).

[0074] According to one embodiment, a wearable device (200) may be worn on a part of a user's body. The wearable device (200) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the wearable device (200). For example, the wearable device (200) may output a virtual reality image to the user through at least one display (250) in response to a designated (or specific) gesture of the user obtained through the motion recognition camera (240-2) of FIG. 2b.

[0075] According to one embodiment, at least one display (250) in a wearable device (200) can provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at locations corresponding to the user's left eye and right eye, respectively.

[0076] Referring to FIG. 2b, at least one display (250) may form a display area on a lens to provide a user wearing a wearable device (200) with visual information that is distinct from the visual information, along with the visual information contained in the external light passing through the lens. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by the at least one display (250) may be formed on the second surface (232) among the first surface (231) and the second surface (232) of the lens. When the user wears the wearable device (200), the external light may be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, the at least one display (250) may display a virtual reality image to be combined with a real-world image transmitted through the external light. The virtual reality image output from at least one display (250) can be transmitted to the user's eye through one or more hardware included in the wearable device (200) (e.g., optical devices (282, 284), and / or at least one waveguide (233, 234)).

[0077] According to one embodiment, a wearable device (200) may include waveguides (233, 234) that diffract light transmitted from at least one display (250) and relayed by optical devices (282, 284) and transmit it to a user. The waveguides (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano pattern may be formed on the exterior or at least a portion of the interior of the waveguides (233, 234). The nano pattern may be formed based on a polygonal and / or curved grating structure. Light incident on one end of the waveguides (233, 234) may be propagated to the other end of the waveguides (233, 234) by the nano pattern. Waveguides (233, 234) may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) and at least one reflective element (e.g., a reflective mirror). For example, waveguides (233, 234) may be placed within a wearable device (200) to guide a screen displayed by at least one display (250) to the user's eye. For example, the screen may be transmitted to the user's eye based on total internal reflection (TIR) ​​occurring within the waveguides (233, 234).

[0078] According to one embodiment, a wearable device (200) can analyze an object included in a real-world image collected through a shooting camera (240-1), combine a virtual object corresponding to an object among the analyzed objects that is the target of augmented reality provision, and display it on at least one display (250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real-world image. The wearable device (200) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (200) can perform time-of-flight (ToF) and / or simultaneous localization and mapping (SLAM) supported by the multi-camera. A user wearing the wearable device (200) can view the image displayed on at least one display (250).

[0079] According to one embodiment, the frame may be formed as a physical structure that allows the wearable device (200) to be worn on the user's body. According to one embodiment, the frame may be configured so that when the user wears the wearable device (200), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame may support at least one display (250). For example, the frame may support the first display (250-1) and the second display (250-2) so that they are positioned corresponding to the user's left and right eyes.

[0080] Referring to FIG. 2a, the frame may include a region (220) in which at least a portion of the frame contacts a part of the user's body when the user wears the wearable device (200). For example, the region (220) of the frame in contact with a part of the user's body may include a region in contact with a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the wearable device (200) contacts. According to one embodiment, the frame may include a nose pad (210) that contacts a part of the user's body. When the wearable device (200) is worn by the user, the nose pad (210) may contact a part of the user's nose. The frame may include a first temple (204) and a second temple (205) that contact a different part of the user's body distinct from the part of the user's body.

[0081] For example, the frame may include a first rim (201) covering at least a portion of a first display (250-1), a second rim (202) covering at least a portion of a second display (250-2), a bridge (203) positioned between the first rim (201) and the second rim (202), a first pad (211) positioned along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) positioned along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) extending from the first rim (201) and fixed to a portion of the wearer's ear, and a second temple (205) extending from the second rim (202) and fixed to a portion of the ear opposite to the ear. The first pad (211) and the second pad (212) may come into contact with a part of the user's nose, and the first temple (204) and the second temple (205) may come into contact with a part of the user's face and a part of the ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through a first hinge unit (206) positioned between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through a second hinge unit (207) positioned between the second rim (202) and the second temple (205). According to one embodiment, a wearable device (200) can identify an external object touching the frame (e.g., a user's fingertip) and / or a gesture performed by said external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of the surface of the frame.

[0082] According to one embodiment, the wearable device (200) may include hardware that performs various functions (e.g., hardware described above based on the block diagram of FIG. 1). For example, the hardware may include a battery module (270), an antenna module (275), optical devices (282, 284), speakers (292-1, 292-2), microphones (294-1, 294-2, 294-3), a light-emitting module (not shown), and / or a printed circuit board (290). The various hardware may be placed within a frame.

[0083] According to one embodiment, microphones (294-1, 294-2, 294-3) of a wearable device (200) are positioned on at least a portion of a frame to acquire sound signals. A first microphone (294-1) positioned on a nose pad (210), a second microphone (294-2) positioned on a second rim (202), and a third microphone (294-3) positioned on a first rim (201) are shown in FIG. 2b, but the number and position of the microphones (294) are not limited to the embodiment of FIG. 2b. If the number of microphones (294) included in the wearable device (200) is two or more, the wearable device (200) can identify the direction of the sound signal by using a plurality of microphones positioned on different portions of the frame.

[0084] According to one embodiment, optical devices (282, 284) can transmit a virtual object transmitted from at least one display (250) to wave guides (233, 234). For example, the optical devices (282, 284) may be projectors. The optical devices (282, 284) may be disposed adjacent to at least one display (250) or included within at least one display (250) as part of at least one display (250). The first optical device (282) may correspond to the first display (250-1), and the second optical device (284) may correspond to the second display (250-2). The first optical device (282) can transmit light output from the first display (250-1) to the first waveguide (233), and the second optical device (284) can transmit light output from the second display (250-2) to the second waveguide (234).

[0085] In one embodiment, the camera (240) may include an eye tracking camera (ET CAM) (240-1), a motion recognition camera (240-2), and / or a shooting camera (240-3). The shooting camera, the eye tracking camera (240-1), and the motion recognition camera (240-2) may be positioned at different locations on the frame and may perform different functions. The eye tracking camera (240-1) may output data indicating the gaze of a user wearing the wearable device (200). For example, the wearable device (200) may detect the gaze from an image containing the user's pupils obtained through the eye tracking camera (240-1). An example in which the eye-tracking camera (240-1) is positioned toward the user's right eye is shown in FIG. 2b, but the disclosure is not limited thereto, and the eye-tracking camera (240-1) may be positioned solely toward the user's left eye or toward both eyes.

[0086] In one embodiment, the camera (240-3) may capture a real image or background to be matched with a virtual image in order to implement augmented reality or mixed reality content. The camera may capture an image of a specific object located at the position where the user is looking and provide the image to at least one display (250). The at least one display (250) may display a single image in which information regarding a real image or background including the image of the specific object obtained using the camera is superimposed with a virtual image provided through optical devices (282, 284). In one embodiment, the camera may be placed on a bridge (203) positioned between the first rim (201) and the second rim (202).

[0087] In one embodiment, the eye tracking camera (240-1) can achieve more realistic augmented reality by tracking the gaze of a user wearing the wearable device (200), thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the user looks straight ahead, the wearable device (200) can naturally display environmental information related to the user's front at the location where the user is situated on at least one display (250). The eye tracking camera (240-1) may be configured to capture an image of the user's pupil to determine the user's gaze. For example, the eye tracking camera (240-1) may receive a gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the eye tracking camera (240-1) may be positioned at locations corresponding to the user's left and right eyes. For example, the eye-tracking camera (240-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (200) is located.

[0088] In one embodiment, the motion recognition camera (240-2) may provide a specific event on a screen provided on at least one display (250) by recognizing the movement of the user's entire body or part thereof, such as the user's torso, hands, or face. The motion recognition camera (240-2) may recognize the user's gesture, acquire a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (250). A processor may identify the signal corresponding to the gesture and, based on the identification, perform a designated function. In one embodiment, the motion recognition camera (240-2) may be placed on the first rim (201) and / or the second rim (202).

[0089] In one embodiment, the camera (240) included in the wearable device (200) is not limited to the eye-tracking camera (240-1) and motion recognition camera (240-2) described above. For example, the wearable device (200) can identify external objects included within the FOV by using a shooting camera (240-3) positioned toward the user's FOV. The identification of external objects by the wearable device (200) can be performed based on a sensor for identifying the distance between the wearable device (200) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (240) positioned toward the FOV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (200) may include a camera (240) (e.g., a face tracking camera) positioned toward the face to acquire an image including the face of a user wearing the wearable device (200).

[0090] Although not illustrated, according to one embodiment, the wearable device (200) may further include a light source (e.g., LED) that emits light toward a subject (e.g., user's eye, face, and / or an object outside the FOV) being photographed using a camera (240). The light source may include an LED of infrared wavelength. The light source may be placed in at least one of the frame and hinge units (206, 207).

[0091] According to one embodiment, the battery module (270) can supply power to the electronic components of the wearable device (200). In one embodiment, the battery module (270) may be placed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may each be placed in the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be placed at the end of the first temple (204) and / or the second temple (205).

[0092] According to one embodiment, the antenna module (275) may transmit a signal or power to the outside of the wearable device (200) or receive a signal or power from the outside. The antenna module (275) may be electrically and / or operationally connected to the communication module (190) of FIG. 1. In one embodiment, the antenna module (275) may be placed within the first temple (204) and / or the second temple (205). For example, the antenna module (275) may be placed close to one side of the first temple (204) and / or the second temple (205).

[0093] According to one embodiment, speakers (292-1, 292-2) can output an acoustic signal to the outside of the wearable device (200). The acoustic output module may be referred to as a speaker. In one embodiment, speakers (292-1, 292-2) may be placed within a first temple (204) and / or a second temple (205) to be placed adjacent to the ears of a user wearing the wearable device (200). For example, the wearable device (200) may include a second speaker (292-2) placed adjacent to the user's left ear by being placed within the first temple (204), and a first speaker (292-1) placed adjacent to the user's right ear by being placed within the second temple (205).

[0094] In one embodiment, a light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the wearable device (200) to the user. For example, if the wearable device (200) requires charging, it may repeatedly emit red light at a designated time. In one embodiment, the light-emitting module may be placed on the first rim (201) and / or the second rim (202).

[0095] Referring to FIG. 2b, a wearable device (200) according to one embodiment may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of a first temple (204) or a second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardware components included in the wearable device (200) may be disposed on the PCB (290). The wearable device (200) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0096] According to one embodiment, a wearable device (200) may include at least one of a gyroscope sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the wearable device (200) and / or the posture of a body part (e.g., head) of a user wearing the wearable device (200). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyroscope sensor may measure the angular velocity of each of the designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyroscope sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (200) can identify a user's motion and / or gesture performed to execute or stop a specific function of the wearable device (200) based on an IMU.

[0097] FIGS. 3a and 3b are perspective views illustrating examples of the appearance of a wearable device (300) according to various embodiments. The wearable device (300) of FIGS. 3a and 3b may be included in the electronic device (101) of FIG. 1. According to one embodiment, an example of the appearance of a first surface (310) of the housing of the wearable device (300) may be illustrated in FIG. 3a, and an example of the appearance of a second surface (320) opposite to the first surface (310) may be illustrated in FIG. 3b.

[0098] Referring to FIG. 3a, according to one embodiment, a first surface (310) of a wearable device (300) may have a shape that is attachable to a part of a user's body (e.g., the user's face). Although not illustrated, the wearable device (300) may further include a strap for fixing to a part of a user's body and / or one or more temples (e.g., a first temple (204) and / or a second temple (205) of FIG. 2a and FIG. 2b). A first display (350-1) for outputting an image to the left eye among the user's two eyes, and a second display (350-2) for outputting an image to the right eye among the two eyes may be disposed on the first surface (310). The wearable device (300) may further include a rubber or silicone packing formed on a first surface (310) to prevent and / or reduce interference caused by light different from light emitted from the first display (350-1) and the second display (350-2) (e.g., ambient light).

[0099] According to one embodiment, a wearable device (300) may include cameras (340-1, 340-2) for photographing and / or tracking both eyes of a user adjacent to each of the first display (350-1) and the second display (350-2). The cameras (340-1, 340-2) may be referred to as ET cameras. According to one embodiment, a wearable device (300) may include cameras (340-3, 340-4) for photographing and / or recognizing a user's face. The cameras (340-3, 340-4) may be referred to as FT cameras.

[0100] Referring to FIG. 3b, on a second surface (320) opposite to the first surface (310) of FIG. 3a, a camera (e.g., cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10)) and / or a sensor (e.g., a depth sensor (330)) may be disposed to obtain information related to the external environment of the wearable device (300). For example, cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) may be disposed on the second surface (320) to recognize external objects different from the wearable device (300). For example, using cameras (340-9, 340-10), the wearable device (300) can acquire images and / or videos to be transmitted to each of the user's two eyes. Camera (340-9) may be placed on the second surface (320) of the wearable device (300) to acquire an image to be displayed through a second display (350-2) corresponding to the right eye among the two eyes. Camera (340-10) may be placed on the second surface (320) of the wearable device (300) to acquire an image to be displayed through a first display (350-1) corresponding to the left eye among the two eyes.

[0101] According to one embodiment, the wearable device (300) may include a depth sensor (330) disposed on a second surface (320) to identify the distance between the wearable device (300) and an external object. Using the depth sensor (330), the wearable device (300) may obtain spatial information (e.g., a depth map) for at least a portion of the FOV of a user wearing the wearable device (300).

[0102] Although not shown, a microphone for acquiring sound output from an external object may be placed on the second surface (320) of the wearable device (300). The number of microphones may be one or more depending on the embodiment.

[0103] As described above, according to one embodiment, the wearable device (300) may have a form factor for being worn on a user's head. The wearable device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the head. Using cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) for recording video of an external space, the wearable device (300) and a server connected to the wearable device (300) (e.g., server (110) of FIG. 1) may provide an on-demand service and / or metaverse service that provides video of a location and / or place selected by the user.

[0104] According to one embodiment, a wearable device (300) may display frames acquired through cameras (340-9, 340-10) on each of a first display (350-1) and a second display (350-2). The wearable device (300) may combine a virtual object within a frame containing a real object that is displayed through the first display (350-1) and the second display (350-2), thereby providing a user with a mixed user experience of real objects and virtual objects (e.g., a video see-through (VST)). The wearable device (300) may modify the virtual object based on information acquired by cameras (340-1, 340-2, 340-3, 340-4, 340-5, 340-6, 340-7, 340-8) and / or a depth sensor (330). For example, if a visual object corresponding to a real object and a virtual object are at least partially overlapped within the frame, the wearable device (300) may stop displaying the virtual object based on detecting motion to interact with the real object. By stopping displaying the virtual object, the wearable device (300) may prevent and / or reduce the visibility of the real object as the visual object corresponding to the real object is occluded by the virtual object.

[0105] FIG. 4a is a block diagram illustrating an exemplary configuration of a block diagram of a wearable device according to various embodiments. FIG. 4b is a diagram illustrating an example of a virtual three-dimensional space depicted by a wearable device according to various embodiments. FIG. 4c is a diagram illustrating an example of a user's field of view displayed by a wearable device according to various embodiments.

[0106] The wearable device (401) of FIG. 4a may correspond to the electronic device (101) of FIG. 1. The wearable device (401) of FIG. 4a may correspond to the wearable device (200) of FIG. 2a and FIG. 2b. The wearable device (401) of FIG. 4a may correspond to the wearable device (300) of FIG. 3a and FIG. 3b.

[0107] Referring to FIG. 4a, a wearable device (401) may include at least one of a processor (420) (e.g., including a processing circuit), memory (430), displays (461, 465), and / or cameras (481, 483, 485). The processor (420) of FIG. 4a may correspond to the processor (120) of FIG. 1, and the detailed description associated with the processor (120) above applies equally to the processor (420). The memory (430) of FIG. 4a may correspond to the memory (130) of FIG. 1. The displays (461, 465) of FIG. 4a may correspond to the display module (160) of FIG. 1. The cameras (481, 483, 485) of FIG. 4a may correspond to the camera module (180) of FIG. 1.

[0108] In one embodiment, the processor (420) may include a hardware component comprising various processing circuits for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a field programmable gate array (FPGA), and / or a central processing unit (CPU). The number of processors (420) may be one or more. For example, the processor (420) may have the structure of a multi-core processor such as a dual core, a quad core, or a hexa core.

[0109] In one embodiment, the memory (430) may include a hardware component for storing data and / or instructions that are input to and / or output to the processor (420). The memory (430) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). Volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). Non-volatile memory may include, for example, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, and embedded multi-media card (eMMC).

[0110] In one embodiment, displays (461, 465) can output visualized information to a user (405) of a wearable device (401). For example, displays (461, 465) can be controlled by a processor (420) including a circuit such as a GPU (graphic processing unit) to output visualized information to the user (405). Displays (461, 465) may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LED may include an organic LED (OLED).

[0111] In one embodiment, the displays (461, 465) may be arranged toward the two eyes of the user (405) respectively when the wearable device (401) is worn by the user (405). In one embodiment, the displays (461, 465) may be referred to as a display assembly (460). In one embodiment, the display assembly (460) may correspond to the display (250) of FIGS. 2a and 2b, or the display (350) of FIGS. 3a and 3b.

[0112] In one embodiment, referring to FIG. 4b, a display assembly (460) may provide a field of view (FOV, 410) to a user (405) within a three-dimensional virtual space (400) (or boundary). In one embodiment, for example, the FOV (410) may represent an area that the user (405) can view. In one embodiment, for example, the FOV (410) may represent a display area of ​​a wearable device (401) that the user (405) can view. In one embodiment, the FOV (410) may be a three-dimensional area that the user (405) can see based on the point (or field of view) that the user (405) looks at within the three-dimensional virtual space (400) (or boundary). In one embodiment, the three-dimensional virtual space (400) may be in the form of a capsule. The size of the capsule-shaped virtual space (400) can be set considering the user (405) (e.g., the height of the user (405)). As an example, the height of the upper and lower hemispheres of the virtual space (400) can be set to about 1.8 m. The height of the cylindrical section between the upper and lower hemispheres can be set to about 1 m. The total height of the virtual space (400) including the upper hemisphere, lower hemisphere, and cylindrical section can be set to about 4.6 m.

[0113] Content (or objects) may be displayed in a certain area (or FOV (401)) that includes the surface of the virtual space (400). Content displayed near the surface of the virtual space (400) may be displayed at different distances from the user depending on the type. For example, task windows and / or applications may be displayed at a distance of about 1.3 m to about 2 m from the user's center point (402). System-related objects may be displayed at a distance of about 0.7 m from the user's center point (402).

[0114] When creating a virtual space (400), the wearable device (401) may create the virtual space (400) by taking into account an offset for the user's visual convenience, ease of operation, and / or placement of content (e.g., applications) at natural (or smooth) angles. As an example, the wearable device (401) may create the virtual space (400) such that the center point (403) of the virtual space (400) is formed at a certain distance behind the center point (402) of the user's face (or the worn wearable device (401)). The distance between the center point (403) of the virtual space (400) and the center point (402) of the user's face may be the offset of the virtual space (400). As an example, the offset of the virtual space (400) may be set to approximately 0.5 m.

[0115] In one embodiment, the images displayed in the display assembly (460) may be images that take into account the binocular disparity of the user (405)'s two eyes. In one embodiment, the images displayed in the display assembly (460) may be images that take into account the binocular disparity representing the FOV (410) determined according to the user's (405) gaze. In one embodiment, the images corresponding to the binocular disparity of the user (405) may be referred to as images having binocular disparity. In one embodiment, the images corresponding to the binocular disparity of the user (405) may be referred to as stereoscopic images. For example, the images corresponding to the binocular disparity of the user (405) may have a disparity corresponding to the disparity between the image formed on the user's (405) first eye (e.g., right eye) and the image formed on the user's (405) second eye (e.g., left eye) according to the user's (405) gaze.

[0116] In one embodiment, the images displayed in the display assembly (460) may be images for providing a sense of depth to the user (405). For example, the images displayed in the display assembly (460) may be images having binocular parallax to represent regions at a specific distance from the user (405) within a three-dimensional virtual space (400). For example, referring to FIG. 4c, the images displayed in the display assembly (460) may be images having binocular parallax to represent a region (411) located at a first distance (r1) from the user (405) within the three-dimensional virtual space (400). For example, the images displayed in the display assembly (460) may be images having binocular parallax to represent a region (412) located at a second distance (r2) from the user (405) within the three-dimensional virtual space (400). For example, the images displayed in the display assembly (460) may be images having binocular parallax to represent an area (413) that is a third distance (r3) away from the user (405) in a three-dimensional virtual space (400).

[0117] In one embodiment, images corresponding to the binocular parallax of the user (405) are displayed on the display (461) and the display (465), so that the user (405) can feel a sense of depth according to the gaze within the three-dimensional virtual space (400).

[0118] In one embodiment, the cameras (481, 483, 485) of the wearable device (401) may include one or more light sensors (e.g., a CCD (charged coupled device) sensor, a CMOS (complementary metal oxide semiconductor) sensor) that generate an electrical signal representing the color and / or brightness of light. The plurality of light sensors included in the cameras (481, 483, 485) may be arranged in the form of a two-dimensional grid. The cameras (481, 483, 485) may acquire the electrical signals of each of the plurality of light sensors substantially simultaneously to generate two-dimensional frame data corresponding to the light reaching the light sensors of the two-dimensional grid. For example, photo data captured using the cameras (481, 483, 485) may represent, for instance, one two-dimensional frame data acquired from the cameras (481, 483, 485). For example, video data captured using cameras (481, 483, 485) may represent a sequence of multiple two-dimensional frame data obtained from cameras (481, 483, 485) along a frame rate, for example. The cameras (481, 483, 485) may further include a flash light for outputting light in a direction in which the cameras (481, 483, 485) receive light.

[0119] In one embodiment, the cameras (481, 483, 485) may be positioned facing different directions. Among the cameras (481, 483, 485), cameras (481, 483) may be positioned on the same plane as the displays (461, 465). In one embodiment, the cameras (481, 483) may be positioned facing each of the user's (405) two eyes when the wearable device (401) is worn by the user (405). In one embodiment, the cameras (481, 483) may be referred to as a camera assembly (480). In one embodiment, the camera assembly (480) may be positioned so that the camera (485) captures the rear of the wearable device (401) (or the side facing the user (405) when the wearable device (401) is worn by the user (405). In one embodiment, the camera assembly (480) may correspond to the cameras (240-1, 240-2) of FIGS. 2a and 2b, or the cameras (340-1, 340-2, 340-3, 340-4) of FIGS. 3a and 3b.

[0120] In one embodiment, among the cameras (481, 483, 485), camera (485) may be positioned on a surface different from the displays (461, 465). In one embodiment, camera (485) may be positioned to photograph the front of the wearable device (401) (or a surface that does not face the user (405) when the wearable device (401) is worn by the user (405). In one embodiment, camera (485) may correspond to camera (240-3) of FIGS. 2a and 2b, or cameras (340-5, 340-6, 340-7, 340-8, 340-9, 340-10) of FIGS. 3a and 3b.

[0121] According to one embodiment, within the memory (430) of a wearable device (401), one or more instructions (or commands) representing operations and / or operations to be performed on data by the processor (420) of the wearable device (401) may be stored. A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the wearable device (401) and / or the processor (420) may perform at least one of the operations described in more detail below with reference to FIGS. 12, 13, 14, 15, 16, and 17 when a set of multiple instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. In the following, the statement that an application is installed within a wearable device (401) may indicate, for example, that one or more instructions provided in the form of an application are stored in memory (430), and that said one or more applications are stored in a format executable by a processor (420) (e.g., a file having an extension specified by the operating system of the wearable device (401)). For example, an application may include a program and / or library related to a service provided to a user (405).

[0122] FIG. 5a is a diagram illustrating an example of a depth range in which content can be resolved by a user according to their visual acuity within a virtual three-dimensional space according to various embodiments. FIG. 5b is a diagram illustrating an example of a size range in which content can be resolved by a user according to their visual acuity at a specific depth within a virtual three-dimensional space according to various embodiments. FIG. 5c is a diagram illustrating an example of content having different sizes displayed within a depth range within a virtual three-dimensional space according to various embodiments. FIG. 5d is a diagram illustrating an example of content having a size that can be resolved by a user according to their visual acuity among content having different sizes displayed within a depth range within a virtual three-dimensional space according to various embodiments. FIG. 5e is a diagram illustrating an example of content within a size range and depth range that can be resolved by a user according to their visual acuity within a virtual three-dimensional space according to various embodiments.

[0123] FIGS. 5a, FIGS. 5b, FIGS. 5c, FIGS. 5d and FIGS. 5e can be explained with reference to FIGS. 1, FIGS. 2a, FIGS. 2b, FIGS. 3a, FIGS. 3b, FIGS. 4a, FIGS. 4b and FIGS. 4c.

[0124] Referring to FIG. 5a, the wearable device (401) may display a window within a system depth range (510) when displaying a FOV (410) within a three-dimensional virtual space (400) through a display assembly (460). In one embodiment, the system depth (511) may include the distance closest to a user (405) that the wearable device (401) can render in the three-dimensional virtual space (400). In one embodiment, the system depth (515) may include the distance farthest from a user (405) that the wearable device (401) can render in the three-dimensional virtual space (400). In one embodiment, the system depth range (510) may have the system depth (511) as a lower depth limit and the system depth (515) as an upper depth limit.

[0125] In one embodiment, when a window (or virtual object) (or content) is displayed at a specific size within a resolvable depth range (520), the user (405) can clearly perceive (or identify) the window (or virtual object) (or content). In one embodiment, the user (405) clearly perceiving (or identifying) the window may include the user (405) distinguishing details of the window (e.g., shapes, forms, colors). In one embodiment, the user (405) clearly perceiving (or identifying) the window may include the user (405) distinguishing the window from other windows. In one embodiment, the user (405) clearly perceiving (or identifying) the window may include the user (405) being able to read content (e.g., text) within the window.

[0126] In one embodiment, the resolvable depth (521) may represent the closest distance at which the user (405) can clearly perceive (or identify) the window in the three-dimensional virtual space (400). In one embodiment, the resolvable depth (525) may represent the farthest distance at which the user (405) can clearly perceive (or identify) the window in the three-dimensional virtual space (400). In one embodiment, the resolvable depth range (520) may have the resolvable depth (521) as a lower limit depth and the resolvable depth (525) as an upper limit depth.

[0127] Referring to FIG. 5b, when a window is displayed at a specific depth (530) between a maximum size (531) and a minimum size (535), the user (405) can clearly perceive (or identify) the window. Accordingly, obtaining the user's (405) vision information may be important when the wearable device (401) determines the location to display the window. Here, the user's (405) vision information may include distance information (or depth information) and / or size information that allows the user (405) to clearly perceive (or identify) the window in a three-dimensional virtual space (400).

[0128] In the following, with reference to FIGS. 5C, FIGS. 5D and FIGS. 5E, the operation of a wearable device (401) acquiring vision information of a user (405) can be described.

[0129] In one embodiment, referring to FIG. 5c, the wearable device (401) can display virtual objects (541 to 549) at different distances. In one embodiment, the wearable device (401) can sequentially display virtual objects (541 to 549) at different distances. For example, the wearable device (401) can sequentially display virtual objects (541 to 549) having the same size (or font size) at different distances. For example, having virtual objects (541 to 549) having the same size (or font size) may include virtual objects (541 to 549) being represented at the same size within a three-dimensional virtual space (400). However, even if the virtual objects (541 to 549) have the same size (or font size), the virtual objects (541 to 549) may be perceived by the user (405) as having different sizes depending on the distance from the user (405).

[0130] In one embodiment, the wearable device (401) can sequentially display virtual objects (541 to 549) having a first size (or a first font size) at different distances, and then sequentially display virtual objects having a second size (or a second font size) at different distances.

[0131] In one embodiment, the user (405) can select decomposable (or perceptible) virtual objects among sequentially displayed virtual objects (541 to 549). For example, referring to FIG. 5d, the user (405) can select virtual objects (543 to 547) among sequentially displayed virtual objects (541 to 549) as decomposable (or perceptible) virtual objects. For example, the wearable device (401) can identify a depth range (520) in which virtual objects (543 to 547) that are decomposable (or perceptible) to the user (405) are displayed among virtual objects (541 to 549) having the same size (or font size).

[0132] In one embodiment, the wearable device (401) may obtain visual information of the user (405) based on the sizes and / or distances of virtual objects selected by the user (405) as resolvable (or perceptible) virtual objects for virtual objects displayed at different sizes and / or different distances. In one embodiment, the visual information of the user (405) may include information about the distances of virtual objects resolvable (or perceptible) to the user (405). The information about the distances of virtual objects may include information about the distance (521) closest to the user (405) and the distance (525) farthest from the user (405) that the user (405) can resolvable. In one embodiment, the visual information of the user (405) may include information about the sizes of virtual objects resolvable (or perceptible) to the user (405) when virtual objects are displayed at each of the distances. For example, information regarding the sizes of the virtual object may include information regarding the smallest size (561) and the largest size (565) that the user (405) can decompose when the virtual object is displayed at distance (521). For example, information regarding the sizes of the virtual object may include information regarding the smallest size (571) and the largest size (575) that the user (405) can decompose when the virtual object is displayed at distance (525).

[0133] According to an embodiment, vision information may be obtained through a method other than the operation in which the wearable device (401) described with reference to FIG. 5c, FIG. 5d and FIG. 5e obtains the vision information of the user (405).

[0134] For example, the wearable device (401) can obtain the user's (405) vision information by displaying selectable options (or options that allow the user to select at least one of the visual values) to the user (405) and allowing the user to select at least one of the displayed selectable options.

[0135] For example, while the user (405) is using the wearable device (401), the wearable device (401) can obtain the user's (405) vision information by calculating vision information based on the accuracy and / or reaction time of selecting the user's (405) visual object. In one embodiment, the wearable device (401) calculating vision information may include calculating based on a specified rule. In one embodiment, the wearable device (401) calculating vision information may include calculating based on a specified artificial intelligence model (e.g., an artificial intelligence model trained to output the user's (405) vision information based on the user's (405) usage pattern).

[0136] For example, based on a designated function of the wearable device (401) (e.g., an autofocus function of the lens, and / or an auto-refraction test function), the wearable device (401) can acquire vision information of the user (405). For example, based on an eye image of the user (405) acquired through the camera of the wearable device (401) (e.g., information about the eye condition of the user (405) acquired from the eye image), the wearable device (401) can acquire vision information of the user (405).

[0137] FIG. 6a is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments. FIG. 6b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0138] FIGS. 6a and 6b can be explained with reference to FIGS. 1 through 5e.

[0139] In one embodiment, referring to FIG. 6a, a wearable device (401) may receive input for displaying a window (610) through a display assembly (460). For example, the wearable device (401) may receive input for displaying the window (610) within a three-dimensional virtual space (400). For example, the wearable device (401) may receive input for displaying the window (610) through an FOV (410) corresponding to the line of sight of a user (405) within the three-dimensional virtual space (400). In one embodiment, the input for displaying the window (610) may include input for executing an application. In one embodiment, the input for displaying the window (610) may include input for executing an application related to the window (610). For example, the window (610) may be a virtual object on a two-dimensional plane. For example, the window (610) may be a virtual object (or a virtual object without volume) extending in three mutually orthogonal directions. For example, the window (610) may be a window on a two-dimensional plane. However, the disclosure is not limited thereto. For example, the window (610) may be a virtual object (or a virtual object with volume) extending in three mutually orthogonal directions.

[0140] In one embodiment, the wearable device (401) may determine the position, orientation, and / or size within a three-dimensional virtual space (400) for displaying the window (610) based on receiving an input for displaying the window (610) through a display assembly (460). In one embodiment, the position of the window (610) may be defined based on a coordinate system (e.g., Cartesian coordinate system, cylindrical coordinate system, or spherical coordinate system) with the user (405) as the reference (or center). For example, based on a spherical coordinate system, the position of the window (610) may be determined by the distance from the user (405) and / or angles (e.g., azimuth, or zenith). In one embodiment, the orientation of the window (610) may be determined by the degree of rotation based on three mutually orthogonal axes. For example, the orientation of the window (610) can be determined by the degree of rotation along the vertical axis (e.g., yawing axis), the degree of rotation along the horizontal axis (e.g., pitching axis), and / or the degree of rotation along the vertical axis (e.g., rolling axis).

[0141] In one embodiment, the wearable device (401) may determine the location and / or size within a three-dimensional virtual space (400) for displaying the window (610) based on the user's (405) vision information, based on receiving an input for displaying the window (610) through the display assembly (460).

[0142] In one embodiment, the wearable device (401) may determine a location within the FOV (410) for displaying a window (610) within a depth range (520) representing the visual information of the user (405). In one embodiment, the wearable device (401) may determine a location within the FOV (410) based on the size of the window (610) within the depth range (520). For example, the wearable device (401) may determine a location based on the size of the contents (611, 613, 615, 617, 619) within the window (610) within the depth range (520). In one embodiment, the contents (611, 613, 615, 617, 619) may be images, videos, and / or text.

[0143] For example, the wearable device (401) can determine the position of the window (610) based on the size of the smallest content (611, 613, or 615) among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the smallest font size of the text written in the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the size of the content (617) located relatively in the center among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the font size of the text written in the content (617) located relatively centrally among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the size of the main content (617) among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the font size of the text written in the main content (617) among the contents (611, 613, 615, 617, 619) within the window (610).

[0144] For example, the wearable device (401) can determine the position of the window (610) based on the size of the content (611, 613, 615, 617, 619) within the window (610) that has specified attributes. For example, the specified attributes of the content may include the type of content (e.g., image, text, shape), the resolution of the content, and / or tags associated with the content.

[0145] For example, the wearable device (401) can determine the location of the window (610) based on content (e.g., 611, 613, 615, 617) having a specified type (e.g., text) among the contents (611, 613, 615, 617, 619) within the window (610).

[0146] For example, the wearable device (401) can determine the location of the window (610) based on the content (e.g., 619) having the lowest image resolution among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the location of the window (610) based on the content (e.g., 615) having the smallest text size among the contents (611, 613, 615, 617, 619) within the window (610).

[0147] For example, the wearable device (401) can determine the location of the window (610) based on content (611, 613, 615, 617, 619) within the window (610) that has a specified tag (or, in a key-value pair, a specified value). In one embodiment, the tag is a specified attribute (e.g., ,) where the content (611, 613, 615, 617, 619) is a resource indicated by a markup language. , , <hr> , <font>, <small text>The location of the window (610) can be determined based on the content indicated by the resource having ). For example, the wearable device (401) may determine the location of a specified paragraph ( ) contained in a specified area (e.g. ) among the contents (611, 613, 615, 617, 619) within the window (610). , ), and / or table( < / small> , and / or <small text>The content within ) is a specified attribute (e.g., specified font( <font>), or specified small text( <small text>If you have )), the location of the window (610) can be determined based on the content.

[0148] For example, the wearable device (401) can determine the position of the window (610) based on the content that occupies the largest proportion among the proportions of the contents (611, 613, 615, 617, 619) within the window (610) (e.g., the ratio of the area of ​​each of the contents (611, 613, 615, 617, 619) displayed in the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the size of the text and / or objects included in the content that occupies the largest proportion.

[0149] For example, the wearable device (401) can determine the position of the window (610) based on the most recently updated content among the contents (611, 613, 615, 617, 619) within the window (610). For example, the wearable device (401) can determine the position of the window (610) based on the size of the text and / or objects included in the most recently updated content.

[0150] For example, the wearable device (401) can determine the position of the window (610) based on the content (611, 613, 615, 617, 619) within the window (610) that is of the highest interest to the user. For example, the wearable device (401) can determine the position of the window (610) based on the size of the text and / or objects included in the content that is of the highest interest to the user. In one embodiment, the user's interest can be identified according to the user's usage pattern of the wearable device (401). For example, the user's interest can be determined based on the order of web pages accessed through the wearable device (401) (or the order of applications executed).

[0151] For example, referring to FIG. 6b, the window (610) may be located at a position (621) closer to the user (405) within the depth range (520) as the size of the content determining the position of the window (610) is smaller. For example, referring to FIG. 6b, the window (610) may be located at a position (625) farther to the user (405) within the depth range (520) as the size of the content determining the position of the window (610) is larger. For example, the wearable device (401) may display the window (610) at a position (623) based on the smallest font size of the text written in the contents (611, 613, 615, 617, 619) within the window (610).

[0152] FIG. 6c is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments. FIG. 6d is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0153] FIGS. 6c and 6d may be described with reference to FIGS. 1 through 5e. Descriptions of FIGS. 6c and 6d that overlap with descriptions of FIGS. 6a and 6b may not be repeated.

[0154] In one embodiment, referring to FIG. 6c, the wearable device (401) can receive an input to display a window (630) through a display assembly (460).

[0155] In one embodiment, the wearable device (401) may determine the position, orientation, and / or size within a three-dimensional virtual space (400) for displaying the window (630) based on receiving input for displaying the window (630) through a display assembly (460). In one embodiment, the wearable device (401) may determine the position and / or size within a three-dimensional virtual space (400) for displaying the window (630) based on the visual information of the user (405) based on receiving input for displaying the window (630) through a display assembly (460).

[0156] In one embodiment, the wearable device (401) can determine a location within the FOV (410) for displaying a window (630) within a depth range (520) representing the visual information of the user (405). In one embodiment, the wearable device (401) can determine a location within the FOV (410) based on the size of the window (630) within the depth range (520). For example, the wearable device (401) can determine a location based on the size of the contents (631, 633, 635, 637) within the window (630) within the depth range (520).

[0157] For example, referring to FIG. 6d, the window (630) may be located at a position (641) closer to the user (405) within the depth range (520) as the size of the content determining the position of the window (630) is smaller. For example, referring to FIG. 6d, the window (630) may be located at a position (645) farther to the user (405) within the depth range (520) as the size of the content determining the position of the window (630) is larger. For example, the wearable device (401) may display the window (630) at a position (643) based on the smallest font size of the text written in the contents (631, 633, 635, 637) within the window (630).

[0158] FIG. 6e is a diagram illustrating an example of a two-dimensional window displayed in a virtual three-dimensional space by a wearable device according to various embodiments. FIG. 6f is a diagram illustrating an example of an operation in which a wearable device according to various embodiments determines the display position of a two-dimensional window within a depth range that is resolvable by a user.

[0159] FIGS. 6e and 6f may be described with reference to FIGS. 1 through 5e. Descriptions of FIGS. 6e and 6f that overlap with descriptions of FIGS. 6a and 6b may not be repeated.

[0160] In one embodiment, referring to FIG. 6e, the wearable device (401) can receive an input for displaying a window (650) through a display assembly (460).

[0161] In one embodiment, the wearable device (401) may determine the position, orientation, and / or size within a three-dimensional virtual space (400) for displaying the window (650) based on receiving an input for displaying the window (650) through a display assembly (460). In one embodiment, the wearable device (401) may determine the position and / or size within a three-dimensional virtual space (400) for displaying the window (650) based on the visual information of the user (405) based on receiving an input for displaying the window (650) through a display assembly (460).

[0162] In one embodiment, the wearable device (401) can determine a location within the FOV (410) for displaying a window (650) within a depth range (520) representing the visual information of the user (405). In one embodiment, the wearable device (401) can determine a location within the FOV (410) based on the size of the window (650) within the depth range (520). For example, the wearable device (401) can determine a location based on the size of the contents (651, 653, 655) within the window (650) within the depth range (520).

[0163] For example, referring to FIG. 6f, the window (650) may be located at a position (661) closer to the user (405) within the depth range (520) as the size of the content determining the position of the window (650) is smaller. For example, referring to FIG. 6f, the window (650) may be located at a position (665) farther to the user (405) within the depth range (520) as the size of the content determining the position of the window (650) is larger. For example, the wearable device (401) may display the window (650) at position (663) based on the smallest font size of the text written in the contents (651, 653, 655) within the window (650).

[0164] FIG. 7a is a diagram illustrating an example of an operation in which a wearable device according to various embodiments displays a two-dimensional window within a depth range resolvable by a user. FIG. 7b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments changes the display position of a two-dimensional window based on user input. FIG. 7c illustrates an example of an operation in which a wearable device according to various embodiments displays a two-dimensional window at a changed position within a depth range resolvable by a user.

[0165] FIGS. 7a, FIGS. 7b, and FIGS. 7c can be explained with reference to FIGS. 1 through 5e.

[0166] In one embodiment, the wearable device (401) can display a window (720) through a display assembly (460). In one embodiment, the wearable device (401) can display the window (720) within a three-dimensional virtual space (400) based on a position, orientation, and / or size determined based on an input for displaying the window (720) through the display assembly (460). In one embodiment, the wearable device (401) can display the window (720) within a depth range (520) represented by the visual information of the user (405). For example, referring to FIG. 7a, the wearable device (401) can display the window (720) at a first distance (731) from the user (405).

[0167] In one embodiment, the wearable device (401) may receive an input to change the position of the window (720) while displaying the window (720) through the display assembly (460). In one embodiment, the input to change the position of the window (720) may be an input to change the depth of the window (720). In one embodiment, the input to change the position of the window (720) may be an input to change the distance of the window (720) from the user (405). For example, the input to change the position of the window (720) may be an input to change the position of the window (720) closer to the user (405). However, the disclosure is not limited thereto. For example, the input to change the position of the window (720) may be an input to change the position of the window (720) farther from the user (405).

[0168] For example, receiving input to change the position of the window (720) may include voice input from the user (405) (e.g., "Change the display position of the window (720)," "Show the window (720) up close"). For example, receiving input to change the position of the window (720) may include input transmitted from an external electronic device (e.g., the electronic device (102) of FIG. 1) (e.g., a smart ring, a smart watch, a smartphone, a remote controller, or a stylus). For example, receiving input to change the position of the window (720) may include gestures from the user (405) (e.g., a gesture for zooming in, a gesture for zooming out).

[0169] In one embodiment, the gesture of the user (405) may be a gesture through one of the user (405)'s hands identified through an image acquired through a camera (485). In one embodiment, the gesture of the user (405) may be a gesture through at least one of the user (405)'s eyes identified through images of the user (405)'s eyes acquired through a camera assembly (480). In one embodiment, the gesture through at least one of the user (405)'s eyes may include a gesture of the user (405) closing both eyes. For example, referring to FIG. 7a, when the user (405) has both eyes open (711), the wearable device (401) may not identify a gesture for changing the position of the window (720). For example, referring to FIG. 7b, when the user (405) has both eyes squinted (713), the wearable device (401) can identify a gesture to change the position of the window (720).

[0170] In one embodiment, the wearable device (401) can determine a new position and / or new size of the window (720) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (720).

[0171] In one embodiment, the wearable device (401) may determine a position within the FOV (410) for displaying the window (720) within a depth range (520) representing the user's (405) vision information, based on receiving an input to change the position of the window (720). In one embodiment, the wearable device (401) may determine a position within the FOV (410) based on the size of the window (720) within the depth range (520). For example, the wearable device (401) may determine a position based on the size of the contents within the window (720) within the depth range (520).

[0172] For example, the wearable device (401) can determine the position of the window (720) based on the size of the smallest content among the contents within the window (720). For example, the wearable device (401) can determine the position of the window (720) based on the smallest font size of the text written in the contents within the window (720). For example, the wearable device (401) can determine the position of the window (720) based on the size of the content located relatively in the center among the contents within the window (720). For example, the wearable device (401) can determine the position of the window (720) based on the font size of the text written in the content located relatively in the center among the contents within the window (720). For example, the wearable device (401) can determine the position of the window (720) based on the size of the main content among the contents within the window (720). For example, the wearable device (401) can determine the position of the window (720) based on the font size of the text written in the main content among the contents in the window (720).

[0173] For example, the wearable device (401) can determine the position of the window (720) based on the size of the content within the window (720) to which the user (405)’s gaze (701) is directed. For example, the wearable device (401) can determine the position of the window (720) based on the font size of the text written on the content within the window (720) to which the user (405)’s gaze (701) is directed. In one embodiment, the wearable device (401) can identify the user (405)’s gaze (701) based on images of the user (405)’s two eyes obtained through the camera assembly (480). For example, the wearable device (401) can identify the gaze (701) of the user (405) based on the position of the irises of the two eyes represented by images of the user's (405) two eyes.

[0174] For example, referring to FIG. 7b, the wearable device (401) may move the window (720) from a first distance (731) from the user (405) to a second distance (735) from the user (405) based on receiving an input (e.g., a state of squinting both eyes (713)) to change the position of the window (720). However, the disclosure is not limited thereto. For example, the wearable device (401) may display a new window at a second distance (735) from the user (405) that is closer than the window (720) displayed at the first distance (731) from the user (405) based on receiving an input (e.g., a state of squinting both eyes (713)). In one embodiment, the new window may have the same size as the window (720). In one embodiment, the size of the content included in the new window may be the same as the size of the content within the window (720). In one embodiment, the new window may be displayed on a virtual axis connecting the user (405) and the window (720).

[0175] For example, the wearable device (401) may display at least one of the contents within the window (720) at a second distance (735) from the user (405) that is closer than the window (720) displayed at a first distance (731) from the user (405), based on receiving an input (e.g., both eyes squinted (713)).

[0176] For example, the wearable device (401) may display content at a second distance (735) from the user (405) that the gaze (701) directs toward the user (405), which is closer than the window (720) displayed at a first distance (731) from the user (405), based on receiving input (e.g., both eyes squinted (713)). In one embodiment, the content displayed at the second distance (735) may have the same size as the content of the window (720) displayed at the first distance (731). In one embodiment, the content displayed at the second distance (735) may be displayed on a virtual axis connecting the user (405) and the window (720).

[0177] In one embodiment, the wearable device (401) can move the window (720) from a first distance (731) to a second distance (735) based on a translational transform. In one embodiment, the wearable device (401) can move the window (720) from a first distance (731) to a second distance (735) based on a translational transform without a scaling transform. In one embodiment, the translational transform may move the window (720) so that the size of the window (720) and the size of the content within the window (720) are not changed within a three-dimensional virtual space (400). In one embodiment, the translation transformation may be to move the window (720) so that the ratio of the window (720) and the ratio of the content within the window (720) to the window (720) within the three-dimensional virtual space (400) are not changed. In one embodiment, the size of the window (720) within the three-dimensional virtual space (400) may be maintained by the translation transformation. In one embodiment, the size of the window (720) shown to the user (405) may be changed by the translation transformation. This does not indicate, for example, that the size of the window (720) within the three-dimensional virtual space (400) is changed, such that the window (720) appears larger as it moves closer to or further away from the user (405). In one embodiment, the size transformation may be to change the size of the window (720) within the three-dimensional virtual space (400).

[0178] For example, referring to FIG. 7c, after the window (720) is moved from a first distance (731) from the user (405) to a second distance (735) from the user (405), an input to change the position of the window (720) (e.g., eyes squinted (713)) may be released (e.g., eyes normally open (715)). However, the initiation is not limited thereto. For example, while the input to change the position of the window (720) is maintained, the wearable device (401) may stop the movement of the window (720) based on the window (720) being moved from a first distance (731) from the user (405) to a second distance (735) from the user (405). For example, the wearable device (401) can fix the window (720) in a positioned state at a second distance (735) for a specified time while an input to change the position of the window (720) is maintained.

[0179] FIG. 8a is a diagram illustrating an example of an operation in which a wearable device according to various embodiments moves a two-dimensional window to a position determined by the user's eyesight within a depth range that the user can resolve.

[0180] FIG. 8a can be explained with reference to FIGS. 1 to 5e.

[0181] In one embodiment, the wearable device (401) can display the window (820) through the display assembly (460). In one embodiment, the wearable device (401) can display the window (820) within a three-dimensional virtual space (400) based on a position, orientation, and / or size determined based on an input for displaying the window (820) through the display assembly (460). For example, referring to FIG. 8a, the wearable device (401) can display the window (820) at a first distance (811) from the user (405).

[0182] In one embodiment, the wearable device (401) may receive an input to change the position of the window (820) while displaying the window (820) through the display assembly (460). In one embodiment, the input to change the position of the window (820) may be an input to change the depth of the window (820). In one embodiment, the input to change the position of the window (820) may be an input to change the distance of the window (820) from the user (405). For example, the input to change the position of the window (820) may be an input to change the position of the window (820) closer to the user (405). However, the disclosure is not limited thereto. For example, the input to change the position of the window (820) may be an input to change the position of the window (820) farther from the user (405).

[0183] For example, receiving input to change the position of the window (820) may include voice input from the user (405), input transmitted from an external electronic device (e.g., smart ring, smart watch, smartphone, remote controller, or stylus), and / or gestures from the user (405).

[0184] In one embodiment, the wearable device (401) can determine a new position and / or new size of the window (820) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (820).

[0185] For example, referring to FIG. 8a, the wearable device (401) can move the window (820) from a first distance (811) from the user (405) to a second distance (813) from the user (405) based on receiving an input to change the position of the window (820).

[0186] In one embodiment, the wearable device (401) can move the window (820) from a first distance (811) to a second distance (813) based on a movement transformation. In one embodiment, the wearable device (401) can move the window (820) from a first distance (811) to a second distance (813) based on a movement transformation without a size transformation.

[0187] In one embodiment, the wearable device (401) can move the window (820) so that the size of the window (820) and the size of the content within the window (820) are not changed within the three-dimensional virtual space (400). In one embodiment, the wearable device (401) can move the window (820) so that the ratio of the window (820) and the ratio of the content within the window (820) to the window (820) are not changed within the three-dimensional virtual space (400). In one embodiment, the wearable device (401) can move the window (820) so that the size of the window (820) within the three-dimensional virtual space (400) is maintained.

[0188] For example, referring to FIG. 8a, as the window (820) moves, the size of the window (820) at the first distance (811) may be the same as the size of the window (820) at the second distance (813). For example, referring to FIG. 8a, as the window (820) moves, the size of the content (e.g., font size) within the window (820) at the first distance (811) may be the same as the size of the content (e.g., font size) within the window (820) at the second distance (813). For example, referring to FIG. 8a, as the window (820) moves, the arrangement of the content (e.g., line breaks) within the window (820) at the first distance (811) may be the same as the arrangement of the content (e.g., line breaks) within the window (820) at the second distance (813).

[0189] For example, the wearable device (401) can move the window (820) from a first distance (811) from the user (405) to a second distance (813) from the user (405) while an input to change the position of the window (820) is maintained.

[0190] For example, while an input to change the position of the window (820) is maintained, the wearable device (401) may stop the movement of the window (820) based on the window (820) moving from a first distance (811) to a second distance (813). For example, the wearable device (401) may fix the window (820) in a positioned state at the second distance (813) for a specified time while an input to change the position of the window (820) is maintained.

[0191] FIG. 8b is a diagram illustrating an example of an operation in which a wearable device according to various embodiments moves two-dimensional windows to a position determined by the user's eyesight within a depth range that the user can resolve. FIG. 8c is a diagram illustrating a planar view of the two-dimensional windows moved by a wearable device according to various embodiments.

[0192] FIGS. 8b and FIGS. 8c can be explained with reference to FIGS. 1 to 5e and FIG. 8a.

[0193] In one embodiment, the wearable device (401) can display windows (820) and windows (830) through a display assembly (460). In one embodiment, the wearable device (401) can display windows (820) and windows (830) within a three-dimensional virtual space (400) based on a position, orientation, and / or size determined based on an input for displaying windows (820) and windows (830) through the display assembly (460). For example, referring to FIG. 8b, the wearable device (401) can display windows (820) and windows (830) at a first distance (811) from the user (405).

[0194] In one embodiment, the wearable device (401) may receive an input to change the position of the window (820) and / or the window (830) while displaying the window (820) and the window (830) through the display assembly (460). In one embodiment, the input to change the position of the window (820) and / or the window (830) may be an input to change the depth of the window (820) and / or the window (830). In one embodiment, the input to change the position of the window (820) and / or the window (830) may be an input to change the distance of the window (820) and / or the window (830) from the user (405).

[0195] In one embodiment, the wearable device (401) can determine a new position and / or new size of the window (820) and / or window (830) within a three-dimensional virtual space (400) based on receiving an input to change the position of the window (820) and / or window (830).

[0196] For example, referring to FIG. 8b, the wearable device (401) can move the window (820) from a first distance (811) from the user (405) to a second distance (813) from the user (405) based on receiving a first input for changing the position of the window (820). For example, referring to FIG. 8b, the wearable device (401) can move the window (830) from a first distance (811) from the user (405) to a third distance (815) from the user (405) based on receiving a second input for changing the position of the window (830).

[0197] In one embodiment, the wearable device (401) can move the window (820) from a first distance (811) to a second distance (813) based on a translational transformation. In one embodiment, the wearable device (401) can move the window (820) from a first distance (811) to a second distance (813) based on a translational transformation without a translational transformation. In one embodiment, the wearable device (401) can move the window (830) from a first distance (811) to a third distance (815) based on a translational transformation. In one embodiment, the wearable device (401) can move the window (830) from a first distance (811) to a third distance (815) based on a translational transformation without a translational transformation.

[0198] Referring to FIG. 8b, since the size of the content (e.g., font size) within the window (830) is smaller than the size of the content (e.g., font size) within the window (820), the wearable device (401) can move the window (830) to a third distance (815) that is closer than the second distance (813). Referring to FIG. 8c, the wearable device (401) can move the window (830) to a third distance (815) that is visible to the user (405) such that the size of the content (e.g., font size) within the window (830) is equal to the size of the content (e.g., font size) within the window (820).

[0199] For example, referring to FIG. 8b, as the window (820) moves, the size of the window (820) at the first distance (811) may be the same as the size of the window (820) at the second distance (813). For example, referring to FIG. 8b, as the window (820) moves, the size of the content (e.g., font size) within the window (820) at the first distance (811) may be the same as the size of the content (e.g., font size) within the window (820) at the second distance (813). For example, referring to FIG. 8b, as the window (820) moves, the arrangement of the content (e.g., line breaks) within the window (820) at the first distance (811) may be the same as the arrangement of the content (e.g., line breaks) within the window (820) at the second distance (813).

[0200] For example, referring to FIG. 8b, as the window (830) moves, the size of the window (830) at the first distance (811) may be the same as the size of the window (830) at the third distance (815). For example, referring to FIG. 8b, as the window (830) moves, the size of the content (e.g., font size) within the window (830) at the first distance (811) may be the same as the size of the content (e.g., font size) within the window (830) at the third distance (815). For example, referring to FIG. 8b, as the window (830) moves, the arrangement of the content (e.g., line breaks) within the window (830) at the first distance (811) may be the same as the arrangement of the content (e.g., line breaks) within the window (830) at the third distance (815).

[0201] Referring to FIG. 8c, as the wearable device (401) moves the window (830) to a third distance (815) where the size of the content (e.g., font size) within the window (830) is the same as the size of the content (e.g., font size) within the window (820) to the user (405), the user (405) may perceive the font size within the window (830) and the font size within the window (820) as being the same. However, this does not indicate that, for example, the font size within the window (830) and the font size within the window (820) appear the same as the font size within the window (830) and the font size within the window (820) as the window (830) and the window (820) are separated by different relative distances from the user (405), for example, that the font size within the window (830) changes to be the same as the font size within the window (820).

[0202] For example, while an input to change the position of the window (830) is maintained, the wearable device (401) may stop the movement of the window (830) based on the window (830) moving from a first distance (811) to a third distance (815). For example, the wearable device (401) may fix the window (830) in a positioned state at the third distance (815) for a specified time while an input to change the position of the window (830) is maintained.

[0203] FIG. 9a is a diagram illustrating in a planar view a situation in which a wearable device according to various embodiments positions two-dimensional windows at different depths.

[0204] FIG. 9a can be explained with reference to FIGS. 1 to 5e.

[0205] In one embodiment, the wearable device (401) can display windows (820) and windows (830) through a display assembly (460). In one embodiment, the wearable device (401) can display windows (820) and windows (830) within a three-dimensional virtual space (400) based on a position, orientation, and / or size determined based on an input for displaying windows (820) and windows (830) through the display assembly (460). For example, referring to FIG. 9a, the wearable device (401) can display windows (820) at a first distance (911) from the user (405) and display windows (830) at a second distance (912) from the user (405). In one embodiment, the first distance (911) may be determined based on the size of the window (820) and / or the size of the content within the window (820). In one embodiment, the second distance (912) may be determined based on the size of the window (830) and / or the size of the content within the window (830).

[0206] In one embodiment, the wearable device (401) may receive an input to change the position of the window (830) while displaying the window (820) and the window (830) through the display assembly (460). In one embodiment, the input to change the position of the window (830) may be an input to change the depth of the window (830). In one embodiment, the input to change the position of the window (830) may be an input to change the distance of the window (830) from the user (405).

[0207] In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on a window other than the window (830).

[0208] In one embodiment, the wearable device (401) may move the window (830) to a distance corresponding to the distance of another window for alignment with another window, based on receiving an input to change the position of the window (830). For example, referring to FIG. 9a, the wearable device (401) may move the window (830) from a second distance (912) from the user (405) to a first distance (911) corresponding to the distance of the window (820), based on receiving an input to change the position of the window (830).

[0209] In one embodiment, the wearable device (401) can move the window (830) from a second distance (912) to a first distance (911) based on a movement transformation. In one embodiment, the wearable device (401) can move the window (830) from a second distance (912) to a first distance (911) based on a movement transformation without a size transformation.

[0210] For example, while an input to change the position of the window (830) is maintained, the wearable device (401) may stop the movement of the window (830) based on the window (830) moving from the second distance (912) to the first distance (911). For example, the wearable device (401) may fix the window (830) in the position of the first distance (911) for a specified time while an input to change the position of the window (830) is maintained. For example, the wearable device (401) may fix the window (830) in the position of the other window (820) for a specified time based on the window (830) being aligned with the other window (820) while an input to change the position of the window (830) is maintained.

[0211] FIG. 9b is a diagram illustrating, in a planar view, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved. FIG. 9c is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0212] FIGS. 9b and 9c may be described with reference to FIGS. 1 through 5e. In FIGS. 9b and 9c, compared to FIG. 9a, an operation of further performing a size transformation of the window (830) along with a translation transformation of the window (830) may be described.

[0213] In one embodiment, the wearable device (401) can display windows (820) and windows (830) through a display assembly (460). In one embodiment, the wearable device (401) can display windows (820) and windows (830) within a three-dimensional virtual space (400) based on a position, orientation, and / or size determined based on an input for displaying windows (820) and windows (830) through the display assembly (460). For example, referring to FIGS. 9b and 9c, the wearable device (401) can display windows (820) at a first distance (911) from the user (405) and display windows (830) at a second distance (912) from the user (405). In one embodiment, the first distance (911) may be determined based on the size of the window (820) and / or the size of the content within the window (820). In one embodiment, the second distance (912) may be determined based on the size of the window (830) and / or the size of the content within the window (830).

[0214] In one embodiment, the wearable device (401) may receive an input to change the position of the window (830) while displaying the window (820) and the window (830) through the display assembly (460). In one embodiment, the input to change the position of the window (830) may be an input to change the depth of the window (830). In one embodiment, the input to change the position of the window (830) may be an input to change the distance of the window (830) from the user (405).

[0215] In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on a window other than the window (830).

[0216] In one embodiment, the wearable device (401) may move the window (830) to a distance corresponding to the distance of another window for alignment with another window, based on receiving an input to change the position of the window (830). For example, referring to FIGS. 9b and 9c, the wearable device (401) may move the window (830) from a second distance (912) from the user (405) to a first distance (911) corresponding to the distance of the window (820), based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may move the window (830) from the second distance (912) to the first distance (911) based on a movement conversion.

[0217] In one embodiment, the wearable device (401) may enlarge the window (830) based on receiving an input to change the position of the window (830), so that the size of the content in the window (830) corresponds to the size of the content in the window (820) for alignment with the size of the content in the window (820).

[0218] In one embodiment, the wearable device (401) may enlarge the size of the window (830) and the size of the content within the window (830) so that the size of the content within the window (830) corresponds to the size of the content within the window (820). In one embodiment, the wearable device (401) may enlarge the size of the window (830) and the size of the content within the window (830) so that the ratio of the window (830) and / or the ratio of the content within the window (830) is maintained. As the size of the window (830) and the size of the content within the window (830) are enlarged so that the ratio of the window (830) and / or the ratio of the content within the window (830) is maintained, the layout of the enlarged window (920) and / or the layout of the content within the enlarged window (920) may not be changed.

[0219] For example, the wearable device (401) may enlarge the size of the window (830) and the size of the content within the window (830) so that the size of the content within the window (830) corresponds to the size of the content within the window (820) (e.g., font size) while moving the window (830) from a second distance (912) to a first distance (911) based on receiving an input to change the position of the window (830). However, the disclosure is not limited thereto. For example, the wearable device (401) may, upon receiving an input to change the position of the window (830), move the window (830) from a second distance (912) to a first distance (911), and then enlarge the size of the window (830) and the size of the content within the window (830) so that the size of the content within the window (830) (e.g., font size) corresponds to the size of the content within the window (820) (e.g., font size).

[0220] For example, referring to FIGS. 9b and 9c, depending on the translation and scaling of the window (830), the size of the enlarged window (920) at the first distance (911) may be larger than the size of the window (830) at the second distance (912). For example, referring to FIGS. 9b and 9c, depending on the translation and scaling of the window (830), the arrangement of content (e.g., line breaks) within the enlarged window (920) at the first distance (911) may be the same as the arrangement of content (e.g., line breaks) within the window (830) at the second distance (912). For example,

[0221] Referring to FIGS. 9b and 9c, depending on the translation and resizing of the window (830), the size of the content (e.g., font size) within the enlarged window (920) at the first distance (911) may be larger than the size of the content (e.g., font size) within the window (820) at the second distance (912).

[0222] For example, while an input to change the position of the window (830) is maintained, the wearable device (401) may stop the movement of the window (830) based on the window (830) moving from the second distance (912) to the first distance (911). For example, the wearable device (401) may fix the window (830) in the position of the first distance (911) for a specified time while an input to change the position of the window (830) is maintained. For example, the wearable device (401) may fix the window (830) in the position of the other window (820) for a specified time based on the window (830) being aligned with the other window (820) while an input to change the position of the window (830) is maintained.

[0223] FIG. 9d is a diagram illustrating, in a planar view, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved. FIG. 9e is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0224] FIGS. 9d and 9e can be described with reference to FIGS. 1 through 5e, FIG. 9b, and FIG. 9c. FIGS. 9d and 9e may illustrate subsequent operations of FIGS. 9b and FIG. 9c. In FIGS. 9d and 9e, compared to FIG. 9a, operations may be described that further perform a size transformation of the enlarged window (920) along with a translation transformation of the enlarged window (920).

[0225] In one embodiment, the wearable device (401) can display a window (820) and an enlarged window (920) through a display assembly (460). In one embodiment, the wearable device (401) can display an enlarged window (920) through a display assembly (460) at a first distance (911) based on an input to change the position of the window (830) while displaying the window (830) at a second distance (912). In one embodiment, the wearable device (401) can display a window (820) and an enlarged window (920) at a first distance (911).

[0226] In one embodiment, the wearable device (401) may receive an input to change the position of the enlarged window (920) while displaying the window (820) and the enlarged window (920) through the display assembly (460). In one embodiment, the input to change the position of the enlarged window (920) may be an input to change the depth of the enlarged window (920). In one embodiment, the input to change the position of the enlarged window (920) may be an input to change the distance of the enlarged window (920) from the user (405). In one embodiment, the input to change the position of the enlarged window (920) may be a continuous input to the input to change the position of the window (830) described through FIGS. 9b and 9c. However, the disclosure is not limited thereto. For example, the input for changing the position of the enlarged window (920) may be the input that is entered after the input for changing the position of the window (830) described through FIG. 9b and FIG. 9c has been released.

[0227] In one embodiment, the wearable device (401) may determine a new position and / or new size of the enlarged window (920) within a three-dimensional virtual space (400) based on receiving an input to change the position of the enlarged window (920). In one embodiment, the wearable device (401) may determine a new position and / or new size of the enlarged window (920) within a three-dimensional virtual space (400) based on the alignment between the enlarged window (920) and the window (820) being released. For example, referring to FIGS. 9d and 9e, the wearable device (401) may move the enlarged window (920) based on receiving an input to change the position of the enlarged window (920) aligned with another window (e.g., window (820)).

[0228] In one embodiment, the wearable device (401) may reduce the size of the enlarged window (920) to the size of the original window (820) for size alignment with the window (820) based on receiving an input to change the position of the enlarged window (920). In one embodiment, the wearable device (401) may reduce the size of the content within the enlarged window (920) to the size of the content within the original window (830) for size alignment with the content within the window (820) based on receiving an input to change the position of the enlarged window (920). In one embodiment, the wearable device (401) may reduce the size of the enlarged window (920) and the size of the content within the enlarged window (920). In one embodiment, the wearable device (401) can reduce the size of the enlarged window (920) and the size of the content within the enlarged window (920) so that the ratio of the enlarged window (920) and / or the ratio of the content within the enlarged window (920) is maintained.

[0229] For example, the wearable device (401) may enlarge the size of the enlarged window (920) and the size of the content within the enlarged window (920) so that the size of the content within the enlarged window (920) corresponds to the size of the content within the original window (830) (e.g., font size) while moving the enlarged window (920) from a first distance (911) to a third distance (913) based on receiving an input to change the position of the enlarged window (920). However, the disclosure is not limited thereto. For example, the wearable device (401) may, upon receiving an input to change the position of the enlarged window (920), move the enlarged window (920) from a first distance (911) to a third distance (913), and then enlarge the size of the enlarged window (920) and the size of the content within the enlarged window (920) so that the size of the content within the enlarged window (920) (e.g., font size) corresponds to the size of the content within the original window (830) (e.g., font size).

[0230] For example, referring to FIGS. 9d and 9e, depending on the translation and scaling of the enlarged window (920), the size of the reduced window (830) at the third distance (913) may be the same as the size of the original window (830) at the second distance (912). For example, referring to FIGS. 9d and 9e, depending on the translation and scaling of the enlarged window (920), the arrangement of content (e.g., line breaks) within the reduced window (830) at the third distance (913) may be the same as the arrangement of content (e.g., line breaks) within the original window (830) at the second distance (912). For example, referring to FIG. 9d and FIG. 9e, depending on the translation and resizing of the enlarged window (920), the size of the content (e.g., font size) in the reduced window (830) at the third distance (913) may be the same as the size of the content (e.g., font size) in the original window (830) at the second distance (912).

[0231] FIG. 10a is a diagram illustrating, in a planar view, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved. FIG. 10b is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0232] FIGS. 10a and FIGS. 10b may be described with reference to FIGS. 1 through 5e. In FIGS. 10a and FIGS. 10b, compared with FIGS. 9b and FIGS. 9c, an operation of performing a size conversion of the content within the window (830) without a size conversion of the window (830) may be described.

[0233] In one embodiment, the wearable device (401) may display a window (820) and a window (830) through a display assembly (460). For example, referring to FIGS. 10a and FIGS. 10b, the wearable device (401) may display a window (820) at a first distance (1011) from the user (405) and display a window (830) at a second distance (1012) from the user (405). In one embodiment, the first distance (1011) may be determined based on the size of the window (820) and / or the size of the content within the window (820). In one embodiment, the second distance (1012) may be determined based on the size of the window (830) and / or the size of the content within the window (830).

[0234] In one embodiment, the wearable device (401) may receive an input to change the position of the window (830) while displaying the window (820) and the window (830) through the display assembly (460). In one embodiment, the input to change the position of the window (830) may be an input to change the depth of the window (830). In one embodiment, the input to change the position of the window (830) may be an input to change the distance of the window (830) from the user (405).

[0235] In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (830) in a three-dimensional virtual space (400) based on a window other than the window (830).

[0236] In one embodiment, the wearable device (401) may move the window (830) to a distance corresponding to the distance of another window for alignment with another window, based on receiving an input to change the position of the window (830). For example, referring to FIGS. 10a and 10b, the wearable device (401) may move the window (830) from a second distance (1012) from the user (405) to a first distance (1011) corresponding to the distance of the window (820), based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may move the window (830) from the second distance (1012) to the first distance (1011) based on a movement conversion.

[0237] In one embodiment, the wearable device (401) may enlarge the size of the content within the window (830) so that the size of the content within the window (830) corresponds to the size of the content within the window (820) in order to align with the size of the content within the window (820) based on receiving an input to change the position of the window (830). In one embodiment, the wearable device (401) may enlarge the size of the content within the window (830) without changing the size of the window (830) so that the size of the content within the window (830) corresponds to the size of the content within the window (820). As the size of the content within the window (830) is enlarged without changing the size of the window (830), the layout of the content within the window (1020) may be changed.

[0238] For example, the wearable device (401) may enlarge the size of the content within the window (830) without changing the size of the window (830) while moving the window (830) from a second distance (1012) to a first distance (1011) based on receiving an input to change the position of the window (830), so that the size of the content within the window (830) (e.g., font size) corresponds to the size of the content within the window (820) (e.g., font size). However, the disclosure is not limited thereto. For example, the wearable device (401) can move the window (830) from a second distance (1012) to a first distance (1011) based on receiving an input to change the position of the window (830), and then enlarge the size of the content within the window (830) without changing the size of the window (830) so that the size of the content within the window (830) (e.g., font size) corresponds to the size of the content within the window (820) (e.g., font size).

[0239] For example, referring to FIGS. 10a and 10b, depending on the translation of the window (830), the size of the window (1020) at the first distance (1011) may be the same as the window (830) at the second distance (1012). For example, referring to FIGS. 10a and 10b, depending on the translation of the window (830) and the size translation of the content, the arrangement of content (e.g., line breaks) within the window (1020) at the first distance (1011) may be different from the arrangement of content (e.g., line breaks) within the window (830) at the second distance (1012). For example, referring to FIG. 10a and FIG. 10b, depending on the translation of the window (830) and the size translation of the content, the size of the content (e.g., font size) in the window (1020) at the first distance (1011) may be larger than the size of the content (e.g., font size) in the window (820) at the second distance (1012).

[0240] For example, while an input to change the position of the window (830) is maintained, the wearable device (401) may stop the movement of the window (830) based on the window (830) moving from the second distance (1012) to the first distance (1011). For example, the wearable device (401) may fix the window (830) in the position of the first distance (1011) for a specified time while an input to change the position of the window (830) is maintained. For example, the wearable device (401) may fix the window (830) in the position of the other window (820) for a specified time based on the window (830) being aligned with the other window (820) while an input to change the position of the window (830) is maintained.

[0241] FIG. 10c is a diagram illustrating, in a planar view, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved. FIG. 10d is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments changes its size as a two-dimensional window is moved.

[0242] FIGS. 10c and FIGS. 10d can be described with reference to FIGS. 1 to 5e and FIGS. 9a to 9c. FIGS. 10c and FIGS. 10d can illustrate subsequent operations of FIGS. 9b and FIGS. 9c. In FIGS. 10c and FIGS. 10d, compared with FIGS. 9d and FIGS. 9e, an operation of performing a size conversion on the content within the window (1020) without a size conversion on the window (1020) can be described.

[0243] In one embodiment, the wearable device (401) can display the window (820) and the window (1020) through the display assembly (460). In one embodiment, the wearable device (401) can display the window (1020) through the display assembly (460) at a first distance (1011) based on an input to change the position of the window (830) while displaying the window (830) at a second distance (1012). In one embodiment, the wearable device (401) can display the window (820) and the window (1020) at the first distance (1011).

[0244] In one embodiment, the wearable device (401) may receive an input to change the position of the window (1020) while displaying the window (820) and the window (1020) through the display assembly (460). In one embodiment, the input to change the position of the window (1020) may be an input to change the depth of the window (1020). In one embodiment, the input to change the position of the window (1020) may be an input to change the distance of the window (1020) from the user (405). In one embodiment, the input to change the position of the window (1020) may be a continuous input to the input to change the position of the window (830) described through FIGS. 10a and FIGS. 10b. However, the disclosure is not limited thereto. For example, the input for changing the position of the window (1020) may be the input that is entered after the input for changing the position of the window (830) described through FIG. 10a and FIG. 10b has been released.

[0245] In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (1020) in a three-dimensional virtual space (400) based on receiving an input to change the position of the window (1020). In one embodiment, the wearable device (401) may determine a new position and / or new size of the window (1020) in a three-dimensional virtual space (400) based on the alignment between the window (1020) and the window (820) being released. For example, referring to FIG. 10c and FIG. 10d, the wearable device (401) may move the window (1020) based on receiving an input to change the position of the window (1020) aligned with another window (e.g., window (820)).

[0246] In one embodiment, the wearable device (401) may reduce the size of the content within the window (1020) to the size of the content within the original window (830) for size alignment with the content within the window (820) based on receiving an input to change the position of the window (1020). In one embodiment, the wearable device (401) may reduce the size of the content within the window (1020) without changing the size of the window (1020). In one embodiment, the wearable device (401) may reduce the size of the content within the window (1020) without changing the size of the window (1020) so that the aspect ratio of the window (1020) is maintained.

[0247] For example, the wearable device (401) may enlarge the size of the content within the window (1020) so that the size of the content within the window (1020) corresponds to the size of the content within the original window (830) (e.g., font size) while moving the window (1020) from a first distance (1011) to a third distance (1013) based on receiving an input to change the position of the window (1020). However, the disclosure is not limited thereto. For example, the wearable device (401) may, upon receiving an input to change the position of the window (1020), move the window (1020) from a first distance (1011) to a third distance (1013), and then enlarge the size of the content within the window (1020) so that the size of the content within the window (1020) (e.g., font size) corresponds to the size of the content within the original window (830) (e.g., font size).

[0248] For example, referring to FIGS. 10c and FIGS. 10d, depending on the translation of the window (1020), the size of the window (830) at the third distance (1013) may be the same as the size of the window (1020) at the first distance (1011) and the size of the window (830) at the second distance (1012). For example, referring to FIGS. 10c and FIGS. 10d, depending on the translation of the window (1020) and the size translation of the content, the arrangement of content (e.g., line breaks) within the window (830) at the third distance (1013) may be the same as the arrangement of content (e.g., line breaks) within the original window (830) at the second distance (1012). For example, referring to FIG. 10c and FIG. 10d, depending on the translation of the window (1020) and the size transformation of the content, the size of the content (e.g., font size) in the reduced window (830) at the third distance (1013) may be the same as the size of the content (e.g., font size) in the original window (830) at the second distance (1012).

[0249] FIG. 11a is a diagram illustrating, in a planar view, a situation in which a wearable device according to various embodiments bends a two-dimensional window as it moves the two-dimensional window. FIG. 11b is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments bends a two-dimensional window in the left-right direction as it moves the two-dimensional window. FIG. 11c is a diagram illustrating, according to various embodiments, a situation in which a wearable device according to various embodiments bends a two-dimensional window in the up-down direction as it moves the two-dimensional window.

[0250] FIGS. 11a, FIGS. 11b, and FIGS. 11c can be explained with reference to FIGS. 1 to 5e.

[0251] In one embodiment, the wearable device (401) can display the window (820) through the display assembly (460). In one embodiment, the wearable device (401) can receive an input to change the position of the window (820) while displaying the window (820) through the display assembly (460). In one embodiment, the input to change the position of the window (820) may be an input to change the depth of the window (820).

[0252] For example, referring to FIGS. 11a, 11b and 11c, the wearable device (401) can move the window (820) toward the user (405) based on receiving an input to change the position of the window (820).

[0253] In one embodiment, as the window (820) is moved toward the user (405), the wearable device (401) can identify whether the window (820) is out of the user's (405) field of view (1110) (e.g., 30 degrees left and right, 15 degrees up and down). For example, the window (820) being out of the user's (405) field of view (1110) may include the length of the window (820) being longer than the length considering the user's (405) field of view (1110) (or the length of the side opposite (or opposite the field of view (1110)) when the user (405) is the vertex) (e.g., left-right length, or up-down length).

[0254] In one embodiment, as the window (820) is moved toward the user (405), the wearable device (401) can identify whether at least one of the edges (1101, 1103, 1105, 1107) of the window (820) is out of the user's (405) field of view (1110). For example, an edge of the window (820) being out of the user's (405) field of view (1110) may include the edge of the window (820) being out of the boundary (or limit) of the field of view (1110) centered on the user's (405) line of sight (1115).

[0255] In one embodiment, the wearable device (401) may bend the window (820) so that the edges (1101, 1103) do not go out of the field of view (1110) based on identifying that the edges (1101, 1103) of the window (820) go out of the field of view (1110). In one embodiment, the wearable device (401) may bend at least one of the edges (1101, 1103, 1105, 1107) based on identifying that the window (820) goes out of the field of view (1110) of the user (405). In one embodiment, the wearable device (401) may curve at least one of the sides (1101, 1103, 1105, 1107) according to a specified curvature based on identifying that the window (820) is out of the user's (405) field of view (1110). In one embodiment, the specified curvature may be determined based on the size of the window (820), the length of the side of the window (820), and / or the size of the content within the window (820). In one embodiment, the specified curvature may be determined based on the user's (405) vision information.

[0256] For example, referring to FIG. 11a and FIG. 11b, the wearable device (401) may bend the edges (1105, 1107) of the window (820) so that the edges (1101, 1103) do not go out of the field of view (1110), based on identifying that the edges (1101, 1103) of the window (820) go out of the field of view (1110). However, the disclosure is not limited thereto. For example, referring to FIG. 11c, the wearable device (401) can bend the edges (1101, 1103) of the window (820) so that the edges (1105, 1107) do not go out of the field of view (1110), based on identifying that the edges (1105, 1107) of the window (820) go out of the field of view (1110).

[0257] In one embodiment, the layout of the content within the curved window (1120) may be the same as the layout of the content within the window (820). For example, referring to FIG. 11a and FIG. 11b, the size of the content within the curved window (1120) (e.g., font size) may be the same as the size of the content within the window (820) (e.g., font size).

[0258] FIG. 12 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0259] FIG. 12 can be described with reference to FIG. 4a through FIG. 11c. The operations of FIG. 12 can be performed sequentially for each of a plurality of distances. The operations of FIG. 12 can be performed sequentially for each of a plurality of sizes.

[0260] Referring to FIG. 12, in operation 1210, the wearable device (401) can display a virtual object of a specified size at a specified distance. In one embodiment, the wearable device (401) can display a virtual object at a specified distance determined within a system depth range (510) when displaying a FOV (410) in a three-dimensional virtual space (400) through a display assembly (460). In one embodiment, the wearable device (401) can display a virtual object at a size determined within a size range (e.g., between a maximum size (531) and a minimum size (535)) when displaying a FOV (410) in a three-dimensional virtual space (400) through a display assembly (460).

[0261] In operation 1220, the wearable device (401) may receive input (e.g., user input) regarding the displayed virtual object. For example, the wearable device (401) may receive user input indicating that the user (405) can disassemble the displayed virtual object. For example, the wearable device (401) may receive user input indicating that the user (405) cannot disassemble the displayed virtual object.

[0262] In operation 1230, the wearable device (401) can obtain visual information of the user (405) based on user input. For example, the wearable device (401) can obtain visual information indicating that the user (405) can decompose the size and distance of the displayed virtual object based on receiving user input indicating that the user (405) can decompose the displayed virtual object. For example, the wearable device (401) can obtain visual information indicating that the user (405) cannot decompose the size and distance of the displayed virtual object based on receiving user input indicating that the user (405) cannot decompose the displayed virtual object.

[0263] In one embodiment, the wearable device (401) can obtain visual information of the user (405) according to the multiple distances and multiple sizes by sequentially performing the operations of FIG. 12 for each of the multiple distances and multiple sizes.

[0264] FIG. 13 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0265] FIG. 13 can be explained with reference to FIGS. 4a to FIGS. 11c.

[0266] Referring to FIG. 13, in operation 1310, the wearable device (401) may receive an input requesting the display of a window. In one embodiment, the input requesting the display of a window may include an input for executing an application. For example, the window may be a virtual object on a two-dimensional plane. For example, the window may be a virtual object (or a virtual object without volume) extending in three mutually orthogonal directions. For example, the window may be a window on a two-dimensional plane. However, the disclosure is not limited thereto. For example, the window may be a virtual object (or a virtual object with volume) extending in three mutually orthogonal directions.

[0267] In one embodiment, the input for displaying a window may include an input for running an application related to the window. For example, the input requesting the display of a window may include voice input from the user (405) (e.g., "Display the window," "Run the application"). For example, the input requesting the display of a window may include an input transmitted from an external electronic device (e.g., the electronic device (102) of FIG. 1) (e.g., a smart ring, a smart watch, a smartphone, a remote controller, or a stylus). For example, the input requesting the display of a window may include a gesture of the user (405) (e.g., a gesture for displaying a window, a gesture for running an application). In one embodiment, the gesture of the user (405) may be a gesture through one of the user's (405) hands identified through an image acquired via the camera (485). In one embodiment, the gesture of the user (405) may be a gesture through at least one of the two eyes of the user (405) identified through images of the two eyes of the user (405) obtained through the camera assembly (480).

[0268] In operation 1320, the wearable device (401) can identify the layout of the window to be displayed. In one embodiment, the wearable device (401) can identify the arrangement of contents within the window to be displayed. In one embodiment, the wearable device (401) can identify the sizes (or font sizes) of the contents within the window to be displayed. In one embodiment, the contents may be images, videos, and / or text.

[0269] In operation 1330, the wearable device (401) can determine the position and size of the window based on the layout of the window.

[0270] For example, the wearable device (401) can determine the position of the window based on the size of the smallest content among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the smallest font size of the text written in the contents within the window. For example, the wearable device (401) can determine the position of the window based on the size of the content located relatively in the center among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the font size of the text written in the content located relatively in the center among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the size of the main content among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the font size of the text written in the main content among the contents within the window.

[0271] In operation 1340, the wearable device (401) can display a window based on a determined position and size.

[0272] FIG. 14 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0273] FIG. 14 can be explained with reference to FIG. 4a to FIG. 11c.

[0274] Referring to FIG. 14, in operation 1410, the wearable device (401) can display a window at a first position. In one embodiment, the first position may be a position determined based on the operations according to FIG. 13.

[0275] In operation 1420, the wearable device (401) can receive input to change the distance of the window.

[0276] In one embodiment, the wearable device (401) may receive an input to change the position of the window while displaying the window through the display assembly (460). In one embodiment, the input to change the position of the window may be an input to change the depth of the window. In one embodiment, the input to change the position of the window may be an input to change the distance of the window from the user (405). For example, the input to change the position of the window may be an input to change the position of the window closer to the user (405). However, the disclosure is not limited thereto. For example, the input to change the position of the window may be an input to change the position of the window further away from the user (405).

[0277] For example, receiving input to change the position of the window may include voice input from the user (405) (e.g., "Change the display position of the window," "Show the window up close"). For example, receiving input to change the position of the window may include input transmitted from an external electronic device (e.g., the electronic device (102) of FIG. 1) (e.g., a smart ring, a smart watch, a smartphone, a remote controller, or a stylus). For example, receiving input to change the position of the window may include gestures from the user (405) (e.g., a gesture for zooming in, a gesture for zooming out).

[0278] In one embodiment, the gesture of the user (405) may be a gesture through one of the user's (405) hands identified through an image obtained through a camera (485). In one embodiment, the gesture of the user (405) may be a gesture through at least one of the user's (405) eyes identified through images of the user's (405) eyes obtained through a camera assembly (480). In one embodiment, the gesture through at least one of the user's (405) eyes may include a gesture of the user (405) closing both eyes.

[0279] In operation 1430, the wearable device (401) can determine the position of the window based on the user's vision information. In one embodiment, the wearable device (401) can determine the position within the FOV (410) for displaying the window within the depth range (520) represented by the user's (405) vision information, based on receiving an input to change the position of the window. In one embodiment, the wearable device (401) can determine the position within the FOV (410) based on the size of the window within the depth range (520). For example, the wearable device (401) can determine the position based on the size of the contents within the window within the depth range (520).

[0280] For example, the wearable device (401) can determine the position of the window based on the size of the smallest content among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the smallest font size of the text written in the contents within the window. For example, the wearable device (401) can determine the position of the window based on the size of the content located relatively in the center among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the font size of the text written in the content located relatively in the center among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the size of the main content among the contents within the window. For example, the wearable device (401) can determine the position of the window based on the font size of the text written in the main content among the contents within the window.

[0281] For example, the wearable device (401) can determine the position of the window based on the size of the content within the window that the user (405) looks at. For example, the wearable device (401) can determine the position of the window based on the font size of the text written on the content within the window that the user (405) looks at. In one embodiment, the wearable device (401) can identify the user's (405) gaze based on images of the user's (405) eyes obtained through the camera assembly (480). For example, the wearable device (401) can identify the user's (405) gaze based on the position of the irises of the two eyes indicated by the images of the user's (405) eyes.

[0282] In operation 1440, the wearable device (401) can move the window to a determined second position. In one embodiment, the determined second position may be a position determined according to operation 1430.

[0283] In one embodiment, the wearable device (401) can move the window from a first position to a second position based on a translational transform. In one embodiment, the wearable device (401) can move the window from a first position to a second position based on a translational transform without a scaling transform. In one embodiment, the translational transform may be such that the size of the window and the size of the content within the window are not changed within a three-dimensional virtual space (400).

[0284] For example, after the window is moved from a first position with the user (405) to a second position with the user (405), the input to change the position of the window (e.g., with both eyes squinted) may be released (e.g., with both eyes normally open). However, the initiation is not limited to this. For example, while the input to change the position of the window is maintained, the wearable device (401) may stop the movement of the window based on the window being moved from a first position with the user (405) to a second position with the user (405). For example, the wearable device (401) may fix the window in a position at the second position for a specified time while the input to change the position of the window is maintained.

[0285] FIG. 15 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0286] FIG. 15 may be described with reference to FIG. 4a through FIG. 11c. In one embodiment, the operations 1510, 1520, 1550, and 1560 of FIG. 15 may correspond to the operations 1410, 1420, 1430, and 1440 of FIG. 14, respectively. In the following descriptions of the operations 1510, 1520, 1550, and 1560 of FIG. 15, descriptions that overlap with the descriptions of the operations 1410, 1420, 1430, and 1440 of FIG. 14 may not be repeated.

[0287] Referring to FIG. 15, in operation 1510, the wearable device (401) can display a window at a first position. In operation 1520, the wearable device (401) can receive an input to change the distance of the window.

[0288] In operation 1530, the wearable device (401) can determine whether another window exists. For example, the wearable device (401) can determine whether another window exists in the direction in which the window is moved. For example, the wearable device (401) can determine whether another window exists to be aligned with the window in the direction in which the window is moved.

[0289] Based on the determination in operation 1530 that another window exists, the wearable device (401) can perform operation 1540. Based on the determination in operation 1530 that another window does not exist, the wearable device (401) can perform operation 1550.

[0290] In operation 1540, the wearable device (401) can determine the position of the window based on the position of another window. In one embodiment, the wearable device (401) can determine the position to which the window is to be moved based on the position of another window according to an input to change the distance of the window. For example, the wearable device (401) can determine the position to which the window is to be moved such that the distance to the user (405) of the window is equal to the distance to the user (405) of another window.

[0291] In operation 1550, the wearable device (401) can determine the position of the window based on the user's (405) vision information.

[0292] In operation 1560, the wearable device (401) can move the window to a determined second position. In one embodiment, the determined second position may be one of the position determined according to operation 1540 or the position determined according to operation 1550.

[0293] In one embodiment, when moving a window so that the window is aligned with another window, the wearable device (401) may move the window from a first position to a second position based on a translation transformation. In one embodiment, when moving a window so that the window is aligned with another window, the wearable device (401) may move the window from a first position to a second position based on a translation transformation along with a size transformation for the window. In one embodiment, when moving a window so that the window is aligned with another window, the wearable device (401) may move the window from a first position to a second position based on a translation transformation along with a size transformation for the contents within the window. In one embodiment, the translation transformation may be such that the size of the window and the size of the contents within the window are not changed within a three-dimensional virtual space (400).

[0294] For example, after the window is moved from a first position with the user (405) to a second position with the user (405), the input to change the position of the window (e.g., with both eyes squinted) may be released (e.g., with both eyes normally open). However, the initiation is not limited to this. For example, while the input to change the position of the window is maintained, the wearable device (401) may stop the movement of the window based on the window being moved from a first position with the user (405) to a second position with the user (405). For example, the wearable device (401) may fix the window in a position at the second position for a specified time while the input to change the position of the window is maintained.

[0295] FIG. 16 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0296] FIG. 16 can be described with reference to FIG. 4a through FIG. 11c. In one embodiment, operation 1610 of FIG. 16 may correspond to operation 1420 of FIG. 14. In the following descriptions of operation 1610 of FIG. 16, descriptions that overlap with descriptions of operation 1420 of FIG. 14 may not be repeated.

[0297] Referring to FIG. 16, in operation 1610, the wearable device (401) can receive an input to change the distance of the window.

[0298] In operation 1620, the wearable device (401) can determine whether a change in the size of the content is necessary. In one embodiment, the wearable device (401) can determine that a change in the size of the content is necessary based on the determination that the window is not moved to a position corresponding to the user (405)'s vision information and that the window is aligned with another window. In one embodiment, the wearable device (401) can determine that the size of the content needs to be enlarged if the window's display position is farther away than the position corresponding to the user (405)'s vision information. In one embodiment, the wearable device (401) can determine that the size of the content needs to be reduced if the window's display position is closer than the position corresponding to the user (405)'s vision information.

[0299] Based on determining in operation 1620 that a size conversion of the content is required, the wearable device (401) can perform operation 1630. Based on determining in operation 1620 that a size conversion of the content is not required, the wearable device (401) can perform operation 1660.

[0300] In operation 1630, the wearable device (401) can determine whether a window size conversion is required.

[0301] In one embodiment, the wearable device (401) may determine that a window size conversion is required based on the determination that the size of the window is different from the size of another window. In one embodiment, the wearable device (401) may determine that a window size conversion is required so that the size of the window is aligned with the size of another window. In one embodiment, the wearable device (401) may determine that the size of the window should be reduced if the size of the window is larger than the size of another window. In one embodiment, the wearable device (401) may determine that the size of the window should be expanded if the size of the window is smaller than the size of another window. However, the disclosure is not limited thereto. For example, the wearable device (401) may determine that a window size conversion is required based on the determination that the window is aligned with another window and that the display position of the window is not moved to a position corresponding to the user's (405) vision information. In one embodiment, the wearable device (401) can determine that the size of the window should be enlarged if the display position of the window is farther than the position corresponding to the user's (405) vision information. In one embodiment, the wearable device (401) can determine that the size of the window should be reduced if the display position of the window is closer than the position corresponding to the user's (405) vision information.

[0302] Based on the determination in operation 1630 that a window size conversion is required, the wearable device (401) can perform operation 1640. Based on the determination in operation 1630 that a window size conversion is not required, the wearable device (401) can perform operation 1650.

[0303] In operation 1640, the wearable device (401) can move the window to a second position along with a change in the size of the window. For example, the wearable device (401) can move the window to a second position along with a change in the size of the window so that the size of the content within the window corresponds to the size of the content within another aligned window. For example, the wearable device (401) can move the window to a second position along with a change in the size of the window so that the size of the window corresponds to the size of another aligned window.

[0304] In operation 1650, the wearable device (401) can move the window to a second position with a change in the size of the content. For example, the wearable device (401) can move the window to a second position with a change in the size of the content without changing the size of the window so that the size of the content within the window corresponds to the size of the content within another aligned window.

[0305] In operation 1660, the wearable device (401) can move the window to a second position without changing its size.

[0306] FIG. 17 is a flowchart illustrating exemplary operation of a wearable device (401) according to various embodiments.

[0307] FIG. 17 can be described with reference to FIG. 4a through FIG. 11c. The operations of FIG. 17 can be performed together with the operation 1440 of FIG. 14, the operation 1560 of FIG. 15, and the operations 1640, 1650, and 1660 of FIG. 16.

[0308] Referring to FIG. 17, in operation 1710, the wearable device (401) can move the window.

[0309] In operation 1720, the wearable device (401) can determine whether the window has moved out of the field of view. In one embodiment, as the window is moved toward the user (405), the wearable device (401) can determine whether the window has moved out of the user's (405) field of view (e.g., 30 degrees to the left and right, 15 degrees to the up and down). For example, the window moving out of the user's (405) field of view may include the window being longer than the length of the window considering the user's (405) field of view (or, the length of the side opposite (or opposite the field of view) when the user (405) is the vertex) (e.g., left-right length, or up-down length).

[0310] In one embodiment, as the window is moved toward the user (405), the wearable device (401) can identify whether at least one of the edges of the window is out of the user's (405) field of view. For example, the edge of the window being out of the user's (405) field of view may include the edge of the window being out of the boundary (or limit) of the field of view centered on the user's (405) gaze.

[0311] In operation 1720, based on determining that the window has deviated from the viewing angle, the wearable device (401) can perform operation 1730. In operation 1720, based on determining that the window has not deviated from the viewing angle, the wearable device (401) can perform operation 1710.

[0312] In operation 1730, the wearable device (401) can bend the window.

[0313] In one embodiment, the wearable device (401) may curve the window so that the edges do not go out of the field of view based on identifying that the edges of the window go out of the field of view. In one embodiment, the wearable device (401) may curve at least one of the edges based on identifying that the window goes out of the user's (405) field of view. In one embodiment, the wearable device (401) may curve at least one of the edges according to a specified curvature based on identifying that the window goes out of the user's (405) field of view. In one embodiment, the specified curvature may be determined based on the size of the window, the length of the edges of the window, and / or the size of the content within the window. In one embodiment, the specified curvature may be determined based on the user's (405) vision information.

[0314] In one embodiment, the layout of the content within the curved window may be the same as the layout of the content within the window. For example, the size of the content within the curved window (e.g., font size) may be the same as the size of the content within the window (e.g., font size).

[0315] The technical problems addressed in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0316] A wearable device according to an exemplary embodiment as described above may include a display assembly comprising displays arranged to face the two eyes of a user based on the user wearing the wearable device, at least one processor comprising a processing circuit, and a memory comprising one or more storage media for storing instructions. When the above instructions are executed individually or collectively by the at least one processor, the wearable device displays a virtual window containing at least one content at a position at a first distance from the user based on the user's gaze on the display assembly, receives an input to change the distance between the user and the virtual window, and while receiving the input, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content included in the virtual window corresponds to the user's visual information in the user's gaze at a second distance from the user to the virtual window changed from the first distance, and based on identifying the second distance of the virtual window based on the visual information, may cause the device to stop changing the distance between the user and the virtual window according to the received input.

[0317] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may be caused to identify a designated gesture by the two eyes through the images of the two eyes and to identify the designated gesture as an input for changing the distance of the virtual window.

[0318] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may cause the device to stop changing the distance of the virtual window according to the received input while changing the distance of the virtual window from the first distance: identifying that the third distance of the virtual window, changed from the first distance, corresponds to the distance of another virtual window, and based on identifying the third distance corresponding to the distance of the other virtual window.

[0319] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may cause the size of the virtual window to be changed from a first size to a second size corresponding to the size of the other virtual window, so that at the third distance, the size of the virtual window corresponds to the size of the virtual window.

[0320] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may cause the distance of the virtual window to be changed from the third distance according to the received input after stopping the change of the distance of the virtual window for a specified time, and the size of the virtual window to be changed from the second size to the first size based on the change of the distance of the virtual window from the third distance.

[0321] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may cause the size of the content within the virtual window to be changed from a first size to a second size corresponding to the size of the other content within the other virtual window without changing the size of the virtual window, so that at the third distance, while changing the distance of the virtual window from the first distance, the size of the content within the virtual window corresponds to the size of the other content within the virtual window.

[0322] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may cause the distance of the virtual window to be changed from the third distance according to the received input after stopping the change of the distance of the virtual window for a specified time, and based on the change of the distance of the virtual window from the third distance, the size of the content within the virtual window to be changed from the second size to the first size without changing the size of the virtual window.

[0323] The second distance corresponding to the above visual information may include a distance such that the size of the virtual window visible to the user has a size that the user can resolve.

[0324] The second distance corresponding to the above visual information may include a distance such that the size of the content to which the user’s gaze is directed among a plurality of contents within the virtual window has a size that the user can resolve.

[0325] The second distance corresponding to the above visual information may include a distance such that the size of the smallest content among a plurality of contents within the virtual window has a size that the user can resolve.

[0326] The virtual window may be a window in a two-dimensional plane. When the instructions are executed individually or collectively by the at least one processor, the wearable device may cause the curvature of the virtual window to change from a first curvature to a second curvature corresponding to the user's vision information, based on changing the distance of the virtual window from a first distance while receiving the input.

[0327] When the above instructions are executed individually or collectively by the at least one processor, the wearable device may receive another input for displaying the virtual window, and based on receiving the other input, identify the size of the virtual window and, using the first distance corresponding to the size of the virtual window within a distance range corresponding to the user's vision information, cause the virtual window to be displayed.

[0328] A method according to an exemplary embodiment as described above may be performed in a wearable device comprising a display assembly including displays arranged toward the two eyes of a user based on the user wearing the wearable device. The method may include: displaying a virtual window containing at least one content at a position at a first distance from the user based on the user's gaze on the display assembly; receiving an input to change the distance between the user and the virtual window; while receiving the input, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content included in the virtual window corresponds to the user's vision information at the user's gaze at a second distance from the user to the virtual window changed from the first distance; and stopping the change of the distance between the user and the virtual window according to the received input based on identifying the second distance of the virtual window based on the vision information.

[0329] The above method may include the operation of identifying a designated gesture by the two eyes through images of the two eyes obtained through a camera assembly comprising cameras configured to obtain images of the two eyes based on the user wearing the wearable device, and the operation of identifying the input for changing the distance of the virtual window for the designated gesture.

[0330] The above method may include an operation of identifying that, while changing the distance of the virtual window from the first distance, the third distance of the virtual window changed from the first distance corresponds to the distance of another virtual window. The above method may include an operation of stopping the change of the distance of the virtual window according to the received input based on identifying the third distance corresponding to the distance of the other virtual window.

[0331] The above method may include an operation of changing the size of the virtual window from a first size to a second size corresponding to the size of the other virtual window at the third distance, while changing the distance of the virtual window from the first distance, so that the size of the virtual window corresponds to the size of the virtual window.

[0332] The above method may include, after suspending the change of the distance of the virtual window for a specified time, an operation to change the distance of the virtual window from the third distance according to the received input, and an operation to change the size of the virtual window from the second size to the first size based on the change of the distance of the virtual window from the third distance.

[0333] The above method may include an operation of changing the size of the content within the virtual window from a first size to a second size corresponding to the size of the other content within the other virtual window, without changing the size of the virtual window, so that at the third distance, while changing the distance of the virtual window from the first distance, the size of the content within the virtual window corresponds to the size of the other content within the virtual window.

[0334] The above method may include, after suspending the change of the distance of the virtual window for a specified time, an operation to change the distance of the virtual window from the third distance according to the received input, and an operation to change the size of the content within the virtual window from the second size to the first size without changing the size of the virtual window based on the change of the distance of the virtual window from the third distance.

[0335] The virtual window may be a window in a two-dimensional plane. The method may include, while receiving the input, an operation of changing the curvature of the virtual window from a first curvature to a second curvature corresponding to the user's vision information, based on changing the distance of the virtual window from a first distance.

[0336] A non-transitory computer-readable storage medium as described above can store a program containing instructions. When the above instructions are executed individually or collectively by at least one processor comprising a processing circuit of a wearable device including a display assembly comprising displays arranged to face the two eyes of the user based on the user wearing the wearable device, the wearable device displays a virtual window containing at least one content at a position at a first distance from the user based on the user's gaze on the display assembly, receives an input to change the distance between the user and the virtual window, and while receiving the input, the wearable device may cause to stop changing the distance between the user and the virtual window based on the input being received, based on changing the distance between the user and the virtual window from the first distance: identifying that the size of the at least one content contained in the virtual window at a second distance from the user to the virtual window, which is changed from the first distance, corresponds to the user's visual information in the user's gaze, and based on identifying the second distance of the virtual window based on the visual information.

[0337] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0338] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device, etc. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0339] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicationly," said component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0340] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software or firmware, or any combination thereof, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0341] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0342] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read only memory)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0343] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0344] Although the present disclosure has been illustrated and described by reference to various exemplary embodiments, it should be understood that the various exemplary embodiments are intended for illustration and not to be limiting. Those skilled in the art will understand that various modifications, alternatives, and / or variations of the various exemplary embodiments may be made without departing from the true technical spirit and the entire technical scope of the present disclosure, including the appended claims and their equivalents. Furthermore, it will be understood that any embodiment(s) described herein may be used in conjunction with any other embodiment(s) described herein.< / small> < / font> < / small> < / font>

Claims

1. In a wearable device (401), A display assembly (460) comprising displays (461, 465) arranged to face the two eyes of the user (405) based on the user (405) wearing the wearable device (401); At least one processor (420) including a processing circuit; and The wearable device (401) includes a memory (430) that stores instructions and includes one or more storage media, and when the instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), On the display assembly (460), a virtual window containing at least one content is displayed at a position at a first distance (811) from the user (405) based on the user's (405) gaze; Receive input to change the distance between the user (405) and the virtual window (820); While receiving the above input, based on changing the distance between the user (405) and the virtual window (820) from the first distance (811): Identifying that the size of at least one content included in the virtual window (820) corresponds to the user's (405) visual information in the user's (405) line of sight at the second distance (813) of the virtual window (820) from the user (405), which is changed from the first distance (811); Based on identifying the second distance (813) of the virtual window (820) based on the above visual information, causing to stop changing the distance between the user (405) and the virtual window according to the received input, Wearable device.

2. In Claim 1, Based on the user (405) wearing the wearable device (401), the camera assembly (480) includes at least one camera (481, 483) configured to acquire images of the two eyes of the user (405), and When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), Through the images of the two eyes, identify a designated gesture by the two eyes, and Causing the above-mentioned gesture to be identified as the input for changing the distance of the virtual window (820), Wearable device.

3. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), While changing the distance of the virtual window (820) from the first distance (811): Identifying that the third distance of the virtual window (820), which is changed from the first distance (811), corresponds to the distance of another virtual window (830), and Based on identifying the third distance corresponding to the distance of the other virtual window (830), causing to stop changing the distance of the virtual window (820) according to the received input, Wearable device.

4. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), While changing the distance of the virtual window (820) from the first distance (811), At the third distance above, causing the size of the virtual window (820) to be changed from a first size to a second size corresponding to the size of the other virtual window (830) so that the size of the virtual window (820) corresponds to the size of the virtual window (820), Wearable device.

5. In Claim 4, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), After stopping the change of the distance of the virtual window (820) for a specified time, the distance of the virtual window (820) is changed from the third distance according to the received input, and Based on changing the distance of the virtual window (820) from the third distance, causing the size of the virtual window (820) to change from the second size to the first size, Wearable device.

6. In Claim 3, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), While changing the distance of the virtual window (820) from the first distance (811), At the third distance above, causing the size of the content within the virtual window (820) to correspond to the size of other content within the virtual window (820) without changing the size of the virtual window (820), thereby causing the size of the content within the virtual window (820) to change from a first size to a second size corresponding to the size of other content within the other virtual window (830). Wearable device.

7. In Claim 6, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), After stopping the change of the distance of the virtual window (820) for a specified time, the distance of the virtual window (820) is changed from the third distance according to the received input, and Based on changing the distance of the virtual window (820) from the third distance, Causing the size of the content within the virtual window (820) to change from the second size to the first size without changing the size of the virtual window (820). Wearable device.

8. In Claim 1, The second distance (813) corresponding to the above vision information is, The virtual window (820) visible to the user (405) includes a distance such that the size of the virtual window (820) has a size that the user (405) can resolve. Wearable device.

9. In Claim 1, The second distance (813) corresponding to the above vision information is, A distance including a distance such that the size of the content to which the user (405) looks among the plurality of contents within the virtual window (820) is a size that the user (405) can resolve. Wearable device.

10. In Claim 1, The second distance (813) corresponding to the above vision information is, A distance including such that the smallest content among the plurality of contents within the virtual window (820) has a size that is resolvable by the user (405). Wearable device.

11. In Claim 1, The virtual window (820) above is a window of a two-dimensional plane, and When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), While receiving the above input, based on changing the distance of the virtual window (820) from the first distance (811): Causing the curvature of the virtual window (820) to change from a first curvature to a second curvature corresponding to the visual information of the user (405), Wearable device.

12. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor (420), the wearable device (401), Receiving other inputs to display the virtual window (820) above, Based on receiving the other inputs mentioned above, identify the size of the virtual window (820), and Causing the virtual window (820) to be displayed by using the first distance (811) corresponding to the size of the virtual window (820) within a distance range corresponding to the visual information of the user (405). Wearable device.

13. A method performed by a wearable device (401) comprising a display assembly (460) comprising displays (461, 465) arranged to face the two eyes of the user (405), based on the user (405) wearing the wearable device (401), wherein The operation of displaying a virtual window (820) containing at least one content at a position of a first distance (811) from the user (405) on the display assembly (460) based on the user's (405) gaze, The operation of receiving input to change the distance between the user (405) and the virtual window (820), While receiving the above input, based on changing the distance between the user (405) and the virtual window (820) from the first distance (811): An operation to identify that the size of at least one content included in the virtual window (820) corresponds to the user's (405) visual information in the user's (405) line of sight at the second distance (813) of the virtual window (820) from the user (405), which is changed from the first distance (811), and Based on identifying the second distance (813) of the virtual window (820) based on the above visual information, the operation of stopping the change in the distance between the user (405) and the virtual window (820) according to the received input method.

14. In Claim 13, An action of identifying a designated gesture by the two eyes through images of the two eyes obtained through a camera assembly (480) comprising cameras (481, 483) configured to obtain images of the two eyes of the user (405) based on the user (405) wearing the wearable device (401), and The above-mentioned designated gesture includes an operation to identify the input for changing the distance of the virtual window (820). method.

15. In Claim 13, While changing the distance of the virtual window (820) from the first distance (811): An operation to identify that the third distance of the virtual window (820), which is changed from the first distance (811), corresponds to the distance of another virtual window (830), and Based on identifying the third distance corresponding to the distance of the other virtual window (830), the operation of stopping the change of the distance of the virtual window (820) according to the received input method.

Images