Electronic device and method for displaying content in virtual environment

Abstract

This wearable device may comprise: a first display and a second display; a camera; a processor; and a memory for storing instructions. The instructions, when executed by the processor, may cause the wearable device to: display content having a first displaying size on the first display and the second display so that the content is perceived as being located at a first depth in a three-dimensional (3D) virtual environment; and when the content is displayed for a time period equal to or longer than a reference time, display the content in a second displaying size that is substantially the same as the first displaying size on the first display and the second display so that the content is perceived as being located at a second depth exceeding the first depth in the 3D virtual environment.

Description

Electronic device and method for displaying content within a virtual environment

[0001] The present disclosure relates to an electronic device for displaying content in a virtual environment and a method performed by the electronic device.

[0002] To provide an enhanced user experience, electronic devices are being developed that provide virtual environment services that display computer-generated information in conjunction with external objects in the real world. These electronic devices may include wearable devices worn by users. For example, these electronic devices may include user equipment, augmented reality (AR) glasses, or head-mounted devices (HMDs).

[0003] A wearable device may include a display. The wearable device may include a camera. The wearable device may include a processor. The processor may be configured to display content having a first size within a first region of a virtual environment, through at least a portion of a display region of the display. The processor may be configured to identify, based on the camera, whether a time for which a user of the wearable device gazes at the content having the first size is greater than or equal to a reference time. Based on identifying that the time is greater than or equal to the reference time, the processor may be configured to display, through at least a portion of the display, the content having a second size different from the first size within a second region, the second region having a different depth from a reference location corresponding to the user within the virtual environment.

[0004] A wearable device may include a display. The wearable device may include a camera. The wearable device may include a processor. The processor may be configured to display content having a first size in a first area within a virtual environment through at least a portion of the display. The processor may be configured to identify whether a function for adjusting a focal length is activated. The processor may be configured to maintain displaying the content having the first size in the first area through at least a portion of the display based on identifying that the function is deactivated. The processor may be configured to, based on identifying that the function is activated, change a location from the first area to a second area having a different depth from a reference location within the virtual environment for adjusting the focal length, change a size from the first size to a second size according to the adjustment of the focal length, and display the content having the second size within the second area through at least a portion of the location. The reference location may indicate a location within the virtual environment corresponding to a user of the wearable device.

[0005] A wearable device may include a first display positioned with respect to a user's left eye. The wearable device may include a second display positioned with respect to the user's right eye. The wearable device may include at least one processor including a processing circuit. The wearable device may include a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to display content having a first displaying size on the first display and the second display such that the content is perceived as being positioned at a first depth in a three-dimensional virtual environment. The instructions, when individually or collectively executed by the at least one processor, may cause the wearable device to display the content on the first display and the second display in a second display size that is substantially the same as the first display size, such that the content is perceived as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for a time period that is greater than a reference time.

[0006] The above and other aspects, features, and advantages of specific embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0007] FIG. 1 illustrates a block diagram of an electronic device within a network environment according to embodiments of the present disclosure;

[0008] FIG. 2A illustrates an example of a perspective view of a wearable device according to embodiments of the present disclosure;

[0009] FIG. 2b illustrates an example of one or more hardware elements within a wearable device according to embodiments of the present disclosure;

[0010] FIGS. 3A and 3B illustrate examples of wearable devices according to embodiments of the present disclosure;

[0011] FIG. 4a illustrates an example of a method for displaying content based on focal length within a virtual environment;

[0012] FIG. 4b illustrates an example of a method for displaying content based on a focal distance within a virtual environment according to embodiments of the present disclosure;

[0013] FIG. 5 illustrates an exemplary block diagram of a wearable device according to embodiments of the present disclosure;

[0014] FIG. 6 illustrates an example flowchart of a method for displaying content according to a focal length within a virtual environment according to embodiments of the present disclosure;

[0015] FIG. 7 illustrates examples of display areas of a display for displaying content according to focal distance according to embodiments of the present disclosure;

[0016] FIG. 8 illustrates an example of an operational flow for a method of adjusting a focal length and obtaining an adjusted result based on capability information for the focal length according to embodiments of the present disclosure;

[0017] FIG. 9 illustrates an example of a flowchart for a method of displaying content having different sizes depending on a focal length within a virtual environment according to embodiments of the present disclosure; and

[0018] FIG. 10 illustrates an example flowchart of a method for displaying content according to depth within a virtual environment according to embodiments of the present disclosure.

[0019] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

[0020] One or more embodiments of the present disclosure described below illustrate a hardware-based approach. However, since various embodiments of the present disclosure include techniques utilizing both hardware and software, one or more embodiments of the present disclosure do not exclude a software-based approach.

[0021] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled. However, this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." Conditions described as "more than" may be replaced with "more than," conditions described as "less than," and conditions described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of the elements from A (including A) to B (including B).

[0022] The term "couple" and its derivatives mean direct or indirect communication between two or more elements, whether or not the two or more elements are in physical contact with each other. The terms "transmit," "receive," and "communicate," and their derivatives, include both direct and indirect communication. The terms "include" and "comprise," and their derivatives, mean including without limitation. The term "or" is an inclusive term meaning "and / or." The phrase "associated with" and its derivatives refer to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, have a relationship to or with, etc. The term "controller" means any device, system, or part thereof that controls at least one operation. Such a controller may be implemented as hardware or a combination of hardware and software and / or firmware. The functionality associated with a particular controller may be centralized or distributed, either locally or remotely.The phrase "at least one of" used with a list of items means that various combinations of one or more of the listed items may be used, and only one item from the list may be required. For example, "at least one of A, B, C" includes combinations of A, B, C, A and B, A and C, B and C, and A, B, and C, as well as all variations thereof. Similarly, the term "set" means one or more. Thus, a set of items may be a single item or a collection of two or more items.

[0023] FIG. 1 illustrates a block diagram of an electronic device within a network environment according to embodiments of the present disclosure.

[0024] Referring to FIG. 1, in a network environment (100), an electronic device (101) (e.g., a wearable device) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)). In some embodiments, the processor (120) may correspond to at least one processor.

[0025] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) (the at least one processor) may include at least one main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0026] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0027] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0028] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0029] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0030] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0031] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0032] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0033] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0034] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0035] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0036] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0037] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0038] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0039] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0040] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0041] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0042] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0043] According to one or more embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0044] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0045] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0046] FIG. 2A illustrates an example of a perspective view of a wearable device according to embodiments of the present disclosure. FIG. 2B illustrates an example of one or more hardware elements within a wearable device according to embodiments of the present disclosure.

[0047] According to one embodiment, the wearable device (101) may have the form of glasses that are wearable on a body part of the user (e.g., the head). The wearable device (101) of FIGS. 2A and 2B may be an example of the electronic device (101) of FIG. 1. The wearable device (101) may include a head mounted display (HMD). For example, the housing of the wearable device (101) may include a flexible material, such as rubber and / or silicone, that is configured to fit closely to a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the wearable device (101) may include one or more straps that are capable of being twined around the user's head, and / or one or more temples that are detachably attachable to the ears of the head.

[0048] Referring to FIG. 2A, according to one embodiment, a wearable device (101) may include at least one display (250) and a frame (200) supporting at least one display (250).

[0049] According to one embodiment, a wearable device (101) may be worn on a part of a user's body. The wearable device (101) may provide a user wearing the wearable device (101) with augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality. For example, the wearable device (101) may display a virtual reality image provided from at least one optical device (282, 284) of FIG. 2B on at least one display (250) in response to a user's designated gesture acquired through the motion recognition cameras (260-2, 264) of FIG. 2B. For example, the display (250) may include at least a part of the display module (160) of FIG. 1.

[0050] According to one embodiment, at least one display (250) may provide visual information to a user. For example, at least one display (250) may include a transparent or translucent lens. At least one display (250) may include a first display (250-1) and / or a second display (250-2) spaced apart from the first display (250-1). For example, the first display (250-1) and the second display (250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0051] Referring to FIG. 2B, at least one display (250) can provide visual information transmitted from external light to the user through a lens included in the at least one display (250), and other visual information distinct from the visual information. The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (250) can include a first surface (231) and a second surface (232) opposite to the first surface (231). A display area can be formed on the second surface (232) of the at least one display (250). When a user wears the wearable device (101), external light can be transmitted to the user by being incident on the first surface (231) and transmitted through the second surface (232). As another example, at least one display (250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (282, 284) on a real screen transmitted through external light, in a display area formed on the second surface (232).

[0052] In one embodiment, at least one display (250) may include at least one waveguide (233, 234) that diffracts light emitted from at least one optical device (282, 284) and transmits the diffracted light to a user. The at least one waveguide (233, 234) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (233, 234). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (233, 234) may be propagated to the other end of the at least one waveguide (233, 234) by the nano-pattern. At least one waveguide (233, 234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (233, 234) may be arranged within the wearable device (101) to guide a screen displayed by at least one display (250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the at least one waveguide (233, 234).

[0053] The wearable device (101) can analyze an object included in a real image collected through a shooting camera (245), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (250). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The wearable device (101) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the wearable device (101) can execute simultaneous localization and mapping (SLAM) using a multi-camera, an IMU (inertial measurement units) (or an IMU sensor), and / or a ToF (time-of-flight). A user wearing the wearable device (101) can view an image displayed on at least one display (250).

[0054] According to one embodiment, the frame (200) may be formed as a physical structure that allows the wearable device (101) to be worn on the user's body. According to one embodiment, the frame (200) may be configured so that, when the user wears the wearable device (101), the first display (250-1) and the second display (250-2) can be positioned corresponding to the user's left and right eyes. The frame (200) may support at least one display (250). For example, the frame (200) may support the first display (250-1) and the second display (250-2) to be positioned corresponding to the user's left and right eyes.

[0055] Referring to FIG. 2A, the frame (200) may include a region (220) that is in contact with at least a portion of a user's body when the user wears the wearable device (101). For example, the region (220) of the frame (200) that is in contact with a portion of the user's body may include a region that is in contact with a portion of the user's nose, a portion of the user's ear, and a portion of the side of the user's face that the wearable device (101) makes contact with. According to one embodiment, the frame (200) may include a nose pad (210) that is in contact with a portion of the user's body. When the wearable device (101) is worn by the user, the nose pad (210) may be in contact with a portion of the user's nose. The frame (200) may include a first temple (204) and a second temple (205) that are in contact with another portion of the user's body that is distinct from the portion of the user's body.

[0056] For example, the frame (200) may include a first rim (201) that surrounds at least a portion of the first display (250-1), a second rim (202) that surrounds at least a portion of the second display (250-2), a bridge (203) that is disposed between the first rim (201) and the second rim (202), a first pad (211) that is disposed along a portion of the edge of the first rim (201) from one end of the bridge (203), a second pad (212) that is disposed along a portion of the edge of the second rim (202) from the other end of the bridge (203), a first temple (204) that extends from the first rim (201) and is fixed to a portion of the wearer's ear, and a second temple (205) that extends from the second rim (202) and is fixed to a portion of the ear opposite the ear. The first pad (211) and the second pad (212) may be in contact with a portion of the user's nose, and the first temple (204) and the second temple (205) may be in contact with a portion of the user's face and a portion of the user's ear. The temples (204, 205) may be rotatably connected to the rim through the hinge units (206, 207) of FIG. 2B. The first temple (204) may be rotatably connected to the first rim (201) through the first hinge unit (206) disposed between the first rim (201) and the first temple (204). The second temple (205) may be rotatably connected to the second rim (202) through the second hinge unit (207) disposed between the second rim (202) and the second temple (205). According to one embodiment, the wearable device (101) can identify an external object (e.g., a user's fingertip) touching the frame (200) and / or a gesture performed by the external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (200).

[0057] According to one embodiment, the wearable device (101) may include hardwares that perform various functions (e.g., hardwares to be described later based on the block diagram of FIG. 5). For example, the hardwares may include a battery module (270), an antenna module (275), at least one optical device (282, 284), speakers (e.g., speakers 255-1, 255-2), microphones (e.g., microphones 265-1, 265-2, 265-3), a light-emitting module, and / or a printed circuit board (PCB) (290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (200).

[0058] According to one embodiment, the microphones (e.g., microphones 265-1, 265-2, 265-3) of the wearable device (101) may be disposed on at least a portion of the frame (200) to acquire sound signals. A first microphone (265-1) disposed on the bridge (203), a second microphone (265-2) disposed on the second rim (202), and a third microphone (265-3) disposed on the first rim (201) are illustrated in FIG. 2B , but the number and arrangement of the microphones (265) are not limited to the embodiment of FIG. 2B . When the number of microphones (265) included in the wearable device (101) is two or more, the wearable device (101) may identify the direction of the sound signal by using a plurality of microphones disposed on different portions of the frame (200).

[0059] According to one embodiment, at least one optical device (282, 284) may project a virtual object onto at least one display (250) to provide various image information to a user. For example, at least one optical device (282, 284) may be a projector. At least one optical device (282, 284) may be disposed adjacent to at least one display (250) or may be included within at least one display (250) as a part of at least one display (250). According to one embodiment, the wearable device (101) may include a first optical device (282) corresponding to a first display (250-1) and a second optical device (284) corresponding to a second display (250-2). For example, at least one optical device (282, 284) may include a first optical device (282) disposed at an edge of a first display (250-1) and a second optical device (284) disposed at an edge of a second display (250-2). The first optical device (282) may transmit light to a first waveguide (233) disposed on the first display (250-1), and the second optical device (284) may transmit light to a second waveguide (234) disposed on the second display (250-2).

[0060] In one embodiment, the camera (260) may include a recording camera (245), an eye tracking camera (ET camera) (260-1), and / or a motion recognition camera (260-2). The recording camera (245), the eye tracking camera (260-1), and the motion recognition cameras (260-2, 264) may be positioned at different locations on the frame (200) and may perform different functions. The eye tracking camera (260-1) may output data representing the gaze of a user wearing the wearable device (101). For example, the wearable device (101) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (260-1). An example in which the gaze tracking camera (260-1) is positioned toward the user's right eye is illustrated in FIG. 2B, but the embodiment is not limited thereto, and the gaze tracking camera (260-1) may be positioned solely toward the user's left eye, or may be positioned toward both eyes.

[0061] In one embodiment, the capturing camera (245) can capture an actual image or background to be aligned with a virtual image in order to implement augmented reality or mixed reality content. The capturing camera (245) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (250). The at least one display (250) can display a single image in which information about the actual image or background including the image of the specific object acquired using the capturing camera (245) is superimposed with a virtual image provided through at least one optical device (282, 284). In one embodiment, the capturing camera (245) can be placed on a bridge (203) disposed between the first rim (201) and the second rim (202).

[0062] The gaze tracking camera (260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing a wearable device (101), thereby matching the user's gaze with visual information provided to at least one display (250). For example, when the wearable device (101) looks straight ahead, the wearable device (101) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (250). The gaze tracking camera (260-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (260-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (260-1) may be positioned within the first rim (201) and / or the second rim (202) to face the direction in which the user wearing the wearable device (101) is positioned.

[0063] The motion recognition camera (260-2, 264) can provide a specific event on a screen provided on at least one display (250) by recognizing the movement of the user's entire body, such as the user's torso, hands, or face, or a part of the body. The motion recognition camera (260-2, 264) can recognize the user's motion (gesture recognition), obtain a signal corresponding to the motion, and provide a display corresponding to the signal on at least one display (250). The processor can identify the signal corresponding to the motion and perform a designated function based on the identification. In one embodiment, the motion recognition camera (260-2, 264) can be disposed on the first limb (201) and / or the second limb (202).

[0064] The camera (260) included in the wearable device (101) is not limited to the above-described gaze tracking camera (260-1) and motion recognition cameras (260-2, 264). For example, the wearable device (101) can identify an external object included in the FoV using the camera (260) positioned toward the user's FoV. The wearable device (101) can identify an external object based on a sensor for identifying the distance between the wearable device (101) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (260) positioned toward the FoV can support an autofocus function and / or an optical image stabilization (OIS) function. For example, the wearable device (101) may include a camera (260) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the wearable device (101).

[0065] Although not shown, in one embodiment, the wearable device (101) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (260). The light source may include an LED having an infrared wavelength. The light source may be disposed on at least one of the frame (200) and the hinge units (206, 207).

[0066] According to one embodiment, the battery module (270) may supply power to electronic components of the wearable device (101). In one embodiment, the battery module (270) may be disposed within the first temple (204) and / or the second temple (205). For example, the battery module (270) may be a plurality of battery modules (270). The plurality of battery modules (270) may be disposed within each of the first temple (204) and the second temple (205). In one embodiment, the battery module (270) may be disposed at an end of the first temple (204) and / or the second temple (205).

[0067] The antenna module (275) can transmit signals or power to the outside of the wearable device (101), or receive signals or power from the outside. In one embodiment, the antenna module (275) can be positioned within the first temple (204) and / or the second temple (205). For example, the antenna module (275) can be positioned close to one surface of the first temple (204) and / or the second temple (205).

[0068] The speaker (255) can output an acoustic signal to the outside of the wearable device (101). The acoustic output module may be referred to as a speaker. In one embodiment, the speaker (255) may be positioned within the first temple (204) and / or the second temple (205) so as to be positioned adjacent to the ear of a user wearing the wearable device (101). For example, the speaker (255) may include a second speaker (255-2) positioned within the first temple (204) and thus positioned adjacent to the user's left ear, and a first speaker (255-1) positioned within the second temple (205) and thus positioned adjacent to the user's right ear.

[0069] The light-emitting module may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state to visually provide information regarding a specific state of the wearable device (101) to the user. For example, when the wearable device (101) requires charging, the wearable device (101) may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (201) and / or the second rim (202).

[0070] Referring to FIG. 2B, according to one embodiment, a wearable device (101) may include a printed circuit board (PCB) (290). The PCB (290) may be included in at least one of the first temple (204) or the second temple (205). The PCB (290) may include an interposer disposed between at least two sub-PCBs. One or more hardwares included in the wearable device (101) (e.g., hardwares illustrated by different blocks in FIG. 5) may be disposed on the PCB (290). The wearable device (101) may include a flexible PCB (FPCB) for interconnecting the hardwares.

[0071] According to one embodiment, a wearable device (101) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the wearable device (101) and / or a posture of a body part (e.g., a head) of a user wearing the wearable device (101). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device (101) may identify a user's motion and / or gesture performed to execute or terminate a specific function of the wearable device (101) based on the IMU.

[0072] FIGS. 3A and 3B illustrate examples of the appearance of a wearable device according to embodiments of the present disclosure.

[0073] The wearable device (101) of FIGS. 3A and 3B may be an example of the electronic device (101) of FIG. 1. According to one embodiment, an example of the appearance of a first side (310) of a housing of the wearable device (101) is illustrated in FIG. 3A, and an example of the appearance of a second side (320) opposite to the first side (310) may be illustrated in FIG. 3B.

[0074] Referring to FIG. 3A, according to one embodiment, a first surface (310) of a wearable device (101) may have a form attachable to a body part of a user (e.g., the face of the user). In one embodiment, the wearable device (101) may further include a strap for being fixed to a body part of a user, and / or one or more temples (e.g., the first temple (204) and / or the second temple (205) of FIGS. 2A and 2B). A first display (250-1) for outputting an image to a left eye among the user's two eyes, and a second display (250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (310). The wearable device (101) is formed on the first surface (310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light emitted from the first display (250-1) and the second display (250-2).

[0075] According to one embodiment, the wearable device (101) may include cameras (260-3, 260-4) for photographing and / or tracking the user's two eyes adjacent to the first display (250-1) and the second display (250-2), respectively. For example, the cameras (260-3, 260-4) may be referred to as ET cameras. According to one embodiment, the wearable device (101) may include cameras (260-5, 260-6) for photographing and / or recognizing the user's face. The cameras (260-5, 260-6) may be referred to as FT cameras.

[0076] Referring to FIG. 3B, a camera (e.g., cameras 260-7, 260-8, 260-9, 260-10, 260-11, 260-12)) and / or a sensor (e.g., a depth sensor 330) for obtaining information related to the external environment of the wearable device (101) may be disposed on a second surface (320) opposite to the first surface (310) of FIG. 3A. For example, the cameras (260-7, 260-8, 260-9, 260-10) may be disposed on the second surface (320) to recognize external objects. For example, using the cameras (260-11, 260-12), the wearable device (101) may obtain images and / or videos to be transmitted to each of the user's two eyes. The camera (260-11) may be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the second display (250-2) corresponding to the right eye among the two eyes. The camera (260-12) may be placed on the second face (320) of the wearable device (101) to obtain an image to be displayed through the first display (250-1) corresponding to the left eye among the two eyes.

[0077] According to one embodiment, the wearable device (101) may include a depth sensor (330) disposed on the second surface (320) to identify a distance between the wearable device (101) and an external object. Using the depth sensor (330), the wearable device (101) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the wearable device (101).

[0078] Although not shown, a microphone may be placed on the second side (320) of the wearable device (101) to acquire sound output from an external object. The number of microphones may be one or more depending on the embodiment.

[0079] As described above, according to one embodiment, the wearable device (101) may include hardware (e.g., cameras (260-7, 206-8, 260-9, 260-10) and / or a depth sensor (330)) for identifying a body part including a user's hand. The wearable device (101) may identify a gesture indicated by a motion of the body part. The wearable device (101) may provide a user interface (UI) based on the identified gesture to a user wearing the wearable device (101). The UI may support a function for editing images and / or videos stored in the wearable device (101). The wearable device (101) may communicate with an external electronic device different from the wearable device (101) in order to more accurately identify the gesture.

[0080] The wearable device (101) of FIGS. 2A to 3B (or the electronic device (101) of FIG. 1) can provide a virtual environment. For example, the virtual environment may represent an example of extended reality (XR) provided through the wearable device (101). For example, XR may include augmented reality (AR), virtual reality (VR), and mixed reality (MR). For example, a wearable device (101) for AR may provide augmented information based on real objects. For example, the wearable device (101) may include AR glasses or VR glasses for providing information to a user based on real objects. For example, the wearable device (101) may include a video see-through (VST) device.

[0081] The virtual environment provided by the wearable device (101) may include virtual objects with different depths. The virtual objects may be referred to as content. For example, when a user wearing the wearable device (101) views the content, the focal length may change depending on the content. The focal length may represent the focal length of the wearable device (101) with respect to the user's eyes. For example, since the position of the content with respect to the eyes generally does not change while the user is viewing the content, the focal length may be fixed at a specific distance. Accordingly, the user's eyesight may be deteriorated. In contrast, for a user utilizing the virtual environment including virtual objects with different depths, various focal lengths are used depending on the virtual objects, and thus the user's eyesight may be improved. However, even within the virtual space, when using fixed content, the problem of the focal length being fixed to a specific distance may still exist. Hereinafter, the present disclosure describes a device and method for using various focal lengths for specific content when using the content within the virtual environment. Figures 4a and 4b describe a method for displaying content within the virtual environment according to a user's dynamic focal length.

[0082] FIG. 4A illustrates an example of a method for displaying content based on a focal length within a virtual environment. FIG. 4B illustrates an example of a method for displaying content based on a focal length within a virtual environment according to embodiments of the present disclosure.

[0083] The method of FIGS. 4a and 4b can be performed by the wearable device (101) of FIGS. 2a to 3b (or the electronic device of FIG. 1).

[0084] Referring to FIGS. 4A and 4B , a user (400) may wear a wearable device (101). For example, the wearable device (101) may include an HMD. For example, the HMD may be worn on the head of the user (400). FIGS. 4A and 4B illustrate an HMD including two displays (250-1, 250-2) as an example of the wearable device (101), but the embodiments of the present disclosure are not limited thereto. For example, the wearable device (101) may include one display or three displays. In addition, for example, the wearable device (101) may include a lens having a fixed focal length. When using multiple displays including lenses having fixed focal lengths, the wearable device (101) may adjust the focal length using the multiple displays. Alternatively, for example, the wearable device (101) may include a lens having a variable focal length. When using a display including a lens having a variable focal length, the wearable device (101) can adjust the focal length by adjusting the lens having a variable focal length within the display. Referring to FIGS. 4A and 4B , the wearable device (101) may provide a virtual environment. For example, the virtual environment may include content (410). For example, the content (410) may be referred to as a virtual object or a visual object displayed within the virtual environment. Although FIGS. 4A and 4B illustrate content (410) as a two-dimensional (2D) object, embodiments of the present disclosure are not limited thereto. For example, embodiments of the present disclosure may include content (410) as a three-dimensional (3D) object.In the above-described example, the wearable device (101) can express depth according to the position of a virtual object within the virtual environment through at least one display including a lens having a fixed focal length or a lens having a variable focal length.

[0085] Referring to FIGS. 4A and 4B , while using the virtual environment through the wearable device (101), the wearable device (101) can display content (410) having a specified size at a specified location within the virtual environment. For example, the wearable device (101) can display content (410) having a first size (420) within a first area of ​​the virtual environment. For example, the first area (or the first depth of the virtual environment) can indicate a location within the virtual environment where the focal length is a first distance (430). The wearable device (101) can display content (410) having a first size (420) within the first area through at least one display (250). For example, in order to display content (410) having a first size (420) within the first area, the wearable device (101) may display a first image (440-1) through at least a portion of the active area of ​​the first display (250-1). In addition, for example, in order to display content (410) having a first size (420) within the first area, the wearable device (101) may display a second image (440-2) through at least a portion of the active area of ​​the second display (250-2). In order to display content (410) having a first size (420) within the first area, the areas occupied by each of the first image (440-1) and the second image (440-2) within the active area may be substantially the same. However, the positions within the display areas of the first image (440-1) and the second image (440-2) may be different from each other. Specific details related to this are described below in FIG. 7.

[0086] In FIG. 4A, the wearable device (103) can display content (410) having a first size (420) within a second area different from the first area through at least one display (250). For example, the second area (or the second depth of the virtual environment) can indicate a location within the virtual environment where the focal distance is a second distance (435). The wearable device (101) can display content (410) having a first size (420) within the second area through at least one display (250). For example, to display content (410) having the first size (420) within the second area, the wearable device (101) can display an image (445-1) through at least a portion of an active area of ​​the first display (250-1). Additionally, for example, in order to display content (410) having a first size (420) within the second area, the wearable device (101) may display an image (445-2) through at least a portion of the display area of ​​the second display (250-2). As the distance changes from the first distance (430) to the second distance (435), the size occupied by the image (445-1) or the image (445-2) in the display area may change. For example, the display size of the image (445-1) may be smaller than the display size of the first image (440-1). Or, for example, the display size of the image (445-2) may be smaller than the display size of the second image (440-2). As the depth changes from the first distance (430) to a deeper second distance (435), the wearable device (101) can change the size occupied by the image (445-1 or 445-2) in the display area to indicate perspective.

[0087] In contrast, in FIG. 4b according to some embodiments of the present disclosure, an example is shown in which, in order to protect the eyesight of a user (400) according to embodiments of the present disclosure, an area (or depth) in which content (410) is displayed is changed according to the time at which content (410) is displayed, and the size of the content (410) within the virtual environment is changed according to the changed area (or depth). In this case, even if the size within the virtual environment is changed, the size of the image for displaying the content (410) on at least one display (250) can be maintained substantially the same.

[0088] Referring to FIG. 4B, while the user (400) views content (410) through the wearable device (101), the wearable device (101) can change the size and position of the content (410). For example, the wearable device (101) can change the position of the content (410) within the virtual environment from the first area to a second area. For example, the second area can represent a position within the virtual environment where the focal distance is a second distance (460). The second distance (460) can represent a distance greater than the first distance (430). In addition, the wearable device (101) can enlarge the size of the content (410) from the first size (420) to the second size (450). In other words, the wearable device (101) can display content (410) having a changed size when displaying content (410) of a changed focal length. At this time, the wearable device (101) can display content (410) having a second size (450) within the second area through at least one display (250). For example, in order to display content (410) having a second size (450) within the second area, the wearable device (101) can display a third image (470-1) through at least a portion of the active area of ​​the first display (250-1). Additionally, for example, in order to display content (410) having a second size (450) within the second area, the wearable device (101) may display a fourth image (470-2) through at least a portion of the display area of ​​the second display (250-2). In order to display content (410) having a second size (450) within the second area, the areas occupied by each of the third image (470-1) and the fourth image (470-2) within the display area may be substantially the same.However, the positions within the display areas of the third image (470-1) and the fourth image (470-2) may be different from each other. In this case, the difference between the first image (440-1) of the first display (250-1) and the second image (440-2) of the second display (250-2) may be greater than the difference between the third image (470-1) of the first display (250-1) and the fourth image (470-2) of the second display (250-2). For example, the difference may indicate a difference between the coordinates of the designated positions of each of the images (e.g., the first image (440-1) and the second image (440-2) or the third image (470-1) and the fourth image (470-2)). Specific details related thereto are described below in FIG. 7.

[0089] Referring to FIG. 4B, the wearable device (101) can change the position and size at which content (410) is displayed in order to change the focal length. For example, the wearable device (101) can change the position and size at which content (410) is displayed in order to change the focal length within a specified range. For example, the specified range can be identified based on capability information for adjusting the focal length of the user (400). For example, the capability information can include at least one of a minimum length and a maximum length for the focal length of the user (400), or a preferred focal length of the user (400). The maximum length can also be referred to as a 'limit distance' for the focal length of the user (400). For example, if the minimum distance of the specified range is the first distance (430) and the maximum distance is the second distance (460), the wearable device (101) can display content (410) having a size between the first size (420) and the second size (450). At this time, the content (410) having a size between the first size (420) and the second size (450) can be displayed at a location within the virtual environment between the first area and the second area. For example, the size of the content (410) can be identified based on the location within the virtual environment. For example, the size can be linearly proportional to the distance from a reference location corresponding to the user (400) within the virtual environment to the location of the content (410) within the virtual environment. For example, the distance can substantially correspond to the focal length.In the example of FIG. 4B, when the focal length is gradually changed from the first distance (430) to the second distance (460), the wearable device (101) can gradually enlarge the size of the content (410) from the first size (420) to the second size (450). Conversely, when the focal length is gradually changed from the second distance (460) to the first distance (430), the wearable device (101) can gradually reduce the size of the content (410) from the second size (450) to the first size (420). As described above, the wearable device (101) can enlarge and reduce the location and size at which the content (410) is displayed in order to prevent the focal length of the user (400) from being fixed.

[0090] As described above, while the location and size of the content (410) being displayed are changed, the content (410) recognized by the user (400) may remain substantially the same. For example, the range within the display area (or display) occupied by each of the first image (440-1) and the second image (440-2), which represent the content (410) having the first size (420) within the first area, may be substantially the same as the range within the display area (or display) occupied by each of the third image (470-1) and the fourth image (470-2), which represent the content (410) having the second size (450) within the second area. Accordingly, while the location and size of the content (410) are changed within the specified range, the user (400) may not recognize the change in the focal distance for viewing the content (410). In other words, the user (400) can perceive that the position or size of the content (410) being viewed is maintained without change.

[0091] In FIG. 4B, a wearable device (101) that displays content (410) having different depths by using binocular parallax (e.g., a first image (440-1) or a third image (470-1) of a first display (250-1) and a second image (440-2) or a fourth image (470-2) of a second display (250-2)) is illustrated, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content (410) having different depths (or focal lengths) even without using binocular parallax. In the case of a wearable device (101) including a variable focus lens, even if the content (410) is displayed through one display, the content (410) having different depths may be displayed.

[0092] The device and method according to an embodiment of the present disclosure can display content (410) using a variable focal length while maintaining the viewing experience of the user (400) using the content (410). Accordingly, the device and method according to an embodiment of the present disclosure can prevent the user (400) from deteriorating in his / her ability to adjust the focal length when viewing the content (410). In addition, the device and method according to an embodiment of the present disclosure can provide a user experience similar to viewing substantially the same content even when the focal length is changed. In addition, the device and method according to an embodiment of the present disclosure can perform training for protecting the eyesight of the user (400) without consuming additional resources. Specific details related to the training are described below in FIG. 8.

[0093] FIG. 5 illustrates an exemplary block diagram of a wearable device according to embodiments of the present disclosure.

[0094] The wearable device (101) of FIG. 5 may be an example of the electronic device (101) of FIG. 1 and the wearable device (101) of FIGS. 2A to 3B.

[0095] Referring to FIG. 5, according to one embodiment, a wearable device (101) may include at least one of a processor (120), a memory (130), a camera (510), and a display (520). The processor (120), the memory (130), the camera (510), and the display (520) may be electrically and / or operably coupled with each other by a communication bus. Hereinafter, operably coupled hardware components may mean that a direct connection or an indirect connection is established between the hardware components, either wired or wireless, such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and some of the hardware components illustrated in FIG. 5 (e.g., at least a portion of the processor (120) and the memory (130)) may be included in a single integrated circuit such as a system on a chip (SoC). The type and / or number of hardware components included in the wearable device (101) are not limited to those illustrated in FIG. 5. For example, the wearable device (101) may include only some of the hardware components illustrated in FIG. 5.

[0096] For example, the wearable device (101) may be connected to an external electronic device based on a wired network and / or a wireless network. For example, the wired network may include a network such as the Internet, a local area network (LAN), a wide area network (WAN), or a combination thereof. For example, the wireless network may include a network such as long term evolution (LTE), 5g new radio (NR), wireless fidelity (WiFi), Zigbee, near field communication (NFC), Bluetooth, Bluetooth low-energy (BLE), or a combination thereof. The wearable device (101) may be directly connected to the external electronic device, or may be indirectly connected via one or more routers and / or access points (APs).

[0097] According to one embodiment, the processor (120) of the wearable device (101) may include a hardware component for processing data based on one or more instructions. The hardware component for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), and a field programmable gate array (FPGA). As an example, the hardware component for processing data may include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP), and / or a neural processing unit (NPU). The number of processors (120) may be one or more. For example, the processor (120) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core. The processor (120) of FIG. 5 may include at least a part of the processor (120) of FIG. 1.

[0098] According to one embodiment, the memory (130) of the wearable device (101) may include a hardware component for storing data and / or instructions input to and / or output from the processor (120). The memory (130) may include, for example, a volatile memory such as a random-access memory (RAM), and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, and an embedded multimedia card (eMMC). The memory (130) of FIG. 5 may include at least a portion of the memory (130) of FIG. 1.

[0099] According to one embodiment, the camera (510) of the wearable device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate electrical signals representing the color and / or brightness of light. The plurality of optical sensors included in the camera (510) may be arranged in the form of a two-dimensional array. The camera (510) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid and including a plurality of pixels arranged two-dimensionally. For example, photographic data captured using the camera (510) may mean one image acquired from the camera (510). For example, video data captured using the camera (510) may mean a sequence of a plurality of images acquired from the camera (510) according to a specified frame rate. A wearable device (101) according to one embodiment may further include a camera (510) positioned facing the direction in which it receives light and a flash light for outputting light in the direction. The number of cameras (510) included in the wearable device (101) may be one or more, as described above with reference to FIGS. 2A and 2B, and / or FIGS. 3A and 3B.

[0100] According to one embodiment, a display (520) of a wearable device (101) can output visualized information (e.g., images of FIG. 4B, images of FIG. 7) to a user. The number of displays (520) included in the wearable device (101) may be one or more. For example, the display (520) may be controlled by a processor (120) and / or a graphic processing unit (GPU) to output visualized information to a user. The display (520) may include a flat panel display (FPD) and / or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), a digital mirror device (DMD), one or more light emitting diodes (LEDs), and / or micro LEDs. The LEDs may include organic LEDs (OLEDs). The display (520) of FIG. 5 may include at least a portion of the display module (160) of FIG. 1. The display (520) of FIG. 5 may represent an example of at least one display (250) of FIG. 2A.

[0101] In one embodiment, light transmission may occur in at least a portion of the display (520). The wearable device (101) may provide a user experience related to augmented reality by providing a combination of light output through the display (520) and light transmitting through the display (520) to the user. Referring to FIGS. 2A and 2B and / or 3A and 3B , the display (520) of the wearable device (101) according to one embodiment may have a structure for covering the entire field-of-view (FoV) of the user, or radiating light toward the FoV, while being worn on a body part of the user, such as the head. In one embodiment, the wearable device (101) may include other output means for outputting information in a form other than a visual or auditory form. For example, the wearable device (101) may include at least one speaker for outputting an audio signal, and / or a motor (or actuator) for providing haptic feedback based on vibration.

[0102] According to one embodiment, a communication circuit of a wearable device (101) may include hardware for supporting transmission and / or reception of electrical signals between the wearable device (101) and an external electronic device. The communication circuit may include, for example, at least one of a modem, an antenna, and an optical / electronic (O / E) converter. The communication circuit may support transmission and / or reception of electrical signals based on various types of communication means, such as Ethernet, Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), and 5G new radio (NR). The communication circuit of FIG. 5 may include at least a part of the communication module (190) and / or the antenna module (197) of FIG. 1.

[0103] In one embodiment, the wearable device (101) may include an output means for outputting information in a form other than a visualized form. For example, the wearable device (101) may include a speaker for outputting an acoustic signal. For example, the wearable device (101) may include a motor for providing haptic feedback based on vibration.

[0104] Referring to FIG. 5, according to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by a processor (120) of the wearable device (101) may be stored in the memory (130) of the wearable device (101). A set of one or more instructions may be referred to as a program, firmware, an operating system, a process, a routine, a sub-routine, and / or an application. Hereinafter, when an application is installed in an electronic device (e.g., a wearable device (101)), it may mean that one or more instructions provided in the form of an application are stored in the memory (130), and that the one or more applications are stored in a format executable by the processor of the electronic device (e.g., a file having an extension designated by the operating system of the wearable device (101)). According to one embodiment, the wearable device (101) can perform the operations of FIGS. 6, 8, 9, and 10 by executing one or more instructions stored in the memory (130).

[0105] Referring to FIG. 5, one or more instructions included in the memory (130) may be divided into a contents outputting portion (531), a sight protection portion (533), and / or a focal length training portion (535). For example, each of the contents outputting portion (531), the sight protection outputting portion (533), and the focal length training portion (535) may be implemented as a program or software.

[0106] For example, the wearable device (101) can display at least one content within the virtual environment using the content output unit (531). For example, the wearable device (101) can render the content based on rendering information for the content within the virtual environment using the content output unit (531). For example, the rendering information can include at least one of a z-index, brightness, transparency, pixel, and color for the content. The wearable device (101) can display an image in which the content is rendered using the content output unit (531) through the display (520).

[0107] For example, the wearable device (101) can change the position and size of the content within the virtual environment using the eye protection output unit (533). For example, the wearable device (101) can adjust the focal length of a user (e.g., the user (400) of FIGS. 4A and 4B) using the eye protection output unit (533). For example, to adjust the focal length, the wearable device (101) can change the position and size of the content. For example, the size of the content can be identified based on the position of the content. For example, the size can be proportional to the difference between the position of the content and a reference position corresponding to the user within the virtual environment. For example, the reference position can represent a virtual position within the virtual environment where the user's gaze starts. The difference between the reference position and the position of the content can correspond to the focal length. In other words, as the focal length increases, the location of the content may move away from the reference position, and thus the size of the content may increase. Conversely, as the focal length decreases, the location of the content may move closer to the reference position. Accordingly, the size of the content may decrease. The range within which the focal length is adjusted may be identified based on at least one of information regarding the user's ability to adjust the focal length, or characteristics of the content. For example, the ability information may include at least one of a reaction speed related to the user's focal length adjustment, a minimum length and a maximum length for the user's focal length, or a preferred focal length of the user.For example, the characteristics of the content may include at least one of the content's playback speed or the content's type. The content's type may include a static type, such as text or images, or a dynamic type, such as video.

[0108] For example, the wearable device (101) may output substantially the same image using the content output unit (531) while changing the location and size of the content based on the vision protection output unit (533). Referring to FIG. 4B, the area occupied by each of the first image (440-1) and the second image (440-2) representing the content (410) having the first size (420) within the first region within the display area of ​​the display (520) may be substantially the same as the area occupied by each of the third image (470-1) and the fourth image (470-2) representing the content (410) having the second size (450) within the second region within the display area of ​​the display (520). In other words, the resolution of the display (520) for the first image (440-1) and the second image (440-2) may correspond to the resolution of the display (520) for the third image (470-1) and the fourth image (470-2). Specific details related thereto are described below in FIG. 7.

[0109] For example, the wearable device (101) can perform training on the user's focal length using the focal length training unit (535). For example, the wearable device (101) can identify capability information on the user's focal length using the focal length training unit (535). For example, the capability information can be identified through the user's eye calibration. For example, the eye calibration can be executed when the user initially wears the wearable device (101) or based on an input by the user. For example, the wearable device (101) can adjust the user's focal length based on the identified capability information using the focal length training unit (535). For example, the wearable device (101) can change the location and size of the content within the virtual environment based on the capability information. For example, the wearable device (101) can identify a range within which the position and size of the content will change based on the capability information. For example, the wearable device (101) can identify a result of the focal length adjustment using the focal length training unit (535) while the position and size of the content change within the range according to the adjustment of the focal length. For example, the wearable device (101) can identify the actual focal length of the user. For example, the wearable device (101) can identify the actual focal length by tracking the user's gaze using the camera (510). For example, the wearable device (101) can identify a difference between the actual focal length and a focal length identified (or calculated) based on the capability information. The difference between the actual focal length and the identified focal length can be included in the result.The wearable device (101) may store the result in the memory (130). For example, the wearable device (101) may perform an adjustment optimized for the user by adjusting the focal length based on the stored result. In addition, the wearable device (101) may perform training on the ability to adjust the focal length by adjusting the position of the content within the virtual environment to correspond to a focal length that is outside the user's limit focal length, which is identified based on the ability information. The limit focal length may be included in the range in which the position and size of the content are to be changed. The focal length that is outside the limit focal length may be referred to as a training range. For example, the wearable device (101) may perform an adjustment of the focal length for the training range identified based on the result, using the eye protection output unit (533). Specific details related thereto are described below in FIG. 8.

[0110] FIG. 6 illustrates an example flowchart of a method for displaying content according to a focal length within a virtual environment according to embodiments of the present disclosure.

[0111] At least some of the methods of FIG. 6 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the methods may be controlled by the processor (120) of the wearable device (101).

[0112] Referring to FIG. 6, in operation (600), the wearable device (101) may obtain an input for displaying content. While the content, which is a single object in FIG. 6, is described as an example, the embodiments of the present disclosure are not limited thereto. For example, the wearable device (101) may also obtain an input for displaying multiple contents. According to one embodiment, the wearable device (101) may display a virtual environment. For example, the wearable device (101) may display the virtual environment in response to the execution of a software application for providing the virtual environment. For example, the software application may represent an example of a service that provides the virtual environment. For example, while the software application is running, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input of a user wearing a wearable device (101).

[0113] In operation (605), the wearable device (101) may display content having a specified size within a specified area of ​​the virtual environment. According to one embodiment, the wearable device (101) may display the content having the specified size within the specified area based on the input. For example, the specified area may be referred to as an 'initial area' set by the user where the content will be displayed. For example, the specified size may be referred to as an initial size set by the user where the content is displayed. For example, the specified size (or the initial size) may represent the area of ​​the content with respect to the direction in which the user views the content. Hereinafter, the specified area may be referred to as a first area, and the specified size may be referred to as a 'first size'. For example, the wearable device (101) may display the content having the first size within the first area of ​​the virtual environment. For example, the first area may represent a location within the virtual environment where the user's focal length is a first distance. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the specified size and the specified location. By displaying the rendered image through the display area of ​​the display (520), the content having the first size may be displayed within the first area.

[0114] According to one embodiment, the content having the first size within the first area may be displayed through at least a portion of a display area of ​​the display (520) of the wearable device (101). For example, the display area may represent the entire area in which an image may be displayed through the display (520). For example, the at least a portion of the display area may represent a part or the entirety of a display area for displaying the content having the first size within the first area among the display areas. When the display (520) includes a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2A) (or display areas), the wearable device (101) may display a first image through at least a portion of a first display area of ​​the first display (250-1) and a second image through at least a portion of a second display area of ​​the second display (250-2). The first image and the second image may represent images for displaying the content having the first size within the first area. For example, the first display area may be positioned with respect to (facing) the user's left eye. For example, the second display area may be positioned with respect to (facing) the user's right eye. Positioning with respect to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In the above example, an example of a wearable device (101) that uses a method of representing the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto.For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without utilizing binocular parallax.

[0115] In operation (610), the wearable device (101) may optionally identify whether an eye protection function is activated. The eye protection function may indicate a function of changing the position and size of the content within the virtual environment in order to protect the user's eyesight. In this case, as the position and size of the content change, the focal length while the user views the content may change. In addition, as the size changes based on the position of the content while the user views the content, the size at which the content is displayed externally as recognized by the user may remain constant. The externally displayed size may be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of ​​the display (520). In other words, even if the position and size of the content within the virtual environment change, the size at which the content is displayed externally may remain substantially constant. Accordingly, while the user's viewing experience remains constant while viewing the content, the user's focal length can be dynamically changed. Accordingly, the user's eyesight can be protected according to the dynamic focal length.

[0116] In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the virtual environment. In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the settings of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can also be set for each content.

[0117] In operation (610), if the vision protection function is activated, the wearable device (101) can perform operation (620). Conversely, in operation (610), if the vision protection function is deactivated, the wearable device (101) can perform operation (615).

[0118] In operation (615), the wearable device (101) can maintain the size and location of the content. For example, the wearable device (101) can maintain the size of the content as the first size and the location as the first area. For example, in response to identifying that the eye protection function is deactivated, the wearable device (101) can maintain a state of displaying the content having the first size within the first area.

[0119] In operation (620), the wearable device (101) can identify whether the time (or time interval) at which the content is displayed is greater than or equal to a reference time. According to one embodiment, the wearable device (101) can identify whether the time at which the content is displayed is greater than or equal to the reference time in response to (based on) identifying that the eye protection function is activated.

[0120] According to one embodiment, the reference time may be identified based on at least one of the user's ability to adjust the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the user's focal length adjustment, the minimum length and the maximum length of the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference time may be set longer for a content that is dynamic (or has a fast play speed) than for a content that is static (or has a slow play speed).

[0121] In operation (620), if the time is greater than or equal to the reference time, the wearable device (101) may perform operation (625). Conversely, in operation (620), if the time is less than or equal to the reference time, the wearable device (101) may perform operation (620) again. For example, the wearable device (101) may identify whether the time is greater than or equal to the reference time.

[0122] In operation (625), the wearable device (101) may change the size and position of the content. In one embodiment, the wearable device (101) may change the size and position of the content in response to identifying that the time is greater than or equal to the reference time. For example, the wearable device (101) may change the first size and the first area of ​​the content to a second size different from the first size and a second area different from the first area, respectively. In one embodiment, the wearable device (101) may identify the second size and the second area based on the capability information. For example, the wearable device (101) may identify the second area and the second size based on the capability information including a focal length preferred by the user. For example, the second area may represent an area that is changed from the first area in order to change to a focal length preferred by the user. For example, the second region may represent a location within the virtual environment where the focal distance linearly changes from the first region, indicating a second distance. The second distance may represent a focal distance preferred by the user or a focal distance between the first distance and the focal distance preferred by the user. In other words, the second region may differ from the first region in terms of a depth identified from a reference location corresponding to the user within the virtual environment. For example, when the second distance from a reference location corresponding to the user within the virtual environment is further than the first distance, the second size may be larger than the first size. The second size may be enlarged from the first size.Additionally, for example, if the second distance from the reference position corresponding to the user within the virtual environment is closer than the first distance, the second size may be smaller than the first size. The second size may be reduced from the first size. Even in the above-described case, the size at which the content perceived by the user is displayed externally may be maintained constant. Specific details related to this are described in FIG. 7 below.

[0123] In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce the size from the second size back to the first size. Alternatively, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge the size from the first size back to the second size. Alternatively, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

[0124] Referring to FIG. 6, the wearable device (101) may change the size and position of the content based on identifying that the time is greater than or equal to the reference time. For example, the wearable device (101) may change from the content having the first size and the first position to the content having the second size and the second position. Thereafter, in response to (based on) identifying that the time is greater than or equal to the reference time, the wearable device (101) may change from the content having the second size and the second position to the content having a third size and a third position. In some embodiments, the third position, which changes from the first position to the second position, may change linearly (or proportionally). The linear change may indicate a change by a specified length. For example, the specified length may be in centimeters. However, the embodiments of the present disclosure are not limited thereto. Additionally, while changing from the first position to the third position, the size of the content may linearly change from the first size to the second size to the third size. The size of the content may linearly change in proportion to the linearly changed position of the content. However, the embodiments of the present disclosure are not limited thereto.

[0125] In FIG. 6, an example is shown in which the size and position of the content are changed in response to identifying a case in which the time at which the content is displayed is greater than or equal to the reference time, but the embodiments of the present disclosure are not limited thereto.

[0126] According to one embodiment, the wearable device (101) may change the size and position of the content by determining (or identifying) whether the time for which the user of the wearable device (101) gazes at the content (hereinafter, “gaze time”) is greater than or equal to the reference gaze time, if the time is greater than or equal to the reference gaze time. Specific details related thereto are described in FIG. 9 below.

[0127] According to one embodiment, the wearable device (101) can identify whether the size and position of the content have changed based on other conditions. For example, if the eye protection function is set for the content, the wearable device (101) can identify that the size and position of the content have changed. For example, if the content is a web page, the eye protection function can be set for the content as the web page is typically used for a specified period of time. In other words, the eye protection function can be set for each content. In addition, for example, the wearable device (101) can identify whether the content is a visual object floating on the display (520). For example, the floating visual object can refer to an object that is always displayed in a portion of the display area of ​​the display (520) regardless of its location within the virtual environment. If the above content is a floating visual object, the wearable device (101) can change the size and position of the content.

[0128] Additionally, while FIG. 6 illustrates an example in which the content expands as it moves away or contracts as it approaches, the embodiments of the present disclosure are not limited thereto. For example, the content may be repeatedly expanded and contracted within a range of focal lengths defined by the minimum and maximum focal lengths of the user included in the capability information. In other words, the wearable device (101) may display the content by changing its location and size within the range.

[0129] In operation (630), the wearable device (101) may display the content based on the changed size and position. For example, the wearable device (101) may display the content having the second size within the second area. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the changed size and position. By displaying the rendered image through the display area of ​​the display (520), the content having the second size may be displayed within the second area.

[0130] According to one embodiment, the wearable device (101) may maintain a value indicating a z-index of the content while the location of the content changes from the first area to the second area. For example, when the location of the content changes from the first area to the second area, the wearable device (101) may set the value to a value higher than a second value indicating a z-index of second content positioned between the first area and the second area. In other words, the value indicating the z-index of the content may be a value higher than the second value indicating the z-index of the second content. For example, the higher the z-index, the closer the second content may be displayed to a reference location corresponding to the user within the virtual environment. Based on the setting, the second content may be prevented from being displayed on the content as the location of the content changes from the first area to the second area. According to one embodiment, the wearable device (101) may display the content by rendering it based on the z-index. For example, since the second value of the second content is lower than the value of the content, the wearable device (101) may render only the content. Accordingly, the wearable device (101) may display only the content. Alternatively, for example, after rendering both the content and the multi-second content, the wearable device (101) may refrain from displaying the second content having a lower z-index than the content and display only the content. In the above example, it is described that the wearable device (101) displays the content closer to the reference position as the z-index has a higher value, but the embodiments of the present disclosure are not limited thereto.For example, depending on the rendering method, the lower the z-index value, the closer the wearable device (101) may display the content to the reference position.

[0131] According to one embodiment, the content having the second size within the second region may be displayed through at least a portion of a display area of ​​the display (520) of the wearable device (101). The at least portion for displaying the content having the second size within the second region may correspond to the at least portion for displaying the content having the first size within the first region. In other words, the area of ​​the at least portion for displaying the content having the second size within the second region may correspond to the area of ​​the at least portion for displaying the content having the first size within the first region. However, the image (or images) for displaying the content having the second size within the second region may be different from the image (or images) for displaying the content having the first size within the first region. For example, the position within the display area of ​​an image (or images) for displaying the content having the second size within the second area may be different from the position within the display area of ​​an image (or images) for displaying the content having the first size within the first area.

[0132] As described above, the display (520) may include a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2A) (or display areas). For example, in order to display the content having the second size within the second area, the wearable device (101) may display a third image through at least a portion of the first display area of ​​the first display (250-1) and a fourth image through at least a portion of the second display area of ​​the second display (250-2). The third image and the fourth image may represent images for displaying the content having the second size within the second area. For example, the first display area may be positioned with respect to (toward) the user's left eye. For example, the second display area may be positioned with respect to (toward) the user's right eye. Positioning relative to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In the above example, an example of a wearable device (101) that uses a method of indicating the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) using the variable focus lens within the display (520), even without using binocular parallax.

[0133] FIG. 7 illustrates examples of display areas of a display for displaying content according to focal distance according to embodiments of the present disclosure.

[0134] In FIG. 7, a method of expressing the depth of the content within a virtual environment based on binocular parallax is described as an example in which the display (520) of the wearable device (101) includes two displays (250-1, 250-2) (or display areas). However, the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without utilizing binocular parallax. The depth may be identified based on a distance from a reference position within the virtual environment corresponding to a user of the wearable device (101) to the content.

[0135] FIG. 7 illustrates an example (700) of displaying the content having the first size within the first region, which is an example described in FIG. 6, and an example (750) of displaying the content having the second size within the second region. The second region may indicate a location within the virtual environment corresponding to a focal distance further than the first region. Accordingly, the second size may be a size enlarged compared to the first size. In FIG. 7, the second region indicates a focal distance further than the first region, but the embodiments of the present disclosure are not limited thereto. For example, the second region may indicate a focal distance closer than the first region. In this case, the second size may be reduced compared to the first size.

[0136] Referring to example (700) of FIG. 7, in order to display the content having the first size within the first area, the wearable device (101) may display a first image (700-1) through the first display (250-1) and a second image (700-2) through the second display (250-2). For example, the wearable device (101) may display the first image (700-1) through at least a portion of the first display area of ​​the first display (250-1). Additionally, the wearable device (101) may display the second image (700-2) through at least a portion of the second display area of ​​the second display (250-2). The area (or first display size) of at least a portion of the first display area for the first image (700-1) may correspond to the area (or first display size) of at least a portion of the second display area for the second image (700-2). In this case, the position of at least a portion of the first display area for the first image (700-1) may be different from the position of at least a portion of the second display area for the second image (700-2). For example, the coordinates of a designated position (e.g., the upper left corner) (710) of the first image (700-1) may be (x1, y1), and the coordinates of a designated position (e.g., the upper left corner) (720) of the second image (700-2) may be (x2, y2). Based on the difference between the designated location (710) and the designated location (720), the content having the first size located within the first area can be displayed. In other words, based on the difference, the depth of the content can be identified. For example, the depth of the content can be referenced as in the following mathematical equation.

[0137]

[0138] In the above mathematical expression 1, z may represent the depth of the content within the virtual environment, b may represent the distance between the user's eyes (baseline), f may represent the focal length of the lens of the display (520) on which the content will be displayed, and d may represent the disparity between images for the content. For example, the disparity between the images may represent the difference between the coordinate x1 of the designated location (710) of the first image (700-1) and the coordinate x2 of the designated location (720) of the second image (700-2).

[0139] Referring to example (750) of FIG. 7, in order to display the content having the second size within the second area, the wearable device (101) may display a third image (750-1) through the first display (250-1) and a fourth image (750-2) through the second display (250-2). For example, the wearable device (101) may display the third image (750-1) through at least a portion of the first display area of ​​the first display (250-1). Additionally, the wearable device (101) may display the fourth image (750-2) through at least a portion of the second display area of ​​the second display (250-2). The area (or second display size) of at least a portion of the first display area for the third image (750-1) may correspond to the area (or second display size) of at least a portion of the second display area for the fourth image (750-2). In other words, the first display size for displaying the first image (700-1) and the second image (700-2) may be substantially the same as the second display size for displaying the third image (750-1) and the fourth image (750-2). In this case, the position of at least a portion of the first display area for the third image (750-1) may be different from the position of at least a portion of the second display area for the fourth image (750-2). For example, the coordinates of a designated location (e.g., the upper left corner) (760) of a third image (750-1) may be (x3, y3), and the coordinates of a designated location (e.g., the upper left corner) (770) of a fourth image (750-2) may be (x4, y4). Based on another difference between the designated location (760) and the designated location (770), the content having the second size located within the second area may be displayed.In other words, based on the above difference, the depth of the content can be identified.

[0140] The difference (d1) between the designated location (710) and the designated location (720) of the example (700) may be greater than the other difference (d2) between the designated location (760) and the designated location (770) of the example (750). For example, the difference (d1) may be identified based on (x1, y1) and (x2, y2). For example, the other difference (d2) may be identified based on (x3, y3) and (x4, y4). In the above example, the difference (d1) may be a value greater than the other difference (d2). This may be because the content having the first size within the first region is located at a closer focal distance than the content having the second size within the second region. In other words, the image displayed on the first display (250-1) when the focal distance is close (e.g., the first image (700-1)) and the image displayed on the second display (250-2) when the focal distance is close (e.g., the second image (700-2)) may be further different from each other than the image displayed on the first display (250-1) when the focal distance is far (e.g., the third image (750-1)) and the image displayed on the second display (250-2) when the focal distance is far (e.g., the fourth image (750-2)). For example, the difference between the positions where an image (e.g., the first image (700-1)) displayed on a first display (250-1) and an image (e.g., the second image (700-2)) displayed on a second display (250-2) when the focal distance is close may be greater than the difference between the positions where an image (e.g., the third image (750-1)) displayed on a first display (250-1) and an image (e.g., the fourth image (750-2)) displayed on a second display (250-2) when the focal distance is far. However, even in the above-described example, the size of the area occupied by each image within the display area may be maintained substantially the same.This may be to keep the size of the content perceived by the user constant even if the focal length of the user changes.

[0141] According to one embodiment, the wearable device (101) may perform scaling when generating images to be displayed on the displays (250-1, 250-2). For example, the scaling may be referred to as screen interpolation. For example, the wearable device (101) may maintain the size of the images displayed on the displays (250-1, 250-2) substantially the same even if the size of the content within the virtual environment changes. In this case, the wearable device (101) may perform downscaling when generating images for the content having a relatively large size compared to a reference size. In other words, the images for the content having the second size within the virtual environment (e.g., the third image (700-3) and the fourth image (700-2)) may include a portion of the content having the second size based on the downscaling. Alternatively, at this time, the wearable device (101) may perform upscaling when generating an image for the content having a relatively smaller size compared to the reference size. In other words, the images for the content having the first size within the virtual environment (e.g., the first image (700-1) and the second image (700-2)) may further include an interpolated portion for the content having the first size and at least a portion of the content. In one embodiment, the case where the reference size is a size between the first size and the second size is exemplified, but the embodiments of the present disclosure are not limited thereto. For example, if the first size is the reference size, images for the content having the first size (e.g., the first image (700-1) and the second image (700-2)) can be generated without scaling.At this time, images for the content having the second size (e.g., the third image (700-3) and the fourth image (700-2)) can be generated based on the downscaling.

[0142] As described above, the device and method according to the embodiments of the present disclosure can display content using a variable focal length while maintaining the user's viewing experience using the content. Accordingly, the device and method according to the embodiments of the present disclosure can prevent the user's ability to adjust the focal length from deteriorating when viewing the content. Furthermore, the device and method according to the embodiments of the present disclosure can provide a user experience that is similar to viewing substantially the same content even when the focal length is changed. Furthermore, the device and method according to the embodiments of the present disclosure can perform training for protecting the user's eyesight without consuming additional resources. Specific details related to the training are described below in FIG. 8.

[0143] FIG. 8 illustrates an example of an operational flow for a method of adjusting a focal length and obtaining an adjusted result based on capability information for the focal length according to embodiments of the present disclosure.

[0144] At least some of the methods of FIG. 8 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the methods may be controlled by the processor (120) of the wearable device (101).

[0145] Referring to FIG. 8, in operation (800), the wearable device (101) may obtain capability information regarding the user's focal length. For example, the capability information may indicate information regarding the user's ability to adjust the focal length. For example, the wearable device (101) may perform eye calibration when the user wears the wearable device (101) or based on the user's input. For example, the eye calibration may be performed when the user initially wears the wearable device (101). The eye calibration may indicate a function of measuring the user's capability information. For example, based on the eye calibration, the minimum and maximum distances for the user's focal length and the user's preferred focal length may be identified. The user's preferred focal length may indicate a focal length at which the user's eyes adjust most quickly and accurately. The maximum distance may also be referred to as a limit distance for the user's focal length.

[0146] In operation (805), the wearable device (101) may display the content while the eye protection function is activated. For example, the wearable device (101) may display the content having a specified size within a specified area within the virtual environment. The wearable device (101) may identify whether the eye protection function is activated while displaying the content having the specified size within the specified area. As described above, displaying the content having the specified size within the specified area may be performed before, simultaneously with, or after identifying whether the eye protection function is activated. In the following examples, for convenience of explanation, an example in which the content having a first size is displayed within a first area is described.

[0147] In operation (810), the wearable device (101) may change the size and position of the content based on the capability information. For example, the capability information may represent the capability information about the user obtained based on the eye calibration. According to one embodiment, the wearable device (101) may change the size and position of the content based on the capability information obtained based on the eye calibration. For example, the size and position of the content may be changed based on a range of the user's focal distance included in the capability information. For example, the range may be defined based on the minimum distance and the maximum distance of the user's focal distance. For example, the wearable device (101) may change the position and size of the content from a first distance, which is a focal distance corresponding to the first region, to a second distance within the range that is different from the first distance. At this time, the wearable device (101) may change the position and size of the content corresponding to the second distance. For example, the wearable device (101) may change the size and location of the content corresponding to the second distance to a second size and a second area. The second area may have a depth identified from a reference location corresponding to the user within the virtual environment that differs from the first area.

[0148] In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce the size from the second size back to the first size. Alternatively, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge the size from the first size back to the second size. Alternatively, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

[0149] In operation (815), the wearable device (101) can identify the result of the user's focal length adjustment for the changed content. According to one embodiment, the wearable device (101) can display the content based on the changed location and size. For example, the wearable device (101) can display the content having the second size within the second area. While the content having the second size is displayed within the second area, the wearable device (101) can identify the movement of the user's eyes. For example, based on the movement of the eyes, the wearable device (101) can identify the result of the focal length adjustment. For example, the wearable device (101) can identify the user's actual focal length identified based on the movement of the eyes. The wearable device (101) can obtain the result including the difference between the second distance corresponding to the second area where the content having the second size is displayed and the actual focal length. For example, based on the result, the wearable device (101) can identify how similarly the user's eyes moved to a target focal length (e.g., the second distance).

[0150] In operation (820), the wearable device (101) may store the identified result. According to one embodiment, the wearable device (101) may store the identified result in the memory (130). For example, the identified result may be used when the wearable device (101) changes the size and position of the content having the second size within the second area. In other words, the capability information may be updated based on the identified result.

[0151] The method of FIG. 8 may include measuring capability information for the focal length, changing the size and position of the content based on the measured capability information, measuring the actual focal length of the user while displaying the changed content, thereby identifying the result of the adjustment, and updating the capability information based on the identified result. However, the embodiments of the present disclosure are not limited thereto. According to one embodiment, the wearable device (101) may change the size and position of the content to correspond to a focal length outside the range of the focal length identified based on the capability information. In other words, the size and position of the content may be changed to have a focal length outside the range. The focal length outside the range may be referred to as a training range. According to one embodiment, the wearable device (101) may perform training for the ability to adjust the focal length by changing the size and position of the content to a focal length within the training range. For example, when the training is performed, the wearable device (101) can obtain information about the training range in which the size and position of the content have been changed. For example, the information about the training range can include information about the focal length within the training range and the distance (length) by which the focal length within the training range is outside the range. In addition, the wearable device (101) can identify the degree to which the user's coordination ability is expected to improve due to the training. According to one embodiment, the wearable device (101) can display information about the training range and a visual object indicating the degree through the display (520). Accordingly, the user can check the training results for the user's coordination ability for the focal length.

[0152] In one embodiment, the wearable device (101) may perform vision correction of the user based on the training. For example, the wearable device (101) may perform vision correction of the user by adjusting the focal length within the training range. In one embodiment, the wearable device (101) may perform the training based on the mode of the wearable device (101). For example, the wearable device (101) may activate a training function based on identifying that the mode is a training mode. Activating the training function may be referred to as performing the training. Alternatively, the wearable device (101) may deactivate the training function based on identifying that the mode is another mode (e.g., a normal mode or a content concentration mode). Disabling the training function may be referred to as refraining from or skipping the training. In addition, according to one embodiment, the wearable device (101) may disable the training function based on identifying that a designated function is being executed. For example, the designated function may include a function for eye protection of the user. For example, the designated function may include a blue light filter function for a screen displayed through a display of the wearable device (101) (e.g., displays (250-1, 250-2)). Alternatively, for example, the designated function may include a night mode (or dark mode) for a screen displayed through a display of the wearable device (101) (e.g., displays (250-1, 250-2)).Alternatively, for example, the specified function may include a low-power mode for reducing battery consumption of the wearable device (101). However, the embodiments of the present disclosure are not limited thereto. In addition, according to one embodiment, the wearable device (101) may deactivate the training function based on the usage time. For example, the usage time may indicate the time that the user uses the virtual environment provided through the wearable device (101). For example, the wearable device (101) may deactivate the training function when the usage time exceeds a reference usage time. This may be to protect the user's eyesight.

[0153] FIG. 9 illustrates an example flowchart of a method for displaying content having different sizes depending on a focal length within a virtual environment according to embodiments of the present disclosure.

[0154] At least some of the methods of FIG. 9 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the methods may be controlled by the processor (120) of the wearable device (101).

[0155] Referring to FIG. 9, in operation (900), the wearable device (101) may display content having a first size within a first area of ​​a virtual environment. According to one embodiment, the wearable device (101) may obtain an input for displaying the content having the first size within the first area. For example, the wearable device (101) may display the virtual environment in response to (based on) the execution of a software application for providing the virtual environment. For example, the software application may represent an example of a service that provides the virtual environment. For example, while the software application is running, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input of a user wearing the wearable device (101).

[0156] According to one embodiment, the wearable device (101) may display the content having the first size within the first area based on the input. For example, the first area may be referred to as an initial area set by the user in which the content is to be displayed. For example, the first size may be referred to as an initial size in which the content is to be displayed, set by the user. For example, the first size (or the initial size) may represent an area of ​​the content with respect to a direction in which the user views the content. For example, the first area may represent a location within the virtual environment in which the user's focal length is the first distance. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the first size and the first area. By displaying the rendered image through the display area of ​​the display (520), the content having the first size can be displayed within the first area.

[0157] According to one embodiment, the content having the first size within the first area may be displayed through at least a portion of a display area of ​​the display (520) of the wearable device (101). For example, the display area may represent the entire area in which an image may be displayed through the display (520). For example, the at least a portion may represent a portion of a display area for displaying the content having the first size within the first area among the display areas. When the display (520) includes a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2A) (or display areas), the wearable device (101) may display a first image through at least a portion of a first display area of ​​the first display (250-1) and a second image through at least a portion of a second display area of ​​the second display (250-2). The first image and the second image may represent images for displaying the content having the first size within the first area. For example, the first display area may be positioned with respect to (toward) the user's left eye. For example, the second display area may be positioned with respect to (toward) the user's right eye. Positioning with respect to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In some embodiments, an example of a wearable device (101) that uses a method of representing the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto.For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) by using the variable focus lens within the display (520), even without utilizing binocular parallax.

[0158] In operation (905), the wearable device (101) can identify whether the gaze time is greater than or equal to a reference gaze time. For example, the wearable device (101) can identify whether the gaze time of gazing at the content is greater than or equal to the reference gaze time. For example, after recognizing that the time for which the content is displayed is greater than or equal to the reference time, the wearable device (101) can determine whether the gaze time is greater than or equal to the reference gaze time. However, the embodiments of the present disclosure are not limited thereto. For example, the wearable device (101) can identify whether the gaze time is greater than or equal to the reference gaze time without performing a comparison between the time and the reference time. Alternatively, for example, the wearable device (101) can perform a comparison between the time and the reference time and a comparison between the gaze time and the reference gaze time together.

[0159] According to one embodiment, the wearable device (101) can identify whether an eye protection function is activated. The eye protection function may indicate a function of changing the position and size of the content within the virtual environment in order to protect the user's eyesight. In this case, as the position and size of the content change, the focal length while the user views the content may change. In addition, as the size changes based on the position of the content while the user views the content, the size at which the content is displayed externally as recognized by the user may be maintained constant. The externally displayed size may be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of ​​the display (520). In other words, even if the position and size of the content within the virtual environment change, the size at which the content is displayed externally may be maintained constant. Accordingly, while the user's viewing experience remains constant while viewing the content, the user's focal length can be dynamically changed. Accordingly, the user's eyesight can be protected according to the dynamic focal length.

[0160] In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the virtual environment. In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the settings of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can also be set for each content.

[0161] In one embodiment, when the vision protection function is activated, the wearable device (101) can identify whether the gaze time is greater than or equal to the reference gaze time. In one embodiment, in response to identifying that the vision protection function is activated, the wearable device (101) can identify whether the gaze time is greater than or equal to the reference gaze time. For example, the gaze time may indicate the time during which the user's gaze, tracked through the camera (510), is positioned within an area corresponding to the content. For example, the area corresponding to the content may indicate at least a portion of the display area.

[0162] According to one embodiment, the reference gaze time may be identified based on at least one of the user's ability to adjust the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the user's focal length adjustment, the minimum length and the maximum length of the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference gaze time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference gaze time may be set longer for a content that is dynamic (or has a fast play speed) than for a content that is static (or has a slow play speed).

[0163] In contrast, according to one embodiment, when the vision protection function is deactivated, the wearable device (101) can maintain the size and position of the content. For example, the wearable device (101) can maintain the size of the content as the first size and the position as the first area. For example, the wearable device (101) can maintain a state of displaying the content having the first size within the first area based on identifying that the vision protection function is deactivated.

[0164] In operation (910), the wearable device (101) may display content having a second size within a second region. For example, the wearable device (101) may display the content having a second size different from the first size within a second region having a different depth from the first region and a reference location corresponding to the user within the virtual environment, through at least a portion of the display, based on identifying that the gaze time is greater than or equal to the reference gaze time.

[0165] In one embodiment, the wearable device (101) can change the size and position of the content. For example, the wearable device (101) can change the size and position of the content in response to identifying that the gaze time is greater than or equal to the reference gaze time. For example, the wearable device (101) can change the first size and the first area of ​​the content to the second size and the second area, which are different from the first size, respectively.

[0166] In one embodiment, the wearable device (101) may identify the second size and the second area based on the capability information. For example, the wearable device (101) may identify the second area and the second size based on the capability information including the user's preferred focal length. For example, the second area may represent an area that changes from the first area to change to the user's preferred focal length. For example, the second area may represent a location within the virtual environment where the focal length linearly changes from the first area, indicating a second distance. The second distance may represent the user's preferred focal length or a focal length between the first distance and the user's preferred focal length. For example, if the second distance from a reference location corresponding to the user within the virtual environment is further than the first distance, the second size may be larger than the first size. In other words, the second size may be enlarged from the first size. Conversely, if the second distance from the reference position corresponding to the user within the virtual environment is closer than the first distance, the second size may be smaller than the first size. In other words, the second size may be reduced from the first size. Even in the above-described case, the size at which the content is externally displayed as perceived by the user may remain constant.

[0167] FIG. 9 illustrates an example of changing the size and position of the content in response to identifying that the gaze time for gazing at the content is greater than or equal to the reference gaze time. However, the embodiments of the present disclosure are not limited thereto. According to one embodiment, the wearable device (101) may identify whether the size and position of the content are changed based on other conditions. For example, the wearable device (101) may identify that the size and position of the content are changed when the eye protection function is set for the content. For example, when the content is a web page, the eye protection function may be set for the content, as the web page is generally used by gazing at it for a specified period of time. In addition, for example, the wearable device (101) may identify whether the content is a visual object floating on the display (520). For example, the floating visual object may represent an object that is always displayed in a portion of the display area of ​​the display (520), regardless of its location within the virtual environment. If the content is the floating visual object, the wearable device (101) may change the size and location of the content.

[0168] Furthermore, FIG. 9 illustrates an example in which the content expands as it moves away or contracts as it approaches. However, embodiments of the present disclosure are not limited thereto. For example, the content may be repeatedly contracted and expanded within a focal distance range defined by the minimum and maximum focal distances of the user included in the capability information. In other words, the wearable device (101) may display the content by changing its location and size within the range.

[0169] According to one embodiment, the wearable device (101) may display the content based on the changed second size and the second area. For example, the wearable device (101) may display the content having the second size within the second area. According to one embodiment, the wearable device (101) may render an image (or images) for displaying the content based on the changed size and location. By displaying the rendered image through the display area of ​​the display (520), the content having the second size may be displayed within the second area.

[0170] According to one embodiment, the wearable device (101) may maintain a value indicating a z-index of the content while the location of the content changes from the first area to the second area. For example, the wearable device (101) may set the value to a value higher than a second value indicating a z-index of second content positioned between the first area and the second area while the location of the content changes from the first area to the second area. In other words, the value indicating the z-index of the content may be a value higher than the second value indicating the z-index of the second content. For example, the higher the z-index, the closer it may be displayed to a reference location corresponding to the user within the virtual environment. Based on the above setting, the second content can be prevented from being displayed on the content as the location of the content changes from the first area to the second area. According to one embodiment, the wearable device (101) can display the content by rendering it based on the z-index. For example, since the second value of the second content is lower than the value of the content, the wearable device (101) can render only the content. Accordingly, the wearable device (101) can display only the content. Alternatively, for example, after rendering both the content and the second content, the wearable device (101) can refrain from displaying the second content having a lower z-index than the content and display only the content.

[0171] According to one embodiment, the content having the second size within the second region may be displayed through at least a portion of a display area of ​​the display (520) of the wearable device (101). The at least portion for displaying the content having the second size within the second region may correspond to the at least portion for displaying the content having the first size within the first region. In other words, the area of ​​the at least portion for displaying the content having the second size within the second region may correspond to the area of ​​the at least portion for displaying the content having the first size within the first region. However, the image (or images) for displaying the content having the second size within the second region may be different from the image (or images) for displaying the content having the first size within the first region. For example, the position within the display area of ​​an image (or images) for displaying the content having the second size within the second area may be different from the position within the display area of ​​an image (or images) for displaying the content having the first size within the first area.

[0172] As described above, the display (520) may include a plurality of displays (e.g., the first display (250-1) and the second display (250-2) of FIG. 2A) (or display areas). For example, in order to display the content having the second size within the second area, the wearable device (101) may display a third image through at least a portion of the first display area of ​​the first display (250-1) and a fourth image through at least a portion of the second display area of ​​the second display (250-2). The third image and the fourth image may represent images for displaying the content having the second size within the second area. For example, the first display area may be positioned with respect to (toward) the user's left eye. For example, the second display area may be positioned with respect to (toward) the user's right eye. Positioning relative to the left or right eye may indicate that it is positioned in an area viewable through the user's left or right eye. In the above example, an example of a wearable device (101) that uses a method of indicating the content and the depth of the content using binocular parallax is described, but the embodiments of the present disclosure are not limited thereto. For example, a wearable device (101) including a variable focus lens may display content having different depths (or focal lengths) using the variable focus lens within the display (520), even without using binocular parallax.

[0173] FIG. 10 illustrates an example flowchart of a method for displaying content according to depth within a virtual environment according to embodiments of the present disclosure.

[0174] At least some of the above methods of FIG. 10 may be performed by the wearable device (101) of FIG. 5. For example, at least some of the above methods may be controlled by the processor (120) of the wearable device (101).

[0175] In operation (1010), the wearable device (101) can display the content having a first display size on the first display (250-1) and the second display (250-2) so that the content is perceived as being located at a first depth in a 3D virtual environment.

[0176] For example, the 3D virtual environment may represent the virtual environment that provides an XR environment. For example, the first depth may represent a location within the 3D virtual environment where the focal length of the user of the wearable device (101) is a first distance (e.g., the first distance (430) of FIG. 4B). For example, the first depth may be referred to as a first area within the 3D virtual environment.

[0177] For example, the wearable device (101) may be displayed through at least a portion of the display areas of the first display (250-1) and the second display (250-2). For example, the at least portion may represent a portion or the entirety of a display area for displaying the content having the first display size among the display areas. For example, the wearable device (101) may display a first image through at least a portion of the first display area of ​​the first display (250-1) and a second image through at least a portion of the second display area of ​​the second display (250-2). The first image and the second image may represent images for displaying the content having the first display size. For example, the first display area may be positioned with respect to (toward) the user's left eye. For example, the second display area may be positioned with respect to (toward) the user's right eye. Positioning relative to the left or right eye may indicate that it is positioned in an area that can be seen through the user's left or right eye.

[0178] In one embodiment, the wearable device (101) may obtain an input for displaying the content. For example, the wearable device (101) may display the virtual environment in response to the execution of a software application for providing the 3D virtual environment. For example, the software application may represent an example of a service that provides the virtual environment. For example, while the software application is running, the wearable device (101) may obtain an input for displaying the content. For example, the input may include a user input from a user wearing the wearable device (101).

[0179] According to one embodiment, the wearable device (101) can identify whether an eye protection function is activated. The eye protection function may indicate a function of changing the position and size of the content within the 3D virtual environment in order to protect the user's eyesight. In this case, as the position and size of the content change, the focal length while the user views the content may change. In addition, as the size changes based on the position of the content while the user views the content, the size at which the content is displayed externally as recognized by the user may be maintained constant. The externally displayed size may be identified based on the ratio (or resolution) of the area for the content (e.g., at least a portion) to the display area of ​​the first display (250-1) and the second display (250-2). In other words, even if the position and size of the content within the virtual environment change, the size at which the content is displayed externally may be maintained substantially constant. Accordingly, while the user's viewing experience remains constant while the user views the content, the user's focal length can be dynamically changed.

[0180] In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the software application providing the 3D virtual environment. In one embodiment, the wearable device (101) can identify whether the vision protection function is activated within the settings of the wearable device (101). In other words, the vision protection function can be applied to each software application or to all software applications. In addition, for example, the vision protection function can also be set for each content.

[0181] In one embodiment, when the eye protection function is deactivated, the wearable device (101) can maintain the size and position of the content within the 3D virtual environment. For example, the wearable device (101) can maintain the size of the content as a first size and the position as a first area. For example, the wearable device (101) can maintain a state of displaying the content having the first size within the first area in response to identifying that the eye protection function is deactivated.

[0182] According to one embodiment, when the vision protection function is activated, the wearable device (101) can identify whether the time period during which the content is displayed is longer than or equal to a reference time. According to one embodiment, in response to identifying that the vision protection function is activated, the wearable device (101) can identify whether the time period during which the content is displayed is longer than or equal to the reference time.

[0183] According to one embodiment, the reference time may be identified based on at least one of the user's ability to adjust the focal length or the characteristic of the content. The ability information may include at least one of the user's reaction speed related to the user's focal length adjustment, the minimum length and the maximum length of the user's focal length, or the user's preferred focal length. For example, the characteristic of the content may include at least one of the play speed of the content or the type of the content. The type of the content may include a static type such as text or an image or a dynamic type such as a video. For example, the reference time may be set longer for a person with a slow reaction speed (e.g., an elderly person) than for a person with a fast reaction speed (e.g., a young person). Alternatively, the reference time may be set longer for a content that is dynamic (or has a fast play speed) than for a content that is static (or has a slow play speed).

[0184] In operation (1020), the wearable device (101) may display the content in a second display size substantially the same as the first display size on the first display (250-1) and the second display (250-2) so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for the time period longer than the reference time. In the example, the second depth exceeding the first depth is described as an example, but the embodiments of the present disclosure are not limited thereto. For example, the second depth may be less than or equal to the first depth.

[0185] In one embodiment, the wearable device (101) may change the size of the content within the 3D virtual environment while changing the location within the 3D virtual environment from the first depth to the second depth. In one embodiment, the wearable device (101) may change the size of the content in response to identifying that the time interval is greater than or equal to the reference time. For example, the wearable device (101) may change the first size and the first area of ​​the content to a second size different from the first size and a second area different from the first area, respectively.

[0186] In one embodiment, the change in the size and position of the content may be repeated by reducing and enlarging. For example, the wearable device (101) may expand the size of the content from the first size to the second size, and then reduce the size from the second size back to the first size. Alternatively, for example, the wearable device (101) may reduce the size of the content from the second size to the first size, and then enlarge the size from the first size back to the second size. Alternatively, for example, the wearable device (101) may repeat the reducing and enlarging according to a specified cycle.

[0187] As described above, the wearable device (101) can maintain the display size of the content displayed on the first display (250-1) and the second display (250-2) substantially the same while changing the location within the 3D virtual environment from the first depth to the second depth. For example, the wearable device (101) can maintain the display size from the first display size to the second display size that is substantially the same as the first display size even when the location changes from the first depth to the second depth. In other words, the wearable device (101) can display the content having the second display size on the first display (250-1) and the second display (250-2) so as to be recognized as being located at the second depth.

[0188] For an example of a method in which the wearable device (101) displays the first display size and the second display size in the display areas of the first display (250-1) and the second display (250-2), reference may be made to FIG. 7. In addition, for a specific example of a method in which the wearable device (101) obtains a result regarding the user's focal length and performs training and vision correction based on the result, reference may be made to FIG. 8. In addition, for a specific example of a method in which the wearable device (101) displays the content having the second display size at the second depth based on the time in which the user's gaze is positioned within an area corresponding to the content having the first display size, reference may be made to FIG. 9.

[0189] As described above, the wearable device (101) may include a display (520). The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The processor (120) may be configured to display content having a first size in a first area of ​​a virtual environment through at least a portion of a display area of ​​the display (520). The processor (120) may be configured to identify, based on the camera (510), whether a time for which a user of the wearable device (101) gazes at the content having the first size is greater than or equal to a reference time. The processor (120) may be configured to display, through at least a portion of the display (520), the content having a second size different from the first size within a second area having a different depth from the first area and a reference location corresponding to the user within the virtual environment, based on identifying that the time is greater than or equal to the reference time.

[0190] In one embodiment, when the first region represents a first location within the virtual environment where the user's focal length corresponds to a first distance from the reference position, and the second region represents a second location within the virtual environment where the focal length corresponds to a second distance from the reference position that is longer than the first distance, the second size may be larger than the first size.

[0191] In one embodiment, when the first region represents a first location within the virtual environment where the user's focal length corresponds to a first distance from the reference position, and the second region represents a second location within the virtual environment where the focal length corresponds to a second distance from the reference position, the second size may be smaller than the first size.

[0192] According to one embodiment, the processor (120) may be configured to identify whether a function for adjusting the user's focal length is activated. In response to identifying that the function is activated, the processor (120) may be configured to identify whether the time is greater than or equal to the reference time. In response to identifying that the function is deactivated, the processor (120) may be configured to maintain display of the content having the first size within the first area through the at least a portion of the display area of ​​the display (520).

[0193] In one embodiment, the processor (120) may be configured to obtain an input for displaying the content. In response to the input, the processor (120) may be configured to display the content having the first size through at least a portion of the content. Each of the first size and the first area may be specified by the user.

[0194] In one embodiment, the reference time may be identified based on the play speed of the content or the user's ability to adjust the focal length. The capability information may include the range of the user's focal length.

[0195] According to one embodiment, the content having the first size within the first area may be displayed based on a first image displayed in a first display area of ​​the display (520) positioned with respect to (toward) the user's left eye and a second image displayed in a second display area of ​​the display (520) positioned with respect to (toward) the user's right eye. The content having the second size within the second area may be displayed based on a third image displayed in the first display area and a fourth image displayed in the second display area.

[0196] According to one embodiment, when the second size is larger than the first size, the difference between the coordinates for the specified location of the first image and the coordinates for the specified location of the second image may be greater than the difference between the coordinates for the specified location of the third image and the coordinates for the specified location of the fourth image.

[0197] According to one embodiment, the processor (120) may be configured to acquire capability information regarding the user's focal length based on performing eye calibration on the user. The processor (120) may be configured to change the size of the content from the first size to the second size and change the location of the content from the first area to the second area based on the capability information. The capability information may include a range of the user's focal length.

[0198] In one embodiment, the processor (120) may be configured to identify a result of a user's adjustment of a focal length for the content having the second size within the second area, based on the capability information. The result may include a difference between the user's focal length calculated based on the second area and the user's actual focal length.

[0199] According to one embodiment, the processor (120) may be configured to maintain a value representing a z-index of the content while the location of the content changes from the first area to the second area.

[0200] In one embodiment, the processor (120) may be configured to identify whether the content is a visual object floating on the display (520). In response to identifying that the content is the floating visual object, the processor (120) may be configured to change the size of the content from the first size to the second size and change the location of the content from the first area to the second area.

[0201] According to one embodiment, the time may represent the time at which the user's gaze is positioned within an area corresponding to the content.

[0202] In one embodiment, the content may include a two-dimensional object or a three-dimensional object within the virtual environment.

[0203] As described above, the wearable device (101) may include a display (520). The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The processor (120) may be configured to display content, which is displayed in a first area within a virtual environment and has a first size within the virtual environment, through at least a portion of the display (520). The processor (120) may be configured to identify whether a function for adjusting a focal length is activated. The processor (120) may be configured to maintain displaying the content, which has the first size within the first area, through at least a portion of the display based on identifying that the function is deactivated. The processor (120) may be configured to, based on identifying that the function is activated, change a location from the first area to a second area having a different depth identified from a reference location within the virtual environment for adjusting the focal length, change a size from the first size to a second size according to the adjustment of the focal length, and display the content having the second size within the second area through at least a portion thereof. The reference location may indicate a location within the virtual environment corresponding to a user of the wearable device (101).

[0204] In one embodiment, when the first region represents a position within the virtual environment at which the focal distance from the reference position corresponds to a first distance (length), and the second region represents a position within the virtual environment at which the focal distance from the reference position corresponds to a second distance longer than the first distance, the second size may be larger than the first size.

[0205] According to one embodiment, the display (520) may include a first display area positioned with respect to (toward) a left eye of a user of the wearable device (101) and a second display area positioned with respect to (toward) a right eye of the user. The content having the first size in the first area may be displayed based on a first image displayed in the first display area and a second image displayed in the second display area. The content having the second size in the second area may be displayed based on a third image displayed in the first display area and a fourth image displayed in the second display area.

[0206] According to one embodiment, when the second size is larger than the first size, the difference between the coordinates for the specified location of the first image and the coordinates for the specified location of the second image may be greater than the difference between the coordinates for the specified location of the third image and the coordinates for the specified location of the fourth image.

[0207] In one embodiment, the processor (120) may be configured to obtain capability information regarding the focal length based on performing eye calibration for the user. The processor (120) may be configured to change the size from the first size to the second size and change the location from the first area to the second area based on the capability information. The capability information may include a range of the focal length.

[0208] According to one embodiment, the processor (120) may be configured to maintain a value representing a z-index of the content while the location changes from the first area to the second area.

[0209] As described above, the wearable device (101) may include a first display (250-1) positioned with respect to (toward) the user's left eye. The wearable device (101) may include a second display (250-2) positioned with respect to (toward) the user's right eye. The wearable device (101) may include a camera (510). The wearable device (101) may include a processor (120). The wearable device (101) may include a memory that stores instructions. The instructions, when executed by the processor (120), may cause the wearable device to display the content having a first displaying size on the first display (250-1) and the second display (250-2) such that the content is perceived as being located at a first depth in a 3-dimensional virtual environment. The instructions, when executed by the processor (120), may cause the wearable device to display the content at a second displaying size that is substantially the same as the first displaying size on the first display (250-1) and the second display (250-2) such that the content is perceived as being located at a second depth exceeding the first depth in the 3-dimensional virtual environment when the content is displayed for a time period that is greater than a reference time.

[0210] In one embodiment, the size of the content within the 3D virtual environment at the first depth of the 3D virtual environment may have a first size. The size of the content within the 3D virtual environment at the second depth of the 3D virtual environment may have a second size that is larger than the first size.

[0211] In one embodiment, the first depth may represent a first location within the 3D virtual environment where the user's focal length corresponds to a first length. The second depth may represent a second location within the 3D virtual environment where the focal length corresponds to a second length greater than the first length.

[0212] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify whether a function for adjusting a focal length of the user is activated. The instructions, when executed by the processor (120), may cause the wearable device, in response to identifying that the function is activated, to identify whether the time interval is greater than or equal to the reference time. The instructions, when executed by the processor (120), may cause the wearable device, in response to identifying that the function is deactivated, to maintain display of the content having the first display size on the first display (250-1) and the second display (250-2) such that the content is recognized as being located at the first depth in the 3D virtual environment.

[0213] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to obtain an input for displaying the content. The instructions, when executed by the processor (120), may cause the wearable device to display the content having the first display size on the first display (250-1) and the second display (250-2), in response to the input. The first depth may be specified by the user.

[0214] In one embodiment, the reference time may be identified based on the play speed of the content or the user's ability to adjust the focal length. The capability information may include the range of the user's focal length.

[0215] According to one embodiment, the content having the first display size on the first display (250-1) and the second display (250-2) may be displayed based on a first image displayed in a first display area of ​​the first display (250-1) having the first display size and a second image displayed in a second display area of ​​the second display (250-2) having the first display size. The content having the second display size on the first display (250-1) and the second display (250-2) may be displayed based on a third image displayed in a third display area of ​​the first display (250-1) having the second display size and a fourth image displayed in a fourth display area of ​​the second display (250-2) having the second display size.

[0216] According to one embodiment, the difference between the coordinates for the specified location of the first image and the coordinates for the specified location of the second image may be greater than the difference between the coordinates for the specified location of the third image and the coordinates for the specified location of the fourth image.

[0217] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to obtain capability information regarding a focal length of the user based on performing eye calibration for the user. The instructions, when executed by the processor (120), may cause the wearable device to change a location of the content in the 3D virtual environment from the first depth to the second depth based on the capability information. The capability information may include a range of a focal length of the user.

[0218] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify a result of adjusting the user's focal length for the content having the second display size changed based on the capability information. The result may include a difference between the user's focal length calculated based on the second depth and the user's actual focal length.

[0219] According to one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to maintain a value representing a z-index of the content while the location of the content in the 3D virtual environment changes from the first depth to the second depth.

[0220] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to identify whether the content is a visual object floating on the first display (250-1) and the second display (250-2). The instructions, when executed by the processor (120), may cause the wearable device to change a location of the content in the 3D virtual environment from the first depth to the second depth in response to identifying the content as the floating visual object.

[0221] In one embodiment, the instructions, when executed by the processor (120), may cause the wearable device to, in response to the time interval being greater than or equal to the reference time, identify, based on the camera (510), whether a gazing time of the user is greater than or equal to a reference gazing time. The instructions, when executed by the processor (120), may cause the wearable device to display the content having the second display size at the second depth based on identifying that the gazing time is greater than or equal to the reference gazing time. The gazing time may represent a time interval during which the user's gaze is positioned within an area corresponding to the content having the first display size.

[0222] In one embodiment, the content may include a two-dimensional object or a three-dimensional object within the 3D virtual environment.

[0223] Electronic devices according to one or more embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0224] It should be understood that one or more embodiments of this document and terminology used therein are not intended to limit the technical features described in this document to a particular embodiment, but rather to encompass various modifications, equivalents, or alternatives of the embodiment. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish the corresponding element from other corresponding elements and do not limit the corresponding elements in any other respect (e.g., importance or order). When a (e.g., a first) element is referred to as "coupled" or "connected" to another (e.g., a second) element, with or without the terms "functionally" or "communicatively," it means that said element can be connected to said other element directly (e.g., wired), wirelessly, or through a third element.

[0225] The term "module" as used in one or more embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or portion of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0226] One or more embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0227] According to one embodiment, a method according to one or more embodiments disclosed herein may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0228] According to one or more embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one or more embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, according to one or more embodiments, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one or more embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a wearable device (101), A first display (250-1) positioned with respect to the user's left eye; A second display (250-2) positioned against the user's right eye; At least one processor (120) comprising a processing circuit; and A memory storing instructions and including one or more storage media, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Displaying the content having a first displaying size on the first display (250-1) and the second display (250-2) so that the content is perceived as being located at a first depth in a 3 dimensional virtual environment; and When the content is displayed for a time period longer than a reference time, the content is displayed on the first display (250-1) and the second display (250-2) in a second display size that is substantially the same as the first display size so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment. Wearable device (101).

2. In claim 1, The size of the content within the 3D virtual environment at the first depth of the 3D virtual environment has a first size, and The size of the content within the 3D virtual environment at the second depth of the 3D virtual environment has a second size larger than the first size, Wearable device (101).

3. In claim 1, The first depth represents a first location within the 3D virtual environment where the focal length from the left and right eyes of the user to the content corresponds to a first length, and The second depth represents a second location within the 3D virtual environment corresponding to a second distance where the focal length is longer than the first distance, Wearable device (101).

4. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Identify whether the function for adjusting the focal length of the user is activated; Based on identifying that the function for adjusting the focal length of the user is activated, identifying whether the time period is greater than or equal to the reference time; Based on identifying that the function for adjusting the focal length of the user is disabled, further causing display of the content having the first display size on the first display (250-1) and the second display (250-2) so that the content is recognized as being located at the first depth in the 3D virtual environment. Wearable device (101).

5. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Obtaining input from the user for displaying the above content; Based on the above input, further causing the content having the first display size to be displayed on the first display (250-1) and the second display (250-2), and The above first depth is specified by the user, Wearable device (101).

6. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Further causing the reference time to be identified based on information about the play speed of the content or the capability of adjusting the user's focal distance, and The above capability information includes the range of the user's focal length, Wearable device (101).

7. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Based on the first image and the second image, the content having the first display size is displayed on the first display (250-1) and the second display (250-2), the first image is displayed on the first display area having the first display size of the first display (250-1), and the second image is displayed on the second display area having the first display size of the second display (250-2), and Based on the third image and the fourth image, cause the content having the second display size to be displayed on the first display (250-1) and the second display (250-2), wherein the third image is displayed in a third display area having the second display size of the first display (250-1) and the fourth image is displayed in a fourth display area having the second display size of the second display (250-2). Wearable device (101).

8. In claim 7, A first difference between a first coordinate for a specified location in the first image and a second coordinate for the specified location in the second image is greater than a second difference between a third coordinate for the specified location in the third image and a fourth coordinate for the specified location in the fourth image. Wearable device (101).

9. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Based on the eye calibration for the user, ability information on the focal length of the user is obtained; and Based on the above capability information, further causing the location of the content in the 3D virtual environment to be changed from the first depth to the second depth, The above capability information includes the range of the user's focal length, Wearable device (101).

10. In claim 9, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Further causing the user to identify the result of adjusting the focal length of the content having the second display size, which has been changed based on the above capability information, The result of the above user's focal length adjustment includes the difference between the user's focal length calculated based on the second depth and the user's actual focal length. Wearable device (101).

11. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Further causing a value representing a z-index of said content to be maintained while the position of said content in said 3D virtual environment changes from said first depth to said second depth. Wearable device (101).

12. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Identifying whether the content is a visual object floating on the first display (250-1) and the second display (250-2), and Further causing a location of said content in said 3D virtual environment to be changed from said first depth to said second depth, based on identifying that said content is said floating visual object. Wearable device (101).

13. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable device to: Based on the camera (510) of the wearable device, identifying whether the gazing time of the user is greater than or equal to a reference gazing time, wherein the gazing time represents a time interval during which the user's gaze is positioned within the first display size; and Further causing the content having the second display size to be displayed at the second depth based on identifying that the gaze time is greater than or equal to the reference gaze time. Wearable device (101).

14. A method performed by a wearable device (101) including a first display (250-1) positioned with respect to the left eye of the user and a second display (250-2) positioned with respect to the right eye of the user, An operation of displaying the content having a first displaying size on the first display (250-1) and the second display (250-2) so that the content is perceived as being located at a first depth in a 3 dimensional virtual environment; and An operation of displaying the content in a second display size that is substantially the same as the first display size on the first display (250-1) and the second display (250-2) so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for a time period that is longer than a reference time, method.

15. A non-transitory computer-readable storage medium, when individually or collectively executed by at least one processor (120) of a wearable device (101) including a first display (250-1) positioned with respect to a left eye of a user and a second display (250-2) positioned with respect to a right eye of the user: Displaying the content having a first displaying size on the first display (250-1) and the second display (250-2) so that the content is perceived as being located at a first depth in a 3 dimensional virtual environment; and Storing one or more programs including instructions that cause the content to be displayed on the first display (250-1) and the second display (250-2) in a second display size substantially equal to the first display size, so that the content is recognized as being located at a second depth exceeding the first depth in the 3D virtual environment when the content is displayed for a time period longer than a reference time, A non-transitory computer-readable storage medium.

Images