Head-mounted device for displaying screen corresponding to content, and operation method thereof

Abstract

The head-mounted device may comprise: a display; a memory including one or more storage media storing instructions; and at least one processor including a processing circuit. The instructions, when executed by the at least one processor individually or collectively, may cause the head-mounted device to: provide content corresponding to a first space through the display on the basis of a first safety area corresponding to the first space; on the basis of acquiring a request related to content corresponding to a second space, identify whether an execution condition of the second space is satisfied on the basis of the first safety area; on the basis of the execution condition of the second space not being satisfied, display at least one affordance related to a second safety area corresponding to the second space through the display; and on the basis of an input corresponding to the at least one affordance, provide content corresponding to the second space on the basis of the second safety area through the display.

Description

Head-mounted device for displaying a screen corresponding to content and method for operating the same

[0001] The present disclosure relates to a head-mounted device for displaying a screen corresponding to content according to one or more embodiments and a method of operating the same.

[0002] Various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic notebooks, smartphones, tablet PCs (personal computers), and wearable devices, are widely used. For example, electronic devices can provide virtual reality (VR), which allows users to experience a realistic experience in a computer-generated virtual world; augmented reality (AR), which adds virtual information (or objects) to the real world; and mixed reality (MR), which combines virtual reality and augmented reality.

[0003] Wearable type electronic devices that are worn by the user, such as head-mounted devices, require compact space utilization, and to utilize the space, a technology may be required to provide light corresponding to the screen display of the display to the user's eyes through a lens.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one or more embodiments, a head mounted device may include a display, a memory including one or more storage media storing instructions, and at least one processor including a processing circuit, wherein the instructions, when individually or collectively executed by the at least one processor, cause the head mounted device to: provide content corresponding to a first space through the display based on a first safe area corresponding to the first space; identify, based on obtaining a request related to content corresponding to a second space, whether an execution condition of the second space is satisfied based on the first safe area; display, based on a determination that the execution condition of the second space is not satisfied, at least one affordance related to a second safe area corresponding to the second space; and provide, based on an input corresponding to the at least one affordance, content corresponding to the second space through the display based on the second safe area.

[0006] According to one or more embodiments, a method of operating a head mounted device may include: providing content corresponding to a first space through a display based on a first safe area corresponding to the first space; identifying, based on a request related to content corresponding to a second space, whether an execution condition of the second space is satisfied based on the first safe area; displaying, based on an input corresponding to the at least one affordance, at least one affordance related to a second safe area corresponding to the second space through the display; and providing, based on an input corresponding to the at least one affordance, content corresponding to the second space through the display based on the second safe area.

[0007] According to one or more embodiments, a non-transitory computer-readable medium storing instructions may be configured to, when individually or collectively executed by at least one processor of a head mounted device, cause the head mounted device to: provide, through a display, content corresponding to a first space based on a first safe area corresponding to the first space; identify, based on obtaining a request related to content corresponding to a second space, whether an execution condition of the second space is satisfied based on the first safe area; display, through the display, at least one affordance related to a second safe area corresponding to the second space based on an input corresponding to the at least one affordance; and provide, through the display, content corresponding to the second space based on the second safe area.

[0008] According to one or more embodiments, a head mounted device may include a display, a memory storing instructions, and at least one processor, wherein the instructions, when executed by the at least one processor, cause the head mounted device to: activate a first safe area based on a request for a first space in an extended reality environment; determine, in response to a request for execution of an application requiring a second space, whether a size of the activated first safe area satisfies an execution condition of the application; provide a spatial lock screen including at least one affordance corresponding to a gesture input based on a size of the activated first safe area not satisfies an execution condition of the application; and release the spatial lock screen and activate a second safe area based on the gesture input.

[0009] The above and other aspects, features and advantages of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to one or more embodiments of the present disclosure.

[0011] FIG. 2 is a front perspective view of a head mounted device according to one or more embodiments of the present disclosure.

[0012] FIG. 3 is a rear perspective view of a head mounted device according to one or more embodiments of the present disclosure.

[0013] FIG. 4 is an exploded perspective view of a head mounted device according to one or more embodiments of the present disclosure.

[0014] FIG. 5A is a front view of a head mounted device according to one or more embodiments of the present disclosure.

[0015] FIG. 5b is a rear view of a head mounted device according to one or more embodiments of the present disclosure.

[0016] FIG. 6A illustrates a front view of a controller according to one or more embodiments of the present disclosure.

[0017] FIG. 6b illustrates a rear view of a controller according to one or more embodiments of the present disclosure.

[0018] FIG. 6c illustrates an input method of a head mounted device (200) according to various embodiments of the present disclosure.

[0019] FIG. 6d illustrates an input method of a head mounted device (200) according to various embodiments of the present disclosure.

[0020] FIG. 6e illustrates an input method of a head mounted device (200) according to various embodiments of the present disclosure.

[0021] FIG. 6f illustrates an input method of a head mounted device (200) according to various embodiments of the present disclosure.

[0022] FIG. 7A illustrates a software architecture of a head mounted device (200) according to one or more embodiments of the present disclosure.

[0023] FIG. 7b illustrates a data flow for a composition operation according to one or more embodiments of the present disclosure.

[0024] FIG. 7c illustrates a rendering flow of a display screen according to one or more embodiments of the present disclosure.

[0025] FIG. 8 is a block diagram of a head mounted device according to one or more embodiments of the present disclosure.

[0026] Figure 9a is a state diagram for setting a room scale according to a comparative embodiment of the present disclosure.

[0027] Figure 9b is a state diagram for setting a room scale according to a comparative embodiment of the present disclosure.

[0028] Figure 9c is a state diagram for setting a room scale according to a comparative embodiment of the present disclosure.

[0029] FIG. 10 illustrates various space and safety areas according to one or more embodiments of the present disclosure.

[0030] FIG. 11A illustrates a first space and a first safety area according to one or more embodiments of the present disclosure.

[0031] FIG. 11B illustrates a first space and a first safety area according to one or more embodiments of the present disclosure.

[0032] FIG. 11c illustrates a first space and a first safety area according to one or more embodiments of the present disclosure.

[0033] FIG. 12 illustrates at least one account registered to a head mounted device according to one or more embodiments of the present disclosure.

[0034] FIG. 13A illustrates an example of a taskbar according to one or more embodiments of the present disclosure.

[0035] FIG. 13b illustrates an example of a taskbar according to one or more embodiments of the present disclosure.

[0036] FIG. 14 illustrates an affordance displayed on a taskbar of a display according to one or more embodiments of the present disclosure.

[0037] FIG. 15A illustrates a state of displaying a lock screen according to one or more embodiments of the present disclosure.

[0038] FIG. 15b illustrates an example of a lock screen according to one or more embodiments of the present disclosure.

[0039] FIG. 15c illustrates movement and rotation of a head mounted device according to one or more embodiments of the present disclosure.

[0040] FIG. 16 illustrates an example of an affordance that induces a wearer's gaze input according to one or more embodiments of the present disclosure.

[0041] FIG. 17 illustrates an example of an affordance that induces a wearer's gaze input according to one or more embodiments of the present disclosure.

[0042] FIG. 18A is a schematic diagram of a head mounted device according to one or more embodiments of the present disclosure receiving data from an external device.

[0043] FIG. 18B is an example of data received by a head mounted device according to one or more embodiments of the present disclosure.

[0044] FIG. 19 illustrates an activated state of a second safety zone according to one or more embodiments of the present disclosure.

[0045] FIG. 20 illustrates a state of providing content corresponding to a second space according to one or more embodiments of the present disclosure.

[0046] FIG. 21 illustrates a state in which a third safety area is activated according to one or more embodiments of the present disclosure.

[0047] FIG. 22 illustrates a state of displaying a 3D object that induces movement of a wearer according to one or more embodiments of the present disclosure.

[0048] FIG. 23 is a flowchart of a method for operating a head mounted device according to one or more embodiments of the present disclosure.

[0049] FIG. 24A illustrates a portion of a flowchart of a method for operating the head mounted device of FIG. 23 according to one or more embodiments of the present disclosure.

[0050] FIG. 24B illustrates a portion of a flowchart of a method for operating the head mounted device of FIG. 23 according to one or more embodiments of the present disclosure.

[0051] FIG. 25A illustrates a state in which a designated lock screen including at least one affordance is provided according to embodiments of the present disclosure.

[0052] FIG. 25b illustrates a state in which a designated lock screen including at least one affordance is provided according to embodiments of the present disclosure.

[0053] FIG. 25c illustrates a state in which a designated lock screen including at least one affordance is provided according to embodiments of the present disclosure.

[0054] FIG. 25d illustrates a state in which a designated lock screen including at least one affordance is provided according to embodiments of the present disclosure.

[0055] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment of the present disclosure.

[0056] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0057] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0058] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0059] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0060] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0061] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0062] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0063] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0064] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0065] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0066] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0067] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0068] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0069] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0070] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0071] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0072] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0073] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0074] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0075] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0076] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0077] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0078] FIG. 2 is a front perspective view of a head mounted device (200) according to one or more embodiments of the present disclosure. FIG. 3 is a rear perspective view of a head mounted device (200) according to one or more embodiments of the present disclosure. FIG. 4 is an exploded perspective view of a head mounted device (200) according to one or more embodiments of the present disclosure. FIG. 5A is a front view of a head mounted device (200) according to one or more embodiments of the present disclosure. FIG. 5B is a rear view of a head mounted device (200) according to one or more embodiments of the present disclosure.

[0079] Referring to FIGS. 2 to 4, 5a and 5b, a head mounted device (200, e.g., the electronic device (101) of FIG. 1) according to one or more embodiments may include a HeT camera (210), a face tracking camera (215), a VST camera (220), a display member (225), an eye tracking camera (227), a depth sensor (230), a speaker (240) and / or a microphone (245). The head mounted device (200) according to one or more embodiments may further include a face cover to enhance a wearing comfort, foam cushioning to protect the head, and / or glasses temples to secure the head mounted device (200) to the head.

[0080] The HeT camera (210) according to one or more embodiments may be positioned to face the front of the head mounted device (200) and may be positioned at a plurality of locations (e.g., four locations). In one or more embodiments, the HeT camera (210) may be used for hand detection and tracking, and recognition of the wearer's gestures (e.g., hand movements). The HeT camera (210) according to one or more embodiments may be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition to provide a mixed reality experience.

[0081] A face tracking camera (215) according to one or more embodiments may be used to recognize the wearer's face, or may recognize and / or track both eyes of the wearer. In one or more embodiments, the face tracking camera (215) may detect movement of the wearer's face.

[0082] A face tracking camera (215) according to one or more embodiments may be equipped with an infrared LED (217) for the face tracking camera that irradiates infrared rays toward the face of the wearer.

[0083] A VST camera (220) according to one or more embodiments can capture external images while the wearer is wearing the head-mounted device (200). In one or more embodiments, the VST camera (220) can acquire images related to the surrounding environment of the head-mounted device (200). In one or more embodiments, images of the surrounding environment captured through the VST camera (220) can be provided to implement mixed reality.

[0084] A VST camera (220) according to one or more embodiments may be positioned at a position corresponding to the indicator member (225) (e.g., lens) below, facing in the opposite direction of the indicator member (225).

[0085] A display member (225) according to one or more embodiments may be configured to display an image and may include a lens that guides an image generated by a light output module. In one or more embodiments, the lens may be a Fresnel lens or a pancake lens.

[0086] A display member (225) according to one or more embodiments may display an image corresponding to mixed reality in front of the wearer's eyes. In one or more embodiments, the display member (225) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED) as a microphone (245).

[0087] The display member (225) according to one or more embodiments may further include a vision correction lens for correcting the vision of the wearer's eyes, and may include a vision adjustment wheel (223) that can adjust the vision correction lens to correspond to the wearer's vision.

[0088] A gaze tracking camera (227) according to one or more embodiments detects the wearer's eyes, and accordingly, the head mounted device (200) can adjust the screen displayed through the display member (225) based on the detected eye or gaze of the wearer. In one or more embodiments, the gaze tracking camera (227) can track the wearer's gaze or recognize the iris included in the eye. In one or more embodiments, the gaze tracking camera (227) may further include an infrared (IR) light source.

[0089] A depth sensor (230) according to one or more embodiments may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for determining the distance to an object, such as a time of flight (TOF) sensor. Instead of or in addition to the depth sensor (230), camera modules may determine the distance to an object.

[0090] A proximity sensor (235) according to one or more embodiments may be configured to detect whether the wearer is wearing the device. In one or more embodiments, the proximity sensor (235) may be positioned toward the wearer and in proximity to the indicator member (225) positioned to correspond to the wearer's eyeball, thereby detecting whether the wearer's face is positioned in proximity.

[0091] A speaker (240) according to one or more embodiments may output a sound that can be heard by the wearer.

[0092] A microphone (245) according to one or more embodiments may receive the wearer's voice or surrounding sounds. In one or more embodiments, the head-mounted device (200) may record sounds received through the microphone (245).

[0093] A head mounted device (200) according to one or more embodiments may include a power button (250) and a volume button (255) capable of receiving input from a wearer. In one or more embodiments, the power button (250) may be configured to turn the head mounted device (200) on or off by a long-press input. In one or more embodiments, the power button (250) may be configured to turn the screen of the head mounted device (200) on or off by a short-press input. In one or more embodiments, the power button (250) may be configured to recognize a fingerprint corresponding to a finger of the wearer in contact. In one or more embodiments, the volume button (255) may be configured to adjust the volume of the speaker (240) by a short-press input.

[0094] In one or more embodiments, the head mounted device (200) may execute an action specified by a combination of inputs corresponding to the power button (250) and the volume button (255). For example, based on an input of simultaneously pressing the power button (250) and the volume button (255) (e.g., the down button) for more than 7 seconds, the head mounted device (200) may execute a reboot.

[0095] A head mounted device (200) according to one or more embodiments may further include a circuit board (410) to which various components are connected, a battery bracket (420) for fixing a battery (430), and a battery (430) for charging and / or discharging power.

[0096] A head mounted device (200) according to one or more embodiments may further include a ventilation hole (253) for discharging heat generated inside, a FAN (440) for circulating air to dissipate heat through the ventilation hole, and / or a status indicator light (257) for displaying the current status of the head mounted device (200) through light output. A head mounted device (200) according to one or more embodiments may further include a connection jack (260) for connecting to an external connector, and / or a Pogo mounting groove (270) formed to be in contact with a Pogo pin provided in a case device when mounted on the case device.

[0097] As described above, according to one or more embodiments, the head-mounted device (200) may have a form factor for being worn on a wearer's head. For example, the head-mounted device (200) may further include straps and / or wearing elements for being secured on a body part of the user. In one or more embodiments, the head-mounted device (200) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the wearer's head.

[0098] FIG. 6A illustrates a front view of a controller (600) according to one or more embodiments of the present disclosure. FIG. 6B illustrates a rear view of a controller (600) according to one or more embodiments of the present disclosure.

[0099] Referring to FIGS. 6A and 6B, a head mounted device (200) according to one or more embodiments may be communicatively connected to a controller (600) and receive input from a wearer through the controller (600).

[0100] A controller (600) according to one or more embodiments may include at least one button (610, 620, 630, 640, 650, 660, 680, 690) and may transmit a signal corresponding to a specific input to a head mounted device (200) based on an input corresponding to the at least one button (610, 620, 630, 640, 650, 660, 680, 690).

[0101] At least one button (610, 620, 630, 640, 650, 660, 680, 690) included in a controller (600) according to one or more embodiments may include an A button (610), a B button (620), a home button (630), an X button (640), a Y button (650), and a menu button (660). In one or more embodiments, each button may be assigned an input corresponding to a specific action. In one or more embodiments, the controller (600) may further include a grab button (680) and / or a trigger button (690).

[0102] In one or more embodiments, the controller (600) may include a stick (670) configured to receive a wearer's manipulation input. In one or more embodiments, the controller (600) may receive the wearer's manipulation input for the stick (670) and transmit a corresponding signal to the head mounted device (200).

[0103] The controller (600) according to one or more embodiments may further include a status indicator (605) that outputs light in relation to the status of the controller (600) or the transmission / reception status of a signal corresponding to an input.

[0104] A controller (600) according to one or more embodiments may be held in the hand of a wearer, detect movement or rotation of the hand of the wearer, and transmit an input signal according to the detected movement or rotation to the head mounted device (200).

[0105] FIGS. 6C, 6D, 6E, and 6F illustrate input methods of a head mounted device (200) according to various embodiments of the present disclosure. Referring to FIGS. 6C, 6D, 6E, and 6F, a head mounted device (200) according to one or more embodiments can obtain interaction inputs from a user (U) according to various input methods.

[0106] A head-mounted device (200) according to one or more embodiments may acquire a gesture input using a hand (H) of a user (U), as illustrated in FIG. 6C . For example, the gesture input of the user (U) may include a pinch input, a pinch & hold input, and a pinch & move input. In addition, the gesture input of the user (U) may include various inputs of a specified pattern.

[0107] A head-mounted device (200) according to one or more embodiments may obtain input through an input device such as a keyboard (K) or a mouse (M), as illustrated in FIG. 6d. In one or more embodiments, the keyboard (K) or mouse (M) may be a physical device, or may be a virtual keyboard or virtual mouse displayed virtually on a display (e.g., a display member (225) of FIG. 3).

[0108] A head mounted device (200) according to one or more embodiments may obtain a touch input via an external device (E), as illustrated in FIGS. 6E and 6F . For example, the external device (E) may be a personal electronic device (e.g., a smartphone or a smartwatch) including a touch panel. In one or more embodiments, the head mounted device (200) may receive, from the external device (E), a touch input for a button displayed on a display of the external device (E), or a touch input in a designated pattern of a wearer corresponding to the touch panel.

[0109] A head mounted device (200) according to one or more embodiments may receive voice input from a wearer via an artificial intelligence application capable of voice recognition (e.g., bixby).

[0110] FIG. 7A illustrates the software architecture of a head-mounted device (200) according to one or more embodiments of the present disclosure. FIG. 7B illustrates a data flow for a composition operation according to one or more embodiments of the present disclosure. FIG. 7C illustrates a rendering flow of a display screen according to one or more embodiments of the present disclosure.

[0111] Referring to FIGS. 7A, 7B and 7C, the software architecture of a head mounted device (200) according to one or more embodiments may be implemented by a processor (e.g., processor (120) of FIG. 1 or processor (810) of FIG. 8).

[0112] The OS (710) according to one or more embodiments may receive data or signals from an input device (e.g., a camera, a controller (600), a keyboard / mouse, a sensor) and output data or signals to an output device (e.g., a speaker, a display). The OS (710) according to one or more embodiments may transmit and receive data or signals to and from a mixed reality system (e.g., a VST manager) or an account system (e.g., a global membership system (GMS)).

[0113] An OS (710) according to one or more embodiments may transmit and receive data or signals with an application library (720). The application library (720) according to one or more embodiments may include at least one library related to applications, and may include applications based on 2D screens (Android 2D / 2.5D) and / or applications based on 3D screens (Impress or Immersive).

[0114] An OS (710) according to one or more embodiments may display a screen on a display by composing an image (Passthrough) captured using a camera and virtual reality graphics (Graphics).

[0115] A CPM (740, composing presentation manager) according to one or more embodiments is configured in a Native Framework and can generate a mixed reality screen by synthesizing an image captured using a camera (Passthrough) and virtual reality graphics (Graphics).

[0116] A CPM (740) according to one or more embodiments may render a 3D display screen based on layers of a hierarchy in a defined z-order in a 3D coordinate space. A CPM (740) according to one or more embodiments may first synthesize existing buffers and geometry using new pose values ​​and late-stage reprojection, and then process updates (e.g., new buffers or new poses) in the XR application and updates in the 2D panel. A CPM (740) according to one or more embodiments may, as a lowest priority, clean up texture caches, old entries in hash tables, and performance metric records.

[0117] In one or more embodiments, the CPM (740) may display a 3D window created through the Java API Framework on the screen based on an application based on a 2D screen.

[0118] In one or more embodiments, the CPM (740) may display a 3D object rendered on the screen through a boundary system (730) based on an application based on a 3D screen. In one embodiment, the boundary system (730) may display a 3D object on the screen based on a safe area and / or a boundary of a safe area specified for each application.

[0119] FIG. 8 is a block diagram of a head mounted device (200) according to one or more embodiments of the present disclosure.

[0120] Referring to FIG. 8, a head mounted device (200) according to one or more embodiments may include a processor (810), a memory (820), a display (830), a camera (840), a sensor circuit (850), and / or a communication circuit (communication interface) (860).

[0121] A processor (810, e.g., processor (120) of FIG. 1 ) according to one or more embodiments may control at least one other component (e.g., hardware or software component) of the head mounted device (200). In one or more embodiments, the processor (810) may perform various data processing or operations, and as at least part of the data processing or operations, may store commands or data received from other components in a memory (820), process the commands or data stored in the memory (820), and store result data in the memory (820).

[0122] A memory (820, e.g., memory (130) of FIG. 1) according to one or more embodiments may store instructions executable by the processor (810).

[0123] In one or more embodiments, the display (830, e.g., the display module (160) of FIG. 1 or the display member (225) of FIG. 3) may be configured to display a screen in front of the wearer's eyes. The display (830), according to one or more embodiments, may display a screen corresponding to virtual reality or mixed reality. In one or more embodiments, the display (830) may display a three-dimensionally rendered 3D screen.

[0124] A camera (840, e.g., camera module (180) of FIG. 1, HeT camera (210) or VST camera (220) of FIG. 2) according to one or more embodiments may be configured to acquire an image of the surrounding environment. In one or more embodiments, a plurality of cameras (840) may be provided, each of which may be positioned adjacent to or corresponding to the wearer's eye. In one or more embodiments, the cameras (840) may be positioned to face a direction that includes the wearer's field of view (FOV), so as to acquire an image of the surrounding environment corresponding to the wearer's line of sight.

[0125] In one or more embodiments, the head mounted device (200) may further include a separate camera device (e.g., a face tracking camera (215) or an eye tracking camera (227) of FIG. 3) for tracking the wearer's eyes, identifying the wearer's gestures, or recognizing the wearer's face.

[0126] A sensor circuit (850, e.g., sensor module (176) of FIG. 1) according to one or more embodiments may be configured to obtain at least one value related to the surrounding environment or the state of the user (U). In one or more embodiments, the sensor circuit (850) may include at least one of an inertial sensor, an acceleration sensor, or a gyro sensor that detects movement or rotation of the wearer. In one or more embodiments, the sensor circuit (850) may include a camera sensor that detects and / or tracks the position or gaze direction of the wearer's eyes (e.g., a face tracking camera (215) or an eye tracking camera (227) of FIG. 3), or a vision sensor or a depth sensor that obtains at least one value related to the external environment (e.g., a depth sensor (230) of FIG. 2).

[0127] In one or more embodiments, the sensor circuit (850) can acquire posture information of the wearer. For example, the sensor circuit (850) can identify whether the wearer is in a sitting or standing posture, or can identify the wearer's moving posture. The head-mounted device (200) according to one or more embodiments can provide guidance regarding the posture of the user (U) based on the posture of the wearer identified through the sensor circuit (850).

[0128] A communication circuit (860, e.g., communication module (190) of FIG. 1) according to one or more embodiments may be configured to transmit and receive data (or signals) with an external device (e.g., an external device (E) of FIGS. 6E and 6F). In one or more embodiments, the communication circuit (860) may be communicatively connected to the external device (E) via a designated communication method. In one or more embodiments, the communication circuit (860) may transmit or receive data related to the surrounding environment or the state of the user (U) from the communicatively connected external device (E). In one or more embodiments, the external device (E) may be worn on a wearer to obtain data related to the state of the wearer or obtain data related to the surrounding environment of the wearer.

[0129] A head mounted device (200) according to one or more embodiments may further include, or exclude some of, the configurations included in the electronic device (101) of FIG. 1 or the head mounted device (200) of FIGS. 2 to 3, in addition to the configurations illustrated and described.

[0130] FIG. 9a, FIG. 9b and FIG. 9c are state diagrams for setting a room scale according to a comparative embodiment of the present disclosure.

[0131] Referring to FIGS. 9A, 9B, and 9C, a head mounted device (200) according to one or more embodiments may switch its operating mode between a fixed mode in which the boundary is fixed and a room-scale mode in response to an application being executed or content of the application. In one or more embodiments, the fixed mode may be an operating mode in which content is provided in a basic safety protection boundary space (e.g., 1 [m] X 1 [m]) designated centered on the position of the user (U) while the position of the user (U) is fixed.

[0132] In one or more embodiments, room scale may be a feature that allocates a real space of a size corresponding to the virtual reality environment to the virtual reality. In one or more embodiments, room scale mode may be an operating mode that provides content such that a user (U) can move within a safety protection boundary space (S, e.g., 2 [m] X 2 [m] or more).

[0133] A head mounted device (200) according to one or more embodiments may manually set a space (S) of a room scale, and may set a boundary (B) of the room scale, for example, as a user (U) moves. In one or more embodiments, the head mounted device (200) may have a different required room scale size depending on the application being executed or the content of the application, and may require manual setting of the room scale to change the room scale.

[0134] In one or more embodiments, the head mounted device (200) may reduce the immersion of the user (U) due to a guardian action that indicates the boundary (B) of the room scale when the user goes beyond the set room scale.

[0135] FIG. 10 illustrates various spaces (S1, S2, S3) and safety zones (Z1, Z2, Z3) according to one or more embodiments of the present disclosure.

[0136] Referring to FIG. 10, a head mounted device (200) according to one or more embodiments may display screens corresponding to various spaces (S1, S2, S3). In one or more embodiments, the head mounted device (200) may display a screen corresponding to an application being executed or content of an application in a designated space.

[0137] In one or more embodiments, the head mounted device (200) may have different required safety areas depending on the application being executed or the content of the application.

[0138] In one or more embodiments, the head mounted device (200) may include a first space (S1) corresponding to a near field of view and a first safety area (Z1). For example, the first safety area (Z1) may be a space having a radius of 1.7 [m] or less from the user (U) or the head mounted device (200). For example, the first space (S1) may be a space located at the boundary or inside of the first safety area (Z1). For example, the first space (S1) may be a cylindrical curved surface or plane extending vertically from the boundary or inside of the first safety area (Z1). For example, the head mounted device (200) may display a screen of a near field of view, such as a dash, a taskbar, or a home menu, in the first space (S1).

[0139] In one or more embodiments, the head mounted device (200) may include a second space (S2) corresponding to the center and a second safety zone (Z2). For example, the second safety zone (Z2) may be a space having a radius of 2.0 [m] or less from the user (U) or the head mounted device (200).

[0140] For example, the second space (S2) may be a space located at the boundary or inside of the second safety zone (Z2). For example, the second space (S2) may be a cylindrical curved surface extending vertically from the boundary or inside of the second safety zone (Z2). For example, the head-mounted device (200) may display a wide-field screen, such as a game, in the second space (S2).

[0141] In one or more embodiments, the head mounted device (200) may include a third space (S3) corresponding to a distance and a third safety zone (Z3). For example, the third safety zone (Z3) may be a space having an infinite radius from the user (U) or the head mounted device (200). For example, the third space (S3) may be a space located at the boundary or within the third safety zone (Z3). For example, the head mounted device (200) may display an infinite background screen in the third space (S3).

[0142] The above space and safety areas are only examples, and various other space and safety areas may be established.

[0143] FIGS. 11A, 11B and 11C illustrate a first space (S1) and a first safety area (Z1) according to one or more embodiments of the present disclosure.

[0144] Referring to FIGS. 11a, 11b and 11c, a head mounted device (200) according to one or more embodiments may provide content corresponding to a first space (S1) through a display based on a first safety area (Z1) corresponding to the first space (S1).

[0145] A head mounted device (200) according to one or more embodiments may automatically activate a first safety zone (Z1) upon booting or when worn by a user (U). In one or more embodiments, the head mounted device (200) may display a screen in a first space (S1) and activate the first safety zone (Z1) upon initial access to a designated user account. For example, the first safety zone (Z1) and / or the first space (S1) may correspond to a near-field area of ​​the user (U).

[0146] In one or more embodiments, the head mounted device (200) may activate the first space (S1) and the first safety zone (Z1) using basic configuration information. In one or more embodiments, the head mounted device (200) may reset the activated space or safety zone based on images or data acquired via a camera, sensor circuit, and / or communication circuit.

[0147] A head mounted device (200) according to one or more embodiments can manually activate a first safety zone (Z1) by input from a user (U).

[0148] A head mounted device (200) according to one or more embodiments may activate a first safe area (Z1) corresponding to a first space (S1) based on acquisition of a request related to content corresponding to the first space (S1). In one or more embodiments, the first safe area (Z1) may be activated when an application providing content corresponding to the first space (S1) is executed, or when a task providing content corresponding to the first space (S1) is executed in an executed application.

[0149] A head mounted device (200) according to one or more embodiments may display a task bar (1100) in a first space (S1) that displays a status related to an application or space being executed (1110, 1120). In one or more embodiments, the head mounted device (200) may display the task bar (1100) in a designated location and / or designated area of ​​the first space (S1). In one or more embodiments, the task bar may be automatically displayed in the first space (S1) through a display, but may be hidden without being displayed by an input of a user (U) or by displayed content.

[0150] In one or more embodiments, the head mounted device (200) may display a dashboard (D) displaying 2D objects, 3D objects, 2D windows, and / or 3D windows in the first space (S1). For example, the dashboard (D) may be a flat or curved screen displayed in at least a portion of the first space (S1) in front of a user (U) wearing the head mounted device (200).

[0151] In one or more embodiments, the head mounted device (200) may display a home screen including a dashboard (D) and a taskbar (1100) in a first space (S1) via the display, as illustrated in FIG. 11c.

[0152] In one or more embodiments, the head mounted device (200) may display a 3D screen corresponding to an immersive application in a first space (S1) based on a first safety area (Z1).

[0153] A head-mounted device (200) according to one or more embodiments may acquire an image of the surrounding environment, at least one value related to the surrounding environment or the state of the user (U) and / or data related to the surrounding environment or the state of the user (U) from a camera (e.g., a camera (840) of FIG. 8) set to acquire an image of the surrounding environment, a sensor circuit (e.g., a sensor circuit (850) of FIG. 8) set to acquire at least one value related to the surrounding environment or the state of the user (U), and a communication circuit (e.g., a communication circuit (860) of FIG. 8) set to transmit and receive data related to the surrounding environment or the state of the user (U) from an external device.

[0154] A head mounted device (200) according to one or more embodiments may expand a first safety zone (Z1) based on at least one of an image of the surrounding environment, at least one value related to the surrounding environment or the state of the user (U), and / or data related to the surrounding environment or the state of the user (U).

[0155] A head mounted device (200) according to one or more embodiments may update a first safety area (Z1) in real time to gradually expand an initially set first safety area (Z1) while displaying a screen in a first space (S1). In one or more embodiments, the head mounted device (200) may store information corresponding to the updated first safety area (Z1). In one or more embodiments, the head mounted device (200) may store information corresponding to the updated first safety area (Z1) corresponding to a logged-in account.

[0156] FIG. 12 illustrates at least one account registered in a head mounted device (200) according to one or more embodiments of the present disclosure.

[0157] Referring further to FIG. 12, a head mounted device (200) according to one or more embodiments may register at least one account (e.g., Mike Fake, Sam, Guest) and display data related to at least one registered account on a display (830). In one or more embodiments, the head mounted device (200) may receive a selection regarding one of the registered accounts, log in to the account, and provide content corresponding to the logged-in account through the display (830).

[0158] A head mounted device (200) according to one or more embodiments may activate a stored area corresponding to at least one registered account. In one or more embodiments, the head mounted device (200) may set the stored area corresponding to one of the registered accounts as a first safety area (Z1) and activate the set first safety area (Z1). In one or more embodiments, the head mounted device (200) may display a screen corresponding to content in a first space (S1) corresponding to the activated first safety area (Z1).

[0159] A head-mounted device (200) according to one or more embodiments may set a lock for at least one registered account. In one or more embodiments, the head-mounted device (200) may use various methods, such as a password, biometrics, gestures, or head tracking, to unlock the account.

[0160] A head-mounted device (200) according to one or more embodiments may display a designated lock screen on the display when receiving an input for logging in to or changing a registered account. In one or more embodiments, the head-mounted device (200) may receive an interaction input (e.g., a gesture or head tracking) from a user (U) while displaying the designated lock screen through the display.

[0161] FIGS. 13A and 13B illustrate examples of a taskbar (1100) according to one or more embodiments of the present disclosure.

[0162] Referring further to FIGS. 13A and 13B , a head mounted device (200) according to one or more embodiments may display a task bar (1100) via a display (830). The task bar (1100) according to one or more embodiments may include a button related to space (1310), a button related to a running application (1320), a button related to a recently used application (1330), a button related to a shortcut to at least one function (1340), and / or a button related to a logged-in account (1350).

[0163] The task bar (1100) according to one or more embodiments may further display information regarding the status of the head mounted device (200). For example, the task bar (1100) may display the current time, notifications of the head mounted device (200), communication connection status of the head mounted device (200), and / or battery status of the head mounted device (200).

[0164] In one or more embodiments, the taskbar (1100) may include a button (1313) that displays a space that is currently displayed or displayable on the display (830) and / or a button (1315) that displays information related to a displayable space corresponding to a running application or content.

[0165] In one or more embodiments, the taskbar (1100) may include at least one button (1323, 1325) associated with a running application. In one or more embodiments, the taskbar (1100) may include at least one button (1330) associated with a recently used application.

[0166] A head mounted device (200) according to one or more embodiments may obtain a request related to content corresponding to a second space (S2) while activating a first safety zone (Z1) to provide content corresponding to a first space (S1). For example, the second space (S2) may be displayed at a location relatively spaced apart from the first space (S1) and may request a relatively wide safety zone. For example, the content corresponding to the second space (S2) may be a game screen according to a game application.

[0167] In one or more embodiments, when the head mounted device (200) obtains a request related to content corresponding to the second space (S2), it can identify whether the execution condition of the second space (S2) is satisfied based on the first safe area (Z1).

[0168] A head mounted device (200) according to one or more embodiments may, when executing an application that provides content corresponding to a second space (S2) or receiving input for providing content corresponding to a second space (S2), compare a second safety area (Z2) corresponding to the second space (S2) with a currently activated first safety area (Z1).

[0169] In one or more embodiments, the head mounted device (200) can identify whether a second safety area (Z2) corresponding to a second space (S2) is included in a first safety area (Z1). In one or more embodiments, the head mounted device (200) can identify whether a size of a second safety area (Z2) corresponding to a second space (S2) is less than or equal to a size of an activated first safety area (Z1).

[0170] In one or more embodiments, the head mounted device (200) may display content corresponding to the second space (S2) in the second space (S2) based on the first safety area (Z1), when the second safety area (Z2) corresponding to the second space (S2) is included in the first safety area (Z1).

[0171] In one or more embodiments, the head mounted device (200) may display, through the display, at least one affordance related to the second safety area (Z2) corresponding to the second space (S2), when the second safety area (Z2) corresponding to the second space (S2) is not included in the first safety area (Z1).

[0172] FIG. 14 illustrates an affordance displayed on a task bar of a display according to one or more embodiments of the present disclosure.

[0173] Referring to FIG. 14, a head mounted device (200) according to one or more embodiments may display a task bar (1100) that indicates a status related to an application or space being executed. In one or more embodiments, the head mounted device (200) may display the task bar (1100) in a first space (S1).

[0174] A head mounted device (200) according to one or more embodiments may display an affordance (1400) indicating whether an execution condition of a second space (S2) is satisfied on a task bar (1100). In one or more embodiments, the head mounted device (200) may display an affordance (1400) indicating a disabled state on a button (1310) related to a space. For example, the head mounted device (200) may display the button (1310) related to a space in gray color so that a user (U) may recognize that the button (1310) related to the space is disabled, or may display a badge (1400) on the button (1310) related to the space.

[0175] A head mounted device (200) according to one or more embodiments may, when there are multiple spaces and multiple buttons respectively associated with a task bar (1100), display a badge (not shown) indicating an activated state on a button (not shown) associated with a space that is displayable based on an activated safe area, and display a badge (1400) indicating an inactivated state on a button (1310) associated with a space that is not displayable based on an activated safe area.

[0176] FIG. 15A illustrates a state in which a lock screen (1500) is displayed according to one or more embodiments of the present disclosure. FIG. 15B illustrates an example of a lock screen (1500) according to one or more embodiments of the present disclosure. FIG. 15C illustrates movement and rotation of a head mounted device (200) according to one or more embodiments of the present disclosure.

[0177] Referring to FIGS. 15A, 15B, and 15C, a head mounted device (200) according to one or more embodiments may display a designated lock screen (1500) including at least one affordance on at least a portion of a display (830) based on not satisfying an execution condition of a second space (S2). In one or more embodiments, the head mounted device (200) may display a spatial lock screen (1500) on a first space (S1).

[0178] A head mounted device (200) according to one or more embodiments may display a designated lock screen (1500) on a display (830) when receiving an input to log in to a registered account or change an account.

[0179] In one or more embodiments, the head mounted device (200) may receive an interaction input (e.g., a gesture or head tracking) from a user (U) while displaying a designated lock screen (1500) through the display (830).

[0180] In one or more embodiments, the head mounted device (200) can identify a method of input by a user (U). In one or more embodiments, the head mounted device (200) can identify a method of input corresponding to at least one affordance. For example, the method of input may include input using a controller (600), input using touch, input using voice, input using a keyboard or mouse, input using gestures, input using an external device, and / or input using head tracking. In one or more embodiments, the head mounted device (200) can display at least one affordance that induces input according to the identified method of input.

[0181] In one or more embodiments, the head mounted device (200) may induce a head tracking input of a user (U) in response to a designated lock screen (1500). In one or more embodiments, the head mounted device (200) may induce the user (U) to move or rotate his / her head according to a designated pattern in response to an affordance included in the designated lock screen (1500). In one or more embodiments, the head mounted device (200) may induce the user (U) to move his / her head in the x-axis, y-axis, or z-axis, or to rotate his / her head in the pitch, yaw, or roll direction.

[0182] In one or more embodiments, the head mounted device (200) may activate a safe zone by acquiring an image of the surrounding environment through a camera in response to an interaction input of a user (U), and identifying an area stored in response to an account as a safe zone based on the acquired image of the surrounding environment.

[0183] In one or more embodiments, the head mounted device (200) can identify whether an execution condition of a second space (S2) is satisfied based on an input corresponding to at least one affordance, and can release the display of the designated lock screen (1500) based on the satisfaction of the execution condition of the second space (S2).

[0184] In one or more embodiments according to the present disclosure, if the surrounding environment acquired through the camera is different from the safe area stored corresponding to the user account, the head mounted device (200) may provide an affordance that induces resetting the safe area. Specifically, the head mounted device (200) according to one or more embodiments may acquire an image of the surrounding environment (e.g., an image including an air conditioner (1510), a TV (1520), and a PC (1530) of FIG. 15A) through the camera. The head mounted device (200) may identify a safe area based on the acquired image of the surrounding environment. If the identified safe area is different from the safe area stored corresponding to the user account, the head mounted device (200) may provide at least one affordance that induces a user input for resetting to the identified safe area, and may reset and activate the safe area based on an interaction input of the user (U) corresponding to the affordance.

[0185] FIG. 16 and FIG. 17 illustrate examples of affordances that induce gaze input from a user (U) according to one or more embodiments of the present disclosure.

[0186] Referring to FIGS. 16 and 17, a head mounted device (200) according to one or more embodiments may display at least one affordance (1600, 1710, 1720) on at least a portion of a display (830) based on not satisfying an execution condition of a second space (S2).

[0187] A head mounted device (200) according to one or more embodiments may identify a method of input corresponding to at least one affordance (1600, 1710, 1720) and display at least one affordance (1600, 1710, 1720) that induces an input corresponding to the identified method of input.

[0188] In one or more embodiments, the head mounted device (200) may display, through the display (830), at least one affordance (1600, 1710, 1720) that induces a gaze input from the user (U).

[0189] In one or more embodiments, as illustrated in FIG. 16, the head mounted device (200) may display an object (1600) corresponding to a falling meteor or an object (1600) corresponding to a constellation, as an affordance (1600, 1710, 1720) that guides the gaze of the user (U).

[0190] In one or more embodiments, as illustrated in FIG. 17, the head mounted device (200) may display a screen on the display (830) such that an unconfirmed area (1720) is distinguished from a confirmed area (1710) by a gaze input of the user (U). In one or more embodiments, the head mounted device (200) may induce a gaze input for an unconfirmed area (1720) where no gaze input has occurred.

[0191] In one or more embodiments, the head mounted device (200) may display areas (1720) that are not identified by gaze input as dark and display areas (1710) identified by gaze input as relatively bright.

[0192] In one or more embodiments, the head-mounted device (200) can generate differences in sharpness based on distance. For example, a relatively close foreground area can be displayed relatively clearly, and a relatively distant foreground area can be displayed relatively darkly. Accordingly, the head-mounted device (200) can induce a user's (U) gaze input toward an unidentified area (1720) and / or a relatively distant foreground area.

[0193] In one or more embodiments, the head mounted device (200) may acquire an image or at least one value of the surrounding environment from a camera or sensor circuit based on gaze input.

[0194] FIG. 18A is a schematic diagram of a head mounted device (200) according to one or more embodiments of the present disclosure receiving data from an external device. FIG. 18B is an example of data received by a head mounted device (200) according to one or more embodiments of the present disclosure.

[0195] Referring to FIGS. 18A and 18B , a head mounted device (200) according to one or more embodiments may receive data related to the surrounding environment or the state of a user (U) from an external device (1820) via a communication circuit (e.g., the communication circuit (860) of FIG. 8 ). In one or more embodiments, the head mounted device (200) may be directly connected to the external device (1820) to transmit and receive data with the external device (1820). In one or more embodiments, the head mounted device (200) may transmit and receive data with the external device (1820) via a network (1810).

[0196] In one or more embodiments, the external device (1820) may be a robot vacuum cleaner. In one embodiment, the robot vacuum cleaner (1820) may create a map of an indoor space through simultaneous localization and map-building (SLAM) functionality. The head-mounted device (200) according to one or more embodiments may receive data related to the indoor map (1830) from the robot vacuum cleaner (1820) through the communication circuit (860).

[0197] As illustrated in FIG. 18b, data related to an indoor map (1830) received from a robot cleaner (1820) may include a space in which a user (U) wearing a head mounted device (200) can move.

[0198] A head mounted device (200) according to one or more embodiments may set a safety zone or expand an activated safety zone based on data related to a received indoor map (1830).

[0199] A head mounted device (200) according to one or more embodiments may receive data regarding a location of an external device (e.g., a relative distance apart) from an external device (1820) to which the device is connected via a directional communication method (e.g., ultra-wide band (UWB) communication). The head mounted device (200) according to one or more embodiments may generate spatial map data based on the received data regarding the location of the external device (1820).

[0200] FIG. 19 illustrates a state in which a second safety zone (Z2) is activated, according to one or more embodiments of the present disclosure. FIG. 20 illustrates a state in which content corresponding to a second space (S2) is provided, according to one or more embodiments of the present disclosure.

[0201] Referring to FIGS. 19 and 20, a head mounted device (200) according to one or more embodiments may activate a second safety area (Z2) corresponding to a second space (S2) in order to provide content corresponding to the second space (S2). In one or more embodiments, the head mounted device (200) may activate a second safety area (Z2) corresponding to the second space (S2) when the first safety area (Z1) (e.g., the extended first safety area (Z1)) satisfies an execution condition of the second space (S2).

[0202] In one or more embodiments, the head mounted device (200) may identify whether an execution condition of the second space (S2) is satisfied based on an input corresponding to at least one affordance associated with the second safety zone (Z2). In one or more embodiments, the head mounted device (200) may release the display of the designated lock screen (1500) and activate the second safety zone (Z2) based on the satisfaction of the execution condition of the second space (S2).

[0203] A head mounted device (200) according to one or more embodiments may provide content corresponding to a second space (S2) based on an activated second safety zone (Z2). In one or more embodiments, the head mounted device (200) may display a three-dimensional object or a two-dimensional object in the second space (S2) that is relatively far away from the user (U).

[0204] In one or more embodiments, the head mounted device (200) may provide content corresponding to the first space (S1) when the first safety area (Z1) is identified as being contained within the second safety area (Z2).

[0205] FIG. 21 illustrates a state in which a third safety zone (Z3) is activated according to one or more embodiments of the present disclosure.

[0206] Referring to FIG. 21, a head mounted device (200) according to one or more embodiments, when obtaining a request related to content corresponding to a third space (S3), can identify whether an execution condition of the third space (S3) is satisfied based on a first safety area (Z1) or a second safety area (Z2).

[0207] A head mounted device (200) according to one or more embodiments may, when executing an application that provides content corresponding to a third space (S3) or receiving input for providing content corresponding to a third space (S3), compare a third safety area (Z3) corresponding to the third space (S3) with a currently activated first safety area (Z1) or second safety area (Z2).

[0208] For example, the third safety zone (Z3) may correspond to a relatively wider distant area than the first safety zone (Z1) corresponding to the near-field area or the second safety zone (Z2) corresponding to the intermediate-field area.

[0209] A head mounted device (200) according to one or more embodiments may identify whether an execution condition of a third space (S3) is satisfied based on an activated first safety zone (Z1) or a second safety zone (Z2). If the execution condition of the third space (S3) is not satisfied, the head mounted device (200) according to one or more embodiments may display at least one affordance through a display.

[0210] According to one or more embodiments, the head mounted device (200) may activate the third safety zone (Z3) and provide content corresponding to the third space (S3) when the execution condition of the third space (S3) is satisfied. In one or more embodiments, the head mounted device (200) may provide content corresponding to the first space (S1) and / or content corresponding to the second space (S2) while the third safety zone (Z3) is activated.

[0211] FIG. 22 is a state diagram showing a 3D object (2200) that induces movement of a user (U) according to one or more embodiments of the present disclosure.

[0212] Referring to FIG. 22, a head mounted device (200) according to one or more embodiments may display a 3D object (2200) that guides movement of a user (U).

[0213] In one or more embodiments, the head mounted device (200) may identify a second safe area (Z2) or a third safe area (Z3) to provide content corresponding to a second space (S2) or content corresponding to a third space (S3).

[0214] In one or more embodiments, the head mounted device (200) may identify the second safe area (Z2) or the third safe area (Z3) when obtaining a request related to content corresponding to the second space (S2) or a request related to content corresponding to the third space (S3). In one or more embodiments, the head mounted device (200) may identify the second safe area (Z2) or the third safe area (Z3) based on an image of the surrounding environment obtained from a camera, data of the surrounding environment obtained through a sensor circuit, and / or data of the surrounding environment received through a communication circuit.

[0215] In one or more embodiments, if a second safety zone (Z2) or a third safety zone (Z3) that is relatively wider than an activated safety zone (e.g., a first safety zone (Z1)) is at least partially different from the currently activated safety zone, the head mounted device (200) may guide the user (U) and / or the head mounted device (200) to move toward the identified second safety zone (Z2) or the third safety zone (Z3). According to one or more embodiments, the head mounted device (200) may display a 3D object (2200) that guides the movement of the user (U) when movement of the user (U) is required to activate the identified second safety zone (Z2) or the third safety zone (Z3). For example, the head mounted device (200) may guide the movement of the user (U) toward a central position of the identified second safety zone (Z2) or the third safety zone (Z3).

[0216] In one or more embodiments, the head mounted device (200) may identify the second safe area (Z2) or the third safe area (Z3) when obtaining a request related to content corresponding to the second space (S2) or a request related to content corresponding to the third space (S3).

[0217] For example, the 3D object (2200) may be set as an image related to content corresponding to the second space (S2) or content corresponding to the third space (S3). For example, when a request is made for content related to a game, the head mounted device (200) may display an image of a game console at a location where movement of the user (U) is required to activate the second safety zone (Z2) or the third safety zone (Z3).

[0218] FIG. 23 is a flowchart of a method of operating a head mounted device (200; 101) according to one or more embodiments of the present disclosure.

[0219] A head mounted device (200; 101) according to one or more embodiments may, in operation 2310, identify whether a request related to content corresponding to a first space (S1) is obtained.

[0220] In one or more embodiments, if a request related to content corresponding to the first space (S1) is not obtained (operation 2310-No), the head mounted device (200; 101) may repeat operation 2310.

[0221] In one or more embodiments, when a request related to content corresponding to the first space (S1) is obtained (operation 2310 - Yes), the head mounted device (200; 101) may activate the first safety area (Z1) corresponding to the first space (S1) in operation 2320.

[0222] A head mounted device (200; 101) according to one or more embodiments may, in operation 2330, provide content corresponding to a first space (S1) based on a first safe area (Z1) corresponding to the first space (S1).

[0223] A head mounted device (200; 101) according to one or more embodiments may expand a first safety zone (Z1) based on at least one of an image acquired from a camera (840; 210, 220; 180), at least one value related to the surrounding environment or the state of the user (U), or at least one of data related to the surrounding environment or the state of the user (U), in operation 2340.

[0224] A head mounted device (200; 101) according to one or more embodiments may, at operation 2350, identify whether a request related to content corresponding to a second space (S2) is obtained.

[0225] In one or more embodiments, if a request related to content corresponding to the second space (S2) is not obtained (operation 2350-No), the head mounted device (200; 101) may repeat operation 2350.

[0226] In one or more embodiments, when a request related to content corresponding to the second space (S2) is obtained (operation 2350 - Yes), the head mounted device (200; 101) can identify, based on the first safety area (Z1), in operation 2360 whether the execution condition of the second space (S2) is unsatisfied.

[0227] In one or more embodiments, if the execution condition of the second space (S2) is unsatisfactory (operation 2360 - Yes), the head mounted device (200; 101) may, in operation 2370, display at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) related to the second safety area (Z2) corresponding to the second space (S2).

[0228] A head mounted device (200; 101) according to one or more embodiments may provide content corresponding to a second space (S2) based on an input of a user (U) corresponding to at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) at operation 2390. In one or more embodiments, the head mounted device (200; 101) may provide content corresponding to the second space (S2) when receiving an input of a user (U) corresponding to at least one affordance (1400; 1500; 1600; 1710, 1720, 2200). In one or more embodiments, the head mounted device (200; 101) may provide content corresponding to the second space (S2) based on a second safe area (Z2) corresponding to the second space (S2).

[0229] In one or more embodiments, if the execution condition of the second space (S2) is satisfied (operation 2360-No), the head mounted device (200; 101) may provide content corresponding to the second space (S2) in operation 2390.

[0230] FIG. 24A illustrates a portion of a flowchart of a method for operating the head mounted device (200; 101) of FIG. 23, according to one or more embodiments of the present disclosure.

[0231] Referring to FIG. 24A, a head mounted device (200; 101) according to one or more embodiments may, at operation 2373, display a designated lock screen including at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) on at least a portion of a display (830; 160; 225).

[0232] In one or more embodiments, the head mounted device (200; 101) may display a designated lock screen including at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) by an operation (operation 2370 of FIG. 23) of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) associated with a second safe area (Z2) corresponding to a second space (S2).

[0233] A head mounted device (200; 101) according to one or more embodiments may, in operation 2383, identify whether an execution condition of a second space (S2) is satisfied based on an input of a user (U) corresponding to at least one affordance (1400; 1500; 1600; 1710, 1720).

[0234] In one or more embodiments, if the execution condition of the second space (S2) is not satisfied (operation 2383-No), the head mounted device (200; 101) may, in operation 2373, display a designated lock screen including at least one affordance (1400; 1500; 1600; 1710, 1720, 2200).

[0235] In one or more embodiments, if the execution condition of the second space (S2) is satisfied (operation 2383-Yes), the head mounted device (200; 101) may, in operation 2385, release the display of the specified lock screen.

[0236] A head mounted device (200; 101) according to one or more embodiments may, after releasing the display of a designated lock screen, provide content corresponding to a second space (S2) based on a second safe area (Z2) corresponding to the second space (S2) (operation 2390 of FIG. 23).

[0237] FIG. 24b illustrates a portion of a flowchart of a method for operating the head mounted device (200; 101) of FIG. 23 according to one or more embodiments of the present disclosure.

[0238] Referring to FIG. 24B, a head mounted device (200; 101) according to one or more embodiments may identify a method of input of a user (U) at operation 2375. In one or more embodiments, the head mounted device (200; 101) may identify a method of input of a user (U) corresponding to at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) by an operation (operation 2370 of FIG. 23) of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) related to a second safe area (Z2) corresponding to a second space (S2).

[0239] A head mounted device (200; 101) according to one or more embodiments may, in operation 2377, display at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces an input according to the manner of the input identified in at least a portion of the second safety area (Z2). In one or more embodiments, the head mounted device (200; 101) may display at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) associated with a second safe area (Z2) corresponding to a second space (S2) (operation 2370 of FIG. 23) to induce an input of a user (U) to extend into the second safe area (Z2).

[0240] A head mounted device (200; 101) according to one or more embodiments may, in operation 2377, acquire an image of the surrounding environment or at least one value from a camera (840; 210, 220; 180) or at least one sensor (850; 176). In one or more embodiments, the head mounted device (200; 101) may expand the activated safety area to a second safety area (Z2) based on the acquired image of the surrounding environment or at least one value.

[0241] A head mounted device (200; 101) according to one or more embodiments may, after releasing the display of a designated lock screen, provide content corresponding to a second space (S2) based on a second safe area (Z2) corresponding to the second space (S2) (operation 2390 of FIG. 23).

[0242] FIGS. 25A, 25B, 25C, and 25D illustrate a state in which a designated lock screen including at least one affordance is provided according to embodiments of the present disclosure. Specifically, FIGS. 25A to 25D illustrate a state in which a designated lock screen including at least one affordance that induces a user interaction input is provided when a second safe area is activated (or expanded, modified) according to one or more embodiments of the present disclosure.

[0243] Referring to FIG. 25A, a head mounted device (200, 101) according to one or more embodiments of the present disclosure may display content (e.g., a table multi-screen) corresponding to a first space (S1) based on a first safety area (Z1) corresponding to the first space (S1). Alternatively, in one or more embodiments, the head mounted device (200, 101) may display a task bar indicating a status related to the first space (S1) at a designated location or area of ​​the first space (S1). Alternatively, in one or more embodiments, the head mounted device (200, 101) may display a home screen including content and a task bar in the first space (S1). In one or more embodiments, the task bar may include a first button (1313) and a second button (1315) associated with the space. In one or more embodiments, the head mounted device (200, 101) may display a first badge (1413) indicating a state (e.g., an activated state) of the first space (S1) on a first button (1313) associated with the first space (S1), and may display a second badge (1415) indicating a state (e.g., a deactivated state) of the second space (S2) on a second button (1315) associated with the second space (S2).

[0244] Referring to FIG. 25B, a head mounted device (200, 101) according to one or more embodiments of the present disclosure may obtain a user interaction input (1501) related to content (e.g., an immersive application) corresponding to a second space (S2). For example, the content (1321) corresponding to the second space (S2) may be a game screen according to a game app. In one or more embodiments, the user interaction input (2501) may be a user input for selecting a game app, and may be, for example, an input using a controller, a gesture input, or head tracking. In one or more embodiments, when the head mounted device (200, 101) obtains a user input related to content corresponding to the second space (S2), it may identify whether an execution condition of the second space (S2) is satisfied based on a first safety area (Z1). In one or more embodiments, the head mounted device (200, 101) may identify the execution condition of the second space (S2) as unsatisfactory if the second safety zone (Z2) corresponding to the second space (S2) is not included in the activated first safety zone (Z1).

[0245] Referring to FIG. 25c, when the execution condition of the second space (S2) is identified as unsatisfactory, the head mounted device (200, 101) according to one or more embodiments of the present disclosure may display a designated lock screen (2500) including at least one affordance (2510 to 2560) related to the second safety area (Z2) corresponding to the second space (S2). The head mounted device (200, 101) according to one or more embodiments may receive a user interaction input (2502) while displaying the designated lock screen (2500). A designated lock screen (2500) may include at least one safety point (2510 to 2560) and a safety path (2570), and a head mounted device (200, 101) may receive a safety authentication input from a user corresponding to at least one safety point (2510 to 2560) and a safety path (2570). According to one or more embodiments, a head mounted device (200, 101) may receive a user interaction input (2502) that moves according to a designated pattern (e.g., a safety path) corresponding to a safety point included in the designated lock screen (2500).

[0246] In one or more embodiments, the head mounted device (200, 101) may provide an affordance requesting a user interaction input (e.g., a gesture input) at the location of at least one safety point on the safety path (2570). For example, the head mounted device (200, 101) may provide an affordance requesting a movement input about at least one of the x-axis, the y-axis, or the z-axis at the safety point (2520). The head mounted device (200, 101) according to one or more embodiments may provide an affordance requesting an additional user interaction input at the location of a safety point on the safety path. For example, the head mounted device (200, 101) may provide an affordance (2531) requesting an additional user face authentication at the safety point (2530). Alternatively, the head mounted device (200, 101) may provide an affordance at a location of a safety point (2540) on a safety path to additionally request interaction input from another surrounding wearable device (e.g., request a step or head movement). Alternatively, in one or more embodiments, the head mounted device (200, 101) may provide an affordance (2532) at a safety point (2530) to guide the user's current field of view (first field of view) to a second field of view, and when the user's field of view reaches the second field of view, may analyze surrounding hazards through a camera and add an affordance at a preliminary safety point (2530'') to guide the user's actions to avoid the hazards and secure a safe area. According to one or more embodiments, the input corresponding to the affordance at the safety point may be different depending on the safety level of the specified lock screen (2500). In one or more embodiments, the security level may be derived based on user accounts, user settings, content properties (or setting options), etc.For example, the head mounted device (200, 101) may provide a lock screen that includes different strengths of affordance depending on the game properties (e.g., role-playing game or static game) or depending on the user account (e.g., gender, age).

[0247] Referring to FIG. 25D, a head mounted device (200, 101) according to one or more embodiments may identify whether an execution condition of a second space (S2) is satisfied based on an input corresponding to at least one affordance, and if the execution condition of the second space (S2) is satisfied, may release the display of a designated lock screen (2500), activate a second safe area (Z2) corresponding to the second space (S2), and display content (1321) corresponding to the second space (S2). In one or more embodiments, the head mounted device (200, 101) may display a badge (1416) indicating a status (e.g., an activation status) of the second space on a button (1315) associated with the second space (S2).

[0248] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary skill in the technical field to which this document pertains from the description below.

[0249] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0250] A head mounted device (200, 101) according to one or more embodiments of the present disclosure may include a display (830, 160, 225), a memory (820, 130) storing executable instructions, and at least one processor (810, 120) accessing the memory (820, 130) to execute the instructions. The at least one processor (810, 120) may be configured to provide content corresponding to a first space (S1) through the display (830, 160, 225) based on a first safe area (Z1) corresponding to the first space (S1). The at least one processor (810, 120) may be configured to, when obtaining a request related to content corresponding to a second space (S2), identify whether an execution condition of the second space (S2) is satisfied based on the first safe area (Z1). The at least one processor (810, 120) may be set to display at least one affordance (1400, 1500, 1600, 1710, 1720, 2200, affordance) related to the second safety area (Z2) corresponding to the second space (S2) through the display (830, 160, 225) based on not satisfying the execution condition of the second space (S2). The at least one processor (810, 120) may be configured to provide content corresponding to the second space (S2) based on the second safety area (Z2) through the display (830, 160, 225) based on an input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200).

[0251] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to activate the first safe area (Z1) corresponding to the first space (S1) based on acquisition of a request related to content corresponding to the first space (S1), at least as part of an operation of providing content corresponding to the first space (S1).

[0252] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to set a stored area or a designated near-field area corresponding to at least one registered account as the first safe area (Z1).

[0253] A head mounted device (200, 101) according to one or more embodiments may further include a camera (840, 210, 220, 180) configured to acquire an image of a surrounding environment, at least one sensor (850, 176) configured to acquire at least one value related to a state of the surrounding environment or the user (U), and a communication circuit (860, 190) configured to transmit and receive data related to the surrounding environment or the state of the user (U) from an external device (E, 1820, 102). In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to expand the first safety area (Z1) based on at least one of an image acquired from the camera (840, 210, 220, 180), the at least one value acquired from the at least one sensor (850, 176), or the data acquired from the communication circuit (860, 190).

[0254] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to identify, as at least part of an operation of identifying whether an execution condition of the second space (S2) is satisfied, whether the second safety area (Z2) corresponding to the second space (S2) is included in the first safety area (Z1).

[0255] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to display, as at least part of an operation of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), a designated lock screen including the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), on at least a portion of the display (830, 160, 225). In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to identify whether an execution condition of the second space (S2) is satisfied based on an input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200). In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to release the display of the designated lock screen based on the execution condition of the second space (S2) being satisfied.

[0256] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to display a task bar (1100) indicating a status related to an application or space being executed. The at least one processor (810, 120) may be configured to display, as at least a part of an operation of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) indicating whether an execution condition of the second space (S2) is satisfied on the task bar (1100).

[0257] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to, at least as a part of an operation of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), identify a method of input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), and display the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces the input according to the method of input.

[0258] A head mounted device (200, 101) according to one or more embodiments may further include a camera (840, 210, 220, 180) configured to acquire an image of a surrounding environment, and at least one sensor (850, 176) configured to acquire at least one value related to a state of the surrounding environment or a user (U). The at least one processor (810, 120) may be configured to display the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) for inducing a gaze input of the user (U) as at least a part of an operation of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) for inducing the input. The at least one processor (810, 120) may be configured to obtain an image of the surrounding environment or the at least one value from the camera (840, 210, 220, 180) or the at least one sensor (850, 176) based on the gaze input.

[0259] A head mounted device (200, 101) according to one or more embodiments may further include a camera (840, 210, 220, 180) configured to acquire an image of a surrounding environment, and at least one sensor (850, 176) configured to acquire at least one value related to a state of the surrounding environment or a user (U). The at least one processor (810, 120) may be configured to display the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) for inducing an action input of the user (U) as at least a part of an operation of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) for inducing an input. The at least one processor (810, 120) may be configured to acquire an image of the surrounding environment or the at least one value from the camera (840, 210, 220, 180) or the at least one sensor (850, 176) based on the action input.

[0260] In a head mounted device (200, 101) according to one or more embodiments, the at least one processor (810, 120) may be configured to display a 3D object (2200) that induces movement of the user (U) based on the second safe area (Z2), at least as a part of an operation of providing content corresponding to the second space (S2).

[0261] A method of operating a head mounted device (200, 101) according to one or more embodiments of the present disclosure may include an operation of providing content corresponding to a first space (S1) through a display (830, 160, 225) based on a first safety area (Z1) corresponding to the first space (S1). A method of operating a head mounted device (200, 101) according to one or more embodiments may include an operation of identifying, when obtaining a request related to content corresponding to a second space (S2), whether an execution condition of the second space (S2) is satisfied based on the first safety area (Z1). A method of operating a head mounted device (200, 101) according to one or more embodiments may include an operation of displaying, through the display (830, 160, 225), at least one affordance (1400, 1500, 1600, 1710, 1720, 2200, affordance) related to a second safe area (Z2) corresponding to the second space (S2), based on not satisfying an execution condition of the second space (S2). A method of operating a head mounted device (200, 101) according to one or more embodiments may include providing content corresponding to the second space (S2) based on the second safety area (Z2) through the display (830, 160, 225) based on an input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200).

[0262] In a method of operating a head mounted device (200, 101) according to one or more embodiments, an operation of providing content corresponding to the first space (S1) (2330) may include an operation of activating the first safe area (Z1) corresponding to the first space (S1) (2320) based on obtaining a request related to the content corresponding to the first space (S1) (2310).

[0263] A method of operating a head mounted device (200, 101) according to one or more embodiments may further include an operation (2340) of expanding the first safety area (Z1) based on at least one of an image of the surrounding environment acquired from a camera (840, 210, 220, 180), at least one value related to the surrounding environment or the state of the user (U) acquired from at least one sensor (850, 176), or data related to the surrounding environment or the state of the user (U) acquired from an external device (E, 1820, 102) via a communication circuit (860, 190).

[0264] In a method of operating a head mounted device (200, 101) according to one or more embodiments, the operation (2370) of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) may display (2373) a designated lock screen including the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) on at least a portion of the display (830, 160, 225). The operating method of a head mounted device (200, 101) according to one or more embodiments may further include an operation (2383) of identifying whether an execution condition of the second space (S2) is satisfied based on an input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200). The operating method of a head mounted device (200, 101) according to one embodiment may further include an operation (2385) of releasing the display of the specified lock screen based on the execution condition of the second space (S2) being satisfied.

[0265] In a method of operating a head mounted device (200, 101) according to one or more embodiments, the operation (2370) of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) may display the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) indicating whether an execution condition of the second space (S2) is satisfied on a task bar (1100) that displays a status related to an application or space being executed.

[0266] In a method of operating a head mounted device (200, 101) according to one or more embodiments, the operation (2370) of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) may include the operation (2375) of identifying a method of input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200), and the operation (2377) of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces the input according to the method of the input in at least a part of the second safety area (Z2).

[0267] In a method of operating a head-mounted device (200, 101) according to one or more embodiments, the operation (2377) of displaying the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces the input may display the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces the gaze input of the user (U). The method of operating a head-mounted device (200, 101) according to one or more embodiments may further include an operation (2387) of acquiring an image of a surrounding environment from a camera (840, 210, 220, 180) based on the gaze input, or acquiring at least one value related to the surrounding environment or the state of the user (U) acquired from at least one sensor (850, 176).

[0268] In a method of operating a head-mounted device (200, 101) according to one or more embodiments, an operation (2377) of displaying at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces the input may display at least one affordance (1400, 1500, 1600, 1710, 1720, 2200) that induces an action input of a user (U). The method of operating a head-mounted device (200, 101) according to one or more embodiments may further include an operation (2387) of acquiring an image of a surrounding environment from a camera (840, 210, 220, 180) or acquiring at least one value related to a state of the surrounding environment or the user (U) from at least one sensor (850, 176), based on the action input.

[0269] In a method of operating a head mounted device (200, 101) according to one or more embodiments, the operation (2390) of providing content corresponding to the second space (S2) may display a 3D object (2200) that induces movement of the user (U) based on the second safety area (Z2) in the second space (S2).

[0270] According to one or more embodiments of the present disclosure, a non-transitory computer-readable storage medium stores instructions that, when executed by at least one processor (810; 120) of a head mounted device (200, 101), cause the head mounted device (200, 101) to provide, through a display (830, 160, 225), content corresponding to a first space (S1) based on a first safe area (Z1) corresponding to the first space (S1) based on execution of an application. The instructions, when executed by the at least one processor (810; 120), cause the head mounted device (200, 101) to, when obtaining a request related to content corresponding to a second space (S2), identify, based on the first safe area (Z1), whether an execution condition of the second space (S2) is satisfied. The above instructions, when executed by the at least one processor (810; 120), cause the head mounted device (200, 101) to display, through the display (830, 160, 225), at least one affordance (1400, 1500, 1600, 1710, 1720, 2200, affordance) related to a second safe area (Z2) corresponding to the second space (S2) based on not satisfying an execution condition of the second space (S2). The above instructions, when executed by the at least one processor (810; 120), cause the head mounted device (200, 101) to provide content corresponding to the second space (S2) based on the second safe area (Z2) through the display (830, 160, 225) based on an input corresponding to the at least one affordance (1400, 1500, 1600, 1710, 1720, 2200).

[0271] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0272] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0273] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0274] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0275] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0276] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In the head mounted device (200; 101), display(830; 160; 225); A memory (820; 130) comprising one or more storage media storing instructions; and At least one processor (810; 120) comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: Based on the first safety area (Z1) corresponding to the first space (S1), content corresponding to the first space (S1) is provided through the display (830; 160; 225). When obtaining a request related to content corresponding to the second space (S2), identify whether the execution condition of the second space (S2) is satisfied based on the first safe area (Z1), Based on not satisfying the execution condition of the second space (S2), at least one affordance (1400; 1500; 1600; 1710, 1720, 2200, affordance) related to the second safety area (Z2) corresponding to the second space (S2) is displayed through the display (830; 160; 225). Based on an input corresponding to at least one of the above affordances (1400; 1500; 1600; 1710, 1720, 2200), providing content corresponding to the second space (S2) based on the second safety area (Z2) through the display (830; 160; 225). Head mounted device (200; 101).

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: At least as part of an operation of providing content corresponding to the first space (S1), Based on the acquisition of a request related to content corresponding to the first space (S1), activating the first safe area (Z1) corresponding to the first space (S1). Head mounted device (200; 101).

3. In any one of paragraphs 1 to 2, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: To set the stored area or designated near field area corresponding to at least one registered account as the first safe area (Z1); Head mounted device (200; 101).

4. In any one of paragraphs 1 to 3, Cameras set to acquire images of the surrounding environment (840; 210, 220; 180); At least one sensor (850; 176) set to obtain at least one value related to the state of the surrounding environment or the user (U); and It further includes a communication circuit (860; 190) set to transmit and receive data related to the surrounding environment or the state of the user (U) from an external device (E; 1820; 102), The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: Expanding the first safety area (Z1) based on at least one of the image acquired from the camera (840; 210, 220; 180), the at least one value acquired from the at least one sensor (850; 176), or the data acquired from the communication circuit (860; 190). Head mounted device (200; 101).

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: As at least a part of the operation of identifying whether the execution condition of the second space (S2) is satisfied, identifying whether the second safety area (Z2) corresponding to the second space (S2) is included in the first safety area (Z1). Head mounted device (200; 101).

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: At least as part of an operation of displaying at least one of the affordances (1400; 1500; 1600; 1710, 1720, 2200), displaying a designated lock screen including the at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) on at least a portion of the display (830; 160; 225), Identifying whether the execution condition of the second space (S2) is satisfied based on the input corresponding to at least one of the above affordances (1400; 1500; 1600; 1710, 1720, 2200), To release the display of the specified lock screen based on satisfying the execution condition of the second space (S2). Head mounted device (200; 101).

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: Displays a taskbar (1100) that displays status related to the running application or space, As at least a part of the operation of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200), displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) indicating whether the execution condition of the second space (S2) is satisfied on the task bar (1100). Head mounted device (200; 101).

8. In any one of paragraphs 1 to 7, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: At least as part of an action that displays at least one of the above affordances (1400; 1500; 1600; 1710, 1720, 2200), Identifying a mode of input corresponding to at least one of the above affordances (1400; 1500; 1600; 1710, 1720, 2200), To display at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces the input based on the method of the input. Head mounted device (200; 101).

9. In paragraph 8, A camera (840; 210, 220; 180) set to acquire images of the surrounding environment; and Further comprising at least one sensor (850; 176) configured to obtain at least one value related to the state of the surrounding environment or the user (U), The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: As at least a part of an operation of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces the input, displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces the gaze input of the user (U), Based on the above gaze input, obtaining an image of the surrounding environment from the camera (840; 210, 220; 180) or at least one value from the at least one sensor (850; 176). Head mounted device (200; 101).

10. In paragraph 8, A camera (840; 210, 220; 180) set to acquire images of the surrounding environment; and Further comprising at least one sensor (850; 176) configured to obtain at least one value related to the state of the surrounding environment or the user (U), The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: At least as part of an action of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces said input, displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200) that induces said user's (U) action input, Based on the above action input, acquiring an image of the surrounding environment from the camera (840; 210, 220; 180) or at least one value from the at least one sensor (850; 176). Head mounted device (200; 101).

11. In any one of paragraphs 1 to 10, The above instructions, when individually or collectively executed by the at least one processor (810; 120), cause the head mounted device (200; 101) to: As at least part of the operation of providing content corresponding to the second space (S2), displaying a 3D object (2200) that induces movement of the user (U) based on the second safe area (Z2). Head mounted device (200; 101).

12. In the operating method of the head mounted device (200; 101), An operation (2330) of providing content corresponding to the first space (S1) through a display (830; 160; 225) based on a first safety area (Z1) corresponding to the first space (S1); When obtaining a request related to content corresponding to the second space (S2) (2350), an operation (2360) of identifying whether the execution condition of the second space (S2) is satisfied based on the first safe area (Z1); An operation (2370) of displaying at least one affordance (1400; 1500; 1600; 1710, 1720, 2200, affordance) related to a second safe area (Z2) corresponding to the second space (S2) through the display (830; 160; 225) based on not satisfying the execution condition of the second space (S2) above (2360); and An operation (2390) of providing content corresponding to the second space (S2) based on the second safe area (Z2) through the display (830; 160; 225) based on an input corresponding to at least one affordance (1400; 1500; 1600; 1710, 1720, 2200). How it works.

13. In paragraph 12, The operation of providing content corresponding to the first space (S1) (2330) includes an operation of activating the first safe area (Z1) corresponding to the first space (S1) (2320) based on obtaining a request related to the content corresponding to the first space (S1) (2310). How it works.

14. In any one of paragraphs 12 to 13, An operation (2340) for expanding the first safety area (Z1) based on at least one of an image of the surrounding environment acquired from a camera (840; 210, 220; 180), at least one value related to the surrounding environment or the state of the user (U) acquired from at least one sensor (850; 176), or data related to the surrounding environment or the state of the user (U) acquired from an external device (E; 1820; 102) via a communication circuit (860; 190). How it works.

15. In a non-transitory computer-readable medium storing instructions, said instructions, when individually or collectively executed by at least one processor (810; 120) of a head mounted device (200; 101), cause said head mounted device (200; 101) to: Based on the first safety area (Z1) corresponding to the first space (S1), content corresponding to the first space (S1) is provided through the display (830; 160; 225). When obtaining a request related to content corresponding to the second space (S2), identify whether the execution condition of the second space (S2) is satisfied based on the first safe area (Z1), Based on not satisfying the execution condition of the second space (S2), at least one affordance (1400; 1500; 1600; 1710, 1720, 2200, affordance) related to the second safety area (Z2) corresponding to the second space (S2) is displayed through the display (830; 160; 225). A non-transitory computer-readable medium for providing content corresponding to the second space (S2) based on the second safe area (Z2) through the display (830; 160; 225), based on an input corresponding to at least one of the affordances (1400; 1500; 1600; 1710, 1720, 2200).

Images